This is a web crawler targeting indeed.com, fetching the lastest full-time software engineer job information for the new graduates.
The keywords include software grad, entry Software, Software university, Software graduate, Software college and junior developer, will be used for indeed.com job search.
多谢看官赏脸 🐶 顺便求个 star🐶
Only for self study purpose. No commercial usage permitted
To configure your system for development, first install Node.js and npm and
then run npm install. This will install some dependencies using npm. The Environment
I use is Node 12.18 and npm 6.14.
To run the scraper, simply cd crawler, and then run node crawler.js, the output.json will be generated directly in the root/crawler directory.