Puppeteer Based Website Crawler
Building Project
- Install NodeJS
- Run
$ npm install
to install dependencies - Add a base url and DOM selector that both match your use case to ./config/default.js. Base url is a url for a webpage that contains a list of urls you would like to crawl
- Run
$ npm run start
to develop the project on a local machine - Run
$ npm run build
to build the project and$ npm run serve
to serve it