- clone the repo and run
npm installoryarn install
- create urls.txt with one url per line
- run
node index.js
node index.js --chunk=20default chunking is set to 10, can be overwritten by--chunk=20or-c 20node index.js --src=failed-urls.txtdefault setting reads urls.txt, but can read other filesnode index.js --prod-domain=www.cracked.comoptional. used to search production domain and replace with dev domainnode index.js --dev-domain=www.crackeddev.comoptional. used to replace production domain with dev domainnode index.js --username=abc --password=abcoptiona. attach HTTP Basic auth to requests
- passed.json contains all urls passed the validator
- failed.json contains all failed urls with error message