LinkSpid3r is a python tool designed to crawl all the web pages from the website.
git clone https://github.com/Sechunt3r/LinkSpid3r.git
Crawnix currently supported Python3.x.
- The recommended version for Python3 is 3.x
$ sudo pip3 install -r requirements.txt --user
- Crawl all Web Pages with in scope urls.
$ python3 LinkSpid3r.py