darkfist / web-crawler Public

Notifications You must be signed in to change notification settings
Fork 0
Star 2

A cool web crawler written in Python

2 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
README.md		README.md
domain.py		domain.py
general.py		general.py
link_finder.py		link_finder.py
main.py		main.py
spider.py		spider.py

Repository files navigation

Web Crawler

A cool web crawler written in Python

Run main.py
Enter a name for the project.
Enter the url to crawl.
Sit back and relax.

Note: url must be entered with "http://" or "https://" like "http://example.com"

About

A cool web crawler written in Python

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%