Skip to content

Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application

Notifications You must be signed in to change notification settings

khpeek/scraper-compose

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scraper-compose

Example project of anonymized scraping with Tor. (The spider is based on the Scrapy Tutorial).

Basic usage

This multi-container application uses Docker Compose. In the project directory run the command

docker-compose build

followed by

docker-compose up

This will start the Tor and Privoxy services and initiate crawling the spider.

About

Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published