A collection of web scraping projects using scarpy and Selenium.
Project | Description |
---|---|
Amazon | Scraping product info from Amazon.com with scrapy |
Ebay | Scraping product info from Ebay.com with scrapy & MySQL |
Indeed | Scraping job postings from Indeed.com with scrapy & SQLite |
Salary | Scraping salary statistics from salary.com with standalone scrapy crawler & JSON |
YahooNews | Scraping Yahoo News article with standalone scrapy crawler |
Glassdoor | Scraping job listing of top Canada cities from "Glassdoor.ca" with Selenium. |