Top Sellers

This is a web scraper, using the Python framework Scrapy, built to collect best-selling games' data from Steam website.

What Data Do We Want to Scrape?

• Game Name
• Game url
• Image url
• Release Date
• Platforms
• Reviews Summary
• Original Price
• Discounted Price
• Discount Rate

Note: The scraper handles pagination and extracts data from all Top Sellers.

💻 Requirements

Before you start, please check if you have met these few basic requirements:

• Installed the latest stable python version (Python 3.7 or later).
• Created a virtual enviroment to run the ScraPy framework on your machine.
• Installed Scrapy 1.6 or a later stable version.

IMPORTANT: It is strongly recommended that you install Scrapy in a dedicated virtualenv, to avoid conflicting with your system packages.

Getting Started

From terminal

1. Create an Enviroment:

$ mkdir virtual-enviroments
$ cd virtual-enviroments
$ python3 -m venv venv

2. Activate it:
   Linux/macOS

$ source venv/bin/activate

3. Install the Scrapy framework:

$ pip install Scrapy

🚀 How to Use:

Clone this repository into your workspace:

$ git clone https://github.com/david-adds/bestsellings-scraper.git

Once you have cloned the repository, open it up so you can run the scraper.

$ cd bestsellings-scraper

Then, run the spider to scrape the data:

$ scrapy crawl best_selling

UP