Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

news-please - an integrated web crawler and information extractor for news that just works

A very simple news crawler with a funny name

A korean news crawler built to ingest large amounts of news data.

A news crawler for BBC News, Reuters and New York Times.

News crawler là một công cụ giúp bạn có thể crawl dữ liệu của một trang tin tức.

Use python scrapy build crawler for real-time Taiwan NEWS website.

Generate large textual corpora for almost any language by crawling the web

A Fast and lightweight Python API that search for articles on Google News and returns a JSON response.

Crawler (Scraper) for several well-known persian news for scraping public data

a web crawler to take all the latest indonesian news from many sources

A Scrapy webscraper that can scrape and store articles of theguardian.com

News crawler project written in Python.