Flexible and concurrent web crawler implemented in 'go'
-
Updated
May 5, 2017 - Go
#
concurrent-web-crawler
Here are 3 public repositories matching this topic...
A concurent web crawler library written in Go.
-
Updated
Mar 25, 2019 - Go
The Concurrent Web Crawler is a Go-based application designed to crawl web pages efficiently using Go's powerful concurrency features.
java scraper spider multithreading async-python aiohttp asyncio html-parsing warc webcrawler graph-generation web-spider concurrent-web-crawler pluggable-modules
-
Updated
Jul 15, 2025 - Go
Improve this page
Add a description, image, and links to the concurrent-web-crawler topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the concurrent-web-crawler topic, visit your repo's landing page and select "manage topics."