Repositories list

• microwler

  Public
  A micro-framework for asynchronous deep crawls and web scraping with Python

  nuxtaiohttpweb-scraping+ 6asyncioparselquartpythonmicro-frameworkweb-crawling

  Python

  •

  MIT License

  •0•13•0•0•Updated Jun 10, 2023Jun 10, 2023

• linkminer

  Public
  A simple tool to find and visualise links between two sets of websites built with Scrapy and Graphviz

  Python

  •0•0•0•4•Updated Nov 4, 2022Nov 4, 2022

• moxnet

  Public
  Generate a local network of randomised and interconnected HTML pages including plug-and-play Docker/NGINX configurations

  Python

  •0•1•0•1•Updated Mar 20, 2021Mar 20, 2021

• scrapretty

  Public
  A pretty and serverless dashboard for your Scrapyd instances

  vueserverlessnuxt+ 6static-sitescrapyvuetifyscrapydscrapyd-uiscrapyd-dashboard

  Vue

  •

  MIT License

  •1•7•0•0•Updated Dec 8, 2020Dec 8, 2020

• scrapy-googlechat

  Public
  Send crawl reports from Scrapy spiders to Google Chat

  botreportingweb-crawling+ 3scrapy-plugingoogle-chatscrapy

  Python

  •

  MIT License

  •1•1•0•0•Updated Dec 1, 2020Dec 1, 2020

• hangouts-chat-samples

  Public
  Chat Bot Samples for Google Chat.

  Python

  •

  Apache License 2.0

  •256•0•0•0•Updated Oct 14, 2020Oct 14, 2020