Repositories list

• duplicate-url-discarder-rules

  Public
  Contains rules for https://github.com/zytedata/duplicate-url-discarder.

  Python

  •

  MIT License

  •1•0•0•0•Updated Feb 5, 2025Feb 5, 2025

• zyte-parsers

  Public
  HTML

  •

  MIT License

  •3•12•1•1•Updated Feb 5, 2025Feb 5, 2025

• html-text

  Public
  HTML

  •

  MIT License

  •0•12•3•0•Updated Feb 5, 2025Feb 5, 2025

• clear-html

  Public
  Remove DIVs, style stuff and normalize HTML preserving structure information

  Python

  •

  MIT License

  •1•9•0•0•Updated Feb 5, 2025Feb 5, 2025

• url-matcher

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•8•1•0•Updated Feb 5, 2025Feb 5, 2025

• zyte-test-websites

  Public
  Websites for testing spiders

  Python

  •

  MIT License

  •0•2•0•1•Updated Feb 5, 2025Feb 5, 2025

• duplicate-url-discarder

  Public
  Python

  •

  MIT License

  •2•5•7•1•Updated Feb 5, 2025Feb 5, 2025

• zyte-spider-templates

  Public
  Spider templates for automatic crawlers.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •4•25•11•5•Updated Feb 3, 2025Feb 3, 2025

• python-zyte-api

  Public
  Python client for Zyte API

  hacktoberfest

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •5•22•7•3•Updated Jan 20, 2025Jan 20, 2025

• zyte-common-items

  Public
  Contains the common item definitions used in Zyte.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •8•9•3•5•Updated Jan 16, 2025Jan 16, 2025

• zyte-spider-templates-project

  Public
  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •9•17•0•2•Updated Dec 27, 2024Dec 27, 2024

• web-scraping-tutorial-project

  Public
  https://docs.zyte.com/web-scraping/tutorial/index.html

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2•5•0•0•Updated Dec 27, 2024Dec 27, 2024

• web-snap

  Public
  Create "perfect" snapshots of web pages

  web-archivingweb-archivesplaywright+ 2capture-pagejavascript

  JavaScript

  •

  MIT License

  •3•32•0•5•Updated Dec 15, 2024Dec 15, 2024

• http-parser

  Public
  Fork of 'https://github.com/benoitc/http-parser'

  C

  •

  Other

  •95•0•0•0•Updated Nov 14, 2024Nov 14, 2024

• extract-summit-contest-solutions

  Public
  Example solutions for the practice and contest websites of the code contest of Web Data Extraction Summit.

  Python

  •

  MIT License

  •2•5•0•0•Updated Oct 21, 2024Oct 21, 2024

• spidyquotes

  Public
  Example site for web scraping tutorials

  playgroundscrapingcrawling+ 4tutorialsweb-scrapingweb-crawlingweb-scraping-tutorials

  Julia

  •

  BSD 3-Clause "New" or "Revised" License

  •17•31•3•3•Updated Oct 9, 2024Oct 9, 2024

• rrweb

  Public
  record and replay the web

  TypeScript

  •

  MIT License

  •1.5k•0•0•3•Updated Sep 14, 2024Sep 14, 2024

• geventhttpclient

  Public
  A high performance, concurrent http client library for python with gevent

  Python

  •

  Other

  •137•0•0•1•Updated Sep 3, 2024Sep 3, 2024

• openvscode-server

  Public
  Run upstream VS Code on a remote machine with access through a modern web browser from any device, anywhere.

  TypeScript

  •

  MIT License

  •30k•0•0•4•Updated Aug 30, 2024Aug 30, 2024

• unsloth_docker

  Public
  A working Dockerfile that has unsloth with all the other dependencies

  Dockerfile

  •0•2•0•0•Updated Aug 23, 2024Aug 23, 2024

• zyte-api-workshop

  Public
  Python

  •0•1•0•7•Updated Jul 29, 2024Jul 29, 2024

• spidermon-workshop

  Public
  Python

  •

  GNU General Public License v3.0

  •0•1•0•2•Updated May 14, 2024May 14, 2024

• onefile

  Public
  Merge multiples files into one!

  HTML

  •

  MIT License

  •0•1•0•0•Updated Apr 2, 2024Apr 2, 2024

• scrapy-time-machine

  Public
  Run your spider against a site's snapshot

  Python

  •

  MIT License

  •2•5•0•0•Updated Feb 1, 2024Feb 1, 2024

• installimage

  Public
  Bash scripts to universally deploy various distributions

  Shell

  •

  Other

  •147•1•0•0•Updated Jan 10, 2024Jan 10, 2024

• kafka-manager

  Public
  A tool for managing Apache Kafka.

  kafkakafka-manager

  Scala

  •

  Apache License 2.0

  •2.5k•4•0•0•Updated Jan 9, 2024Jan 9, 2024

• dj-cloud-task

  Public
  Django Cloud Task Queue. Integrate your Django Application with Google Cloud Task from Google Cloud Platform

  Python

  •

  MIT License

  •4•0•0•0•Updated Dec 19, 2023Dec 19, 2023

• sctools

  Public
  Analyze your jobs on scrapy cloud

  zytescrapy-cloudscrapy

  Clojure

  •

  Other

  •1•5•0•0•Updated Oct 30, 2023Oct 30, 2023

• locust

  Public
  Write scalable load tests in plain Python 🚗💨

  Python

  •

  MIT License

  •3k•0•0•0•Updated Sep 13, 2023Sep 13, 2023

• zyte-smartproxy-selenium

  Public
  A wrapper over Selenium Wire to provide Zyte Smart Proxy Manager specific functionalities.

  Python

  •4•3•1•0•Updated Sep 5, 2023Sep 5, 2023