Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.
-
Updated
Aug 19, 2024 - Python
#
worker-pool
Here are 8 public repositories matching this topic...
Robust Python queuing with message deduplication
python redis queue pubsub message-acknowledgement message-queue pub-sub task-queue data-processing deduplication redis-queue worker-pool message-broker exactly-once idempotent horizontal-scaling exactly-once-processing task-queues
-
Updated
Jan 19, 2024 - Python
Tentacule is an uncomplicated library to deal with a pool of worker processes
-
Updated
Oct 15, 2023 - Python
Async PDF generation in Django Channels worker or with Django 3.1 async views
pdf django async worker channels pdf-generation worker-pool puppeteer django2 pyppeteer django3 django-pdf-reactor django-channels-worker async-generation pdfmate pdf-a
-
Updated
Nov 10, 2022 - Python
Kafka Consumer loop a "worker" running infinitely and listening to kafka topic through long pooling
-
Updated
Feb 16, 2024 - Python
Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.
python automation pipeline tasks pipelines task-runner task-scheduler worker-pool python-framework workload server-framework
-
Updated
Jul 23, 2024 - Python
Enables real time user-presence functionality which marks user active/inactive based on last user activity using heartbeat mechanism, received from the client (here: mouse-up mouse-down movements) and comparing it with a threshold time quantum.
-
Updated
Feb 16, 2024 - Python
Python library for Twitter automation via streaming APIs
-
Updated
Jun 2, 2019 - Python
Improve this page
Add a description, image, and links to the worker-pool topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the worker-pool topic, visit your repo's landing page and select "manage topics."