Skip to content

Commit

Permalink
Merge pull request #3 from percipient/expand-prefetch-warning
Browse files Browse the repository at this point in the history
Expand the warning about prefetch multiplier
  • Loading branch information
clokep authored May 4, 2018
2 parents 5b6ee78 + 06fbcd7 commit c6f5e85
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion celery_batches/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,10 @@
For this to work you have to set
:setting:`worker_prefetch_multiplier` to zero, or some value where
the final multiplied value is higher than ``flush_every``.
the final multiplied value is higher than ``flush_every``. Note that Celery
will attempt to continually pull data into memory if this is set to zero.
This can cause excessive resource consumption on both Celery workers and the
broker when used with a deep queue.
In the future we hope to add the ability to direct batching tasks
to a channel with different QoS requirements than the task channel.
Expand Down

0 comments on commit c6f5e85

Please sign in to comment.