Skip to content

Commit

Permalink
Expand the warning about prefetch multiplier to explain what happens …
Browse files Browse the repository at this point in the history
…if set to 0.
  • Loading branch information
clokep committed May 4, 2018
1 parent 5b6ee78 commit 06fbcd7
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion celery_batches/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,10 @@
For this to work you have to set
:setting:`worker_prefetch_multiplier` to zero, or some value where
the final multiplied value is higher than ``flush_every``.
the final multiplied value is higher than ``flush_every``. Note that Celery
will attempt to continually pull data into memory if this is set to zero.
This can cause excessive resource consumption on both Celery workers and the
broker when used with a deep queue.
In the future we hope to add the ability to direct batching tasks
to a channel with different QoS requirements than the task channel.
Expand Down

0 comments on commit 06fbcd7

Please sign in to comment.