New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add broker component #14

Open

karimsa opened this issue Jul 29, 2018 · 0 comments

Owner

karimsa commented Jul 29, 2018 •

edited

Loading

Broker should be responsible for work assignment
Worker should be responsible for doing work (should be able to take a pool as input so you can control allocation)
Should support in memory brokering (across node processes, across web workers)
Distributed brokering is probably not needed, lots of great solutions like kue & bull exist

Distribution strategies
- By number of requests (can use pool's filter)
- By 'capacity' of worker (event loop delay? CPU?) (can use pool's filter)
- Work stealing (need a queue per worker or global queue)

karimsa closed this as completed

karimsa reopened this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment