Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Major improvements to Synapse workers #2103

Merged
merged 10 commits into from
Sep 15, 2022
Merged

Major improvements to Synapse workers #2103

merged 10 commits into from
Sep 15, 2022

Conversation

spantaleev
Copy link
Owner

This is a massive improvement to our Synapse workers support since #456

Make sure to see the changelog entry for more details.

As stream writer workers are also powered by the `generic_worker`
Synapse app, this necessitated that we provide means for distinguishing
between them and regular `generic_workers`.

I've also taken the time to optimize nginx configuration generation
(more Jinja2 macro usage, less duplication).

Worker names have also changed.
Workers are now named sequentially like this:
- `matrix-synapse-worker-0-generic`
- `matrix-synapse-worker-1-stream-writer-typing`
- `matrix-synapse-worker-2-pusher`

instead of `matrix-synapse-worker_generic_worker-18111` (indexed with a
port number).

People who modify `matrix_synapse_workers_enabled_list` directly will
need to adjust their configuration.
…e_enable_media_repo

.. although.. manual configuration is discouraged in most cases.
… if not necessary

This keeps the configuration cleaner and hopefully prevents odd issues
if Synapse (by any chance) happens to interpret `pusher_instances: []`
as "no pushers", instead of as "push from the master process".

I haven't confirmed what an empty pushers/federation-senders list means,
so it's safer to just avoid it.
@spantaleev spantaleev merged commit 0cf40fe into master Sep 15, 2022
spantaleev added a commit that referenced this pull request Sep 15, 2022
spantaleev added a commit that referenced this pull request Sep 15, 2022
@spantaleev spantaleev deleted the more-workers branch November 3, 2022 07:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant