Merge remote-tracking branch 'origin/develop' into clokep/rm-action-gen

matrix-org · May 10, 2022 · bfd8add · bfd8add
2 parents 7aa18ab + c72d26c
commit bfd8add
Show file tree

Hide file tree

Showing 102 changed files with 597 additions and 415 deletions.
diff --git a/CHANGES.md b/CHANGES.md
@@ -1,8 +1,105 @@
-Synapse 1.59.0
-==============
+Synapse 1.59.0rc1 (2022-05-10)
+==============================
+
+This release makes several changes that server administrators should be aware of:
+
+- Device name lookup over federation is now disabled by default. ([\#12616](https://github.com/matrix-org/synapse/issues/12616))
+- The `synapse.app.appservice` and `synapse.app.user_dir` worker application types are now deprecated. ([\#12452](https://github.com/matrix-org/synapse/issues/12452), [\#12654](https://github.com/matrix-org/synapse/issues/12654))
+
+See [the upgrade notes](https://github.com/matrix-org/synapse/blob/develop/docs/upgrade.md#upgrading-to-v1590) for more details.
+
+Additionally, this release removes the non-standard `m.login.jwt` login type from Synapse. It can be replaced with `org.matrix.login.jwt` for identical behaviour. This is only used if `jwt_config.enabled` is set to `true` in the configuration. ([\#12597](https://github.com/matrix-org/synapse/issues/12597))
+
+Features
+--------
+
+- Support [MSC3266](https://github.com/matrix-org/matrix-doc/pull/3266) room summaries over federation. ([\#11507](https://github.com/matrix-org/synapse/issues/11507))
+- Implement [changes](https://github.com/matrix-org/matrix-spec-proposals/pull/2285/commits/4a77139249c2e830aec3c7d6bd5501a514d1cc27) to [MSC2285 (hidden read receipts)](https://github.com/matrix-org/matrix-spec-proposals/pull/2285). Contributed by @SimonBrandner. ([\#12168](https://github.com/matrix-org/synapse/issues/12168), [\#12635](https://github.com/matrix-org/synapse/issues/12635), [\#12636](https://github.com/matrix-org/synapse/issues/12636), [\#12670](https://github.com/matrix-org/synapse/issues/12670))
+- Extend the [module API](https://github.com/matrix-org/synapse/blob/release-v1.59/synapse/module_api/__init__.py) to allow modules to change actions for existing push rules of local users. ([\#12406](https://github.com/matrix-org/synapse/issues/12406))
+- Add the `notify_appservices_from_worker` configuration option (superseding `notify_appservices`) to allow a generic worker to be designated as the worker to send traffic to Application Services. ([\#12452](https://github.com/matrix-org/synapse/issues/12452))
+- Add the `update_user_directory_from_worker` configuration option (superseding `update_user_directory`) to allow a generic worker to be designated as the worker to update the user directory. ([\#12654](https://github.com/matrix-org/synapse/issues/12654))
+- Add new `enable_registration_token_3pid_bypass` configuration option to allow registrations via token as an alternative to verifying a 3pid. ([\#12526](https://github.com/matrix-org/synapse/issues/12526))
+- Implement [MSC3786](https://github.com/matrix-org/matrix-spec-proposals/pull/3786): Add a default push rule to ignore `m.room.server_acl` events. ([\#12601](https://github.com/matrix-org/synapse/issues/12601))
+- Add new `mau_appservice_trial_days` configuration option to specify a different trial period for users registered via an appservice. ([\#12619](https://github.com/matrix-org/synapse/issues/12619))
+
+
+Bugfixes
+--------
+
+- Fix a bug introduced in Synapse 1.48.0 where the latest thread reply provided failed to include the proper bundled aggregations. ([\#12273](https://github.com/matrix-org/synapse/issues/12273))
+- Fix a bug introduced in Synapse 1.22.0 where attempting to send a large amount of read receipts to an application service all at once would result in duplicate content and abnormally high memory usage. Contributed by Brad & Nick @ Beeper. ([\#12544](https://github.com/matrix-org/synapse/issues/12544))
+- Fix a bug introduced in Synapse 1.57.0 which could cause `Failed to calculate hosts in room` errors to be logged for outbound federation. ([\#12570](https://github.com/matrix-org/synapse/issues/12570))
+- Fix a long-standing bug where status codes would almost always get logged as `200!`, irrespective of the actual status code, when clients disconnect before a request has finished processing. ([\#12580](https://github.com/matrix-org/synapse/issues/12580))
+- Fix race when persisting an event and deleting a room that could lead to outbound federation breaking. ([\#12594](https://github.com/matrix-org/synapse/issues/12594))
+- Fix a bug introduced in Synapse 1.53.0 where bundled aggregations for annotations/edits were incorrectly calculated. ([\#12633](https://github.com/matrix-org/synapse/issues/12633))
+- Fix a long-standing bug where rooms containing power levels with string values could not be upgraded. ([\#12657](https://github.com/matrix-org/synapse/issues/12657))
+- Prevent memory leak from reoccurring when presence is disabled. ([\#12656](https://github.com/matrix-org/synapse/issues/12656))
+
+
+Updates to the Docker image
+---------------------------
+
+- Explicitly opt-in to using [BuildKit-specific features](https://github.com/moby/buildkit/blob/master/frontend/dockerfile/docs/syntax.md) in the Dockerfile. This fixes issues with building images in some GitLab CI environments. ([\#12541](https://github.com/matrix-org/synapse/issues/12541))
+- Update the "Build docker images" GitHub Actions workflow to use `docker/metadata-action` to generate docker image tags, instead of a custom shell script. Contributed by @henryclw. ([\#12573](https://github.com/matrix-org/synapse/issues/12573))
+
+
+Improved Documentation
+----------------------
+
+- Update SQL statements and replace use of old table `user_stats_historical` in docs for Synapse Admins. ([\#12536](https://github.com/matrix-org/synapse/issues/12536))
+- Add missing linebreak to `pipx` install instructions. ([\#12579](https://github.com/matrix-org/synapse/issues/12579))
+- Add information about the TCP replication module to docs. ([\#12621](https://github.com/matrix-org/synapse/issues/12621))
+- Fixes to the formatting of `README.rst`. ([\#12627](https://github.com/matrix-org/synapse/issues/12627))
+- Fix docs on how to run specific Complement tests using the `complement.sh` test runner. ([\#12664](https://github.com/matrix-org/synapse/issues/12664))
 
-The non-standard `m.login.jwt` login type has been removed from Synapse. It can be replaced with `org.matrix.login.jwt` for identical behaviour. This is only used if `jwt_config.enabled` is set to `true` in the configuration.
 
+Deprecations and Removals
+-------------------------
+
+- Remove unstable identifiers from [MSC3069](https://github.com/matrix-org/matrix-doc/pull/3069). ([\#12596](https://github.com/matrix-org/synapse/issues/12596))
+- Remove the unspecified `m.login.jwt` login type and the unstable `uk.half-shot.msc2778.login.application_service` from 
+  [MSC2778](https://github.com/matrix-org/matrix-doc/pull/2778). ([\#12597](https://github.com/matrix-org/synapse/issues/12597))
+- Synapse now requires at least Python 3.7.1 (up from 3.7.0), for compatibility with the latest Twisted trunk. ([\#12613](https://github.com/matrix-org/synapse/issues/12613))
+
+
+Internal Changes
+----------------
+
+- Use supervisord to supervise Postgres and Caddy in the Complement image to reduce restart time. ([\#12480](https://github.com/matrix-org/synapse/issues/12480))
+- Immediately retry any requests that have backed off when a server comes back online. ([\#12500](https://github.com/matrix-org/synapse/issues/12500))
+- Use `make_awaitable` instead of `defer.succeed` for return values of mocks in tests. ([\#12505](https://github.com/matrix-org/synapse/issues/12505))
+- Consistently check if an object is a `frozendict`. ([\#12564](https://github.com/matrix-org/synapse/issues/12564))
+- Protect module callbacks with read semantics against cancellation. ([\#12568](https://github.com/matrix-org/synapse/issues/12568))
+- Improve comments and error messages around access tokens. ([\#12577](https://github.com/matrix-org/synapse/issues/12577))
+- Improve docstrings for the receipts store. ([\#12581](https://github.com/matrix-org/synapse/issues/12581))
+- Use constants for read-receipts in tests. ([\#12582](https://github.com/matrix-org/synapse/issues/12582))
+- Log status code of cancelled requests as 499 and avoid logging stack traces for them. ([\#12587](https://github.com/matrix-org/synapse/issues/12587), [\#12663](https://github.com/matrix-org/synapse/issues/12663))
+- Remove special-case for `twisted` logger from default log config. ([\#12589](https://github.com/matrix-org/synapse/issues/12589))
+- Use `getClientAddress` instead of the deprecated `getClientIP`. ([\#12599](https://github.com/matrix-org/synapse/issues/12599))
+- Add link to documentation in Grafana Dashboard. ([\#12602](https://github.com/matrix-org/synapse/issues/12602))
+- Reduce log spam when running multiple event persisters. ([\#12610](https://github.com/matrix-org/synapse/issues/12610))
+- Add extra debug logging to federation sender. ([\#12614](https://github.com/matrix-org/synapse/issues/12614))
+- Prevent remote homeservers from requesting local user device names by default. ([\#12616](https://github.com/matrix-org/synapse/issues/12616))
+- Add a consistency check on events which we read from the database. ([\#12620](https://github.com/matrix-org/synapse/issues/12620))
+- Remove use of the `constantly` library and switch to enums for `EventRedactBehaviour`. Contributed by @andrewdoh. ([\#12624](https://github.com/matrix-org/synapse/issues/12624))
+- Remove unused code related to receipts. ([\#12632](https://github.com/matrix-org/synapse/issues/12632))
+- Minor improvements to the scripts for running Synapse in worker mode under Complement. ([\#12637](https://github.com/matrix-org/synapse/issues/12637))
+- Move `pympler` back in to the `all` extras. ([\#12652](https://github.com/matrix-org/synapse/issues/12652))
+- Fix spelling of `M_UNRECOGNIZED` in comments. ([\#12665](https://github.com/matrix-org/synapse/issues/12665))
+- Release script: confirm the commit to be tagged before tagging. ([\#12556](https://github.com/matrix-org/synapse/issues/12556))
+- Fix a typo in the announcement text generated by the Synapse release development script. ([\#12612](https://github.com/matrix-org/synapse/issues/12612))
+
+### Typechecking
+
+- Fix scripts-dev to pass typechecking. ([\#12356](https://github.com/matrix-org/synapse/issues/12356))
+- Add some type hints to datastore. ([\#12485](https://github.com/matrix-org/synapse/issues/12485))
+- Remove unused `# type: ignore`s. ([\#12531](https://github.com/matrix-org/synapse/issues/12531))
+- Allow unused `# type: ignore` comments in bleeding edge CI jobs. ([\#12576](https://github.com/matrix-org/synapse/issues/12576))
+- Remove redundant lines of config from `mypy.ini`. ([\#12608](https://github.com/matrix-org/synapse/issues/12608))
+- Update to mypy 0.950. ([\#12650](https://github.com/matrix-org/synapse/issues/12650))
+- Use `Concatenate` to better annotate `_do_execute`. ([\#12666](https://github.com/matrix-org/synapse/issues/12666))
+- Use `ParamSpec` to refine type hints. ([\#12667](https://github.com/matrix-org/synapse/issues/12667))
+- Fix mypy against latest pillow stubs. ([\#12671](https://github.com/matrix-org/synapse/issues/12671))
 
 Synapse 1.58.1 (2022-05-05)
 ===========================

diff --git a/changelog.d/11507.feature b/changelog.d/11507.feature
diff --git a/changelog.d/12168.feature b/changelog.d/12168.feature
diff --git a/changelog.d/12273.bugfix b/changelog.d/12273.bugfix
diff --git a/changelog.d/12356.misc b/changelog.d/12356.misc
diff --git a/changelog.d/12406.feature b/changelog.d/12406.feature
diff --git a/changelog.d/12452.feature b/changelog.d/12452.feature
diff --git a/changelog.d/12485.misc → changelog.d/12477.misc b/changelog.d/12485.misc → changelog.d/12477.misc
diff --git a/changelog.d/12480.misc b/changelog.d/12480.misc
diff --git a/changelog.d/12500.misc b/changelog.d/12500.misc
diff --git a/changelog.d/12505.misc b/changelog.d/12505.misc
diff --git a/changelog.d/12526.feature b/changelog.d/12526.feature
diff --git a/changelog.d/12531.misc b/changelog.d/12531.misc
diff --git a/changelog.d/12536.doc b/changelog.d/12536.doc
diff --git a/changelog.d/12541.docker b/changelog.d/12541.docker
diff --git a/changelog.d/12544.bugfix b/changelog.d/12544.bugfix
diff --git a/changelog.d/12556.misc b/changelog.d/12556.misc
diff --git a/changelog.d/12564.misc b/changelog.d/12564.misc
diff --git a/changelog.d/12568.misc b/changelog.d/12568.misc
diff --git a/changelog.d/12570.bugfix b/changelog.d/12570.bugfix
diff --git a/changelog.d/12573.docker b/changelog.d/12573.docker
diff --git a/changelog.d/12576.misc b/changelog.d/12576.misc
diff --git a/changelog.d/12577.misc b/changelog.d/12577.misc
diff --git a/changelog.d/12579.doc b/changelog.d/12579.doc
diff --git a/changelog.d/12580.bugfix b/changelog.d/12580.bugfix
diff --git a/changelog.d/12581.misc b/changelog.d/12581.misc
diff --git a/changelog.d/12582.misc b/changelog.d/12582.misc
diff --git a/changelog.d/12586.misc b/changelog.d/12586.misc
@@ -0,0 +1 @@
+Add `@cancellable` decorator, for use on endpoint methods that can be cancelled when clients disconnect.
diff --git a/changelog.d/12587.misc b/changelog.d/12587.misc
diff --git a/changelog.d/12588.misc b/changelog.d/12588.misc
@@ -0,0 +1 @@
+Add ability to cancel disconnected requests to `SynapseRequest`.
diff --git a/changelog.d/12589.misc b/changelog.d/12589.misc
diff --git a/changelog.d/12594.bugfix b/changelog.d/12594.bugfix
diff --git a/changelog.d/12596.removal b/changelog.d/12596.removal
diff --git a/changelog.d/12597.removal b/changelog.d/12597.removal
diff --git a/changelog.d/12599.misc b/changelog.d/12599.misc
diff --git a/changelog.d/12601.feature b/changelog.d/12601.feature
diff --git a/changelog.d/12602.misc b/changelog.d/12602.misc
diff --git a/changelog.d/12608.misc b/changelog.d/12608.misc
diff --git a/changelog.d/12610.misc b/changelog.d/12610.misc
diff --git a/changelog.d/12612.bugfix b/changelog.d/12612.bugfix
diff --git a/changelog.d/12613.removal b/changelog.d/12613.removal
diff --git a/changelog.d/12614.misc b/changelog.d/12614.misc
diff --git a/changelog.d/12616.misc b/changelog.d/12616.misc
diff --git a/changelog.d/12619.feature b/changelog.d/12619.feature
diff --git a/changelog.d/12620.misc b/changelog.d/12620.misc
diff --git a/changelog.d/12621.doc b/changelog.d/12621.doc
diff --git a/changelog.d/12624.misc b/changelog.d/12624.misc
diff --git a/changelog.d/12627.doc b/changelog.d/12627.doc
diff --git a/changelog.d/12630.misc b/changelog.d/12630.misc
@@ -0,0 +1 @@
+Add a helper class for testing request cancellation.
diff --git a/changelog.d/12632.misc b/changelog.d/12632.misc
diff --git a/changelog.d/12633.bugfix b/changelog.d/12633.bugfix
diff --git a/changelog.d/12635.feature b/changelog.d/12635.feature
diff --git a/changelog.d/12636.feature b/changelog.d/12636.feature
diff --git a/changelog.d/12637.misc b/changelog.d/12637.misc
diff --git a/changelog.d/12639.bugfix b/changelog.d/12639.bugfix
diff --git a/changelog.d/12650.misc b/changelog.d/12650.misc
diff --git a/changelog.d/12652.misc b/changelog.d/12652.misc
diff --git a/changelog.d/12656.misc b/changelog.d/12656.misc
diff --git a/changelog.d/12657.bugfix b/changelog.d/12657.bugfix
diff --git a/changelog.d/12663.misc b/changelog.d/12663.misc
diff --git a/changelog.d/12664.doc b/changelog.d/12664.doc
diff --git a/changelog.d/12665.misc b/changelog.d/12665.misc
diff --git a/changelog.d/12666.misc b/changelog.d/12666.misc
diff --git a/changelog.d/12667.misc b/changelog.d/12667.misc
diff --git a/changelog.d/12670.feature b/changelog.d/12670.feature
diff --git a/changelog.d/12671.misc b/changelog.d/12671.misc
diff --git a/changelog.d/12679.misc b/changelog.d/12679.misc
@@ -0,0 +1 @@
+Preparation for database schema simplifications: stop writing to `event_reference_hashes`.
diff --git a/changelog.d/12689.misc b/changelog.d/12689.misc
@@ -0,0 +1 @@
+Refactor `EventContext` class.
diff --git a/changelog.d/12694.misc b/changelog.d/12694.misc
@@ -0,0 +1 @@
+Capture the `Deferred` for request cancellation in `_AsyncResource`.
diff --git a/changelog.d/12695.misc b/changelog.d/12695.misc
@@ -0,0 +1 @@
+Fixes an incorrect type hint for `Filter._check_event_relations`.
diff --git a/debian/changelog b/debian/changelog
@@ -1,10 +1,11 @@
-matrix-synapse-py3 (1.58.2) UNRELEASED; urgency=medium
+matrix-synapse-py3 (1.59.0~rc1) stable; urgency=medium
 
   * Adjust how the `exported-requirements.txt` file is generated as part of
     the process of building these packages. This affects the package
     maintainers only; end-users are unaffected.
+  * New Synapse release 1.59.0rc1.
 
- -- Synapse Packaging team <packages@matrix.org>  Fri, 06 May 2022 13:49:29 +0100
+ -- Synapse Packaging team <packages@matrix.org>  Tue, 10 May 2022 10:45:08 +0100
 
 matrix-synapse-py3 (1.58.1) stable; urgency=medium
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Add `@cancellable` decorator, for use on endpoint methods that can be cancelled when clients disconnect.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Add ability to cancel disconnected requests to `SynapseRequest`.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Add a helper class for testing request cancellation.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Preparation for database schema simplifications: stop writing to `event_reference_hashes`.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Capture the `Deferred` for request cancellation in `_AsyncResource`.
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Fixes an incorrect type hint for `Filter._check_event_relations`.