20241002.21

What's Changed

• chore(tests): Update test snapshots 20-09-2024 by @dfe-sdt in #5274
• EES-4046: Add functionality to delete draft releases by @tomjonesdev in #5224
• EES-5519 Wait for remove API data set modal to close by @mmyoungman in #5278
• EES-XXXX - fixed failing Public API test which was expecting an inval… by @duncan-at-hiveit in #5277
• Fix incorrect default request timeout for public API by @ntsim in #5279
• EES-5523 Created Migration to Remove Device Codes And Persist Tables by @rianski in #5273
• EES-4490 - added test theme id to UI test code by @duncan-at-hiveit in #5281
• EES-4490: Add theme to all publications by @tomjonesdev in #5269
• Fix ESLint warnings for missing hook deps by @ntsim in #5282
• EES-4563 Add CSV endpoint to public API by @jack-hive in #5261
• chore(tests): Update test snapshots 26-09-2024 by @dfe-sdt in #5284
• EES-5525 Hide Data catalogue 'Download all [...]' button if using sea… by @mmyoungman in #5276
• EES-5536 Fix styling and markup issues in data set file usage section by @ntsim in #5287
• EES-4771 Move from Azure.Cosmos.Table to Azure.Data.Tables by @mmyoungman in #5271
• EES-5528 Move admin options classes into Options namespace by @ntsim in #5283
• chore(tests): Update test snapshots 27-09-2024 by @dfe-sdt in #5289
• EES-5531 Update public API Bicep params with renamed App options by @ntsim in #5291
• EES-5531 Revert public API app settings in Bicep template to use __ syntax by @ntsim in #5292
• EES-5531 Fix App__Url app setting for public API Bicep template by @ntsim in #5293
• EES-5537 EES-5500 Notifier ContentDB connection and archived subscriptions fixes by @mmyoungman in #5290
• EES-5539 Fix excessively large CodeBlock dependency bundle by @ntsim in #5295
• EES-5531 Update App options for public API processor infrastructure by @ntsim in #5297
• EES-5528 Bind PublicOptions into admin service container by @ntsim in #5298
• EES-5528 Add missing PublicApp.Url to integration test app settings by @ntsim in #5299
• EES-5537 Give Notifier subnet access to ContentDB by @mmyoungman in #5300
• EES-5531 Fix admin not setting App:Url correctly by @ntsim in #5303
• Merge Dev into Master by @N-moh in #5304

New Contributors

• @rianski made their first contribution in #5273

Full Changelog: 20240920.65...20241002.21

20240920.65

What's Changed

• EES-5292: Remove obsolete geospatial objects from database. by @tomjonesdev in #5229
• EES-5477: Add text to footer/release page to identify DfE as the content's producer by @tomjonesdev in #5230
• EES-5486 Added UI test to verify contents inside the 'Live API datase… by @saicharan2789 in #5235
• EES-5489 : Verify Headings and relevant content on 'API dataset details' page. by @saicharan2789 in #5221
• EES-5477: Add footer content to identify DfE as the content's producer in Admin by @tomjonesdev in #5238
• EES-5024 - removing deploy SPN Key Vault Secrets User role assignment by @duncan-at-hiveit in #5240
• EES-5382 hotfix remove devops spn from key vault role assignment by @duncan-at-hiveit in #5243
• EES-5382 - enabling RBAC flag in Key Vault by @duncan-at-hiveit in #5244
• chore(tests): Update test snapshots 13-09-2024 by @dfe-sdt in #5239
• Ees 5382 hotfix remove devops spn from key vault role assignment disable rbac switch by @duncan-at-hiveit in #5245
• EES-5506 fix data-catalogue footnotes rendering html as plain text by @bennettstuart in #5248
• EES-5464 Download data-catalogue CSV with code UI by @bennettstuart in #5236
• EES-5494 Update Swagger documentation to work with public API docs site by @ntsim in #5237
• Merge Master into dev by @N-moh in #5251
• Master by @duncan-at-hiveit in #5247
• Enabling RBAC (after manual switch performed in all environments) and removing old access policies by @duncan-at-hiveit in #5252
• EES-4489: Add endpoint to remove all themes created by UI tests by @tomjonesdev in #5246
• EES-5464 improvements by @bennettstuart in #5253
• chore(tests): Update test snapshots 18-09-2024 by @dfe-sdt in #5257
• EES-5515 Reverting increase in number of provisioned vCores of Prod statistics databases made for EES-5339 by @benoutram in #5258
• chore(tests): Update test snapshots 19-09-2024 by @dfe-sdt in #5259
• EES-5464 increase contrast by @bennettstuart in #5255
• EES-5422 Change filters and indicators to use sqids for public IDs by @ntsim in #5219
• Ees 5479 modularise bicep by @duncan-at-hiveit in #5222
• EES-5520 Group public API data sets in root data-sets dir by @ntsim in #5266
• Merging master into dev after PR #5258 by @benoutram in #5260
• EES-5512 - correcting Container App CORS policy to include public site URL rather than Public API url! by @duncan-at-hiveit in #5268
• EES-5519 Set up Azure pipelines by @saicharan2789 in #5264
• EES-5493 Clean up UI test data to fix Public API error occurring when creating Public API data set by @benoutram in #5267
• EES-5485 Added UI test to validate mapping statuses of 'Map locations… by @saicharan2789 in #5242
• EES 5512 - Verify and update 'Changelog guidance notes' and 'Version History' of an API dataset by @saicharan2789 in #5262
• EES-5464 replace CSV download rewrite with middleware redirect by @bennettstuart in #5265
• EES-5511 Update data set query sorts to handle public IDs correctly by @ntsim in #5256
• EES-5518 Add server URL to OpenAPI docs by @ntsim in #5270
• Merging dev into master by @mmyoungman in #5272

Full Changelog: 20240910.26...20240920.65

20240910.26

What's Changed

• EES-5437 Fix deleted location levels not being considered in mapping state by @ntsim in #5179
• EES-5442 - updating file storage path to reflect updates to a next DataSetVersion's version number by @duncan-at-hiveit in #5183
• EES-5453 Fix list styling for breadcrumbs and footer items by @ntsim in #5185
• EES-5421 Error if ListSubjects finds different number of subjects in DBs by @mmyoungman in #5156
• EES-5382 - switch Key Vault to RBAC mode. Migrate "Get/List secrets" policies to "Key Vault Secrets User" role assignments by @duncan-at-hiveit in #5155
• EES-5382 - moving use of "reference" template function out of variabl… by @duncan-at-hiveit in #5188
• EES-5382 - fixng additional brace by @duncan-at-hiveit in #5189
• EES-5382 - moving use of "reference" template function to valid "inpu… by @duncan-at-hiveit in #5190
• EES-5382 - removing use of "reference" template function when generat… by @duncan-at-hiveit in #5191
• EES-5382 - reverting change to RBAC until SPN or manual users allowed… by @duncan-at-hiveit in #5192
• EES-5409 Added UI tests to create a release with two small API Datasets by @saicharan2789 in #5150
• EES 5430 - Cancel and Removal of draft API datasets by @saicharan2789 in #5170
• EES-5443 - Verify row data contents inside the 'Draft API datasets' summary table by @saicharan2789 in #5181
• EES-5382 - adding Key Vault access policies additions back in until s… by @duncan-at-hiveit in #5194
• EES-5382 - dual-adding Key Vault access policiies and RBAC roles ahea… by @duncan-at-hiveit in #5195
• EES-5382 - separating Data Factory KV role assignment as not possible… by @duncan-at-hiveit in #5196
• Ees 5374 add easyauth to public api endpoints with app roles by @duncan-at-hiveit in #5127
• Ees 5374 fixes by @duncan-at-hiveit in #5198
• EES-5374 - fix typo in yml by @duncan-at-hiveit in #5199
• EES-5374 - replaced null check with empty check by @duncan-at-hiveit in #5201
• EES-5374 - replaced empty check with not-"none" check by @duncan-at-hiveit in #5202
• EES-5374 - split auth settings into site-specific and containerApp-sp… by @duncan-at-hiveit in #5203
• EES-5374 - split auth settings into site-specific and containerApp-sp… by @duncan-at-hiveit in #5204
• EES-5374 - split auth settings into site-specific and containerApp-sp… by @duncan-at-hiveit in #5205
• EES-5374 - corrected registration details of AD block by @duncan-at-hiveit in #5206
• EES-5374 - removed unnecessary brace by @duncan-at-hiveit in #5207
• EES-5456 Fix broken changelog link in API data set version history by @ntsim in #5186
• EES-5024 - adding App Gateway to Bicep deployment by @duncan-at-hiveit in #5131
• EES-5480 - handling creation of container app managed identity and its role assignments in Bicep by @duncan-at-hiveit in #5210
• EES-5480 - corrected renamed module reference. by @duncan-at-hiveit in #5216
• EES-5480 - returning GUID creation for KV roles to original format to… by @duncan-at-hiveit in #5217
• EES-5480 - restoring change to GUID creation to be more in line with … by @duncan-at-hiveit in #5218
• Merge master into dev by @mmyoungman in #5214
• EES-5478 Fix indicator unit test data file by @mmyoungman in #5220
• Ees 5408 automate private endpoint creation for data procesor by @duncan-at-hiveit in #5208
• 🐛 EES-4859 Fix data set id's and data set file id's used by API subscription pages by @benoutram in #5212
• EES-5452 Added UI test that checks creation and revoke of API tokens on 'Preview token log' page by @saicharan2789 in #5200
• EES 5466 - UI test that verifies relevant fields on the 'View Log Details' page for the Active API token" by @saicharan2789 in #5213
• Update @typescript-eslint to 7.18.0 by @ntsim in #5225
• EES-5495 Fix camelCased properties causing FluentValidation test failures by @ntsim in #5223
• EES-4723 Add Content API download link for published data files by @mmyoungman in #5193
• chore(tests): Update test snapshots 09-09-2024 by @dfe-sdt in #5228
• EES-5401 update datablock to use geoJson API call instead of boundaryLevel parameter by @bennettstuart in #5177
• chore(tests): Update test snapshots 10-09-2024 by @dfe-sdt in #5231
• EES-XXXX - Robot test improvements by @duncan-at-hiveit in #5232
• Ees xxxx robot test improvements 2 by @duncan-at-hiveit in #5233
• Merge dev into master by @N-moh in #5234

Full Changelog: 20240904.1...20240910.26

20240904.1

What's Changed

• EES-5478 Introduce new indicator unit 'numberstring' by @mmyoungman in #5211
• EES-5483 Fix privacy notice date by @mmyoungman in #5215

Full Changelog: 20240828.21...20240904.1

20240828.21

What's Changed

• EES-5405 Stash all release related fields of a data set version in a new Release entity by @benoutram in #5157
• EES-4859 api data set subscriptions by @amyb-hiveit in #5145
• EES-5419 import new data set version by @amyb-hiveit in #5152
• EES-4879 Adding a blanket 30s timeout across all Public API endpoints by @jack-hive in #5137
• EES-5427 Add file info to data set version summaries in admin by @ntsim in #5167
• EES-5125 content accessibility validation by @amyb-hiveit in #4870
• EES-4382 api data set history page by @amyb-hiveit in #5164
• EES-5400: Create new endpoint to get GeoJSON for implementing multiple boundary files by @tomjonesdev in #5154
• EES-5303 Remove ability to add italic text in all content editors & strip italic elements from rendered text content by @bennettstuart in #5168
• EES-5424 Add deleted and new location group tables to location mappings page by @ntsim in #5171
• EES-5435 only show api draft version tasks when mapping required by @amyb-hiveit in #5173
• EES-5363 api data set admin changelog by @amyb-hiveit in #5169
• EES-5444 Fix broken ui test by @saicharan2789 in #5174
• EES-5437 Remove JSON DTOs in favour of unmapped entities by @ntsim in #5175
• EES-5445 Fix data set meta endpoint not returning location options by @ntsim in #5176
• EES-4913 Allow preview access to Public API data sets by @benoutram in #5133
• EES-5254/5255/5075: Additionally order publications by latest release version type by @tomjonesdev in #5172
• EES-5442 Set PublicId when creating filter option and location mappings by @benoutram in #5178
• EES-5449 Hide changelog link for v1 draft API data set versions by @ntsim in #5180
• Merge dev into Master by @N-moh in #5182

Full Changelog: 20240820.27...20240828.21

20240820.27

What's Changed

• EES-5274 Added cron jobs to run multiple times on friday, saturday an… by @saicharan2789 in #5106
• EES-4930 Make Azurite available to Publisher function integration tests by @benoutram in #5099
• EES-4930 Send Public API subscription notifications by @benoutram in #5097
• EES-5365 Update to DuckDB.NET.Data.Full 1.0.2 by @benoutram in #5109
• Update node to 20.16.0 by @amyb-hiveit in #5110
• EES-5287 Added retry mechanism to add image to accordion section text… by @saicharan2789 in #5107
• EES-5281 prevent deleting and replacing data for files with api data sets by @amyb-hiveit in #5093
• EES-5367 Update to Microsoft.Azure.Functions.Worker.Extensions.DurableTask 1.1.4 by @benoutram in #5108
• EES-5205 Update RebuildIndexes stored procedure by @mmyoungman in #5103
• 🐛 EES-4930 EES-5377 Correct PublishingService reference to the public storage connection string by @benoutram in #5116
• EES-5366 Updating Swashbuckle.AspNetCore by @jack-hive in #5111
• EES-4529 Upgrade minor dependencies that don't break stuff by @mmyoungman in #5084
• EES-5288 Fix ui test failure by @saicharan2789 in #5112
• EES-5260 Added 'Run_identifier' variable to include test run instance… by @saicharan2789 in #5115
• 🐛 EES-5329 Add missing ASPNETCORE_ENVIRONMENT environment variable and force migration to rerun by @benoutram in #5087
• EES-5314 Fix ui test failure by @saicharan2789 in #5117
• EES-4921 Add public API endpoint for data set version changelog by @ntsim in #5104
• EES-5362 Add admin endpoint for data set version changelog by @ntsim in #5113
• EES-4947 - updating version number after saves by @duncan-at-hiveit in #5102
• EES-5326 Tweaks to location mappings by @ntsim in #5121
• EES-4367 generate api data set preview tokens by @amyb-hiveit in #5098
• EES-5326 edit api data set location mappings by @amyb-hiveit in #5092
• EES-4952 - Changelog: Save user inputted Changelog notes by @jack-hive in #5114
• EES-5253 Squash Public API migrations by @benoutram in #5126
• EES-4368 api data set preview token log by @amyb-hiveit in #5125
• EES-5371 Added retries mechanism until child element is found inside … by @saicharan2789 in #5118
• EES-5379 Fixed ui test failure by @saicharan2789 in #5122
• chore(tests): Update test snapshots 09-08-2024 by @dfe-sdt in #5130
• 🐛 EES-4367 Change data set version id to data set id on release API data set preview token page by @benoutram in #5134
• EES-4920 Version History: Admin Endpoint to list published versions of an API dataset by @jack-hive in #5124
• EES-5373: Remove FullTableQuery.BoundaryLevel by @tomjonesdev in #5119
• EES-5384 : Fix falsy ui test failure reporting via slack by @saicharan2789 in #5129
• EES-5326: Remove "k" character from boundary level table markup. by @tomjonesdev in #5140
• EES-5382 - attempt to prevent ARM template deploy from clearing down other policies by @duncan-at-hiveit in #5128
• EES-5382 - fix deploy name for access policies by @duncan-at-hiveit in #5141
• EES-5382 - fix deploy name for access policies by @duncan-at-hiveit in #5142
• EES-5406 Disabled the off-peak run /;which runs mutliple times on fri… by @saicharan2789 in #5136
• EES-5411 add option to show all axis labels on vertical bar charts by @amyb-hiveit in #5139
• EES-5412 fix map display in chart builder by @amyb-hiveit in #5143
• EES-5380 Fixed page loading issue by @saicharan2789 in #5138
• EES-5382 use key vault RBAC for public api by @duncan-at-hiveit in #5144
• EES-5382 - temporarily reverting RBAC Key Vault auth approach by @duncan-at-hiveit in #5146
• EES-5382 - fixed rename of key vault policy assignment resource by @duncan-at-hiveit in #5147
• EES-5238 - adding in controller call to invoke the completion of next data set version import by @duncan-at-hiveit in #5148
• chore(tests): Update test snapshots 15-08-2024 by @dfe-sdt in #5149
• EES-5382 - attempting to use RBAC key vault role assignments again by @duncan-at-hiveit in #5151
• EES-4997 Add API data set changelog to public frontend by @ntsim in #5135
• EES-5368 RebuildIndexes now writes run data to the DB by @mmyoungman in #5120
• EES-5376 api data set filter mapping by @amyb-hiveit in #5132
• EES-4670 Remove old code previously used with old Data Catalogue page by @mmyoungman in #5158
• EES-5368 On RebuildIndexes stored procedure, set start time before fetching StartFragPercent values by @mmyoungman in #5159
• EES-5416 Fix release files not being unlinked when draft data set versions deleted by @ntsim in #5153
• EES-4670 Revert Data Catalogue code removal by @mmyoungman in #5165
• EES-5426 Fix intermittently failing unit test by @mmyoungman in #5163
• Merge master into dev by @mmyoungman in #5162
• Merging dev into master by @mmyoungman in #5166

Full Changelog: 20240729.3...20240820.27

20240729.3

What's Changed

• EES-4956 - amending wording of release checklist errors and only show… by @duncan-at-hiveit in #5071
• EES-5324 api data set locations mapping page by @amyb-hiveit in #5058
• EES-5251 fix accessibility page ui test by @amyb-hiveit in #5074
• chore(tests): Update test snapshots 18-07-2024 by @dfe-sdt in #5075
• EES-4914 Add endpoints to create a PreviewToken and get a PreviewToken by @benoutram in #5054
• EES-4916 Add endpoint to list PreviewToken's by @benoutram in #5070
• EES-4932 Bulk import: allow users to import multiple data sets from a single zip file by @mmyoungman in #5030
• EES-5275 Add backend validation to request table queries by @mmyoungman in #5060
• EES-4928 API Subscriptions: Add Endpoints to subscribe users by @jack-hive in #5043
• EES-5345: Add Publisher's Guide page. by @tomjonesdev in #5079
• EES-5335 Adding Timer Trigger to remove expired API subscriptions by @jack-hive in #5056
• EES-4915 Add endpoint to revoke a PreviewToken by @benoutram in #5069
• EES-5220: Retain selected sorting method when applying search term, and default to 'Newest' by @tomjonesdev in #5078
• EES-4906 - added restrictions on when to show "Create new version" bu… by @duncan-at-hiveit in #5066
• EES-5258 Fix blank map charts bug by @mmyoungman in #5080
• EES-5342-Prod only UI test failures by @N-moh in #5081
• EES-5329 Create new database users for local environment and new public_data_read_write group role by @benoutram in #5044
• EES-5346 add mapping complete flags to data set by @duncan-at-hiveit in #5068
• EES-5345 update link in publishers guide by @amyb-hiveit in #5083
• EES-4929 Adding endpoint to unsubscribe users from API data sets by @jack-hive in #5076
• EES-5220 fix find stats search ui test by @amyb-hiveit in #5086
• 🐛 EES-5329 Ensure app_public_data_api has USAGE privilege on public schema by @benoutram in #5085
• EES-4928 - adding missing vnet to main ARM template by @duncan-at-hiveit in #5082
• Merge master into dev by @mmyoungman in #5095
• EES-5364 remove notification banner on data catalogue by @amyb-hiveit in #5094
• EES-4950 Re-model data set version change sets by @ntsim in #5089
• EES-4954 - continue import of next data set version, using the mappings by @duncan-at-hiveit in #5047
• chore(tests): Update test snapshots 26-07-2024 by @dfe-sdt in #5096
• Merge dev into master by @mmyoungman in #5105

Full Changelog: 20240723.22...20240729.3

20240723.22

What's Changed

• EES-5361 Fix amendment cancelling by @mmyoungman in #5088

Full Changelog: 20240717.28...20240723.22

20240717.28

What's Changed

• EES-5170: Update geospatial boundary data import process to handle GeoJSON files by @tomjonesdev in #4995
• EES-5337: Increase dev/prod statistics DB size to 600GB/1.5TB respectively by @tomjonesdev in #5041
• EES-5339 Temporarily increase statistics database scale after slow running observed by @benoutram in #5046
• EES-5337: Increase dev/prod statistics DB size to 600GB/1.5TB respectively by @tomjonesdev in #5050
• Merging master into dev after PR #5046 and #5050 by @benoutram in #5048
• EES-5170 handle geojson param casing by @amyb-hiveit in #5052
• EES-5344 fix flaky data catalogue tests by @amyb-hiveit in #5053
• EES-5170: Boundary level admin instructions should always be visible. by @tomjonesdev in #5055
• EES-5238 - adding new HTTP trigger and orchestration for completing the next data set version import by @duncan-at-hiveit in #5038
• EES-5281-backend Adding IsLinkedToApiDataSet flag to the DataFileInfo View Model by @jack-hive in #5049
• EES-5239 Add PreviewToken to Public API data model by @benoutram in #5051
• EES-5114 - serialising GeographicLevel as string for MVC response by @duncan-at-hiveit in #5063
• EES-5170: Add read permission to new BoundaryData table. by @tomjonesdev in #5062
• EES-5251 updated accessibility statement by @amyb-hiveit in #5040
• EES-5238 - extracting Function logic into service layer following PR … by @duncan-at-hiveit in #5059
• EES-5170: Add missing boundary level details to glossary section, advise of file size limit on file upload by @tomjonesdev in #5067
• EES-5270 Fix snapshots by @mmyoungman in #5064
• EES-4529 Update GovukNotify to 7.1.0 by @mmyoungman in #5065
• EES-5170: Fix JS formatting. by @tomjonesdev in #5072
• Merge Dev into Master by @N-moh in #5073

Full Changelog: 20240711.12...20240717.28

20240711.12

What's Changed

• EES 5261 : Fix intermittent test failures in the publish_release_and_amend test suite: by @saicharan2789 in #5004
• EES :5266 : Add parsing logic to handle re-direct failures in local and update the ui test scripts as per latest changes by @saicharan2789 in #5012
• 🐛 EES-5235 Grant the Public API Data Processor Function App user sequence privileges by @benoutram in #5014
• Merge Master back into dev by @N-moh in #5011
• EES-5270 Temporarily disable snapshots for Find stats and Data catalo… by @mmyoungman in #5016
• EES-5277 Quick fix for methodology page href issue by @mmyoungman in #5019
• Merge Master back into Dev by @N-moh in #5021
• EES-4529: Update Azure Storage Movement client library by @benoutram in #5022
• EES-5267 Added UI test with retry mechanism that checks title in data… by @saicharan2789 in #5029
• EES-5269- Fix prod-only UI test failure by @N-moh in #5032
• EES: 5278 by @saicharan2789 in #5020
• EES-5013 Suppress SQL command console logging in Function apps by @benoutram in #5024
• EES-5283 Add missing MetaInsertBatchSize app setting to Public API Data Processor function app by @benoutram in #5033
• EES-5115 - Filter Option mapping endpoint by @duncan-at-hiveit in #5028
• EES-5111 - endpoint to retrieve location mappings by @duncan-at-hiveit in #5026
• EES-5112 - endpoint for autosaving location mappings by @duncan-at-hiveit in #5023
• EES-5011 Change Publisher queue message types to remove use of System.ValueTuple by @benoutram in #5025
• EES-5011 Replace obsolete queue client library Microsoft.Azure.Storage.Queue by @benoutram in #5031
• EES-5112 - fixing startup issue in Admin when Public DB is not present by @duncan-at-hiveit in #5037
• EES-5238 - breaking out shared ImportDataFunction and WriteDataFuncti… by @duncan-at-hiveit in #5036
• EES-5213 change form validation mode and fix publication form issues by @amyb-hiveit in #5035
• EES-5112 - adding validation to ensure Candidate Keys are valid by @duncan-at-hiveit in #5034
• EES-5111 - added Newtonsoft JSON converter by @duncan-at-hiveit in #5042
• EES-4373 create new api data set version by @amyb-hiveit in #5039
• Merge dev into Master by @N-moh in #5045

Full Changelog: 20240627.6...20240711.12