20240627.6

What's Changed

• EES-5232 Fix incorrect DataFiles.BasePath for public API container by @ntsim in #4965
• Improve Methodology Sitemap Item query by @sambiramairelogic in #4966
• EES-5232 Add PUBLIC_API_BASE_URL env variable to environments by @ntsim in #4967
• EES-XXXX - Fix dotnet build error by @sambiramairelogic in #4968
• EES-4994 Fixes and updates to admin API data sets pages by @ntsim in #4962
• EES-5176 accessibility improvements for data catalogue and find stats by @amyb-hiveit in #4950
• EES-4906 Filter API data set candidates that are still importing by @ntsim in #4970
• EES-5208 automatically open external links in new tabs by @amyb-hiveit in #4973
• EES-5227 update find stats to match data catalogue design by @amyb-hiveit in #4977
• EES-5152 Add Public API Data Processor tests for ImportMetadata and ImportData by @benoutram in #4971
• EES-5210 hide browser search clear button by @amyb-hiveit in #4974
• EES-5211 remove group role on details element by @amyb-hiveit in #4975
• EES-4993 Move PublicApiDataSet* columns from Files to ReleaseFiles by @ntsim in #4979
• EES-5214 ensure map legends are visible in high contrast mode by @amyb-hiveit in #4982
• EES- 3174 : UI tests for checklist warnings and errors by @saicharan2789 in #4923
• EES-5212 EES-5217 table tool accessibility improvements by @amyb-hiveit in #4981
• EES-5216 improve CollapsibleList accessibility by @amyb-hiveit in #4983
• EES-5218 fix tab markup on mobile by @amyb-hiveit in #4984
• EES-5231 Add IsSuperseded to Data catalogue view models by @mmyoungman in #4978
• chore(tests): Update test snapshots 20-06-2024 by @dfe-sdt in #4987
• EES-5243 Add CORS policy to allow access to public API from public frontend by @ntsim in #4985
• EES-5036 BST test fix by @saicharan2789 in #4990
• EES-5237 Remove unneeded BauMigrationController by @ntsim in #4994
• EES-5003 - Minor fixes by @sambiramairelogic in #4993
• EES-5235 Prevent collisions of Public API PublicId's in filter and location options by @benoutram in #4992
• Ees 5143 UI test fix by @saicharan2789 in #4998
• EES-5248 Added 15 seconds wait for methodology re-directs & Added pag… by @saicharan2789 in #4999
• EES-4781 remove data catalogue feature flag by @amyb-hiveit in #4989
• EES-5252 Remove listener on SIGINT for Windows in start.ts by @benoutram in #4997
• EES-4716 Fix various issues with data set query endpoint by @ntsim in #4996
• Ees 4944 read next data set version metadata by @duncan-at-hiveit in #4952
• EES-5194 Add Processor bulk delete endpoint for multiple API data set versions by @jack-hive in #4947
• EES-5173 Change Release Version DELETION plan to include deleting draft API data sets by @jack-hive in #4957
• EES-5192 Change Data File DELETION endpoint to be blocked if any linked API data sets exist by @jack-hive in #4958
• EES 5193 Change Data File REPLACEMENT endpoint to be blocked if any linked API data sets exist by @jack-hive in #4972
• EES 5250 by @saicharan2789 in #5003
• Ees 5113 investigate partial json updates by @duncan-at-hiveit in #5007
• Ees 4945 create data set version mappings 3 by @duncan-at-hiveit in #5000
• chore(tests): Update test snapshots 27-06-2024 by @dfe-sdt in #5009
• EES-4921 Refactor out DataSetVersionsController in public API by @ntsim in #5008
• Merge Dev into Master by @N-moh in #5010

Full Changelog: 20240626.14...20240627.6

20240626.14

What's Changed

• EES-5256 Experiment rolling back to EF 8.0.3 related to issue seen with long running db queries using Contains/OPENJSON by @benoutram in #5002
• EES-5256 Fix LocationStep not awaiting form submission by @ntsim in #5005
• EES-5256 Opt-out of OPENJSON subquery transformation in time periods query and revert #5002 by @benoutram in #5006

Full Changelog: 20240614.21...20240626.14

20240614.21

What's Changed

• EES-5201 Refactor functions in preparation for creating next data set versions by @benoutram in #4938
• Merging master into dev after PR #4942 by @benoutram in #4943
• EES-5138 Add linking and release information to data set version by @ntsim in #4939
• EES-5159 data set page fixes by @amyb-hiveit in #4932
• EES-5182 redirect data catalogue slug urls by @amyb-hiveit in #4937
• EES-5003 - Create sitemap.xml and robots.txt files by @sambiramairelogic in #4891
• EES-5160 - Only run www tests against prod and local by @sambiramairelogic in #4948
• Merge Master back into Dev by @N-moh in #4949
• chore(tests): Update test snapshots 12-06-2024 by @dfe-sdt in #4951
• chore(deps): update resource microsoft.storage/storageaccounts to 2023-05-01 by @renovate in #4918
• chore(deps): update resource microsoft.web/sites/slots/config to 2023-12-01 by @renovate in #4908
• chore(deps): update resource microsoft.web/sites/slots to 2023-12-01 by @renovate in #4907
• chore(deps): update resource microsoft.web/sites/config to 2023-12-01 by @renovate in #4906
• chore(deps): update resource microsoft.web/sites to 2023-12-01 by @renovate in #4905
• chore(deps): update resource microsoft.web/serverfarms to 2023-12-01 by @renovate in #4904
• chore(deps): update resource microsoft.network/privateendpoints/privatednszonegroups to 2023-11-01 by @renovate in #4900
• chore(deps): update resource microsoft.network/privateendpoints to 2023-11-01 by @renovate in #4898
• chore(deps): update resource microsoft.managedidentity/identities to 2023-01-31 by @renovate in #4926
• chore(deps): update resource microsoft.storage/storageaccounts/blobservices to 2023-05-01 by @renovate in #4953
• chore(tests): Update test snapshots 13-06-2024 by @dfe-sdt in #4956
• EES-5196 Add data set status and summary to admin details page by @ntsim in #4941
• EES-XXXX - fix out of date app setting path by @duncan-at-hiveit in #4961
• chore(deps): update resource microsoft.storage/storageaccounts/fileservices/shares to 2023-05-01 - autoclosed by @renovate in #4955
• chore(deps): update resource microsoft.storage/storageaccounts/fileservices to 2023-05-01 by @renovate in #4954
• chore(tests): Update test snapshots 14-06-2024 by @dfe-sdt in #4963
• EES-5003 - Sitemap and robots not dynamically generated by @sambiramairelogic in #4959
• Merge Dev into Master by @N-moh in #4964

Full Changelog: 20240611.7...20240614.21

20240611.7

What's Changed

• EES-5158 update national stats branding by @amyb-hiveit in #4909
• EES-5175 and EES-5177 data catalogue updates by @amyb-hiveit in #4914
• EES-5119 - adding Managed Identity authentication to the Data Processor by @duncan-at-hiveit in #4911
• Ees 5147 add data processor function app health checks by @duncan-at-hiveit in #4915
• EES-5119 - slight fix for pluralised filename by @duncan-at-hiveit in #4924
• chore(deps): update minor backend dependencies by @renovate in #4809
• EES-5119 - prevent parallel runs of API infrastructure pipeline by @duncan-at-hiveit in #4925
• EES-XXXX - enabling Public Data DB connection on Dev for Admin and Publisher by @duncan-at-hiveit in #4927
• EES-5159 hook up data set preview, variables and footnotes sections by @amyb-hiveit in #4921
• EES-5187 Remove compression of CSV metadata file in CopyCsvFiles function by @benoutram in #4922
• Increase public API log level for MicroElements.Swashbuckle.FluentValidation by @ntsim in #4928
• EES-5119 - removing "batch" option in favour of exclusive lock setup by @duncan-at-hiveit in #4929
• EES-5147 - giving the Public API Data Processor Function App subnet access to Core Storage by @duncan-at-hiveit in #4930
• EES-5158 increase stats logo size by @amyb-hiveit in #4931
• EES-XXXX - changing connection string type to Custom for PSQL connection for Admin by @duncan-at-hiveit in #4933
• EES-5185 Various cleanup for creating and fetching data sets in admin by @ntsim in #4917
• chore(tests): Update test snapshots 06-06-2024 by @dfe-sdt in #4934
• EES-5163 Clean up DataSetFileMeta and remove migration endpoint by @mmyoungman in #4920
• EES-5188 update node to v20.14.0 by @amyb-hiveit in #4935
• EES-5197 Use temp directory rather than assembly directory for Public API data set version files by @benoutram in #4936
• EES-5172 Adding Admin endpoint to delete DRAFT API data set versions by @jack-hive in #4902
• Merge Dev into Master by @N-moh in #4940
• EES-5203 Disable Publisher config of PublicDataDbContext if the Public API database does not exist by @benoutram in #4942
• Permit uppercase characters in URL path without redirecting by @sambiramairelogic in #4945
• EES-5225 Erroneous key-stage-4-performance redirect by @sambiramairelogic in #4946

Full Changelog: 20240603.6...20240611.7

20240603.6

What's Changed

• Update public API ports to avoid collisions with IDP container by @ntsim in #4889
• Update public API ports to avoid collisions with Windows service host by @ntsim in #4892
• EES-4856 Add csv preview, variables, and footnotes to GetDataSetFile by @mmyoungman in #4865
• EES-5161 Add noindex,nofollow tags to all pages in non-production environments by @sambiramairelogic in #4887
• EES-5160 - Brief #12 - Reroute any url with a hostname beginning www by @sambiramairelogic in #4886
• EES-5101: Add "Last updated" date to Data Catalogue by @tomjonesdev in #4873
• Ees 5127 add parquet file share mounts by @duncan-at-hiveit in #4867
• EES-5164 Ensure isolation of files created between tests by @benoutram in #4893
• EES-5162 Add UUID v7 IDs to public API DB models by @ntsim in #4894
• Update resource Microsoft.Storage/storageAccounts/fileServices to 2023-04-01 by @renovate in #4833
• Update resource Microsoft.Storage/storageAccounts/blobServices to 2023-04-01 by @renovate in #4832
• Update resource Microsoft.Storage/storageAccounts to 2023-04-01 by @renovate in #4831
• Update resource Microsoft.Network/virtualNetworks/subnets to 2023-11-01 by @renovate in #4830
• Update resource Microsoft.Network/virtualNetworks to 2023-11-01 by @renovate in #4829
• Update resource Microsoft.App/managedEnvironments to 2024-03-01 by @renovate in #4828
• Update resource Microsoft.App/containerApps to 2024-03-01 by @renovate in #4827
• Update resource Microsoft.OperationalInsights/workspaces to 2023-09-01 by @renovate in #4764
• EES-5171 - Fixing Prod-only UI tests by @N-moh in #4903
• Update xt0rted/block-autosquash-commits-action digest to 87d56ca by @renovate in #4897
• EES-4974 fix going back to data set page from table tool by @amyb-hiveit in #4895
• chore(tests): Update test snapshots 30-05-2024 by @dfe-sdt in #4910
• EES-4366, EES-4994 Add initial API data set admin pages by @ntsim in #4888
• EES-4995 only show type filter if there are api data sets by @amyb-hiveit in #4899
• EES-5183 Use UTC for ReleaseFiles.Published by @mmyoungman in #4913
• EES-5167 Upload new redirects and use an object instead of an array by @sambiramairelogic in #4916
• EES-5097 Add Processor functions to create data set meta, import to DuckDb and export to Parquet data files by @benoutram in #4880
• EES-5174 fix data catalogue download all button by @amyb-hiveit in #4912
• Merge Dev into Master by @N-moh in #4919

Full Changelog: 20240524.14...20240603.6

20240524.14

What's Changed

• EES-5093 Set Public Data Processor function app ContentDb connection string setting by @benoutram in #4848
• EES-5134 Add links to seeded release files for public API data sets by @ntsim in #4853
• EES-5135 Add meta summary details to admin data set version view models by @ntsim in #4854
• EES-5133 Refactor DataSetControllerGetQueryTests to run faster by @ntsim in #4851
• EES-5040 remove formik by @amyb-hiveit in #4843
• EES-5141 Fix UI test failure by @mmyoungman in #4858
• EES-4910 Create an endpoint for Creating an API Dataset by @jack-hive in #4823
• Fixing ui test failure of admin and public tests in playwright by @saicharan2789 in #4856
• EES-5139 Add API data set details to data set file endpoints by @ntsim in #4857
• Update 'Backend' build job to use xlarge agents by @ntsim in #4861
• Add missing CORS headers for public frontend locally by @ntsim in #4860
• chore(tests): Update test snapshots 16-05-2024 by @dfe-sdt in #4864
• EES-4722 Add data set query POST endpoint by @ntsim in #4849
• EES-4974 Update Data set details page table tool link by @mmyoungman in #4869
• EES-5141 : Fix ui test failures by @saicharan2789 in #4872
• Ees 5144 - allow apostrophes in email addresses for new users by @duncan-at-hiveit in #4862
• EES-5096 Add Processor function to move CSV files from Azure Blob Storage to Azure File Share by @benoutram in #4859
• EES-4996 add api info to data set page by @amyb-hiveit in #4863
• EES-5140 Fix DataSetFileMeta / Add TimePeriodRangeMeta by @mmyoungman in #4871
• EES-4996 Fix various test issues from data catalogue work by @ntsim in #4874
• EES-5151 Update migration to do it in batches by @mmyoungman in #4876
• EES-5141 Added 10 seconds wait to wait for methodology to be published by @saicharan2789 in #4875
• EES-5143 Fix remove ref line check in UI test by @mmyoungman in #4877
• chore(tests): Update test snapshots 23-05-2024 by @dfe-sdt in #4881
• chore(tests): Update test snapshots 23-05-2024 by @dfe-sdt in #4882
• Master to merge into dev by @mmyoungman in #4884
• EES-5143: Excluded create_data_block_with_chart test suite to run aga… by @saicharan2789 in #4885
• Merge dev into master by @N-moh in #4890

Full Changelog: 20240522.7...20240524.14

20240522.7

What's Changed

• EES-5129 - Hotfix - Add manual confirmation pages to publication (un)subscription by @sambiramairelogic in #4878
• EES-5129: Update missed link in robot test by @sambiramairelogic in #4879

Full Changelog: 20240513.5...20240522.7

20240513.5

What's Changed

• chore(tests): Update test snapshots 29-04-2024 by @dfe-sdt in #4807
• EES-5099, EES-5094, EES-5102 Update public data schema with location and data set version changes by @ntsim in #4806
• EES-4993 Show which Datasets have associated API Datasets (Data Catalogue) by @jack-hive in #4802
• EES-4995 show API data sets tag and allow filtering by @amyb-hiveit in #4800
• EES-4979 Remove meta-guidance and data-guidance redirects by @sambiramairelogic in #4812
• EES-5002 Add content security headers to the Content API for SEO reasons by @sambiramairelogic in #4811
• Merge hotfix back into dev by @N-moh in #4817
• chore (deps): update react-lazyload by @amyb-hiveit in #4816
• EES-4891 add notification banner to new data catalogue page by @amyb-hiveit in #4815
• EES-5091 Public Data Processor project setup by @benoutram in #4805
• Ees 4909 add public api assets to publishing checklist by @duncan-at-hiveit in #4774
• chore(tests): Update test snapshots 02-05-2024 by @dfe-sdt in #4821
• EES-4881 adjust view release link position on data catalogue by @amyb-hiveit in #4814
• EES-4662 Add data set file meta info to Data catalogue and Data set pages by @mmyoungman in #4783
• EES-4662 Make migration more robust by @mmyoungman in #4824
• DRAFT: EES-4802 Re-apply redirect map by @sambiramairelogic in #4813
• EES-4353: Trim whitespace and convert fields from CKEditor to textareas. by @tomjonesdev in #4819
• Ees 4807 small tweaks after merge by @duncan-at-hiveit in #4725
• EES-5079 Remove Filter/IndicatorSequence columns from ReleaseSubject by @mmyoungman in #4784
• chore(tests): Update test snapshots 07-05-2024 by @dfe-sdt in #4835
• EES-5122 allow linking to step 3 of table tool by @amyb-hiveit in #4822
• EES-4909 - added fix to use NoOp implementation of Admin DataSetVersionService when Public Data DB is not present in environment by @duncan-at-hiveit in #4836
• EES-5048 RHF chart builder, data catalogue and prototype forms by @amyb-hiveit in #4810
• EES-4909 - defaulting PublicDataDbExists to false, and allowing overriding in Admin and Publisher by @duncan-at-hiveit in #4837
• EES-4909 - enabling "PublicDataDbExists" flag when running Publisher integration tests by @duncan-at-hiveit in #4841
• Fix data guidance in Ui tests by @amyb-hiveit in #4839
• EES-4353 use ckeditor for main data guidance field by @amyb-hiveit in #4840
• Fix data guidance and data catalogue UI tests by @amyb-hiveit in #4842
• chore(tests): Update test snapshots 09-05-2024 by @dfe-sdt in #4844
• Ees 5052 add private endpoint to connect psql to vnet by @duncan-at-hiveit in #4838
• EES-5131 Adding Public Data Processor URL environment variable to the Admin app by @jack-hive in #4845
• EES-5130 Add InvalidRequestInputResultFilter to handle invalid input by @ntsim in #4834
• EES-5051 Added Azure yaml logic for the playwright tests by @saicharan2789 in #4738
• EES-XXXX - adding conditional setup of PSQL connection when running locally without PSQL by @duncan-at-hiveit in #4847
• chore(tests): Update test snapshots 09-05-2024 by @dfe-sdt in #4846
• EES-5121 Refactor data set query string validators into POST request model validators by @ntsim in #4820
• EES-5095 Add new Processor trigger point and function to create new API Dataset by @benoutram in #4825
• EES-XXXX: Frontend housekeeping by @sambiramairelogic in #4850
• EES-XXXX - reverting the use of ConnectionUtils in all but Function App projects by @duncan-at-hiveit in #4852
• Merge Dev into Master by @N-moh in #4855

Full Changelog: 20240426.7...20240513.5

20240426.7

What's Changed

• Update backend styleguide by @mmyoungman in #4706
• EES-5056 Adding relationship from the Content DB's Files table to the Public API DB's DataSetVersion table by @jack-hive in #4739
• EES-5015 Add tests for data set GET query endpoint by @ntsim in #4740
• EES-4908 Add Admin endpoint for listing API datasets for a publication by @benoutram in #4745
• Resolve caniuse warnings by @sambiramairelogic in #4755
• Resolve GovUk-Frontend warnings by @sambiramairelogic in #4756
• EES-4704: Rewrite existing Slack Integrations from webhooks to Slack Apps by @tomjonesdev in #4741
• EES-5036 Accomodate BST and GMT changes in PRA frontend by @sambiramairelogic in #4736
• EES-4704: Fix ARM template brackets for authorisation headers. by @tomjonesdev in #4758
• EES-5057 Add missing public API Swagger docs for required properties and error responses by @ntsim in #4749
• EES-4704: Fix ARM template KeyVault reference for authorisation headers. by @tomjonesdev in #4759
• EES-5057 Add missing 403 response type for GetDataSetVersion endpoint by @ntsim in #4760
• EES-5070 Add DataSetVersionImport to the Public Data model by @benoutram in #4753
• EES-4707: Fix ARM template function syntax for authorisation headers. by @tomjonesdev in #4761
• EES-5049 Grant Admin's database principal permissions on all public_data.public tables by @benoutram in #4750
• EES-4704: Fix ARM template parameter reference for key vault. by @tomjonesdev in #4763
• EES-4806 - updating ARM template structure to define subnets as standalone resources by @duncan-at-hiveit in #4765
• EES-4806 - correcting subnet name construction to use concat function by @duncan-at-hiveit in #4766
• EES-4806 - updating VNet API version in attempt to use the ability to omit "subnets" from the VNet declaration without deleting existing subnets by @duncan-at-hiveit in #4767
• EES-4806 - reinstated "subnets" property of VNet declaration, with additional Public API subnets by @duncan-at-hiveit in #4768
• EES-5049 Configure Admin's connection to the Public Data PostgreSQL database in Azure environments by @benoutram in #4751
• chore(tests): Update test snapshots 18-04-2024 by @dfe-sdt in #4770
• EES-4908 Further changes to list API Datasets in the Admin by @benoutram in #4769
• EES-4704: Remove nested concat function from Authorization header. by @tomjonesdev in #4771
• EES-4704: Remove "Bearer" from ARM template token value. by @tomjonesdev in #4772
• Merge master back into dev after hotfix by @amyb-hiveit in #4773
• EES-5074 Fix server-side validation errors being unrecognised by frontend by @ntsim in #4776
• EES-4704: Move slackAppToken to a parameter. by @tomjonesdev in #4777
• EES-4704 Move logic app to linked template by @benoutram in #4779
• EES-4704 Move logic app to linked template by @benoutram in #4780
• EES-4804 Remove LegacyReleases table and ReleaseSeriesMigrationContro… by @mmyoungman in #4754
• EES-5062 Move FilterSequence and IndicatorSequence from ReleaseSubject to ReleaseFile by @mmyoungman in #4775
• chore(tests): Update test snapshots 22-04-2024 by @dfe-sdt in #4781
• EES-4704: Update UI test environment variable references to new Key Vault secret by @tomjonesdev in #4786
• Ees xxxx/resolve no html link for pages error by @sambiramairelogic in #4787
• EES-4906 - Endpoint to list subjects that can become API data sets by @jack-hive in #4782
• chore(deps): update slackapi/slack-github-action action to v1.26.0 by @renovate in #4778
• EES-5063: Update home page related service link text. by @tomjonesdev in #4789
• EES-4704: Update alert channel for UI tests. by @tomjonesdev in #4791
• EES-5082 Replacing DataSetVersion.CsvFileId with DataSetVersion.ReleaseFileId by @jack-hive in #4790
• EES-5083 Update scheduled UI tests' runs by @N-moh in #4792
• chore(tests): Update test snapshots 25-04-2024 by @dfe-sdt in #4795
• EES-3192: Add error page redirection to Notifier on verification failure by @tomjonesdev in #4794
• Merging master into dev after conflict resolving by @N-moh in #4798
• Merge Master back into Dev by @N-moh in #4796
• EES-5084 Add ProblemDetailsResultFilter to admin by @ntsim in #4797
• EES-5085 Fix incorrect slugs for updated publication titles with dashes and spaces by @ntsim in #4793
• EES-4992 Adding admin endpoint to retrieve the details of an API data set version associated with a release by @jack-hive in #4752
• EES-5090 Fix failing UI test by @mmyoungman in #4801
• Merge Dev into Master. by @N-moh in #4804

Full Changelog: 20240425.20...20240426.7

20240425.20

What's Changed

• EES 4809: Upgrade to NextJS v13 by @sambiramairelogic in #4785
• EES-5080 fix vertical bar chart re-rendering by @amyb-hiveit in #4799

Full Changelog: 20240417.5...20240425.20