20240717.28

What's Changed

• EES-5170: Update geospatial boundary data import process to handle GeoJSON files by @tomjonesdev in #4995
• EES-5337: Increase dev/prod statistics DB size to 600GB/1.5TB respectively by @tomjonesdev in #5041
• EES-5339 Temporarily increase statistics database scale after slow running observed by @benoutram in #5046
• EES-5337: Increase dev/prod statistics DB size to 600GB/1.5TB respectively by @tomjonesdev in #5050
• Merging master into dev after PR #5046 and #5050 by @benoutram in #5048
• EES-5170 handle geojson param casing by @amyb-hiveit in #5052
• EES-5344 fix flaky data catalogue tests by @amyb-hiveit in #5053
• EES-5170: Boundary level admin instructions should always be visible. by @tomjonesdev in #5055
• EES-5238 - adding new HTTP trigger and orchestration for completing the next data set version import by @duncan-at-hiveit in #5038
• EES-5281-backend Adding IsLinkedToApiDataSet flag to the DataFileInfo View Model by @jack-hive in #5049
• EES-5239 Add PreviewToken to Public API data model by @benoutram in #5051
• EES-5114 - serialising GeographicLevel as string for MVC response by @duncan-at-hiveit in #5063
• EES-5170: Add read permission to new BoundaryData table. by @tomjonesdev in #5062
• EES-5251 updated accessibility statement by @amyb-hiveit in #5040
• EES-5238 - extracting Function logic into service layer following PR … by @duncan-at-hiveit in #5059
• EES-5170: Add missing boundary level details to glossary section, advise of file size limit on file upload by @tomjonesdev in #5067
• EES-5270 Fix snapshots by @mmyoungman in #5064
• EES-4529 Update GovukNotify to 7.1.0 by @mmyoungman in #5065
• EES-5170: Fix JS formatting. by @tomjonesdev in #5072
• Merge Dev into Master by @N-moh in #5073

Full Changelog: 20240711.12...20240717.28

20240711.12

What's Changed

• EES 5261 : Fix intermittent test failures in the publish_release_and_amend test suite: by @saicharan2789 in #5004
• EES :5266 : Add parsing logic to handle re-direct failures in local and update the ui test scripts as per latest changes by @saicharan2789 in #5012
• 🐛 EES-5235 Grant the Public API Data Processor Function App user sequence privileges by @benoutram in #5014
• Merge Master back into dev by @N-moh in #5011
• EES-5270 Temporarily disable snapshots for Find stats and Data catalo… by @mmyoungman in #5016
• EES-5277 Quick fix for methodology page href issue by @mmyoungman in #5019
• Merge Master back into Dev by @N-moh in #5021
• EES-4529: Update Azure Storage Movement client library by @benoutram in #5022
• EES-5267 Added UI test with retry mechanism that checks title in data… by @saicharan2789 in #5029
• EES-5269- Fix prod-only UI test failure by @N-moh in #5032
• EES: 5278 by @saicharan2789 in #5020
• EES-5013 Suppress SQL command console logging in Function apps by @benoutram in #5024
• EES-5283 Add missing MetaInsertBatchSize app setting to Public API Data Processor function app by @benoutram in #5033
• EES-5115 - Filter Option mapping endpoint by @duncan-at-hiveit in #5028
• EES-5111 - endpoint to retrieve location mappings by @duncan-at-hiveit in #5026
• EES-5112 - endpoint for autosaving location mappings by @duncan-at-hiveit in #5023
• EES-5011 Change Publisher queue message types to remove use of System.ValueTuple by @benoutram in #5025
• EES-5011 Replace obsolete queue client library Microsoft.Azure.Storage.Queue by @benoutram in #5031
• EES-5112 - fixing startup issue in Admin when Public DB is not present by @duncan-at-hiveit in #5037
• EES-5238 - breaking out shared ImportDataFunction and WriteDataFuncti… by @duncan-at-hiveit in #5036
• EES-5213 change form validation mode and fix publication form issues by @amyb-hiveit in #5035
• EES-5112 - adding validation to ensure Candidate Keys are valid by @duncan-at-hiveit in #5034
• EES-5111 - added Newtonsoft JSON converter by @duncan-at-hiveit in #5042
• EES-4373 create new api data set version by @amyb-hiveit in #5039
• Merge dev into Master by @N-moh in #5045

Full Changelog: 20240627.6...20240711.12

20240627.6

What's Changed

• EES-5232 Fix incorrect DataFiles.BasePath for public API container by @ntsim in #4965
• Improve Methodology Sitemap Item query by @sambiramairelogic in #4966
• EES-5232 Add PUBLIC_API_BASE_URL env variable to environments by @ntsim in #4967
• EES-XXXX - Fix dotnet build error by @sambiramairelogic in #4968
• EES-4994 Fixes and updates to admin API data sets pages by @ntsim in #4962
• EES-5176 accessibility improvements for data catalogue and find stats by @amyb-hiveit in #4950
• EES-4906 Filter API data set candidates that are still importing by @ntsim in #4970
• EES-5208 automatically open external links in new tabs by @amyb-hiveit in #4973
• EES-5227 update find stats to match data catalogue design by @amyb-hiveit in #4977
• EES-5152 Add Public API Data Processor tests for ImportMetadata and ImportData by @benoutram in #4971
• EES-5210 hide browser search clear button by @amyb-hiveit in #4974
• EES-5211 remove group role on details element by @amyb-hiveit in #4975
• EES-4993 Move PublicApiDataSet* columns from Files to ReleaseFiles by @ntsim in #4979
• EES-5214 ensure map legends are visible in high contrast mode by @amyb-hiveit in #4982
• EES- 3174 : UI tests for checklist warnings and errors by @saicharan2789 in #4923
• EES-5212 EES-5217 table tool accessibility improvements by @amyb-hiveit in #4981
• EES-5216 improve CollapsibleList accessibility by @amyb-hiveit in #4983
• EES-5218 fix tab markup on mobile by @amyb-hiveit in #4984
• EES-5231 Add IsSuperseded to Data catalogue view models by @mmyoungman in #4978
• chore(tests): Update test snapshots 20-06-2024 by @dfe-sdt in #4987
• EES-5243 Add CORS policy to allow access to public API from public frontend by @ntsim in #4985
• EES-5036 BST test fix by @saicharan2789 in #4990
• EES-5237 Remove unneeded BauMigrationController by @ntsim in #4994
• EES-5003 - Minor fixes by @sambiramairelogic in #4993
• EES-5235 Prevent collisions of Public API PublicId's in filter and location options by @benoutram in #4992
• Ees 5143 UI test fix by @saicharan2789 in #4998
• EES-5248 Added 15 seconds wait for methodology re-directs & Added pag… by @saicharan2789 in #4999
• EES-4781 remove data catalogue feature flag by @amyb-hiveit in #4989
• EES-5252 Remove listener on SIGINT for Windows in start.ts by @benoutram in #4997
• EES-4716 Fix various issues with data set query endpoint by @ntsim in #4996
• Ees 4944 read next data set version metadata by @duncan-at-hiveit in #4952
• EES-5194 Add Processor bulk delete endpoint for multiple API data set versions by @jack-hive in #4947
• EES-5173 Change Release Version DELETION plan to include deleting draft API data sets by @jack-hive in #4957
• EES-5192 Change Data File DELETION endpoint to be blocked if any linked API data sets exist by @jack-hive in #4958
• EES 5193 Change Data File REPLACEMENT endpoint to be blocked if any linked API data sets exist by @jack-hive in #4972
• EES 5250 by @saicharan2789 in #5003
• Ees 5113 investigate partial json updates by @duncan-at-hiveit in #5007
• Ees 4945 create data set version mappings 3 by @duncan-at-hiveit in #5000
• chore(tests): Update test snapshots 27-06-2024 by @dfe-sdt in #5009
• EES-4921 Refactor out DataSetVersionsController in public API by @ntsim in #5008
• Merge Dev into Master by @N-moh in #5010

Full Changelog: 20240626.14...20240627.6

20240626.14

What's Changed

• EES-5256 Experiment rolling back to EF 8.0.3 related to issue seen with long running db queries using Contains/OPENJSON by @benoutram in #5002
• EES-5256 Fix LocationStep not awaiting form submission by @ntsim in #5005
• EES-5256 Opt-out of OPENJSON subquery transformation in time periods query and revert #5002 by @benoutram in #5006

Full Changelog: 20240614.21...20240626.14

20240614.21

What's Changed

• EES-5201 Refactor functions in preparation for creating next data set versions by @benoutram in #4938
• Merging master into dev after PR #4942 by @benoutram in #4943
• EES-5138 Add linking and release information to data set version by @ntsim in #4939
• EES-5159 data set page fixes by @amyb-hiveit in #4932
• EES-5182 redirect data catalogue slug urls by @amyb-hiveit in #4937
• EES-5003 - Create sitemap.xml and robots.txt files by @sambiramairelogic in #4891
• EES-5160 - Only run www tests against prod and local by @sambiramairelogic in #4948
• Merge Master back into Dev by @N-moh in #4949
• chore(tests): Update test snapshots 12-06-2024 by @dfe-sdt in #4951
• chore(deps): update resource microsoft.storage/storageaccounts to 2023-05-01 by @renovate in #4918
• chore(deps): update resource microsoft.web/sites/slots/config to 2023-12-01 by @renovate in #4908
• chore(deps): update resource microsoft.web/sites/slots to 2023-12-01 by @renovate in #4907
• chore(deps): update resource microsoft.web/sites/config to 2023-12-01 by @renovate in #4906
• chore(deps): update resource microsoft.web/sites to 2023-12-01 by @renovate in #4905
• chore(deps): update resource microsoft.web/serverfarms to 2023-12-01 by @renovate in #4904
• chore(deps): update resource microsoft.network/privateendpoints/privatednszonegroups to 2023-11-01 by @renovate in #4900
• chore(deps): update resource microsoft.network/privateendpoints to 2023-11-01 by @renovate in #4898
• chore(deps): update resource microsoft.managedidentity/identities to 2023-01-31 by @renovate in #4926
• chore(deps): update resource microsoft.storage/storageaccounts/blobservices to 2023-05-01 by @renovate in #4953
• chore(tests): Update test snapshots 13-06-2024 by @dfe-sdt in #4956
• EES-5196 Add data set status and summary to admin details page by @ntsim in #4941
• EES-XXXX - fix out of date app setting path by @duncan-at-hiveit in #4961
• chore(deps): update resource microsoft.storage/storageaccounts/fileservices/shares to 2023-05-01 - autoclosed by @renovate in #4955
• chore(deps): update resource microsoft.storage/storageaccounts/fileservices to 2023-05-01 by @renovate in #4954
• chore(tests): Update test snapshots 14-06-2024 by @dfe-sdt in #4963
• EES-5003 - Sitemap and robots not dynamically generated by @sambiramairelogic in #4959
• Merge Dev into Master by @N-moh in #4964

Full Changelog: 20240611.7...20240614.21

20240611.7

What's Changed

• EES-5158 update national stats branding by @amyb-hiveit in #4909
• EES-5175 and EES-5177 data catalogue updates by @amyb-hiveit in #4914
• EES-5119 - adding Managed Identity authentication to the Data Processor by @duncan-at-hiveit in #4911
• Ees 5147 add data processor function app health checks by @duncan-at-hiveit in #4915
• EES-5119 - slight fix for pluralised filename by @duncan-at-hiveit in #4924
• chore(deps): update minor backend dependencies by @renovate in #4809
• EES-5119 - prevent parallel runs of API infrastructure pipeline by @duncan-at-hiveit in #4925
• EES-XXXX - enabling Public Data DB connection on Dev for Admin and Publisher by @duncan-at-hiveit in #4927
• EES-5159 hook up data set preview, variables and footnotes sections by @amyb-hiveit in #4921
• EES-5187 Remove compression of CSV metadata file in CopyCsvFiles function by @benoutram in #4922
• Increase public API log level for MicroElements.Swashbuckle.FluentValidation by @ntsim in #4928
• EES-5119 - removing "batch" option in favour of exclusive lock setup by @duncan-at-hiveit in #4929
• EES-5147 - giving the Public API Data Processor Function App subnet access to Core Storage by @duncan-at-hiveit in #4930
• EES-5158 increase stats logo size by @amyb-hiveit in #4931
• EES-XXXX - changing connection string type to Custom for PSQL connection for Admin by @duncan-at-hiveit in #4933
• EES-5185 Various cleanup for creating and fetching data sets in admin by @ntsim in #4917
• chore(tests): Update test snapshots 06-06-2024 by @dfe-sdt in #4934
• EES-5163 Clean up DataSetFileMeta and remove migration endpoint by @mmyoungman in #4920
• EES-5188 update node to v20.14.0 by @amyb-hiveit in #4935
• EES-5197 Use temp directory rather than assembly directory for Public API data set version files by @benoutram in #4936
• EES-5172 Adding Admin endpoint to delete DRAFT API data set versions by @jack-hive in #4902
• Merge Dev into Master by @N-moh in #4940
• EES-5203 Disable Publisher config of PublicDataDbContext if the Public API database does not exist by @benoutram in #4942
• Permit uppercase characters in URL path without redirecting by @sambiramairelogic in #4945
• EES-5225 Erroneous key-stage-4-performance redirect by @sambiramairelogic in #4946

Full Changelog: 20240603.6...20240611.7

20240603.6

What's Changed

• Update public API ports to avoid collisions with IDP container by @ntsim in #4889
• Update public API ports to avoid collisions with Windows service host by @ntsim in #4892
• EES-4856 Add csv preview, variables, and footnotes to GetDataSetFile by @mmyoungman in #4865
• EES-5161 Add noindex,nofollow tags to all pages in non-production environments by @sambiramairelogic in #4887
• EES-5160 - Brief #12 - Reroute any url with a hostname beginning www by @sambiramairelogic in #4886
• EES-5101: Add "Last updated" date to Data Catalogue by @tomjonesdev in #4873
• Ees 5127 add parquet file share mounts by @duncan-at-hiveit in #4867
• EES-5164 Ensure isolation of files created between tests by @benoutram in #4893
• EES-5162 Add UUID v7 IDs to public API DB models by @ntsim in #4894
• Update resource Microsoft.Storage/storageAccounts/fileServices to 2023-04-01 by @renovate in #4833
• Update resource Microsoft.Storage/storageAccounts/blobServices to 2023-04-01 by @renovate in #4832
• Update resource Microsoft.Storage/storageAccounts to 2023-04-01 by @renovate in #4831
• Update resource Microsoft.Network/virtualNetworks/subnets to 2023-11-01 by @renovate in #4830
• Update resource Microsoft.Network/virtualNetworks to 2023-11-01 by @renovate in #4829
• Update resource Microsoft.App/managedEnvironments to 2024-03-01 by @renovate in #4828
• Update resource Microsoft.App/containerApps to 2024-03-01 by @renovate in #4827
• Update resource Microsoft.OperationalInsights/workspaces to 2023-09-01 by @renovate in #4764
• EES-5171 - Fixing Prod-only UI tests by @N-moh in #4903
• Update xt0rted/block-autosquash-commits-action digest to 87d56ca by @renovate in #4897
• EES-4974 fix going back to data set page from table tool by @amyb-hiveit in #4895
• chore(tests): Update test snapshots 30-05-2024 by @dfe-sdt in #4910
• EES-4366, EES-4994 Add initial API data set admin pages by @ntsim in #4888
• EES-4995 only show type filter if there are api data sets by @amyb-hiveit in #4899
• EES-5183 Use UTC for ReleaseFiles.Published by @mmyoungman in #4913
• EES-5167 Upload new redirects and use an object instead of an array by @sambiramairelogic in #4916
• EES-5097 Add Processor functions to create data set meta, import to DuckDb and export to Parquet data files by @benoutram in #4880
• EES-5174 fix data catalogue download all button by @amyb-hiveit in #4912
• Merge Dev into Master by @N-moh in #4919

Full Changelog: 20240524.14...20240603.6

20240524.14

What's Changed

• EES-5093 Set Public Data Processor function app ContentDb connection string setting by @benoutram in #4848
• EES-5134 Add links to seeded release files for public API data sets by @ntsim in #4853
• EES-5135 Add meta summary details to admin data set version view models by @ntsim in #4854
• EES-5133 Refactor DataSetControllerGetQueryTests to run faster by @ntsim in #4851
• EES-5040 remove formik by @amyb-hiveit in #4843
• EES-5141 Fix UI test failure by @mmyoungman in #4858
• EES-4910 Create an endpoint for Creating an API Dataset by @jack-hive in #4823
• Fixing ui test failure of admin and public tests in playwright by @saicharan2789 in #4856
• EES-5139 Add API data set details to data set file endpoints by @ntsim in #4857
• Update 'Backend' build job to use xlarge agents by @ntsim in #4861
• Add missing CORS headers for public frontend locally by @ntsim in #4860
• chore(tests): Update test snapshots 16-05-2024 by @dfe-sdt in #4864
• EES-4722 Add data set query POST endpoint by @ntsim in #4849
• EES-4974 Update Data set details page table tool link by @mmyoungman in #4869
• EES-5141 : Fix ui test failures by @saicharan2789 in #4872
• Ees 5144 - allow apostrophes in email addresses for new users by @duncan-at-hiveit in #4862
• EES-5096 Add Processor function to move CSV files from Azure Blob Storage to Azure File Share by @benoutram in #4859
• EES-4996 add api info to data set page by @amyb-hiveit in #4863
• EES-5140 Fix DataSetFileMeta / Add TimePeriodRangeMeta by @mmyoungman in #4871
• EES-4996 Fix various test issues from data catalogue work by @ntsim in #4874
• EES-5151 Update migration to do it in batches by @mmyoungman in #4876
• EES-5141 Added 10 seconds wait to wait for methodology to be published by @saicharan2789 in #4875
• EES-5143 Fix remove ref line check in UI test by @mmyoungman in #4877
• chore(tests): Update test snapshots 23-05-2024 by @dfe-sdt in #4881
• chore(tests): Update test snapshots 23-05-2024 by @dfe-sdt in #4882
• Master to merge into dev by @mmyoungman in #4884
• EES-5143: Excluded create_data_block_with_chart test suite to run aga… by @saicharan2789 in #4885
• Merge dev into master by @N-moh in #4890

Full Changelog: 20240522.7...20240524.14

20240522.7

What's Changed

• EES-5129 - Hotfix - Add manual confirmation pages to publication (un)subscription by @sambiramairelogic in #4878
• EES-5129: Update missed link in robot test by @sambiramairelogic in #4879

Full Changelog: 20240513.5...20240522.7

20240513.5

What's Changed

• chore(tests): Update test snapshots 29-04-2024 by @dfe-sdt in #4807
• EES-5099, EES-5094, EES-5102 Update public data schema with location and data set version changes by @ntsim in #4806
• EES-4993 Show which Datasets have associated API Datasets (Data Catalogue) by @jack-hive in #4802
• EES-4995 show API data sets tag and allow filtering by @amyb-hiveit in #4800
• EES-4979 Remove meta-guidance and data-guidance redirects by @sambiramairelogic in #4812
• EES-5002 Add content security headers to the Content API for SEO reasons by @sambiramairelogic in #4811
• Merge hotfix back into dev by @N-moh in #4817
• chore (deps): update react-lazyload by @amyb-hiveit in #4816
• EES-4891 add notification banner to new data catalogue page by @amyb-hiveit in #4815
• EES-5091 Public Data Processor project setup by @benoutram in #4805
• Ees 4909 add public api assets to publishing checklist by @duncan-at-hiveit in #4774
• chore(tests): Update test snapshots 02-05-2024 by @dfe-sdt in #4821
• EES-4881 adjust view release link position on data catalogue by @amyb-hiveit in #4814
• EES-4662 Add data set file meta info to Data catalogue and Data set pages by @mmyoungman in #4783
• EES-4662 Make migration more robust by @mmyoungman in #4824
• DRAFT: EES-4802 Re-apply redirect map by @sambiramairelogic in #4813
• EES-4353: Trim whitespace and convert fields from CKEditor to textareas. by @tomjonesdev in #4819
• Ees 4807 small tweaks after merge by @duncan-at-hiveit in #4725
• EES-5079 Remove Filter/IndicatorSequence columns from ReleaseSubject by @mmyoungman in #4784
• chore(tests): Update test snapshots 07-05-2024 by @dfe-sdt in #4835
• EES-5122 allow linking to step 3 of table tool by @amyb-hiveit in #4822
• EES-4909 - added fix to use NoOp implementation of Admin DataSetVersionService when Public Data DB is not present in environment by @duncan-at-hiveit in #4836
• EES-5048 RHF chart builder, data catalogue and prototype forms by @amyb-hiveit in #4810
• EES-4909 - defaulting PublicDataDbExists to false, and allowing overriding in Admin and Publisher by @duncan-at-hiveit in #4837
• EES-4909 - enabling "PublicDataDbExists" flag when running Publisher integration tests by @duncan-at-hiveit in #4841
• Fix data guidance in Ui tests by @amyb-hiveit in #4839
• EES-4353 use ckeditor for main data guidance field by @amyb-hiveit in #4840
• Fix data guidance and data catalogue UI tests by @amyb-hiveit in #4842
• chore(tests): Update test snapshots 09-05-2024 by @dfe-sdt in #4844
• Ees 5052 add private endpoint to connect psql to vnet by @duncan-at-hiveit in #4838
• EES-5131 Adding Public Data Processor URL environment variable to the Admin app by @jack-hive in #4845
• EES-5130 Add InvalidRequestInputResultFilter to handle invalid input by @ntsim in #4834
• EES-5051 Added Azure yaml logic for the playwright tests by @saicharan2789 in #4738
• EES-XXXX - adding conditional setup of PSQL connection when running locally without PSQL by @duncan-at-hiveit in #4847
• chore(tests): Update test snapshots 09-05-2024 by @dfe-sdt in #4846
• EES-5121 Refactor data set query string validators into POST request model validators by @ntsim in #4820
• EES-5095 Add new Processor trigger point and function to create new API Dataset by @benoutram in #4825
• EES-XXXX: Frontend housekeeping by @sambiramairelogic in #4850
• EES-XXXX - reverting the use of ConnectionUtils in all but Function App projects by @duncan-at-hiveit in #4852
• Merge Dev into Master by @N-moh in #4855

Full Changelog: 20240426.7...20240513.5