Releases: opensearch-project/opensearch-migrations
Releases · opensearch-project/opensearch-migrations
2.0.0
What's Changed
- Optimize the regex parser for InvalidResponse by @peternied in #1034
Full Changelog: 1.0.19...2.0.0
1.0.19
What's Changed
- ?v -> ?v=true to workaround the sigv4 bug by @mikaylathompson in #1031
- Add indexAllowlist to snapshot create command by @mikaylathompson in #1009
- Add option to take a snapshot of a managed service source cluster by @mikaylathompson in #1028
- Add note about not supporting customer managed keys by @mikaylathompson in #1025
- Removing unused logging utilities class by @peternied in #1032
Full Changelog: 1.0.18...1.0.19
1.0.18
What's Changed
- Update argument parsing to remove dependency on yargs and make more robust by @AndreKurait in #1019
- Upgrade protobuf version by @lewijacn in #1005
Full Changelog: 1.0.17...1.0.18
1.0.17
What's Changed
- Set explicit defaults w/ placeholders in the cdk.context.json by @mikaylathompson in #1021
- Make cdk.context.json valid json by @mikaylathompson in #1022
- Add snapshot delete to cli by @mikaylathompson in #1020
- Fixed bug in mapping parsing; added tests by @chelma in #1023
- Remove arg printing from command line apps with secret values by @AndreKurait in #1024
Full Changelog: 1.0.16...1.0.17
1.0.16
What's Changed
- Removed greedy matching from a regex to address DOS concern. by @chelma in #1006
- Addressed a SonarQube violation in the TS code by @chelma in #1011
- Linting improvements by @gregschohn in #1000
- Add VPCe for all aws services by @AndreKurait in #1010
- Rename
consConfigSnippets
camelcase vars by @mikaylathompson in #1013 - A couple more assertions and throws in error cases to appease SonarQube's quality rules by @gregschohn in #1015
- Updated the ES 7.X transformation code to handle arbitrary type names by @chelma in #1014
- Move okhasawn to emeritus maintainer by @AndreKurait in #1017
Full Changelog: 1.0.15...1.0.16
1.0.15
What's Changed
- Client Traffic Swinging Docs by @AndreKurait in #915
- "Back to the Future" - Upgrading to Lucene 9 to read Lucene 6 by @chelma in #959
- Add Evaluate command and documentation for Metadata Migration by @peternied in #951
- Add inteligentTiering for logs efs by @AndreKurait in #961
- Run some tests in total isolation and all others in parallel by @gregschohn in #918
- Add a welcome message for the migration console by @peternied in #958
- Add cluster version to yaml & rfs command by @mikaylathompson in #960
- Enable trace/debug logging during test/slowTest by @AndreKurait in #963
- Proxy header translations by @gregschohn in #956
- Improve migration console cli.py test coverage by @mikaylathompson in #968
- Fix code smells in RfsMigrateDocuments.java by @peternied in #965
- Extend acceptable docker container startup time in tests by @AndreKurait in #970
- Add more Migration Console test coverage by @mikaylathompson in #971
- Fixed SonarQube bugs in coreUtilities by @AndreKurait in #966
- Fix Sonarqube code smells in console lib by @mikaylathompson in #973
- Address SonarQube findings in transformations by @AndreKurait in #974
- Fix code smells in Metadata Cli by @peternied in #972
- SonarQube RFS Versioned file fixes by @chelma in #969
- Parse config file w/ jackson and set better TLS defaults by @gregschohn in #967
- Design document for the Capture Proxy and Replayer. by @gregschohn in #964
- Replayer Transformation support by @gregschohn in #937
- Use Same Kafka Version by @AndreKurait in #975
- Slim down and update CDK README by @lewijacn in #946
- More SonarQube fixes for the RFS version* code by @chelma in #978
- Resolve some sonar lint issues in captureOffloader by @AndreKurait in #979
- Add Jenkins Webhook and RFS E2E job on PR by @lewijacn in #938
- Ensure the migration console welcome message appears correctly by @peternied in #983
- [Console] Move
humanReadableTuples
into console lib & add tests by @mikaylathompson in #981 - Eliminate some code smells in the replayer by @gregschohn in #977
- SonarQube fixes for Capture Proxy by @AndreKurait in #986
- Cdk maintenance and tests by @AndreKurait in #987
- [Console] Test Coverage &
snapshot create
passes through extra args by @mikaylathompson in #990 - Delete fetch migration by @peternied in #991
- Remove Jenkins Action User Supplied Context Expressions by @lewijacn in #988
- [Bug] Fix invalid character in default-values by @lewijacn in #993
- Specify User Agent for Console CLI requests by @lewijacn in #952
- [Bug] Jenkins action fix by @lewijacn in #994
- Reduce verbosity to trace for parsing bulk responses when determining to retry or not by @gregschohn in #996
- Delete "datastash" which was a dockerfile to use logstash. by @gregschohn in #998
- Fix code smells in metadata commands by @peternied in #980
- Fixed more RFS version* SonarQube by @chelma in #982
- Rename com.rfs through the codebase to org.opensearch.migrations.bulkload by @gregschohn in #997
- Remove kafka printer by @gregschohn in #995
- Remove unused snapshot metadata code by @peternied in #976
- Redo PR 976 because the interim package refactoring caused the files to hang around post merge. by @gregschohn in #999
- Fix metadata migrate get version by @AndreKurait in #1003
- Updated
console cluster cat-indices
to warn when you don't refresh by @chelma in #1004
Full Changelog: 1.0.14...1.0.15
1.0.14
What's Changed
- Add aliases to the metadata migration output by @peternied in #942
- Source password secret permssions + sigv4 yaml fixes by @mikaylathompson in #954
Full Changelog: 1.0.13...1.0.14
1.0.13
What's Changed
- Create a shared log file system for use in all containerized workers by @peternied in #917
- Added Elasticsearch 6.8 support to Document Migrations by @chelma in #921
- [Console API] Add basic get status API by @lewijacn in #903
- Fix broken variable reference in traffic capture by @peternied in #925
- Remove Migration Console API from ALB by @AndreKurait in #924
- [Jenkins] Allow performing AWS actions with an assumed role and minor inconsistency fixes by @lewijacn in #923
- Remove migration console TG from cdk by @AndreKurait in #926
- Implement target gzip request compression by @AndreKurait in #916
- Metadata Migration with user centric output by @peternied in #922
- Support for OpenSearch 1.3 to be a source cluster by @peternied in #927
- Detect when the snapshot repo bucket cannot be found and return a clear error message by @peternied in #929
- Unified code coverage by @AndreKurait in #928
- Add logs to E2E github action by @AndreKurait in #935
- Only run codecov on pr by @AndreKurait in #934
- Add codecov token by @AndreKurait in #939
- Fix extra args command parsing used by Metadata migration by @peternied in #931
- Bump cryptography from 43.0.0 to 43.0.1 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #932
- Bump cryptography from 43.0.0 to 43.0.1 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot in #933
- Bump cryptography from 43.0.0 to 43.0.1 in /FetchMigration/python by @dependabot in #940
- Add default source version for metadata migration by @peternied in #941
- Replayer retries by @gregschohn in #848
- Dashboards sanitizer by @gyalai-aws in #930
- Add a node id to all spans by @gregschohn in #896
- Update gradle scan plugin by @AndreKurait in #948
- Reduce gradle test output from +599 MB -> 300kb by @peternied in #950
- Add source & target details to CDK by @mikaylathompson in #949
New Contributors
- @gyalai-aws made their first contribution in #930
Full Changelog: 1.0.12...1.0.13
1.0.12
What's Changed
- Throughput improvements by @AndreKurait in #905
- [CVE] Updated jersey-common from 2.30.1 -> 2.34 by @peternied in #898
- Update release drafter permissions by @AndreKurait in #913
- NonBlocking Sender Scheduling and Bulk Request Buffering by @AndreKurait in #914
Full Changelog: 1.0.11...1.0.12
1.0.11
What's Changed
- Update Release Drafter and Jenkinsfile with Docker credentials and promotions by @peterzhuamazon in #860
- Switch from _cat/indices to {index}/_count for reliable doc count by @peternied in #870
- Followup #861 by @AndreKurait in #864
- Remove volumes before caching by @AndreKurait in #862
- Fix permissions for github release by @AndreKurait in #871
- Improved RFS readmes, added --help to RFS commands, fixed bug by @chelma in #832
- Bump django from 5.0.7 to 5.0.8 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #875
- Publish latest tags to staging repo by @AndreKurait in #874
- Change the name of the CloudWatch metric namespace for all otel metri… by @gregschohn in #878
- Rfs root metric name switchout by @gregschohn in #879
- Add two new command line flags for RfsMigrateDocuments by @gregschohn in #880
- Updated default max shard size for RFS to 80 GB by @chelma in #877
- Handle InvalidResponse cases during index creation by @peternied in #876
- Keep index creator exception behavior consistent and add unit tests by @peternied in #881
- Properly implement max connections through flux concurrency in RFS by @AndreKurait in #886
- Remove the max report age requirement on codecov by @peternied in #885
- Add otel to RFS stack by @mikaylathompson in #887
- Improve robustness on docker wget calls by @peternied in #883
- Bump aiohttp from 3.9.5 to 3.10.2 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot in #888
- Add OpenSearchClientTest to verify creation and retry behavior by @peternied in #882
- Leases may be acquired and ineligible for others to acquire, but not picked up by the owner by @gregschohn in #889
- [Console] Add more flexibility around which clusters are defined by @mikaylathompson in #890
- [Console] Created -> initiated in snapshot logging by @mikaylathompson in #895
- Added RFS support for Deletes/Updates on ES 7.10+; _source doc bugfix by @chelma in #894
- Remove MSKUtilityStack / Use MSK Alpha CDK Construct by @lewijacn in #893
- Dead Letter Queue for failed bulk requests by @peternied in #892
- Add max bulk size to RFS by @AndreKurait in #891
- Add sourceClusterDisabled option to CDK by @mikaylathompson in #900
- [Console] Add sigv4 signing to cluster api calls by @mikaylathompson in #897
- Create command output models for metadata migration tool by @peternied in #856
- Add Benchmarks for Jackson Parser vs ReadObject by @peternied in #901
- Improved comments on RFS LuceneDocumentsReader by @chelma in #908
- Fixed RFS docker compose, added ES6.8 setup by @chelma in #911
- Fix replayer sigv4 logic without payload by @AndreKurait in #899
New Contributors
- @peterzhuamazon made their first contribution in #860
Full Changelog: 1.0.10...1.0.11