[Meta] Automate the OpenSearch release process

[peternied]

OpenSearch / OpenSearch Dashboards have a number of elements to the release process that should be automated to make sure there is consistent and timely delivery of artifacts.

Preparation

• Create default build manifest
  • Auto-generate next version manifest(s) #461
• Create release tracking ticket
  • Automatically open an issue for every new release #531
• Onboard components that were part of a previous release #1366
• Track component onboarding state
• Create issues on build failures #1899
• Notification when preparation is complete and we have a 'full build'
• Generate testing guide that can be used to pickup the latest version
• File issues for components, or other release processes like retrospective

Development

• Run tests suites, integration / bwc / perf tests
  • Integrate OpenSearch Dashboards release functional tests into CI process #604
  • [META] Run integ tests with every build of OpenSearch and OpenSearch Dashboards and publish test results #818
  • [META] Automate backwards compatibility test support for OpenSearch project #90
  • Integrate performance testing into release workflow  #693
• For test suites results, create issues on components failures
• Track component issue counts state
• When critical dates arrive, make notifications about things that are need to be resolved
• Create a way to pick 'release candidate' that is available for testing, generate all the test documentation for how to pick it up
• add documentation about latest url #1689
• If issues get opened up after there is an active release candidate link it to the release issue so it can be triaged by the distribution
• Track that all components have completed dev work to notify that release can start
• Publish plugin distribution ZIPs to Maven, get rid of checked in snapshot builds #716
• Release notes tracker to track if release notes exists or not based on latest commits
  Release tracker for component repos #2345
• Automate: Update the Github release issue with the right RC information. #2545
• Automate: Update the manifest refs to tags. #2546

Releasing

• From release candidate build, sign all artifacts
• Publish signed artifacts to maven
  • Open-source signing infrastructure #118
• Promote signed artifacts to production s3 buckets
  • [META] Automate artifact signing with OpensearchSignerClient for linux #1351
  • Take a release candidate build and publish its artifacts onto artifacts.opensearch.org #1332
  • [Enhancement] Add tests and improvement to the promotion jenkins workflow #1355
• Run validation on s3 bucket contents
  • Need a post-deployment artifacts validation #1358
• Create updated website sections for artifacts
• Promote docker images
  • Adding Multi-Arch docker automated image build pipeline and related scripts #859
  • Add docker build trigger after bundle builds #928
  • Trigger docker image build after successful bundle build dashboards #929
  • Promote docker Images to Production instead of rebuilding  #1318
• Run validation on prod docker images
  • Need a post-deployment functional validation  #1359
• Deploy updated website
• Send notifications about update build

Cleanup

• Automate the creation of release tags after every release #378
• Automate creation of releases (on github) after every release when the release tag is created #1898
• Track that all components cut a release (github release?)
• Update manifest refs from branch to tags
• Slow down the branch build rate in check for build

[prudhvigodithi]

There are two META issues targeting the Automation of entire OpenSearch Release and a META issue as perquisite for suggested improvements/enhancements to acheive the OpenSearch Release automation. Can we close this and track on the above two META issues? @dblock @bbarani @peternied please suggest.

[peternied]

@prudhvigodithi If you don't think this issue is useful feel free to close it. Beforehand, I think it might be good to take an inventory of incomplete items from this issue.

[gaiksaya]

Marked the issues as resolved for most of tasks. Closing this one.