[RELEASE] Release version 3.0.0

[opensearch-trigger-bot]

Release Status: 3.0.0-alpha1

(Early Integration Phase - Ensure code compilation)

(You can still push feature to 3.0.0-beta1 if not ready by 3.0.0-alpha1)

Release OpenSearch and OpenSearch Dashboards 3.0.0

I noticed that a manifest was automatically created in manifests/3.0.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria	Status	Description	Comments
Each component release issue has an assigned owner	🟢
Documentation draft PRs are up and in tech review for all component changes	🔴
Sanity testing is done for all components	🔴
Code coverage has not decreased (all new code has tests)	🔴
Release notes are ready and available for all components	🔴
Roadmap is up-to-date (information is available to create release highlights)	🔴
Release ticket is cut, and there's a forum post announcing the start of the window	🔴
Any necessary security reviews are complete	🔴

OpenSearch 3.0.0-alpha1 exit criteria status:

Criteria	Status	Description	Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions	🔴
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🔴
Documentation has been fully reviewed and signed off by the documentation community.	🔴
All integration tests are passing	🔴
Release blog is ready	🔴

OpenSearch-Dashboards 3.0.0-alpha1 exit criteria status:

Criteria	Status	Description	Comments
Documentation has been fully reviewed and signed off by the documentation community	🔴
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🔴
All integration tests are passing	🔴
Release blog is ready	🔴

Preparation

• Release manager assigned.
• Update release page on the website with release manager and release issue details. Sample PR
• Existence of label in each component repo. For more information check the release-label section.
• Increase the build frequency.
• Release Issue.

Campaigns

• Component Release Issue.
• Release Campaigns.

Version Increment - (Starts 2025/02/03 Ends 2025/02/18 for 3.0.0-alpha1)

• Core Version Increment.
• Components Version Increment.

Feature Freeze - (Starts 2025/02/03 Ends 2025/03/03 for 3.0.0-alpha1. Note: if you feature not ready by 3.0.0-alpha1 you can wait until 3.0.0-beta1. However your code must be able to compile for alpha1)

• OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - (Starts 2025/02/03 Ends 2025/03/03 for 3.0.0-alpha1)

• Mark this as done once the Code Complete is reviewed.
• Create/Verify pull requests to add each component to relase input manifests/3.0.0-alpha1/opensearch-3.0.0-alpha1.yml and manifests/3.0.0-alpha1/opensearch-dashboards-3.0.0-alpha1.yml.

Release Branch, Release Candidate Creation and Testing - (Starts 2025/03/04 for 3.0.0-alpha1)

• Core Release Branch.
• Components Release Branch.
• Generate Release Candidate.
• Docker Scan.
• Integ Test.
  • TAR
  • RPM
  • DEB
  • Windows
• Backwards Compatibility Tests.
• Broadcast and Communication.
• Release Candidate Lock.
• Stop Release Candidate periodic auto builds

Performance testing validation - (Starts 2025/03/11 for 3.0.0-alpha1)

• Post the benchmark-tests
• Longevity tests do not show any issues.

Pre Release - (2025/03/17 for 3.0.0-alpha1)

• Release Labeled Issues.
• Go or No-Go.
• Release Notes.

Release - (2025/03/18 for 3.0.0-alpha1)

• Central Promotion Workflow.
• Collaboration with the Project Management Team.

Release Checklist.

Release Checklist

Pre-Release activities

• Promote Repos.
  • • OS
  • • OSD
• Promote Artifacts.
  • • Windows
  • • Linux Debian
  • • Linux RPM
  • • Linux TAR
• Consolidated Release Notes.

Release activities

• Docker Promotion.
• Release Validation part 1.
  • • OpenSearch and OpenSearch Dashboard Validation.
  • • Validate the native plugin installation.
• Merge consolidated release notes PR.
• Website and Documentation Changes.
  • • Merge staging website PR.
  • • Promote the website changes to prod.
  • • Add website alert.
• Release Validation part 2.
  • • Validate the artifact download URL's and signatures.
• Release Validation part 3.
  • • Trigger the validation build (Search for Completed validation for <> in the logs).
• Maven Promotion.
• Publish blog posts.
• Advertise on Social Media.
• Post on public slack and Github Release issue.

Post Release

• Release Tags.
• Input Manifest Update.
• OpenSearch Build Release notes.
• Decrease the Build Frequency.
• Retrospective Issue.
• Helm and Ansible Playbook release.
• Upcoming Release Preparation.

Components

Replace with links to all component tracking issues.

Component	On track	Release Notes
{COMPONENT_ISSUE_LINK}	{INDICATOR}}	{STATUS}

OS:

• [RELEASE] Release version 3.0.0 OpenSearch#8756 @expani @sandeshkr419
• [RELEASE] Release version 3.0.0 common-utils#498
• [RELEASE] Release version 3.0.0 job-scheduler#426 @prudhvigodithi
• [RELEASE] Release version 3.0.0 security#3049 @cwperks
• [RELEASE] Release version 3.0.0 k-NN#996 @Vikasht34
• [RELEASE] Release version 3.0.0 geospatial#356 @will-hwang
• [RELEASE] Release version 3.0.0 cross-cluster-replication#1090 @RS146BIJAY
• [RELEASE] Release version 3.0.0 ml-commons#1140 @mingshl
• [RELEASE] Release version 3.0.0 neural-search#225 @will-hwang
• [RELEASE] Release version 3.0.0 notifications#712 @AWSHurneyt
• [RELEASE] Release version 3.0.0 observability#1574 @vamsimanohar
• [RELEASE] Release version 3.0.0 reporting#731 @vamsimanohar
• [RELEASE] Release version 3.0.0 sql#1880 @noCharger
• [RELEASE] Release version 3.0.0 asynchronous-search#318 @sgup432
• [RELEASE] Release version 3.0.0 anomaly-detection#967 @kaituo
• [RELEASE] Release version 3.0.0 alerting#1035 @amsiglan
• [RELEASE] Release version 3.0.0 security-analytics#1025 @amsiglan
• [RELEASE] Release version 3.0.0 index-management#861 @tandonks
• [RELEASE] Release version 3.0.0 performance-analyzer#509 @Gaganjuneja
• [RELEASE] Release version 3.0.0 custom-codecs#107 @RS146BIJAY
• [RELEASE] Release version 3.0.0 flow-framework#487 @dbwiddis
• [RELEASE] Release version 3.0.0 skills#169 @zhichao-aws
• [RELEASE] Release version 3.0.0 query-insights#31 @ansjcy
• [RELEASE] Release version 3.0.0 opensearch-system-templates#13 @mohit10011999
• [RELEASE] Release version 3.0.0 opensearch-learning-to-rank-base#119 @rithin-pullela-aws
• [RELEASE] Release version 3.0.0 opensearch-remote-metadata-sdk#55 @dbwiddis

OSD:

• [RELEASE] Release version 3.0.0 OpenSearch-Dashboards#4583 @kavilla
• [RELEASE] Release version 3.0.0 dashboards-observability#704 @vamsimanohar
• [RELEASE] Release version 3.0.0 dashboards-reporting#150 @vamsimanohar
• [RELEASE] Release version 3.0.0 dashboards-visualizations#213 (Pending removal 3.0)
• [RELEASE] Release version 3.0.0 dashboards-query-workbench#97 @vamsimanohar
• [RELEASE] Release version 3.0.0 dashboards-maps#442 @will-hwang
• [RELEASE] Release version 3.0.0 anomaly-detection-dashboards-plugin#568 @kaituo
• [RELEASE] Release version 3.0.0 ml-commons-dashboards#234 @wanglam
• [RELEASE] Release version 3.0.0 index-management-dashboards-plugin#820 @tandonks
• [RELEASE] Release version 3.0.0 dashboards-notifications#87 @amsiglan
• [RELEASE] Release version 3.0.0 alerting-dashboards-plugin#944 @amsiglan
• [RELEASE] Release version 3.0.0 security-analytics-dashboards-plugin#996 @amsiglan
• [RELEASE] Release version 3.0.0 security-dashboards-plugin#1525 @derek-ho
• [RELEASE] Release version 3.0.0 dashboards-search-relevance#254 @sejli
• [RELEASE] Release version 3.0.0 dashboards-assistant#99 @ruanyl
• [RELEASE] Release version 3.0.0 query-insights-dashboards#59 @derek-ho
• [RELEASE] Release version 3.0.0 dashboards-flow-framework#304 @ohltyler

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

• Update

Issues:

• Bump up GCC version to 12.x or later to support SIMD AVX512 fp16 instructions #5226
• [Enhancement] Add Arm64 runner to docker build and ci runs #5248
• JDK23 supported on new gradle needs to be upgraded on plugins
  • Bump gradle to 8.10.2 and add JDK23 as part of the github checks k-NN#2432
  • Bump gradle to 8.10.2 and add JDK23 as part of the github checks reporting#1062
• [Release 3.0] Update com.github.johnrengelman.shadow to com.gradleup.shadow in gradle plugin #5267
  • [Release 3.0] Update common-utils shadow plugin repo and bump to 3.0.0.0-alpha1 common-utils#775
• [Deprecation] Properly deprecate Ubuntu2004 as CI build image/Supported OS and switch to Ubuntu2404 #5270
• Update NodeJS from version 18 to 20 (v20.18.1 per Switch to NodeJS LTS 20 "Iron" OpenSearch-Dashboards#9171):
  • [BUG] EOL of Node.js version 18.x used in Opensearch-dashboards OpenSearch-Dashboards#8463
• (New Key) Generating new PGP key for signing artifacts starting 3.0.0 with @opensearch.org email #5308
• (Optional?) [Workspace] Migrate tenant data to workspace security-dashboards-plugin#1847
• [BUG] BWC bug that cause query shard failure OpenSearch#17125

Campaigns:

• [PROPOSAL] Release OpenSearch 3.0 .github#250
• [PROPOSAL] OpenSearch Release Schedule for Year 2025 .github#252
• [META] [Release 3.0] Planned Breaking Changes for 3.0 in Core/Plugins #5243
• [META] Set OpenSearch 3.0.0 baseline JDK version to JDK-21 OpenSearch#14011
• [META] OpenSearch 3.0 Core Release Tracker  OpenSearch#16935
• [Campaign] Add distribution level Backward Compatiblity tests to all plugins #3671
• Onboard all OpenSearch plugins to Smoke tests framework #5317

Dreprecation:

• PA next step:
  • Deprecate performance-analyzer-rca performance-analyzer-rca#591
  • [RFC] Migrating Metrics From Performance Analyzer to OpenTelemetry Framework performance-analyzer#585
• Deprecate dashboards visualizations plugin dashboards-visualizations#430
• [Release 3.0] Planned Breaking Changes for 3.0 in Plugin dashboards-observability#2311
• [Release 3.0] Planned Breaking Changes for 3.0 in Plugin sql#3248
• Switch default vector engine from nmslib to faiss k-NN#2163

PRs:

• Update to Apache Lucene 10 for 3.0.0 OpenSearch#16366
• [Release 3.0] Bump 3.0.0 version with alpha qualifier (3.0.0-alpha) OpenSearch#17020
• [Release 3.0] Switch alpha to alpha1 and update publish maven to support qualifier and meet requirements OpenSearch#17094
• [Release 3.0] Adding 3.0.0-alpha1 in manifests and Jenkins runs #5251
• [Release 3.0] Ensure 3.0.0 use lucene9 for now #5253
• Update CCR workflow to support v4 checkout action cross-cluster-replication#1488
• Fix compilation issues after upgrade to Lucene 10 security#5053

Version Bumps alpha1:
(OS)

• Fix test failure after lucene upgrade to 10 ml-commons#3426
• [Release 3.0] Update common-utils shadow plugin repo and bump to 3.0.0.0-alpha1 common-utils#775
• [Release 3.0] Bump main branch to use revision 3.0.0.0-alpha1 opensearch-remote-metadata-sdk#61
• [Release 3.0] Bump version 3.0.0.0-alpha1 and update shadowPlugin for Job Scheduler job-scheduler#722
• K-NN Plugin Upgrade with Lucene 10.0.1 k-NN#2429
• Fix failures after core upgrade to lucene 10 neural-search#1141
• Fix compilation issues after upgrade to Lucene 10 security#5053
• [Release 3.0] Bump gradle 8.10.2 / JDK23 / 3.0.0.0-alpha1 on SQL plugin sql#3319
• [Release 3.0] Bump gradle 8.10.2 / JDK 23 / 3.0.0.0-alpha1 support on geospatial geospatial#723

(OSD)

• Bump dashboards query workbench to version 3.0.0.0-alpha1 dashboards-query-workbench#444

Gradle 8.10.2 Bump:

• Bump gradle to 8.10.2 and add JDK23 as part of the github checks k-NN#2432
  • [Release 3.0] Update gradle to 8.10.2 to support JDK23 k-NN#2460
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks reporting#1062
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks neural-search#1156
  • [Release 3.0] Update gradle to 8.10.2 for JDK23 and codecov to v5 and fix delete backport branches neural-search#1157
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks opensearch-learning-to-rank-base#131
  • [Release 3.0] Bump gradle to 8.10.2 and support JDK23 opensearch-learning-to-rank-base#133
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks cross-cluster-replication#1489
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks sql#3315
  • [Release 3.0] Bump gradle 8.10.2 / JDK23 / 3.0.0.0-alpha1 on SQL plugin sql#3319
• Bump gradle to 8.10.2 and add JDK23 as part of the github checks geospatial#722
  • [Release 3.0] Bump gradle 8.10.2 / JDK 23 / 3.0.0.0-alpha1 support on geospatial geospatial#723

Third Party Upgrades:

• [Release 3.0] Prepare for 3.0 release on Helm Charts helm-charts#648
• [Release 3.0] Prepare for 3.0 release on Ansible Playbook ansible-playbook#174
• [Release 3.0] Prepare for 3.0 release on Terraform Provider terraform-provider-opensearch#235

RFC/Discussion:

• [RFC] Decoupling OpenSearch Distribution, Server and Plugin versioning OpenSearch#17127
• [RFC] Migrating existing OpenSearch plugins from the main OpenSearch repository into their own dedicated repositories OpenSearch#17246

[dblock]

https://hub.docker.com/layers/opensearchstaging/opensearch/3.0.0/images/sha256-cc9eb31c36b3d3c9fc9b0a3d308008b482269700e25de1b11b4ee55396260544?context=explore is currently missing a lot of plugins.

$ curl -k -u admin:$OPENSEARCH_PASSWORD https://localhost:9200/_cat/plugins
01885411c025 opensearch-alerting            3.0.0.0
01885411c025 opensearch-asynchronous-search 3.0.0.0
01885411c025 opensearch-job-scheduler       3.0.0.0
01885411c025 opensearch-notifications       3.0.0.0
01885411c025 opensearch-notifications-core  3.0.0.0
01885411c025 opensearch-security            3.0.0.0

[heemin32]

We need to resolve this bwc issue between 2.19 and 3.0. #3747