Adding open access for a module to fix pa plugin jdk 17 issue (opense…

…arch-project#1947) Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com> Adding code block for maven plugin zips Signed-off-by: pgodithi <pgodithi@amazon.com> Adding code block for maven plugin zips Signed-off-by: pgodithi <pgodithi@amazon.com> zip maven publish Signed-off-by: pgodithi <pgodithi@amazon.com> added zipsmaven dir check Signed-off-by: pgodithi <pgodithi@amazon.com> Adding better gradle project dir Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test maven snapshots Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> Removing build script for PA (opensearch-project#1952) Signed-off-by: Sagar Upadhyaya <sagar.upadhyaya.121@gmail.com> update release issue with steps to update ansible and helm (opensearch-project#1942) * update release issue with steps to update ansible and helm Signed-off-by: Abhinav Gupta <abhng@amazon.com> * updated test as sample PR Signed-off-by: Abhinav Gupta <abhng@amazon.com> * adding periods Signed-off-by: Abhinav Gupta <abhng@amazon.com> Fix the path for maven sign and staging job (opensearch-project#1954) * Fix the path for staging maven Signed-off-by: Zelin Hao <zelinhao@amazon.com> * Add the distribution folder tar to the artifact path and update test Signed-off-by: Zelin Hao <zelinhao@amazon.com> [OSD][2.0.0] use rc1 qualifier (opensearch-project#1949) Signed-off-by: Kawika Avilla <kavilla414@gmail.com> install createrepo in docker image for RPM yum repo support (opensearch-project#1955) * install createrepo in docker image for RPM yum repo support Signed-off-by: Tianle Huang <tianleh@amazon.com> * fix Signed-off-by: Tianle Huang <tianleh@amazon.com> * update opensearch to use new image Signed-off-by: Tianle Huang <tianleh@amazon.com> Add systemd docker for rpm service test (opensearch-project#1958) * Add systemd based image for yum install testing and more Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> * More packages to add to the images Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> lower freq for build for 1.3.1 opensearch-dashboards (opensearch-project#1941) * lower freq for build for 1.3.1 opensearch-dashboards Signed-off-by: Abhinav Gupta <abhng@amazon.com> * removed build for 1.2.x and 1.3.1 Signed-off-by: Abhinav Gupta <abhng@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> Added notifications-core and notifications to 2.0 and add integTest manifest (opensearch-project#1957) * Added notifications-core and notifications to 2.0. Signed-off-by: dblock <dblock@dblock.org> * Remove scripts from opensearch-build. Signed-off-by: dblock <dblock@dblock.org> * Remove dashboards notifications scripts to use the default one Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> * Remove CI checks for lack of gradlew. Signed-off-by: dblock <dblock@dblock.org> * Fix the second subfolder location after core Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> * Add notifications related build scripts to build repo Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> * Tweak build scripts to correctly move the zips Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> Co-authored-by: Peter Zhu <zhujiaxi@amazon.com> Make sure notifications is built correctly while passing ci checks (opensearch-project#1959) Signed-off-by: Peter Zhu <zhujiaxi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com> test snapshot build Signed-off-by: pgodithi <pgodithi@amazon.com>
prudhvigodithi · Apr 13, 2022 · 9964731 · 9964731
1 parent 88c7df3
commit 9964731
Show file tree

Hide file tree

Showing 21 changed files with 219 additions and 609 deletions.
diff --git a/.github/ISSUE_TEMPLATE/release_template.md b/.github/ISSUE_TEMPLATE/release_template.md
@@ -82,6 +82,8 @@ __REPLACE with OpenSearch wide initiatives to improve quality and consistency.__
 - [ ] Create [release tags](https://github.com/opensearch-project/opensearch-build/blob/main/jenkins/release-tag/release-tag.jenkinsfile) for each component (Jenkins job name: release-tag-creation).
 - [ ] Replace refs in [manifests/{{ env.VERSION }}](/opensearch-project/opensearch-build/tree/main/manifests/{{ env.VERSION }}) with tags and remove checks.
 - [ ] Generate distribution release notes reviewed by PM team for opensearch-build repository.
+- [ ] Increment version for Helm Charts [(sample PR)](https://github.com/opensearch-project/helm-charts/pull/246) for the `{{ env.VERSION }}` release.
+- [ ] Increment version for Ansible Charts [(sample PR)](https://github.com/opensearch-project/ansible-playbook/pull/50) for the `{{ env.VERSION }}` release.
 - [ ] Prepare [for next patch release](https://github.com/opensearch-project/opensearch-plugins/blob/main/META.md#increment-a-version-in-every-plugin) by incrementing patch versions for each component.
 - [ ] Lower the [frequency of builds](https://github.com/opensearch-project/opensearch-build/pull/1475) for this version of OpenSearch and/or OpenSearch Dashboards.
 - [ ] Update [this template](https://github.com/opensearch-project/opensearch-build/blob/main/.github/ISSUE_TEMPLATE/release_template.md) with any new or missed steps.

diff --git a/docker/ci/dockerfiles/build.centos7.opensearch-dashboards.x64.arm64.dockerfile b/docker/ci/dockerfiles/build.centos7.opensearch-dashboards.x64.arm64.dockerfile
@@ -105,7 +105,7 @@ SHELL ["/bin/bash", "-lc"]
 CMD ["/bin/bash", "-l"]
 
 # Install ruby / rpm / fpm related dependencies
-RUN . /etc/profile.d/rvm.sh && rvm install 2.4.0 && rvm --default use 2.4.0 && yum install -y rpm-build && yum clean all
+RUN . /etc/profile.d/rvm.sh && rvm install 2.4.0 && rvm --default use 2.4.0 && yum install -y rpm-build createrepo && yum clean all
 
 ENV RUBY_HOME=/usr/local/rvm/rubies/ruby-2.4.0/bin
 ENV RVM_HOME=/usr/local/rvm/bin

diff --git a/docker/ci/dockerfiles/build.centos7.opensearch.x64.arm64.dockerfile b/docker/ci/dockerfiles/build.centos7.opensearch.x64.arm64.dockerfile
@@ -114,7 +114,7 @@ CMD ["/bin/bash", "-l"]
 
 # Install ruby / rpm / fpm related dependencies
 RUN . /etc/profile.d/rvm.sh && rvm install 2.4.0 && rvm --default use 2.4.0 && \
-    yum install -y rpm-build && \
+    yum install -y rpm-build createrepo && yum clean all && \
     gem install fpm -v 1.13.0
 
 ENV RUBY_HOME=/usr/local/rvm/rubies/ruby-2.4.0/bin

diff --git a/docker/ci/dockerfiles/test.centos7.systemd-base.x64.arm64.dockerfile b/docker/ci/dockerfiles/test.centos7.systemd-base.x64.arm64.dockerfile
@@ -0,0 +1,31 @@
+# SPDX-License-Identifier: Apache-2.0
+#
+# The OpenSearch Contributors require contributions made to
+# this file be licensed under the Apache-2.0 license or a
+# compatible open source license.
+
+# This is a docker image specifically for setting up systemd env base for services with root user
+# It is initially designed to test yum installation, but can be used for anything that requires systemd
+# It used the method posted by Daniel Walsh: https://developers.redhat.com/blog/2014/05/05/running-systemd-within-docker-container
+
+# In order to run images with systemd, you need to run in privileged mode: `docker run --privileged -it -v /sys/fs/cgroup:/sys/fs/cgroup:ro <image_tag>`
+
+FROM centos:7
+
+ENV container docker
+
+RUN yum -y update && yum clean all
+
+# Possible retain of multi-user.target.wants later due to PA
+# As of now we do not need this
+RUN yum -y install systemd procps util-linux-ng openssl openssl-devel which curl git gnupg2 tar net-tools && yum clean all && \
+(cd /lib/systemd/system/sysinit.target.wants/; for i in *; do [ $i == systemd-tmpfiles-setup.service ] || rm -f $i; done); \
+rm -f /lib/systemd/system/multi-user.target.wants/*;\
+rm -f /etc/systemd/system/*.wants/*;\
+rm -f /lib/systemd/system/local-fs.target.wants/*; \
+rm -f /lib/systemd/system/sockets.target.wants/*udev*; \
+rm -f /lib/systemd/system/sockets.target.wants/*initctl*; \
+rm -f /lib/systemd/system/basic.target.wants/*;\
+rm -f /lib/systemd/system/anaconda.target.wants/*;
+
+CMD ["/usr/sbin/init"]
diff --git a/jenkins/check-for-build.jenkinsfile b/jenkins/check-for-build.jenkinsfile
@@ -9,13 +9,9 @@ pipeline {
         parameterizedCron '''
             H/10 * * * * %INPUT_MANIFEST=3.0.0/opensearch-3.0.0.yml;TARGET_JOB_NAME=distribution-build-opensearch
             H/10 * * * * %INPUT_MANIFEST=1.3.2/opensearch-1.3.2.yml;TARGET_JOB_NAME=distribution-build-opensearch
-            H/10 * * * * %INPUT_MANIFEST=1.3.1/opensearch-dashboards-1.3.1.yml;TEST_MANIFEST=1.3.1/opensearch-dashboards-1.3.1-test.yml;TARGET_JOB_NAME=distribution-build-opensearch-dashboards
             H/10 * * * * %INPUT_MANIFEST=1.2.5/opensearch-1.2.5.yml;TARGET_JOB_NAME=distribution-build-opensearch
             H/10 * * * * %INPUT_MANIFEST=2.0.0/opensearch-2.0.0.yml;TEST_MANIFEST=2.0.0/opensearch-2.0.0-test.yml;TARGET_JOB_NAME=distribution-build-opensearch
             H/10 * * * * %INPUT_MANIFEST=2.0.0/opensearch-dashboards-2.0.0.yml;TEST_MANIFEST=2.0.0/opensearch-dashboards-2.0.0-test.yml;TARGET_JOB_NAME=distribution-build-opensearch-dashboards
-            H 1 * * * %INPUT_MANIFEST=1.2.1/opensearch-1.2.1.yml;TEST_MANIFEST=1.2.1/opensearch-1.2.1-test.yml;TARGET_JOB_NAME=distribution-build-opensearch
-            H 1 * * * %INPUT_MANIFEST=1.2.2/opensearch-1.2.2.yml;TEST_MANIFEST=1.2.2/opensearch-1.2.2-test.yml;TARGET_JOB_NAME=distribution-build-opensearch
-            H 1 * * * %INPUT_MANIFEST=1.2.3/opensearch-1.2.3.yml;TEST_MANIFEST=1.2.3/opensearch-1.2.3-test.yml;TARGET_JOB_NAME=distribution-build-opensearch
             H 1 * * * %INPUT_MANIFEST=2.1.0/opensearch-2.1.0.yml;TARGET_JOB_NAME=distribution-build-opensearch
         '''
     }
@@ -78,7 +74,7 @@ pipeline {
                             string(name: 'INPUT_MANIFEST', value: "${INPUT_MANIFEST}"),
                             string(name: 'TEST_MANIFEST', value: "${TEST_MANIFEST}")
                             ], wait: true
-                            
+
                             echo "Build succeeded, uploading build SHA for that job"
                             buildUploadManifestSHA(
                                 inputManifest: "manifests/${INPUT_MANIFEST}",

diff --git a/jenkins/opensearch-maven-release/maven-sign-release.jenkinsfile b/jenkins/opensearch-maven-release/maven-sign-release.jenkinsfile
@@ -21,7 +21,7 @@ pipeline {
         )
     }
     environment {
-        ARTIFACT_PATH = "distribution-build-opensearch/${VERSION}/${BUILD_ID}/linux/x64/builds"
+        ARTIFACT_PATH = "distribution-build-opensearch/${VERSION}/${BUILD_ID}/linux/x64/tar/builds"
     }
     stages {
         stage('sign') {
@@ -56,7 +56,7 @@ pipeline {
                 script {
                     // stage artifacts for release with Sonatype
                     withCredentials([usernamePassword(credentialsId: 'Sonatype', usernameVariable: 'SONATYPE_USERNAME', passwordVariable: 'SONATYPE_PASSWORD')]) {
-                        sh('$WORKSPACE/publish/stage-maven-release.sh $WORKSPACE/artifacts/$ARTIFACT_PATH/maven-signed')
+                        sh('$WORKSPACE/publish/stage-maven-release.sh $WORKSPACE/artifacts/$ARTIFACT_PATH/opensearch/maven')
                     }
                 }
             }