Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add search index tool #2356

Merged
merged 15 commits into from
Apr 26, 2024

Conversation

yuye-aws
Copy link
Member

@yuye-aws yuye-aws commented Apr 24, 2024

Description

Add search index tool in the current repo: opensearch-project/skills#294

Issues Resolved

Add search index tool in the current repo: opensearch-project/skills#294

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: yuye-aws <yuyezhu@amazon.com>
Signed-off-by: yuye-aws <yuyezhu@amazon.com>
Signed-off-by: yuye-aws <yuyezhu@amazon.com>
@yuye-aws
Copy link
Member Author

@ylwu-amzn Please help attach backport 2.x label.

@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 25, 2024 17:18 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 25, 2024 17:18 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 25, 2024 17:18 — with GitHub Actions Inactive
@yuye-aws yuye-aws had a problem deploying to ml-commons-cicd-env April 25, 2024 17:18 — with GitHub Actions Failure
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:24 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:24 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:25 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:25 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:25 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 00:25 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 01:13 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 01:13 — with GitHub Actions Inactive
@yuye-aws yuye-aws temporarily deployed to ml-commons-cicd-env April 26, 2024 01:13 — with GitHub Actions Inactive
@@ -184,6 +184,14 @@ integTest {
// Set this to true this if you want to see the logs in the terminal test output.
// note: if left false the log output will still show in your IDE
testLogging.showStandardStreams = true

// Exclude integration test for search index tool for multiple nodes
// because we cannot get concrete exception message in multi-node cluster
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yuye-aws Why can't get concrete exception message ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In multi node cluster, the original exception message is wrapped with RemoteTransportException, the cause of which is still RemoteTransportException.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since this PR is just moving code from skills repo to ml-commons, we can keep it as is. But please create a Github issue for supporting multi-node cluster for this IT.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Created a bug issue: #2362

@ylwu-amzn ylwu-amzn merged commit ea7fefa into opensearch-project:main Apr 26, 2024
13 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Apr 26, 2024
* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix unit test error

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change json file path for search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* skip multiple node integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* resolve code duplication in search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change method access

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove unused class

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove wild card import

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add comment in gradle file

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

---------

Signed-off-by: yuye-aws <yuyezhu@amazon.com>
(cherry picked from commit ea7fefa)
mingshl pushed a commit that referenced this pull request Apr 26, 2024
* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix unit test error

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change json file path for search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* skip multiple node integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* resolve code duplication in search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change method access

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove unused class

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove wild card import

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add comment in gradle file

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

---------

Signed-off-by: yuye-aws <yuyezhu@amazon.com>
(cherry picked from commit ea7fefa)

Co-authored-by: Yuye Zhu <yuyezhu@amazon.com>
@yuye-aws yuye-aws deleted the AddSearchIndexTool branch April 26, 2024 04:13
dhrubo-os pushed a commit to dhrubo-os/ml-commons that referenced this pull request May 17, 2024
…ject#2361)

* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix unit test error

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change json file path for search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* fix integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* run spotless apply

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* skip multiple node integration test for search index tool

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* resolve code duplication in search index tool it

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* change method access

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove unused class

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* remove wild card import

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

* add comment in gradle file

Signed-off-by: yuye-aws <yuyezhu@amazon.com>

---------

Signed-off-by: yuye-aws <yuyezhu@amazon.com>
(cherry picked from commit ea7fefa)

Co-authored-by: Yuye Zhu <yuyezhu@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants