Check before delete

[xinyual]

Description

This pr is to check all downstream service before deleting ml model. Two downstream tasks are checking here:

1. Agent
2. Pipelines

For agent, we enforce this tool factory to implement a method to return the key field name of each tool. Then we create a should DSL query like

{
  "query" : {
    "bool" : {
      "must" : [ {
        "bool" : {
          "should" : [ {
            "bool" : {
              "must_not" : [ {
                "exists" : {
                  "field" : "is_hidden",
                  "boost" : 1.0
                }
              } ],
              "adjust_pure_negative" : true,
              "boost" : 1.0
            }
          }, {
            "bool" : {
              "must" : [ {
                "terms" : {
                  "is_hidden" : [ false ],
                  "boost" : 1.0
                }
              }, {
                "exists" : {
                  "field" : "is_hidden",
                  "boost" : 1.0
                }
              } ],
              "adjust_pure_negative" : true,
              "boost" : 1.0
            }
          } ],
          "adjust_pure_negative" : true,
          "boost" : 1.0
        }
      }, {
        "bool" : {
          "should" : [ {
            "terms" : {
              "tools.parameters.<fieldName>" : [ "<modelId>" ],
              "boost" : 1.0
            }
          }],
          "adjust_pure_negative" : true,
          "boost" : 1.0
        }
      } ],
      "adjust_pure_negative" : true,
      "boost" : 1.0
    }
  }
}

For pipelines, we fetch all ingestion pipelines and search pipelines and check for each pipeline whether they contain the candidate model id.

Related Issues

#3191
#3087
#3088

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.