Upgrade kpt to 1.x.x (3d)

[zijianjoy]

• Latest gcloud sdk 349.0.0 breaks kpt installed manifests #294

• [pH] prepare for kpt v1.0.0-beta.1 kubeflow/pipelines#6100 (comment)

[zijianjoy]

Summary of work after reviewing https://kpt.dev/installation/migration:
It needs to be applied to kubeflow and management folders.

• Change Kptfile format from v1alpha1 to v1.
• Change # {"$kpt-set":"foo"} comments to # kpt-set: ${foo} in yaml files.
• Add configmap for values in env.sh to kpt-setter-config.yaml.
• Uses apply-setters mutator for high level Kptfile
• Update kpt-set.sh to apply kpt values
• Consider removing env.sh
• Automatic fix tool not working kpt fn eval --image gcr.io/kpt-fn/fix:unstable --include-meta-resources failed with error wrong Node Kind for expected: MappingNode was SequenceNode. Reference: Some commands fail on YAML that only contains a list kptdev/kpt#1218
• Documentations
• Makfile uses yq to grab variables for kptfile. Change to use new approach.
• Kubeflow and management directories.

[zijianjoy]

Note:

Download kpt:

curl -L https://github.com/GoogleContainerTools/kpt/releases/download/v1.0.0-beta.4/kpt_linux_amd64 --output kpt
chmod +x kpt

Use new kpt:

export PATH=<path-to-kpt>:$PATH

Apply setter:

kpt fn eval --image gcr.io/kpt-fn/apply-setters:v0.1 ./ --fn-config ./kpt-setter-config.yaml

Migrate:

kpt fn eval --image gcr.io/kpt-fn/fix:v0.2 --include-meta-resources --truncate-output=false

Revert a file

 git checkout 3b7c99baed48bcd0c2b2553773e5d55a2d256262 <filename>

A trick to debug when the error message not helpful:

kpt fn eval -i list-setters:v0.1

configure managed-project

kpt fn eval --image gcr.io/kpt-fn/apply-setters:v0.1 ./managed-project -- \
         name="${MGMT_NAME}" \
         gcloud.core.project="${MGMT_PROJECT}" \
         managed-project="${KF_PROJECT}"

[zijianjoy]

Questions:

1. Do we need to set environment variables in env.sh?

[zijianjoy]

Draft:

• krmignore
• apply-setters. -> kpt-set.sh
• kptconfig/kpt-setter-config.yaml
• kpt pkg get
• remove Kptfile
• yq to overcome yaml file issue with kpt.

[zijianjoy]

Created kptdev/kpt#2506 for kpt pkg get error.

[zijianjoy]

While waiting for TODO in #311 which are outside of the gcp-blueprints scope. Closing this issue. And the tips here are very useful too.