Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Watson pipeline example #1246

Merged
merged 7 commits into from
Apr 29, 2019
Merged

Fix Watson pipeline example #1246

merged 7 commits into from
Apr 29, 2019

Conversation

Tomcli
Copy link
Member

@Tomcli Tomcli commented Apr 26, 2019

This PR contains the following fixes:

  • In config component, add exception to kubectl delete when old secret is not present.
  • Remove spaces in metadata.labels since Argo can't take labels with white space.
  • Fix Watson train to not check on hard coded created text. Also parameterize author email field.
  • Update Watson pipeline arguments to map with the correct component parameters.

This change is Reviewable

@k8s-ci-robot
Copy link
Contributor

Hi @Tomcli. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

1 similar comment
@k8s-ci-robot
Copy link
Contributor

Hi @Tomcli. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Tomcli
Copy link
Member Author

Tomcli commented Apr 26, 2019

/assign @animeshsingh

Copy link
Contributor

@animeshsingh animeshsingh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs couple of minor changes, otherwise good

runtime=runtime,
runtime_version=runtime_version,
run_definition=run_definition,
run_name=run_name
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

since we can just go with the variable values, maybe we can remove duplication here

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed duplications on the last 2 components since they have few arguments. For the train component, I decided to keep using keyword arguments since it has a long list of args and users might mistakenly put them in the wrong order.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My experience is that this makes it less error-prone and also makes it easier for users.
Without explicit names, if you add a new parameter, the calls may become invalid since the wrong arguments will be passed.
Also this makes it easier since the users see the parameter names which can be different from argument names, especially in cases where arguments are constant.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah we discussed internally extensively, specially if there are large number of params. Maybe it would behoove to make it a standard, specially on our pipelines. i am not a fan of mix and match in general

@animeshsingh
Copy link
Contributor

/lgtm
/approve

@animeshsingh
Copy link
Contributor

/retest

@Tomcli
Copy link
Member Author

Tomcli commented Apr 27, 2019

/retest

@k8s-ci-robot
Copy link
Contributor

@Tomcli: Cannot trigger testing until a trusted user reviews the PR and leaves an /ok-to-test message.

In response to this:

/retest

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

1 similar comment
@k8s-ci-robot
Copy link
Contributor

@Tomcli: Cannot trigger testing until a trusted user reviews the PR and leaves an /ok-to-test message.

In response to this:

/retest

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@animeshsingh
Copy link
Contributor

/lgtm
/retest

@animeshsingh
Copy link
Contributor

/ok-to-test

@animeshsingh
Copy link
Contributor

@Ark-kun any reason the test is failing? Don`t think it has anything to do with us?

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 27, 2019

/test kubeflow-pipeline-e2e-test

@animeshsingh
Copy link
Contributor

Don`t think its us - so this can be merged I believe @Ark-kun

I see the following error message

  • O='ERROR: (gcloud.deployment-manager.deployments.describe) ResponseError: code=404, message=The object '''projects/ml-pipeline-test/global/deployments/e2e-26d4d0b-30039-storage''' is not found.'

@animeshsingh
Copy link
Contributor

/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: animeshsingh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

1 similar comment
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: animeshsingh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-e2e-test

3 similar comments
@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-e2e-test

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-e2e-test

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-e2e-test

@animeshsingh
Copy link
Contributor

@Ark-kun is it peculiar to this PR?

@animeshsingh
Copy link
Contributor

animeshsingh commented Apr 29, 2019

Saw this error now

++ curl -LO https://github.com/ksonnet/ksonnet/releases/download/v0.13.0/ks_0.13.0_linux_amd64.tar.gz
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 619 0 619 0 0 1896 0 --:--:-- --:--:-- --:--:-- 1898

0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0
100 282 0 282 0 0 63 0 --:--:-- 0:00:04 --:--:-- 97
++ tar -xzf ks_0.13.0_linux_amd64.tar.gz

gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now

@animeshsingh
Copy link
Contributor

/test kubeflow-pipeline-e2e-test

@mpoqq
Copy link
Contributor

mpoqq commented Apr 29, 2019

I had the same problem this morning local with the 0.13.0 version. The download link for version 0.13.1 is working. If you change the version here it should work.

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

@Ark-kun is it peculiar to this PR?

No

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-e2e-test

@Ark-kun
Copy link
Contributor

Ark-kun commented Apr 29, 2019

/test kubeflow-pipeline-sample-test

@k8s-ci-robot k8s-ci-robot merged commit c77554a into kubeflow:master Apr 29, 2019
@Tomcli Tomcli deleted the wml branch February 28, 2024 23:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants