Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added component with tf slim model generator and pipeline adjustments #335

Merged
merged 2 commits into from
Nov 28, 2018

Conversation

dtrawins
Copy link
Contributor

@dtrawins dtrawins commented Nov 20, 2018

New component generating slim models which can be used in combination with other components for demo and testing purposes.
In the PR is included a sample pipeline linking TF slim models generation with OpenVINO model optimization and converting to IR format.


This change is Reviewable

@k8s-ci-robot
Copy link
Contributor

Hi @dtrawins. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot
Copy link
Contributor

Hi @dtrawins. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@IronPan
Copy link
Member

IronPan commented Nov 28, 2018

/retest

@vicaire
Copy link
Contributor

vicaire commented Nov 28, 2018

Would it be possible to add unit tests in later PRs? It may become difficult for developers to make changes to this doc otherwise.

@vicaire
Copy link
Contributor

vicaire commented Nov 28, 2018

/lgtm
/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vicaire

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

1 similar comment
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vicaire

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit d534103 into kubeflow:master Nov 28, 2018
WORKDIR /
RUN mkdir /bazel && \
cd /bazel && \
curl -H "User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36" -fSsL -O https://github.com/bazelbuild/bazel/releases/download/$BAZEL_VERSION/bazel-$BAZEL_VERSION-installer-linux-x86_64.sh && \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why does this need the User Agent header? There should be a comment about this.


WORKDIR /slim

RUN git clone --depth 1 https://github.com/tensorflow/models && rm -Rf models/.git && \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using master is fragile. We should have an ARG and specify some release tag for it.

@@ -1,7 +1,9 @@
#!/usr/bin/python3
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#!/usr/bin/env python

if return_code:
exit(1)

with open('/tmp/output_path.txt', 'w') as f:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/outputs/output_path/file

pb_visual_writer.add_graph(sess.graph)
print("Visualize the model by running: "
"tensorboard --logdir={}".format(SAVED_MODEL_DIR))
with open('/tmp/saved_model_dir.txt', 'w') as f:
Copy link
Contributor

@Ark-kun Ark-kun Nov 28, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/outputs/model_gcs_path/file

"tensorboard --logdir={}".format(SAVED_MODEL_DIR))
with open('/tmp/saved_model_dir.txt', 'w') as f:
f.write(SAVED_MODEL_DIR)
with open('/tmp/export_dir.txt', 'w') as f:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/outputs/graph_files_gcs_dir/file

HumairAK pushed a commit to red-hat-data-services/data-science-pipelines that referenced this pull request Mar 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants