Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build Pipeline leveraging Arena #1058

Merged
merged 43 commits into from
Apr 16, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
f21208a
add arena samples to pipelines
cheyang Mar 28, 2019
36959c2
update directory
cheyang Mar 28, 2019
c942dac
update docs
cheyang Mar 29, 2019
8e6904d
update docs
cheyang Mar 29, 2019
2108b1d
update func name according to comments
cheyang Apr 4, 2019
9c7e94d
update samples
cheyang Apr 5, 2019
5f1dae0
update samples
cheyang Apr 5, 2019
77acc87
update samples
cheyang Apr 5, 2019
6b02b92
add installation guide
cheyang Apr 5, 2019
3129c43
add installation guide
cheyang Apr 5, 2019
f9a1608
update kfp package
cheyang Apr 5, 2019
c72c5f1
update author name
cheyang Apr 6, 2019
b66ac63
change timeout unit to hour
cheyang Apr 6, 2019
2f5eea3
update API docs
cheyang Apr 6, 2019
23fc1f8
reduce image size
cheyang Apr 6, 2019
053398d
update samples
cheyang Apr 6, 2019
df00d6c
update docker images
cheyang Apr 6, 2019
c95b09b
update docker images
cheyang Apr 6, 2019
7faf8cd
update notebook
cheyang Apr 6, 2019
f5acf8e
update notebook
cheyang Apr 6, 2019
d4f0ae4
re-design API
cheyang Apr 9, 2019
47723a1
update the design of arena op API
cheyang Apr 9, 2019
1737ec1
re-design ops API
cheyang Apr 9, 2019
5ef99bd
update arena launcher implementation
cheyang Apr 10, 2019
4bb9762
refactor launcher
cheyang Apr 10, 2019
d3bdd05
fix api
cheyang Apr 11, 2019
92973fe
fix launcher issue
cheyang Apr 11, 2019
b273e90
update arena version
cheyang Apr 11, 2019
1d6ae5d
update demos
cheyang Apr 11, 2019
2345a55
Merge pull request #1 from cheyang/re-design-arena-api
cheyang Apr 11, 2019
b83336e
add mpi op
cheyang Apr 12, 2019
989400f
fix typo of metric
cheyang Apr 13, 2019
0e1b1d3
update api version
cheyang Apr 13, 2019
5c98044
fix metric name
cheyang Apr 13, 2019
1cb6229
fix metric name
cheyang Apr 13, 2019
6f03374
fix metric name
cheyang Apr 13, 2019
52dd513
fix metric name
cheyang Apr 13, 2019
3615e1b
fix metric name
cheyang Apr 13, 2019
16a24ef
fix metric name
cheyang Apr 13, 2019
a1a0ae9
make it show in pipeline ui
cheyang Apr 13, 2019
1ddc00e
make it show in pipeline ui
cheyang Apr 13, 2019
2bc52fb
update demos
cheyang Apr 15, 2019
b8ab8e9
update demos
cheyang Apr 15, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 44 additions & 0 deletions components/arena/docker/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
FROM golang:1.10-stretch as build

RUN mkdir -p /go/src/github.com/kubeflow && \
cd /go/src/github.com/kubeflow && \
git clone https://github.com/kubeflow/arena.git

WORKDIR /go/src/github.com/kubeflow/arena

RUN cd /go/src/github.com/kubeflow/arena && make

RUN wget https://storage.googleapis.com/kubernetes-helm/helm-v2.9.1-linux-amd64.tar.gz && \
tar -xvf helm-v2.9.1-linux-amd64.tar.gz && \
mv linux-amd64/helm /usr/local/bin/helm && \
chmod u+x /usr/local/bin/helm

ENV K8S_VERSION v1.11.2
RUN curl -o /usr/local/bin/kubectl https://storage.googleapis.com/kubernetes-release/release/${K8S_VERSION}/bin/linux/amd64/kubectl && chmod +x /usr/local/bin/kubectl

# FROM python:3.6.8-stretch

FROM python:3.7-alpine3.9

RUN apk update && \
apk add --no-cache ca-certificates py-dev python-setuptools wget unzip git bash \
rm -rf /var/cache/apk/*

RUN pip install --upgrade pip && \
pip install pyyaml==3.12 six==1.11.0 requests==2.18.4

COPY --from=build /go/src/github.com/kubeflow/arena/bin/arena /usr/local/bin/arena

COPY --from=build /usr/local/bin/helm /usr/local/bin/helm

COPY --from=build /go/src/github.com/kubeflow/arena/kubernetes-artifacts /root/kubernetes-artifacts

COPY --from=build /usr/local/bin/kubectl /usr/local/bin/kubectl

COPY --from=build /go/src/github.com/kubeflow/arena/charts /charts

COPY arena_launcher.py /root

WORKDIR /root

ENTRYPOINT ["python","arean_launcher.py"]
Loading