Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge batch #4414

Merged
merged 74 commits into from
Sep 25, 2018
Merged

Merge batch #4414

merged 74 commits into from
Sep 25, 2018

Conversation

cseed
Copy link
Collaborator

@cseed cseed commented Sep 24, 2018

This is a merge of hail-is/batch master updating only hail-ci-{build, deploy}.sh to resolve merge conflicts.

cseed and others added 21 commits August 27, 2018 19:41
* test

* added git to pr-builder image
* wip: added job/delete

need to test

* added delete, various
* make batch single threaded

polling and k8s watch thread request into main thread
in addition to k8s notifications, periodically poll k8s state

* address comments
* added hail-ci-deploy.sh

add docker to pr-builder image

* added missing deployment.yaml.in

removed deployment.yaml

* consistency

* addessed comments
`gcloud components install kubectl` is failing with a non-obvious error message so I installed it directly
* make batch subproject

fixed more deployment bugs

* updated build image

* fix test race condition

job can complete before it is cancelled
* authenticate docker to push to gcr.io

* add gcloud quiet (-q)

* remove errant tab

* logging to match ci

* do callback asynchronously

* do callback asynchronously
* Update hail-ci-deploy.sh

* Update deployment.yaml.in

* Update hail-ci-deploy.sh

* Update hail-ci-deploy.sh
* add /jobs/<id>/log endpoint

added to api, client
return completed job logs (including deleted ones)
return in-progress logs (if there are any)
return 404 (not empty) if there no logs to be found

status['log'] returns the same log

* fixed bug

* fixed typo
clean up unused files, experiments (jupyter, spark, etc.)
hail-ci-build.sh handles all known projects
fix batch to deploy only when changed
@cseed
Copy link
Collaborator Author

cseed commented Sep 24, 2018

I pushed another commit. Toplevel hail-ci-build.sh handles all known projects (and skips them if they aren't there yet or don't have a build script).

Also, deploy batch only when changed. I will also make this generic by adding a get-deployed-sha.sh to retrieve the current deployed sha to compare against when considering redeploy.

@danking danking merged commit 945d68d into hail-is:master Sep 25, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants