Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compute phasing from trios #30

Closed
cseed opened this issue Oct 29, 2015 · 1 comment
Closed

compute phasing from trios #30

cseed opened this issue Oct 29, 2015 · 1 comment

Comments

@cseed
Copy link
Collaborator

cseed commented Oct 29, 2015

From @cseed on August 31, 2015 22:23

This will involve deciding how to represent phasing information.

Copied from original issue: cseed/hail#38

@cseed
Copy link
Collaborator Author

cseed commented Jul 18, 2017

There isn't currently demand for this.

@cseed cseed closed this as completed Jul 18, 2017
cseed added a commit to cseed/hail that referenced this issue Sep 22, 2018
* add hail-ci-build.sh wip

* wip

* make hail-ci script work

added shutdown endpoint

* fix
danking pushed a commit that referenced this issue Sep 25, 2018
* initial revision

* wip

* added deployment

updated logging

* added service

* wip

* wip

* cancellation, primitive client library

(unused) bidict
jupyter deployment

* batches, higher level api

* fixed readme

* minor

* added tests, reorg

* tests run in itself

* wip

added attributes
removed job names
create batch objects
added callback (untested)

* added callbacks, callback test

* makefile changes

* wip

try to get callback test working on k8s cluster

* tweaks

* callback test works on k8s

* starting to play with containerized spark

some cleanup

* Create setup.py

* move setup.py to correct location

* ignore compiled pyc files

* describe how to use minikube with local docker images

* add special note about `imagePullPolicy`

* add an environment yaml

* add a getting started section

* add a dockerignore file

* do not fail if callback fails

* expose pod/container volumes

* fix volumeMounts field name

* add resources

* add tolerations

* add jobs listing

* add jobs test

* fix the environment

* update Batch.create_job for all the new parameters

* fix missing id

* avoid crashing on bad event types

* update dockerignore

* retry event loops

* Update server.py

* fix dockerignore

* fix dockerignore

* stash the attributes sent by api

* cache the status

* fixed tests (#28)

* Pr builder image (#27)

* added pr-builder image logic

* added missing files

* address comments

* add hail-ci-build.sh (#30)

* add hail-ci-build.sh wip

* wip

* make hail-ci script work

added shutdown endpoint

* fix

* don't log the (pod) log (#29)

* added bash to pr-builder image (#32)

* Add git (#35)

* test

* added git to pr-builder image

* add python alias in pr-builder image

* added curl to pr-builder image

* Job delete (#36)

* wip: added job/delete

need to test

* added delete, various

* tag executable images (#38)

* update deployment (#39)

* make batch single threaded (#40)

* make batch single threaded

polling and k8s watch thread request into main thread
in addition to k8s notifications, periodically poll k8s state

* address comments

* label batch job pods (#41)

* add hail-ci-deploy.sh (#42)

* added hail-ci-deploy.sh

add docker to pr-builder image

* added missing deployment.yaml.in

removed deployment.yaml

* consistency

* addessed comments

* install kubectl in image (#44)

`gcloud components install kubectl` is failing with a non-obvious error message so I installed it directly

* make batch subproject (#46)

* make batch subproject

fixed more deployment bugs

* updated build image

* fix test race condition

job can complete before it is cancelled

* authenticate docker to push to gcr.io (#48)

* authenticate docker to push to gcr.io

* add gcloud quiet (-q)

* remove errant tab

* logging to match ci

* do callback asynchronously

* do callback asynchronously

* expose pod name as well (#49)

* restart ci on deploy (#50)

* Fix SHA check (#51)

* Update hail-ci-deploy.sh

* Update deployment.yaml.in

* Update hail-ci-deploy.sh

* Update hail-ci-deploy.sh

* add /jobs/<id>/log endpoint (#52)

* add /jobs/<id>/log endpoint

added to api, client
return completed job logs (including deleted ones)
return in-progress logs (if there are any)
return 404 (not empty) if there no logs to be found

status['log'] returns the same log

* fixed bug

* fixed typo

* prep to merge into monorepo

clean up unused files, experiments (jupyter, spark, etc.)

* updated build image

* fixes

hail-ci-build.sh handles all known projects
fix batch to deploy only when changed

* fixed typo

* fixed README.md conflict.

* activate environment

* add cloudtools to list of project-changed.py projects
daniel-goldstein referenced this issue in daniel-goldstein/hail Feb 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant