Skip to content

Commit

Permalink
Added initialization time-out option. (hail-is#71)
Browse files Browse the repository at this point in the history
  • Loading branch information
rbonazzola authored and tpoterba committed Aug 31, 2018
1 parent 4614769 commit d654d8b
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -162,7 +162,7 @@ usage: cluster start [-h] [--hash HASH] [--spark {2.0.2,2.2.0}]
[--worker-machine-type WORKER_MACHINE_TYPE] [--zone ZONE]
[--properties PROPERTIES] [--metadata METADATA]
[--packages PACKAGES] [--jar JAR] [--zip ZIP]
[--init INIT] [--vep] [--dry-run]
[--init INIT] [--init_timeout INIT_TIMEOUT] [--vep] [--dry-run]
name
Start a Dataproc cluster configured for Hail.
Expand Down Expand Up @@ -214,6 +214,9 @@ optional arguments:
--jar JAR Hail jar to use for Jupyter notebook.
--zip ZIP Hail zip to use for Jupyter notebook.
--init INIT Comma-separated list of init scripts to run.
--init_timeout INIT_TIMEOUT
Flag to specify a timeout period for the
initialization action
--vep Configure the cluster to run VEP.
--dry-run Print gcloud dataproc command, but don't run it.```

Expand Down
2 changes: 2 additions & 0 deletions cloudtools/start.py
Original file line number Diff line number Diff line change
Expand Up @@ -77,6 +77,7 @@ def init_parser(parser):

# initialization action flags
parser.add_argument('--init', default='', help='Comma-separated list of init scripts to run.')
parser.add_argument('--init_timeout', default='20m', help='Flag to specify a timeout period for the initialization action')
parser.add_argument('--vep', action='store_true', help='Configure the cluster to run VEP.')
parser.add_argument('--dry-run', action='store_true', help="Print gcloud dataproc command, but don't run it.")

Expand Down Expand Up @@ -194,6 +195,7 @@ def main(args):
'--zone={}'.format(args.zone),
'--properties={}'.format(",".join(properties)),
'--initialization-actions={}'.format(','.join(init_actions))
'--initialization-action-timeout={}'.format(args.init_timeout)
]

if args.max_idle:
Expand Down

0 comments on commit d654d8b

Please sign in to comment.