Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WX-1627 Belated addition of v87 changelog entries #7436

Merged
merged 6 commits into from
May 16, 2024
Merged

WX-1627 Belated addition of v87 changelog entries #7436

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
352c7ee
More release notes
jgainerdewar May 15, 2024
fefe2cf
Merge branch 'develop' into jgd_WX-1627_releasenotes
jgainerdewar May 15, 2024
4c9766e
Specify Nvidia version
jgainerdewar May 15, 2024
ac6954f
Fix lingo leakage
jgainerdewar May 15, 2024
9230952
Punctuation
jgainerdewar May 15, 2024
626cbdd
Merge branch 'develop' into jgd_WX-1627_releasenotes
jgainerdewar May 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 33 additions & 2 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,13 +13,33 @@ The `genomics` configuration entry was renamed to `batch`, see [ReadTheDocs](htt

## 87 Release Notes

### GCP Batch

* Added Nvidia driver install (default 418) ([#7235](https://github.com/broadinstitute/cromwell/pull/7235}))
* Fixed Docker mounting volumes with extra colon ([#7240](https://github.com/broadinstitute/cromwell/pull/7240))
* Fixed issue with multiple zones defined in config ([#7240](https://github.com/broadinstitute/cromwell/pull/7240))
* Fixed Batch label regex ([#7355](https://github.com/broadinstitute/cromwell/pull/7355))

### Progress toward WDL 1.1 Support

WDL 1.1 support is in progress. Users that would like to try out the current partial support can do so by using
WDL version `development-1.1`. As of Cromwell 87, `development-1.1` includes:
* Engine functions:
* Added `suffix` ([#7363](https://github.com/broadinstitute/cromwell/pull/7363))
* Added `unzip` ([#7363](https://github.com/broadinstitute/cromwell/pull/7368))
* Added `quote` and `squote` ([#7375](https://github.com/broadinstitute/cromwell/pull/7375))
* Updated `sub` to expect POSIX-flavor regex ([#7374](https://github.com/broadinstitute/cromwell/pull/7374))
* Struct literals can be included in WDLs ([#7391](https://github.com/broadinstitute/cromwell/pull/7391)) ([#7402](https://github.com/broadinstitute/cromwell/pull/7402))
* Added `returnCodes` runtime attribute ([#7389](https://github.com/broadinstitute/cromwell/pull/7389))

### `upgrade` command removed from Womtool

Womtool previously supported a `womtool upgrade` command for upgrading draft-2 WDLs to 1.0. With WDL 1.1 soon to become the latest supported version, this functionality is retiring.
Womtool previously supported a `womtool upgrade` command for upgrading draft-2 WDLs to 1.0. With WDL 1.1 soon to
become the latest supported version, this functionality is retiring. ([#7382](https://github.com/broadinstitute/cromwell/pull/7382))

### Replacement of `gsutil` with `gcloud storage`

In this release, all **localization** functionality on the GCP backend migrates to use the more modern and performant `gcloud storage`. With sufficiently powerful worker VMs, Cromwell can now localize at up to 1200 MB/s [0][1][2].
In this release ([#7359](https://github.com/broadinstitute/cromwell/pull/7359)), all **localization** functionality on the GCP backend migrates to use the more modern and performant `gcloud storage`. With sufficiently powerful worker VMs, Cromwell can now localize at up to 1200 MB/s [0][1][2].

In a future release, **delocalization** will also migrate to `gcloud storage`. As part of that upcoming change, we are considering turning on [parallel composite uploads](https://cromwell.readthedocs.io/en/stable/backends/Google/#parallel-composite-uploads) by default to maximize performance. Delocalized composite objects will no longer have an md5 checksum in their metadata; refer to the matrix below [3]. If you have compatibility concerns for your workflow, please [submit an issue](https://github.com/broadinstitute/cromwell/issues).

Expand All @@ -36,6 +56,17 @@ In a future release, **delocalization** will also migrate to `gcloud storage`. A

[3] Cromwell itself uses crc32c hashes for call caching and is not affected


### Other Improvements
* In certain cases DRS downloads have been found to hang forever. Cromwell will now time these out. ([#7416](https://github.com/broadinstitute/cromwell/pull/7416))
* Increased default Akka `client.parsing.max-response-reason-length` to 1024 ([#7406](https://github.com/broadinstitute/cromwell/pull/7406))
* Workflow Completion Callback bodies now include fully-qualified output names ([#7234](https://github.com/broadinstitute/cromwell/pull/7234))
* Improved workflow abort error handling ([#7245](https://github.com/broadinstitute/cromwell/pull/7245))
* Improved logging for troubleshooting ([#7246](https://github.com/broadinstitute/cromwell/pull/7246)) ([#7253](https://github.com/broadinstitute/cromwell/pull/7253)) ([#7388](https://github.com/broadinstitute/cromwell/pull/7388))
* Support for Intel Ice Lake chips in Life Sciences backend ([#7252](https://github.com/broadinstitute/cromwell/pull/7252))
* Fix workflows getting stuck in Aborting when WDL has a type error ([#7385](https://github.com/broadinstitute/cromwell/pull/7385))
* Updates to dependencies to fix security vulnerabilities.

## 86 Release Notes

### GCP Batch
Expand Down
Loading