Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RELEASE] dask-cuda v0.16 #418

Merged
merged 33 commits into from
Oct 21, 2020
Merged

[RELEASE] dask-cuda v0.16 #418

merged 33 commits into from
Oct 21, 2020

Conversation

GPUtester
Copy link
Contributor

❄️ Code freeze for branch-0.16 and v0.16 release

What does this mean?

Only critical/hotfix level issues should be merged into branch-0.16 until release (merging of this PR).

What is the purpose of this PR?

  • Update documentation
  • Allow testing for the new release
  • Enable a means to merge branch-0.16 into main for the release

raydouglass and others added 30 commits August 6, 2020 15:45
@raydouglass
DOC v0.16 Updates
f4ab9f2
@GPUtester
Merge pull request #354 from rapidsai/branch-0.15
fd78eb7 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #362 from rapidsai/branch-0.15
ecd1064 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #365 from rapidsai/branch-0.15
51e42b9 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #366 from rapidsai/branch-0.15
ecc4f61 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #370 from rapidsai/branch-0.15
11a21a5 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #372 from rapidsai/branch-0.15
5123f79 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #374 from rapidsai/branch-0.15
82a84b0 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #377 from rapidsai/branch-0.15
c1bc1b4 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #381 from rapidsai/branch-0.15
26eb189 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #382 from rapidsai/branch-0.15
ac44e4e 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #386 from rapidsai/branch-0.15
e4583ea 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #387 from rapidsai/branch-0.15
8224059 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #388 from rapidsai/branch-0.15
a23ea45 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #392 from rapidsai/branch-0.15
628a1d3 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@GPUtester
Merge pull request #393 from rapidsai/branch-0.15
71fad3a 
[gpuCI] Auto-merge branch-0.15 to branch-0.16 [skip ci]
@quasiben
parse pool size only when set
b993c8b
@pentschev
Parse pool size only when set in LocalCUDACluster
68ef6d4
@pentschev
Remove unnecessary pool size parsing in CUDAWorker
2693b0e
@pentschev
Test for RMM pool and managed memory separately
e148c32
@pentschev
Merge pull request #396 from quasiben/fix/rmm-managed
3811951 
Parse pool size only when set
@necaris
Allow scheduler to be passed as keyword not positional
2d8ec6a
@necaris
Use dask.config for finding scheduler-address
bd85795 
This means that e.g. setting the environment variable
`DASK_SCHEDULER_ADDRESS` will work
@quasiben
Update dask_cuda/cuda_worker.py
d536ad5
@quasiben
Merge pull request #397 from necaris/fix-cudaworker-init-and-schedule…
2fa52fe 
…r-address-parsing

Improve CUDAWorker scheduler-address parsing and __init__
@jakirkham
Add benchmark for da.map_overlap
537f551
@pentschev
Merge pull request #399 from jakirkham/add_map_overlap_bench
8d42f27 
Add benchmark for `da.map_overlap`
@madsbk
Dataframe shuffle using explicit-comms (#401)
b6cfacc 
* explicit-comms: moved shuffle to its own file

* explicit-comms: implemented dataframe shuffle

* simplified the API

* Using Dask's _concat()
@quasiben @madsbk
Run dask nvml tests (#408)
93458a4 
* Dataframe shuffle using explicit-comms (#401)

* explicit-comms: moved shuffle to its own file

* explicit-comms: implemented dataframe shuffle

* simplified the API

* Using Dask's _concat()

* run nvml tests from dask.distributed

* remove deleted test from dask

Co-authored-by: Mads R. B. Kristensen <madsbk@gmail.com>
@pentschev @jakirkham
Try to import NVTX from its own module (#406)
04dcbb6 
Co-authored-by: John Kirkham <jakirkham@gmail.com>
@pentschev
Skip tests that require cuDF/UCX-Py, when not installed (#411)
0411e3b 
* Skip cuDF explicit_comms tests when not installed

* Skip UCX tests when UCX-Py is not installed

* Fix flake8 formatting

* Fix black formatting
@GPUtester GPUtester requested review from a team as code owners October 16, 2020 14:33
@codecov-io
Copy link

codecov-io commented Oct 16, 2020 •
edited
Loading

Codecov Report

Merging #418 into main will decrease coverage by 3.14%.
The diff coverage is 44.31%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #418      +/-   ##
==========================================
- Coverage   60.04%   56.89%   -3.15%     
==========================================
  Files          17       19       +2     
  Lines        1344     1443      +99     
==========================================
+ Hits          807      821      +14     
- Misses        537      622      +85
Impacted Files Coverage Δ
dask_cuda/benchmarks/local_cupy_map_overlap.py 0.00% <0.00%> (ø)
dask_cuda/local_cuda_cluster.py 82.95% <66.66%> (+0.93%) ⬆️
dask_cuda/explicit_comms/dataframe_shuffle.py 95.52% <95.52%> (ø)
dask_cuda/cuda_worker.py 72.28% <100.00%> (+0.86%) ⬆️
dask_cuda/explicit_comms/__init__.py 100.00% <100.00%> (ø)
dask_cuda/explicit_comms/dataframe_merge.py 90.38% <100.00%> (-0.45%) ⬇️
dask_cuda/utils.py 87.40% <100.00%> (+0.09%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 712364e...0411e3b. Read the comment docs.

@jakirkham
Copy link
Member

rerun tests

@raydouglass raydouglass merged commit 4ec39de into main Oct 21, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
9 participants
@GPUtester @codecov-io @jakirkham @raydouglass @quasiben @pentschev @necaris @madsbk @ajschmidt8