Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bifurcate Dependency Lists [skip-gpuci] #11674

Merged
merged 31 commits into from
Nov 8, 2022
Merged
Show file tree
Hide file tree
Changes from 29 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
cc91dbf
Initial dependency file.
bdice Sep 8, 2022
b43682c
Migrate to generated dependency file.
bdice Sep 8, 2022
6825726
Merge remote-tracking branch 'upstream/branch-22.12' into split-deps
bdice Oct 27, 2022
e18ebce
Update versions and TODO notes.
bdice Oct 27, 2022
9e3b889
Merge remote-tracking branch 'upstream/branch-22.12' into split-deps
bdice Nov 1, 2022
28e745c
Update to drafted schema changes.
bdice Nov 1, 2022
a08111c
Rerun 0.0.20.
bdice Nov 4, 2022
ccda640
Merge remote-tracking branch 'upstream/branch-22.12' into split-deps
bdice Nov 4, 2022
78433a5
Update cuda-python.
bdice Nov 4, 2022
b3a7c60
Remove outdated dependencies on double-conversion and rapidjson.
bdice Nov 4, 2022
b14bf80
Updating TODO items.
bdice Nov 4, 2022
dc50330
Remove style check packages handled by pre-commit.
bdice Nov 4, 2022
6fb0858
Update moto to avoid werkzeug breakage.
bdice Nov 4, 2022
fe65899
Remove style checkers, gcovr, clang, cmake_setuptools.
bdice Nov 4, 2022
c936788
Update pinnings (tested locally).
bdice Nov 4, 2022
f5a5675
Update comment.
bdice Nov 4, 2022
e261a16
Update checks.
bdice Nov 7, 2022
bd886b6
Update dependency-files.yml
bdice Nov 7, 2022
ede4833
Put cuda-python in common packages.
bdice Nov 7, 2022
65bd9ad
Move cudatoolkit.
bdice Nov 7, 2022
6d68f34
Update dependencies.yaml versions on release.
bdice Nov 7, 2022
fd4a781
Ensure that rapids-dependency-file-generator fails in CI.
bdice Nov 7, 2022
aee5118
Revert "Ensure that rapids-dependency-file-generator fails in CI."
bdice Nov 7, 2022
e814cb5
Split test_cpp, test_python
bdice Nov 7, 2022
a47817a
Sort sections alphabetically.
bdice Nov 7, 2022
934acb8
Remove extra channels.
bdice Nov 7, 2022
b3b41a3
Add py_version.
bdice Nov 7, 2022
98451f3
Update dependencies.yaml
bdice Nov 7, 2022
c6cc1e0
Add back channels.
bdice Nov 7, 2022
c29e6bc
Update dependencies.yaml
bdice Nov 7, 2022
d9e7bb8
Update conda/environments/all_cuda-115_arch-x86_64.yaml
bdice Nov 7, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions .github/workflows/dependency-files.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
name: pr

on:
pull_request:

jobs:
checks:
secrets: inherit
uses: rapidsai/shared-action-workflows/.github/workflows/checks.yaml@main
with:
enable_check_size: false
enable_check_style: false
7 changes: 2 additions & 5 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -99,13 +99,13 @@ cd $CUDF_HOME
**Note:** Using a conda environment is the easiest way to satisfy the library's dependencies.
Instructions for a minimal build environment without conda are included below.

- Create the conda development environment `cudf_dev`:
- Create the conda development environment:

```bash
# create the conda environment (assuming in base `cudf` directory)
# note: RAPIDS currently doesn't support `channel_priority: strict`;
# use `channel_priority: flexible` instead
conda env create --name cudf_dev --file conda/environments/cudf_dev_cuda11.5.yml
conda env create --name cudf_dev --file conda/environments/all_cuda-115_arch-x86_64.yaml
# activate the environment
conda activate cudf_dev
```
Expand All @@ -114,9 +114,6 @@ conda activate cudf_dev
development environment may also need to be updated if dependency versions or
pinnings are changed.

- For other CUDA versions, check the corresponding `cudf_dev_cuda*.yml` file in
`conda/environments/`.

#### Building without a conda environment

- libcudf has the following minimal dependencies (in addition to those listed in the [General
Expand Down
5 changes: 3 additions & 2 deletions ci/release/update-version.sh
Original file line number Diff line number Diff line change
Expand Up @@ -63,9 +63,10 @@ sed_runner 's/version = .*/version = '"'${NEXT_SHORT_TAG}'"'/g' docs/cudf/source
sed_runner 's/release = .*/release = '"'${NEXT_FULL_TAG}'"'/g' docs/cudf/source/conf.py

# bump rmm & dask-cuda
for FILE in conda/environments/*.yml; do
sed_runner "s/rmm=${CURRENT_SHORT_TAG}/rmm=${NEXT_SHORT_TAG}/g" ${FILE};
for FILE in conda/environments/*.yaml dependencies.yaml; do
sed_runner "s/dask-cuda=${CURRENT_SHORT_TAG}/dask-cuda=${NEXT_SHORT_TAG}/g" ${FILE};
sed_runner "s/rmm=${CURRENT_SHORT_TAG}/rmm=${NEXT_SHORT_TAG}/g" ${FILE};
sed_runner "s/rmm-cu11=${CURRENT_SHORT_TAG}/rmm-cu11=${NEXT_SHORT_TAG}/g" ${FILE};
done

# Doxyfile update
Expand Down
75 changes: 75 additions & 0 deletions conda/environments/all_cuda-115_arch-x86_64.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
# This file is generated by `rapids-dependency-file-generator`.
# To make changes, edit ../../dependencies.yaml and run `rapids-dependency-file-generator`.
channels:
- rapidsai
- conda-forge
bdice marked this conversation as resolved.
Show resolved Hide resolved
dependencies:
- aiobotocore>=2.2.0
- arrow-cpp=9
- boto3>=1.21.21
- botocore>=1.24.21
- c-compiler
- cachetools
- cmake>=3.23.1
- cubinlinker
- cuda-python>=11.7.1,<12.0
- cudatoolkit=11.5
- cupy>=9.5.0,<12.0.0a0
- cxx-compiler
- cython>=0.29,<0.30
- dask-cuda=22.12.*
- dask>=2022.9.2
- distributed>=2022.9.2
- dlpack>=0.5,<0.6.0a0
- doxygen=1.8.20
- fastavro>=0.22.9
- fsspec>=0.6.0
- gcc_linux-64=9.*
- hypothesis
- ipython
- librdkafka=1.7.0
- mimesis>=4.1.0
- moto>=4.0.8
- myst-nb
- nbsphinx
- notebook>=0.5.0
- numba>=0.56.2
- numpy
- numpydoc
- nvcc_linux-64=11.5
- nvtx>=0.2.1
- packaging
- pandas>=1.0,<1.6.0dev0
- pandoc<=2.0.0
- pip
- pre-commit
- protobuf>=3.20.1,<3.21.0a0
- ptxcompiler
- pyarrow=9.0.0
- pydata-sphinx-theme
- pytest
- pytest-benchmark
- pytest-cases
- pytest-cov
- pytest-xdist
- python-confluent-kafka=1.7.0
- python-snappy>=0.6.0
- python>=3.8,<3.10
- pytorch<1.12.0
- rmm=22.12.*
- s3fs>=2022.3.0
- scikit-build>=0.13.1
- scipy
- sphinx
- sphinx-autobuild
- sphinx-copybutton
- sphinx-markdown-tables
- sphinxcontrib-websupport
- streamz
- sysroot_linux-64==2.17
- transformers
- typing_extensions
- pip:
- git+https://github.com/python-streamz/streamz.git@master
- pyorc
name: all_cuda-115_arch-x86_64
86 changes: 0 additions & 86 deletions conda/environments/cudf_dev_cuda11.5.yml

This file was deleted.

Loading