Merge pull request #2514 from rapidsai/branch-22.08

.github/ops-bot.yaml

@@ -5,4 +5,5 @@ auto_merger: true
 branch_checker: true
 label_checker: true
 release_drafter: true
-external_contributors: false
+copy_prs: true
+rerun_tests: true

.gitignore

@@ -29,11 +29,15 @@ junit-cugraph.xml
 test-results
 
 ## Python build directories & artifacts
+dask-worker-space/
 htmlcov
 dist/
 cugraph.egg-info/
 python/build
 python/cugraph/bindings/*.cpp
+wheels/
+_skbuild/
+cufile.log
 
 ## pylibcugraph build directories & artifacts
 python/pylibcugraph/pylibcugraph.egg-info

CHANGELOG.md

@@ -1,3 +1,113 @@
+# cuGraph 22.08.00 (17 Aug 2022)
+
+## 🚨 Breaking Changes
+
+- Change default return type `PropertyGraph.extract_subgraph() -> cugraph.Graph(directed=True)` ([#2460](https://github.com/rapidsai/cugraph/pull/2460)) [@eriknw](https://github.com/eriknw)
+- cuGraph code cleanup ([#2431](https://github.com/rapidsai/cugraph/pull/2431)) [@seunghwak](https://github.com/seunghwak)
+- Clean up public api ([#2398](https://github.com/rapidsai/cugraph/pull/2398)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Delete old nbr sampling software ([#2371](https://github.com/rapidsai/cugraph/pull/2371)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Remove GraphCSC/GraphCSCView object, no longer used ([#2354](https://github.com/rapidsai/cugraph/pull/2354)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Replace raw pointers with device_span in induced subgraph ([#2348](https://github.com/rapidsai/cugraph/pull/2348)) [@yang-hu-nv](https://github.com/yang-hu-nv)
+- Clean up some unused code in the C API (and beyond) ([#2339](https://github.com/rapidsai/cugraph/pull/2339)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Performance-optimize storing edge partition source/destination properties in (key, value) pairs ([#2328](https://github.com/rapidsai/cugraph/pull/2328)) [@seunghwak](https://github.com/seunghwak)
+- Remove legacy katz ([#2324](https://github.com/rapidsai/cugraph/pull/2324)) [@ChuckHastings](https://github.com/ChuckHastings)
+
+## 🐛 Bug Fixes
+
+- Fix PropertyGraph MG tests ([#2511](https://github.com/rapidsai/cugraph/pull/2511)) [@eriknw](https://github.com/eriknw)
+- Update `k_core.py` to Check for Graph Direction ([#2507](https://github.com/rapidsai/cugraph/pull/2507)) [@oorliu](https://github.com/oorliu)
+- fix non-deterministic bug in uniform neighborhood sampling ([#2477](https://github.com/rapidsai/cugraph/pull/2477)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Fix typos in Python CMakeLists CUDA arch file ([#2475](https://github.com/rapidsai/cugraph/pull/2475)) [@vyasr](https://github.com/vyasr)
+- Updated imports to be compatible with latest version of cupy ([#2473](https://github.com/rapidsai/cugraph/pull/2473)) [@rlratzel](https://github.com/rlratzel)
+- Fix pandas SettingWithCopyWarning, which really shouldn't be ignored. ([#2447](https://github.com/rapidsai/cugraph/pull/2447)) [@eriknw](https://github.com/eriknw)
+- fix handling of fanout == -1 ([#2435](https://github.com/rapidsai/cugraph/pull/2435)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Add options to `extract_subgraph()` to bypass renumbering and adding edge_data, exclude internal `_WEIGHT_` column from `edge_property_names`, added `num_vertices_with_properties` attr ([#2419](https://github.com/rapidsai/cugraph/pull/2419)) [@rlratzel](https://github.com/rlratzel)
+- Remove the comms import from cugraph's init file ([#2402](https://github.com/rapidsai/cugraph/pull/2402)) [@jnke2016](https://github.com/jnke2016)
+- Bug fix (providing invalid sentinel value for cuCollection). ([#2382](https://github.com/rapidsai/cugraph/pull/2382)) [@seunghwak](https://github.com/seunghwak)
+- add debug print for betweenness centrality, fix typo ([#2369](https://github.com/rapidsai/cugraph/pull/2369)) [@jnke2016](https://github.com/jnke2016)
+- Bug fix for decompressing partial edge list and using (key, value) pairs for major properties. ([#2366](https://github.com/rapidsai/cugraph/pull/2366)) [@seunghwak](https://github.com/seunghwak)
+- Fix Fanout -1 ([#2358](https://github.com/rapidsai/cugraph/pull/2358)) [@VibhuJawa](https://github.com/VibhuJawa)
+- Update sampling primitive again, fix hypersparse computations ([#2353](https://github.com/rapidsai/cugraph/pull/2353)) [@ChuckHastings](https://github.com/ChuckHastings)
+- added test cases and verified that algorithm works for undirected graphs ([#2349](https://github.com/rapidsai/cugraph/pull/2349)) [@acostadon](https://github.com/acostadon)
+- Fix sampling bug ([#2343](https://github.com/rapidsai/cugraph/pull/2343)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Fix triangle count ([#2325](https://github.com/rapidsai/cugraph/pull/2325)) [@ChuckHastings](https://github.com/ChuckHastings)
+
+## 📖 Documentation
+
+- Defer loading of `custom.js` ([#2506](https://github.com/rapidsai/cugraph/pull/2506)) [@galipremsagar](https://github.com/galipremsagar)
+- Centralize common `css` & `js` code in docs ([#2472](https://github.com/rapidsai/cugraph/pull/2472)) [@galipremsagar](https://github.com/galipremsagar)
+- Fix issues with day & night modes in python docs ([#2471](https://github.com/rapidsai/cugraph/pull/2471)) [@galipremsagar](https://github.com/galipremsagar)
+- Use Datasets API to Update Docstring Examples ([#2441](https://github.com/rapidsai/cugraph/pull/2441)) [@oorliu](https://github.com/oorliu)
+- README updates ([#2395](https://github.com/rapidsai/cugraph/pull/2395)) [@BradReesWork](https://github.com/BradReesWork)
+- Switch `language` from `None` to `"en"` in docs build ([#2368](https://github.com/rapidsai/cugraph/pull/2368)) [@galipremsagar](https://github.com/galipremsagar)
+- Doxygen improvements to improve documentation of C API ([#2355](https://github.com/rapidsai/cugraph/pull/2355)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Update multi-GPU example to include data generation ([#2345](https://github.com/rapidsai/cugraph/pull/2345)) [@charlesbluca](https://github.com/charlesbluca)
+
+## 🚀 New Features
+
+- Cost Matrix first version ([#2377](https://github.com/rapidsai/cugraph/pull/2377)) [@acostadon](https://github.com/acostadon)
+
+## 🛠️ Improvements
+
+- Pin `dask` & `distributed` for release ([#2478](https://github.com/rapidsai/cugraph/pull/2478)) [@galipremsagar](https://github.com/galipremsagar)
+- Update PageRank to leverage pylibcugraph ([#2467](https://github.com/rapidsai/cugraph/pull/2467)) [@jnke2016](https://github.com/jnke2016)
+- Change default return type `PropertyGraph.extract_subgraph() -> cugraph.Graph(directed=True)` ([#2460](https://github.com/rapidsai/cugraph/pull/2460)) [@eriknw](https://github.com/eriknw)
+- Updates to Link Notebooks ([#2456](https://github.com/rapidsai/cugraph/pull/2456)) [@acostadon](https://github.com/acostadon)
+- Only build cugraphmgtestutil when requested ([#2454](https://github.com/rapidsai/cugraph/pull/2454)) [@robertmaynard](https://github.com/robertmaynard)
+- Datasets API Update: Add Extra Params and Improve Testing ([#2453](https://github.com/rapidsai/cugraph/pull/2453)) [@oorliu](https://github.com/oorliu)
+- Uniform neighbor sample ([#2450](https://github.com/rapidsai/cugraph/pull/2450)) [@VibhuJawa](https://github.com/VibhuJawa)
+- Don't store redundant columns in PropertyGraph Dataframes ([#2449](https://github.com/rapidsai/cugraph/pull/2449)) [@eriknw](https://github.com/eriknw)
+- Changes to Cores, components and layout notebooks ([#2448](https://github.com/rapidsai/cugraph/pull/2448)) [@acostadon](https://github.com/acostadon)
+- Added `get_vertex_data()` and `get_edge_data()` to SG/MG PropertyGraph ([#2444](https://github.com/rapidsai/cugraph/pull/2444)) [@rlratzel](https://github.com/rlratzel)
+- Remove OpenMP dependencies from CMake ([#2443](https://github.com/rapidsai/cugraph/pull/2443)) [@seunghwak](https://github.com/seunghwak)
+- Use Datasets API to Update Notebook Examples ([#2440](https://github.com/rapidsai/cugraph/pull/2440)) [@oorliu](https://github.com/oorliu)
+- Refactor MG C++ tests (handle initialization) ([#2439](https://github.com/rapidsai/cugraph/pull/2439)) [@seunghwak](https://github.com/seunghwak)
+- Branch 22.08 merge 22.06 ([#2436](https://github.com/rapidsai/cugraph/pull/2436)) [@rlratzel](https://github.com/rlratzel)
+- Add get_num_vertices and get_num_edges methods to PropertyGraph. ([#2434](https://github.com/rapidsai/cugraph/pull/2434)) [@eriknw](https://github.com/eriknw)
+- Make cuco a private dependency and leverage rapids-cmake ([#2432](https://github.com/rapidsai/cugraph/pull/2432)) [@vyasr](https://github.com/vyasr)
+- cuGraph code cleanup ([#2431](https://github.com/rapidsai/cugraph/pull/2431)) [@seunghwak](https://github.com/seunghwak)
+- Add core number to the python API ([#2414](https://github.com/rapidsai/cugraph/pull/2414)) [@jnke2016](https://github.com/jnke2016)
+- Enable concurrent broadcasts in update_edge_partition_minor_property() ([#2413](https://github.com/rapidsai/cugraph/pull/2413)) [@seunghwak](https://github.com/seunghwak)
+- Optimize has_duplicate_edges ([#2409](https://github.com/rapidsai/cugraph/pull/2409)) [@VibhuJawa](https://github.com/VibhuJawa)
+- Define API for MG random walk ([#2407](https://github.com/rapidsai/cugraph/pull/2407)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Support building without cugraph-ops ([#2405](https://github.com/rapidsai/cugraph/pull/2405)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Clean up public api ([#2398](https://github.com/rapidsai/cugraph/pull/2398)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Community notebook updates structure/testing/improvement ([#2397](https://github.com/rapidsai/cugraph/pull/2397)) [@acostadon](https://github.com/acostadon)
+- Run relevant CI tests based on what's changed in the ChangeList ([#2396](https://github.com/rapidsai/cugraph/pull/2396)) [@anandhkb](https://github.com/anandhkb)
+- Update `Graph` to store a Pylibcugraph Graph (SG/MG Graph) ([#2394](https://github.com/rapidsai/cugraph/pull/2394)) [@alexbarghi-nv](https://github.com/alexbarghi-nv)
+- Moving Centrality notebooks to new structure and updating/testing ([#2388](https://github.com/rapidsai/cugraph/pull/2388)) [@acostadon](https://github.com/acostadon)
+- Add conda compilers to env file ([#2384](https://github.com/rapidsai/cugraph/pull/2384)) [@vyasr](https://github.com/vyasr)
+- Add get_node_storage and get_edge_storage to CuGraphStorage ([#2381](https://github.com/rapidsai/cugraph/pull/2381)) [@VibhuJawa](https://github.com/VibhuJawa)
+- Pin max version of `cuda-python` to `11.7.0` ([#2380](https://github.com/rapidsai/cugraph/pull/2380)) [@Ethyling](https://github.com/Ethyling)
+- Update cugraph python build ([#2378](https://github.com/rapidsai/cugraph/pull/2378)) [@jnke2016](https://github.com/jnke2016)
+- Delete old nbr sampling software ([#2371](https://github.com/rapidsai/cugraph/pull/2371)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Add datasets API to import graph data from configuration/metadata files ([#2367](https://github.com/rapidsai/cugraph/pull/2367)) [@betochimas](https://github.com/betochimas)
+- Skip reduction for zero (in|out-)degree vertices. ([#2365](https://github.com/rapidsai/cugraph/pull/2365)) [@seunghwak](https://github.com/seunghwak)
+- Update Python version support. ([#2363](https://github.com/rapidsai/cugraph/pull/2363)) [@bdice](https://github.com/bdice)
+- Branch 22.08 merge 22.06 ([#2362](https://github.com/rapidsai/cugraph/pull/2362)) [@rlratzel](https://github.com/rlratzel)
+- Support raft updating to new version of cuco ([#2360](https://github.com/rapidsai/cugraph/pull/2360)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Branch 22.08 merge 22.06 ([#2359](https://github.com/rapidsai/cugraph/pull/2359)) [@rlratzel](https://github.com/rlratzel)
+- Remove topology header ([#2357](https://github.com/rapidsai/cugraph/pull/2357)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Switch back to PC generator ([#2356](https://github.com/rapidsai/cugraph/pull/2356)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Remove GraphCSC/GraphCSCView object, no longer used ([#2354](https://github.com/rapidsai/cugraph/pull/2354)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Resolve Forward merging of branch-22.06 into branch-22.08 ([#2350](https://github.com/rapidsai/cugraph/pull/2350)) [@jnke2016](https://github.com/jnke2016)
+- Replace raw pointers with device_span in induced subgraph ([#2348](https://github.com/rapidsai/cugraph/pull/2348)) [@yang-hu-nv](https://github.com/yang-hu-nv)
+- Some legacy BFS cleanup ([#2347](https://github.com/rapidsai/cugraph/pull/2347)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Remove legacy sssp implementation ([#2344](https://github.com/rapidsai/cugraph/pull/2344)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Unpin `dask` & `distributed` for development ([#2342](https://github.com/rapidsai/cugraph/pull/2342)) [@galipremsagar](https://github.com/galipremsagar)
+- Release notebook: Nx Generators & Adding Perf_counter ([#2341](https://github.com/rapidsai/cugraph/pull/2341)) [@oorliu](https://github.com/oorliu)
+- Clean up some unused code in the C API (and beyond) ([#2339](https://github.com/rapidsai/cugraph/pull/2339)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Add core number to the C API ([#2338](https://github.com/rapidsai/cugraph/pull/2338)) [@betochimas](https://github.com/betochimas)
+- Update the list of algos to benchmark ([#2337](https://github.com/rapidsai/cugraph/pull/2337)) [@jnke2016](https://github.com/jnke2016)
+- Default GPU_COUNT to 1 in cmake file ([#2336](https://github.com/rapidsai/cugraph/pull/2336)) [@ChuckHastings](https://github.com/ChuckHastings)
+- DOC Fix for Renumber-2.ipynb ([#2335](https://github.com/rapidsai/cugraph/pull/2335)) [@oorliu](https://github.com/oorliu)
+- Resolve conflicts for merge from branch-22.06 to branch-22.08 ([#2334](https://github.com/rapidsai/cugraph/pull/2334)) [@rlratzel](https://github.com/rlratzel)
+- update versions to 22.08 ([#2332](https://github.com/rapidsai/cugraph/pull/2332)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Fix experimental labels ([#2331](https://github.com/rapidsai/cugraph/pull/2331)) [@alexbarghi-nv](https://github.com/alexbarghi-nv)
+- Performance-optimize storing edge partition source/destination properties in (key, value) pairs ([#2328](https://github.com/rapidsai/cugraph/pull/2328)) [@seunghwak](https://github.com/seunghwak)
+- Remove legacy katz ([#2324](https://github.com/rapidsai/cugraph/pull/2324)) [@ChuckHastings](https://github.com/ChuckHastings)
+- Add missing Thrust includes ([#2310](https://github.com/rapidsai/cugraph/pull/2310)) [@bdice](https://github.com/bdice)
+
 # cuGraph 22.06.00 (7 Jun 2022)
 
 ## 🚨 Breaking Changes

MANIFEST.in

@@ -1,2 +1,4 @@
 include python/versioneer.py
-include python/cugraph/_version.py
+include python/cugraph/_version.py
+include cugraph/experimental/datasets/*.yaml
+include cugraph/experimental/datasets/metadata/*.yaml