Skip to content
This repository has been archived by the owner on Nov 25, 2024. It is now read-only.

Add initial support of distributed sampling #171

Merged
merged 5 commits into from
May 29, 2024

Conversation

chang-l
Copy link
Contributor

@chang-l chang-l commented May 24, 2024

This PR introduces support for distributed graph sampling (via NCCL backend). The initial implementation focuses on the uniform neighbor sampler.
We are going to extend it to support other samplers in future.

Highlights:

  • Distributed Graph Storage: Now, the graph structure (represented by row_ptr and col_indx tensors) can be stored as wholememory arrays in a distributed fashion with even distribution across ranks (support both cpu and cuda storage type).
  • Distributed Sampling: The sampling process leverages the existing wholegraph gather function to collect the sampled nodes and edges across all ranks.
  • Uniform Neighbor Sampler Support: Currently, only the uniform neighbor sampler is supported.

cc. @linhu-nv @dongxuy04 @BradReesWork @nvcastet @TristonC

Copy link

copy-pr-bot bot commented May 24, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@chang-l chang-l changed the title Add initial support for distributed NCCL sampling Add initial support of distributed sampling May 24, 2024
Copy link
Contributor

@linhu-nv linhu-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems good to me.

@chuangz0 chuangz0 added feature request New feature or request non-breaking Introduces a non-breaking change labels May 28, 2024
@BradReesWork
Copy link
Member

/okay to test

@BradReesWork
Copy link
Member

/okay to test

@BradReesWork
Copy link
Member

/merge

@rapids-bot rapids-bot bot merged commit ae3748a into rapidsai:branch-24.06 May 29, 2024
48 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature request New feature or request non-breaking Introduces a non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants