Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set CUDA_STATIC_MATH_LIBRARIES in Python builds #4612

Conversation

KyleFromNVIDIA
Copy link
Contributor

In #4526, we introduced the CUDA_STATIC_MATH_LIBRARIES option and set it to OFF by default. We did not set it to ON in the Python builds, and as a result ended up bundling dynamic CUDA libraries. Set the option to ON in the Python build.

In rapidsai#4526, we introduced the
CUDA_STATIC_MATH_LIBRARIES option and set it to OFF by default. We
did not set it to ON in the Python builds, and as a result ended
up bundling dynamic CUDA libraries. Set the option to ON in the
Python build.
@KyleFromNVIDIA KyleFromNVIDIA requested a review from a team as a code owner August 15, 2024 18:16
@KyleFromNVIDIA KyleFromNVIDIA added bug Something isn't working non-breaking Non-breaking change labels Aug 15, 2024
@vyasr
Copy link
Contributor

vyasr commented Aug 15, 2024

Thanks Kyle, before I approve this, let's wait until a wheel build completes and we can inspect the resulting outputs. If the sizes go back down then we'll know things worked as expected.

@KyleFromNVIDIA
Copy link
Contributor Author

Comparing https://downloads.rapids.ai/ci/cugraph/branch/branch-24.10/a538745/ (before this change) to https://downloads.rapids.ai/ci/cugraph/pull-request/4612/aa83fbf/ (after this change), it looks like there was a slight reduction in wheel size, but not massive.

@vyasr
Copy link
Contributor

vyasr commented Aug 15, 2024

Interestingly, both look much smaller than what Robert was observing in his document. I would download and untar, it might be compression.

Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm recommending that we merge this fix (since it's definitely needed) and then we reassess package sizes afterwards to see if there's some other additional cause for increased wheel sizes in 24.08.

Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually sorry hold on, I'm seeing some odd things that make me want to investigate a bit more.

Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, so strictly speaking this isn't related to #4526, but rather rapidsai/raft#2376. #4526 changed the build options for cugraph_etl, which doesn't get built into the wheel anyway right, but the changes in raft needed to be propagated up since we rebuild/statically link raft in our wheels.

However, that still doesn't account for the full binary size increase. Most of that is coming from the fact that libcugraph itself seems to have nearly doubled in size from 24.06 to 24.08. We need to look into that, but we can do that independently since it's not a wheels issue (the size difference is evident even in our libcguraph conda packages).

@KyleFromNVIDIA
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit de81819 into rapidsai:branch-24.10 Aug 15, 2024
103 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working CMake non-breaking Non-breaking change python
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants