Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UCT/ROCM: add control of ipc cache usage #10497

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

edgargabriel
Copy link
Contributor

@edgargabriel edgargabriel commented Feb 17, 2025

What?

add a UCX parameter that allows to control whether we want to use the rocm_ipc handle cache.

Why?

There are some situation where caching the IPC handles/registrations is detrimental for a multitude of reasons.

@edgargabriel edgargabriel force-pushed the topic/disable-ipc-cache branch from 1183f77 to 70ab0b9 Compare February 17, 2025 21:20
@edgargabriel edgargabriel changed the title uct/rocm: add control of ipc cache usage rocm/ipc: add control of ipc cache usage Feb 17, 2025
@edgargabriel edgargabriel changed the title rocm/ipc: add control of ipc cache usage UCT/ROCM: add control of ipc cache usage Feb 17, 2025
@edgargabriel edgargabriel force-pushed the topic/disable-ipc-cache branch from 70ab0b9 to 17166be Compare February 17, 2025 21:23
@@ -201,6 +205,7 @@ static UCS_CLASS_INIT_FUNC(uct_rocm_ipc_iface_t, uct_md_h md, uct_worker_h worke

self->config.min_zcopy = config->min_zcopy;
self->config.latency = config->latency;
self->config.enable_ipc_handle_cache = config->enable_ipc_handle_cache;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code style - align = on column

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

yosefe
yosefe previously approved these changes Feb 21, 2025
@edgargabriel edgargabriel force-pushed the topic/disable-ipc-cache branch from c36008b to e0c0ff8 Compare February 26, 2025 18:10
@edgargabriel
Copy link
Contributor Author

squashed the commits

tvegas1
tvegas1 previously approved these changes Mar 3, 2025
@yosefe
Copy link
Contributor

yosefe commented Mar 5, 2025

@edgargabriel pls squash

- add a UCX parameter that allows to control whether we want to use the
ipc handle cache.
- restructure structs in header

Signed-off-by: Edgar Gabriel <Edgar.Gabriel@amd.com>
Co-authored-by: Raul Akhmetshin <74596089+rakhmets@users.noreply.github.com>
@edgargabriel edgargabriel force-pushed the topic/disable-ipc-cache branch from a94ed0e to 918e22b Compare March 5, 2025 08:03
@yosefe yosefe enabled auto-merge March 5, 2025 11:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants