[ROCm] Using a more precise memory profiling#12624

Open

gshtras wants to merge 3 commits intovllm-project:mainfrom ROCm:mem_profile_upstream

+2-1

Commits on Jan 31, 2025

Using a more precise profiling on ROCm to properly account for weights padding (#394 )
gshtras
committed

Commits on Feb 6, 2025