Skip to content
Back to pull request #4688

Reduce the memory usage of logits from O(context_length) to O(1) #19529

Sign in to view logs

Reduce the memory usage of logits from O(context_length) to O(1)

Reduce the memory usage of logits from O(context_length) to O(1) #19529

Annotations

1 warning

test-llama-runner-qnn-linux (fp32, cmake, qnn)  /  linux-job

test-llama-runner-qnn-linux (fp32, cmake, qnn) / linux-job
succeeded Aug 22, 2024 in 18m 58s