Reduce the memory usage of logits from O(context_length) to O(1) (#4688) #3825

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
gather-models	5s
test-arm-backend-delegation / linux-job	16m 14s
test-arm-reference-delegation / linux-job	15m 11s
test-coreml-delegate / macos-job	51m 55s
test-custom-ops-macos (cmake) / macos-job	30m 16s
test-demo-backend-delegation (cmake) / linux-job	5m 23s
test-demo-backend-delegation (buck2) / linux-job	6m 2s
test-llama-runner-mac (fp32, buck2, coreml) / macos-job	1m 29s
test-llama-runner-mac (fp32, buck2, mps) / macos-job	1m 18s
test-llama-runner-mac (fp32, buck2, portable) / macos-job	12m 50s
test-llama-runner-mac (fp32, buck2, xnnpack+kv+custom) / macos-job	11m 54s
test-llama-runner-mac (fp32, cmake, coreml) / macos-job	13m 20s
test-llama-runner-mac (fp32, cmake, mps) / macos-job	11m 50s
test-llama-runner-mac (fp32, cmake, portable) / macos-job	12m 37s
test-llama-runner-mac (fp32, cmake, xnnpack+kv+custom) / macos-job	13m 12s
test-pybind-build-macos (cmake) / macos-job	11m 41s
test-qnn-model (fp32, dl3) / linux-job	12m 21s
test-selective-build-macos (cmake) / macos-job	13m 0s
test-models-macos (cmake, add_mul, portable, macos-m1-stable, 90) / macos-job	10m 12s
test-models-macos (cmake, add_mul, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	15m 27s
test-models-macos (cmake, add, portable, macos-m1-stable, 90) / macos-job	10m 3s
test-models-macos (cmake, add, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	18m 15s
test-models-macos (cmake, dl3, portable, macos-m1-stable, 90) / macos-job	10m 59s
test-models-macos (cmake, dl3, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 48s
test-models-macos (cmake, edsr, portable, macos-m1-stable, 90) / macos-job	11m 29s
test-models-macos (cmake, edsr, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 1s
test-models-macos (cmake, emformer_join, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 16s
test-models-macos (cmake, emformer_join, portable, macos-m1-stable, 90) / macos-job	12m 14s
test-models-macos (cmake, emformer_transcribe, xnnpack-delegation, macos-m1-stable, 90) / macos-job	15m 18s
test-models-macos (cmake, emformer_transcribe, portable, macos-m1-stable, 90) / macos-job	10m 26s
test-models-macos (cmake, ic3, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	16m 19s
test-models-macos (cmake, ic3, portable, macos-m1-stable, 90) / macos-job	10m 27s
test-models-macos (cmake, ic4, portable, macos-m1-stable, 90) / macos-job	10m 44s
test-models-macos (cmake, ic4, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 38s
test-models-macos (cmake, linear, portable, macos-m1-stable, 90) / macos-job	10m 23s
test-models-macos (cmake, llama2, portable, macos-m1-stable, 90) / macos-job	10m 36s
test-models-macos (cmake, linear, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	15m 34s
test-models-macos (cmake, llama2, xnnpack-delegation, macos-m1-stable, 90) / macos-job	13m 25s
test-models-macos (cmake, mobilebert, portable, macos-m1-stable, 90) / macos-job	10m 29s
test-models-macos (cmake, mobilebert, xnnpack-delegation, macos-m1-stable, 90) / macos-job	15m 14s
test-models-macos (cmake, mul, portable, macos-m1-stable, 90) / macos-job	10m 19s
test-models-macos (cmake, mv2, portable, macos-m1-stable, 90) / macos-job	10m 22s
test-models-macos (cmake, mv2_untrained, portable, macos-m1-stable, 90) / macos-job	10m 21s
test-models-macos (cmake, mv2, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	15m 43s
test-models-macos (cmake, mv3, portable, macos-m1-stable, 90) / macos-job	10m 29s
test-models-macos (cmake, mv3, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	15m 49s
test-models-macos (cmake, resnet18, portable, macos-m1-stable, 90) / macos-job	13m 58s
test-models-macos (cmake, resnet18, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	16m 45s
test-models-macos (cmake, resnet50, portable, macos-m1-stable, 90) / macos-job	13m 4s
test-models-macos (cmake, softmax, portable, macos-m1-stable, 90) / macos-job	10m 43s
test-models-macos (cmake, resnet50, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 55s
test-models-macos (cmake, vit, portable, macos-m1-stable, 90) / macos-job	11m 19s
test-models-macos (cmake, vit, xnnpack-delegation, macos-m1-stable, 90) / macos-job	15m 29s
test-models-macos (cmake, w2l, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job	17m 23s
test-models-macos (cmake, w2l, portable, macos-m1-stable, 90) / macos-job	12m 49s
	12h 20m 23s

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Reduce the memory usage of logits from O(context_length) to O(1) (#4688) #3825

Usage

Reduce the memory usage of logits from O(context_length) to O(1) (#4688) #3825

Jobs

Run details

Run time