Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
-
Updated
Jan 9, 2025 - Python
#
early-exit
Here are 4 public repositories matching this topic...
Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
-
Updated
Nov 21, 2024 - Python
Code for paper "EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices"
iot deep-neural-networks deep-learning inference resnet knowledge-distillation edge-computing edge-devices resnets early-exit jetson-nano branchynet edge-applications accuracy-requirements
-
Updated
May 19, 2023 - Python
Official PyTorch implementation of "LGViT: Dynamic Early Exiting for Accelerating Vision Transformer" (ACM MM 2023)
-
Updated
Nov 18, 2024 - Python
Improve this page
Add a description, image, and links to the early-exit topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the early-exit topic, visit your repo's landing page and select "manage topics."