Running large language models on a single GPU for throughput-oriented scenarios.
-
Updated
Oct 28, 2024 - Python
#
offloading
Here are 13 public repositories matching this topic...
Run Mixtral-8x7B models in Colab or consumer desktops
deep-learning pytorch offloading quantization language-model google-colab colab-notebook mixture-of-experts llm
-
Updated
Apr 8, 2024 - Python
PyTorch native quantization and sparsity for training and inference
training sparsity cuda inference optimizer pytorch transformer offloading llama quantization mx brrr dtypes float8
-
Updated
Jan 11, 2025 - Python
A QoE-Oriented Computation Offloading Algorithm based on Deep Reinforcement Learning (DRL) for Mobile Edge Computing (MEC) | This algorithm captures the dynamics of the MEC environment by integrating the Dueling Double Deep Q-Network (D3QN) model with Long Short-Term Memory (LSTM) networks.
deep-reinforcement-learning dqn mdp offloading deep-q-network markov-decision-processes resource-management performance-evaluation mec ddqn edge-computing lstm-networks network-optimization d3qn
-
Updated
Jan 3, 2025 - Python
A lightweight framework that enables serverless users to reduce their bills by harvesting non-serverless compute resources such as their VMs, on-premise servers, or personal computers.
cloud serverless pubsub faas offloading offloading-framework google-cloud-function dag-scheduling serverless-workflow task-offloading
-
Updated
Aug 16, 2024 - Python
A framework for IoT devices to offload tasks to the cloud, resulting in efficient computation and decreased cloud costs.
-
Updated
Jun 21, 2022 - Python
Monero hardware wallet protocol implementation for Trezor, agent
python protocol ed25519 trezor hardware-wallet offloading monero cryptonote transaction-signer bulletproofs trezor-crypto monero-agent trezor-monero borromean ringct key-image-sync
-
Updated
Sep 23, 2022 - Python
Code for paper "Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI" (MobiCom'22)
-
Updated
Apr 13, 2023 - Python
Backend.AI Client Library for Python
-
Updated
Sep 22, 2023 - Python
A Pandas-inspired data analysis project with lazy semantics and query-offloading to SQLite
-
Updated
Feb 25, 2021 - Python
-
Updated
May 2, 2019 - Python
Ferramenta para a criação de ambientes de testes com dispositivos Android
android docker offloading android-emulator command-line-tool docker-android testbed mobile-cloud-computing
-
Updated
Oct 19, 2020 - Python
Offloading Resource-Intensive Tasks to Raspberry Pi (or IoT Devices) Using SSH
-
Updated
Dec 22, 2023 - Python
Improve this page
Add a description, image, and links to the offloading topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the offloading topic, visit your repo's landing page and select "manage topics."