Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
-
Updated
Dec 3, 2024 - JavaScript
#
ggml
Here are 5 public repositories matching this topic...
JavaScript bindings for the ggml-js library
-
Updated
Dec 10, 2023 - JavaScript
Introducing Project Zephyrine: Elevating Your Interaction Plug and Play, and Employing GPU Acceleration within a Modernized Automata Local Graphical User Interface.
electron gui automation metal opencl cuda falcon llama ada gemma gpt-3 llm chatgpt ggml llama-2 gguf llama-3
-
Updated
Feb 26, 2025 - JavaScript
Bring your own copilot server and customize commands to refactor instead of autofill or tabbed completion.
-
Updated
Aug 3, 2023 - JavaScript
Improve this page
Add a description, image, and links to the ggml topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ggml topic, visit your repo's landing page and select "manage topics."