Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.4k 114

  2. rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 49 11

  3. sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 20 2

  4. whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 13 3

  5. tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 9 2

  6. LlamaEdge-Nexus Public

    Rust 3

Repositories

Showing 10 of 25 repositories
  • kw-search-server Public
    Rust 0 0 0 0 Updated Apr 26, 2025
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1,359 Apache-2.0 114 3 2 Updated Apr 25, 2025
  • docs Public
    JavaScript 4 Apache-2.0 6 0 1 Updated Apr 21, 2025
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 49 Apache-2.0 11 12 2 Updated Apr 14, 2025
  • chatbot-ui Public
    TypeScript 20 MIT 20 1 0 Updated Apr 1, 2025
  • LlamaEdge-Nexus Public
    Rust 3 0 0 0 Updated Mar 28, 2025
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 13 3 0 0 Updated Mar 19, 2025
  • www Public

    Public website

    HTML 0 3 0 0 Updated Mar 10, 2025
  • sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 20 2 5 0 Updated Mar 5, 2025
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 9 2 1 0 Updated Mar 5, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…