Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.2k 96

  2. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 34 8

  3. sd-api-server sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 17 2

  4. whisper-api-server whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 10 3

  5. tts-api-server tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 7 1

  6. llama-proxy-server llama-proxy-server Public

    Rust 2

Repositories

Showing 10 of 23 repositories
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/LlamaEdge’s past year of commit activity
    Rust 1,155 Apache-2.0 96 4 2 Updated Dec 26, 2024
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    LlamaEdge/rag-api-server’s past year of commit activity
    Rust 34 Apache-2.0 8 11 2 Updated Dec 25, 2024
  • talktalk Public
    LlamaEdge/talktalk’s past year of commit activity
    Shell 13 1 0 0 Updated Dec 23, 2024
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/tts-api-server’s past year of commit activity
    Rust 7 1 1 0 Updated Dec 16, 2024
  • sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/sd-api-server’s past year of commit activity
    Rust 17 2 5 0 Updated Dec 16, 2024
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/whisper-api-server’s past year of commit activity
    Rust 10 3 0 0 Updated Dec 16, 2024
  • chatbot-ui Public
    LlamaEdge/chatbot-ui’s past year of commit activity
    TypeScript 17 MIT 13 1 0 Updated Dec 11, 2024
  • WavUp Public
    LlamaEdge/WavUp’s past year of commit activity
    Rust 2 0 0 0 Updated Dec 10, 2024
  • LlamaEdge/llama-proxy-server’s past year of commit activity
    Rust 2 0 0 0 Updated Dec 9, 2024
  • LlamaEdge/stock-analyst’s past year of commit activity
    Python 2 1 0 1 Updated Dec 2, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…