Skip to content

Commit

Permalink
docs(README): replace llama.cpp link with python bindings
Browse files Browse the repository at this point in the history
  • Loading branch information
McPatate committed Feb 12, 2024
1 parent 4891468 commit 8926969
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ Note that **llm-ls** does not export any data anywhere (other than setting a use

### Multiple backends

**llm-ls** is compatible with Hugging Face's [Inference API](https://huggingface.co/docs/api-inference/en/index), Hugging Face's [text-generation-inference](https://github.com/huggingface/text-generation-inference), [ollama](https://github.com/ollama/ollama) and OpenAI compatible APIs, like [llama.cpp](https://github.com/ggerganov/llama.cpp/tree/master/examples/server).
**llm-ls** is compatible with Hugging Face's [Inference API](https://huggingface.co/docs/api-inference/en/index), Hugging Face's [text-generation-inference](https://github.com/huggingface/text-generation-inference), [ollama](https://github.com/ollama/ollama) and OpenAI compatible APIs, like the [python llama.cpp server bindings](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#openai-compatible-web-server).

## Compatible extensions

Expand Down
4 changes: 4 additions & 0 deletions crates/custom-types/src/llm_ls.rs
Original file line number Diff line number Diff line change
Expand Up @@ -60,6 +60,10 @@ pub enum Backend {
#[serde(default = "hf_default_url")]
url: String,
},
// TODO:
// LlamaCpp {
// url: String,
// },
Ollama {
url: String,
},
Expand Down

0 comments on commit 8926969

Please sign in to comment.