ggerganov llama.cpp Show And Tell · Discussions · GitHub

Sort by: Latest activity

Categories

Community guidelines

Show and tell Discussions

Show off something you've made

Pinned to Show and tell

You must be logged in to vote

Hugging Face Inference Endpoints now supports GGUF out of the box!

ngxson started Sep 27, 2024 in Show and tell

1

Discussions

You must be logged in to vote

Fun Experiment: Falcon 180B Q4_0 locally on a phone!

BarfingLemurs started Sep 10, 2023 in Show and tell

1
You must be logged in to vote

I built a writing app that lets you run AI models locally.

egonSchiele started Sep 1, 2023 in Show and tell

0
You must be logged in to vote

Interactive chat run script

ossirytk started Aug 19, 2023 in Show and tell

0
You must be logged in to vote

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI

nuance1979 started Apr 3, 2023 in Show and tell

1
You must be logged in to vote

Was able to run it locally on my phone 🥲👍

Mrgithub93 started Aug 3, 2023 in Show and tell

3
You must be logged in to vote

Some more observations regarding QX_0 quantizations with LLaMAv2 7B

ggerganov started Jul 27, 2023 in Show and tell

2
You must be logged in to vote

Presentation on llama.cpp on 25.07.2023 at karlsruhe.ai

JohannesGaessler started Jul 19, 2023 in Show and tell

9
You must be logged in to vote

.NET LLaMA.cpp library! 🦙

hpretila started Mar 25, 2023 in Show and tell

15
You must be logged in to vote

llama.cpp performance numbers

JohannesGaessler started Jul 6, 2023 in Show and tell

4
You must be logged in to vote

Pacha - A TUI Frontend for llama.cpp

mounta11n started Jul 2, 2023 in Show and tell

0
You must be logged in to vote

Introducing my 'VowelReconstruct' Method - A Tangible Test for Comparing LLM's General Intelligence

mounta11n started Jun 14, 2023 in Show and tell

0
You must be logged in to vote

llama.cpp "chat" Qt GUI

niansa started Mar 29, 2023 in Show and tell

3
You must be logged in to vote

3B q4_0 open llama model running on a 4gb Pixel

BarfingLemurs started Jun 1, 2023 in Show and tell

2
You must be logged in to vote

I've made an easy peasy script for llama.cpp

mounta11n started May 21, 2023 in Show and tell

1
You must be logged in to vote

[fixed] multi loras in one ggml file!

FNsi started May 16, 2023 in Show and tell

15
You must be logged in to vote

A Simple Telegram bot for Llama.cpp supported models

aneeshjoy started May 10, 2023 in Show and tell

0
You must be logged in to vote

LocalAI: OpenAI API compatible based on llama.cpp and ggml

mudler started Apr 27, 2023 in Show and tell

3
You must be logged in to vote

Telegram bot chat wrapper

innightwolfsleep started Apr 29, 2023 in Show and tell

0
You must be logged in to vote

gptneox.cpp for OpenAssistant models
model Model specific demo Demonstrate some concept or idea, not intended to be merged
byroneverson started Apr 27, 2023 in Show and tell

3
You must be logged in to vote

A Swift bindings for llama.cpp

siuying started Apr 1, 2023 in Show and tell

1
You must be logged in to vote

Run llama.cpp with tea – without the installation pain!

mfts started Mar 25, 2023 in Show and tell

3
You must be logged in to vote

coinrule

glaslx started Apr 18, 2023 in Show and tell

0
You must be logged in to vote

Instruction using Python expressions

niansa started Apr 16, 2023 in Show and tell

1
You must be logged in to vote

Ruby Bindings

jtp184 started Apr 5, 2023 in Show and tell

0
You must be logged in to vote

~2x perf improvement on Apple Silicon by changing state_shared.has_work access from atomic to mutex/conditional

izard started Mar 30, 2023 in Show and tell

5