Maw

Talk with a local llm with all your friends, straight in discord

mawdemo.mp4

Or.. make your own characters! Edit anything you want, and make it your own!

mawcharacterdemo.mp4

Want to voice chat with it? Transcribe discord calls?

Switch to the voice-chat branch

mawpreview.mp4

Maw can even generate images for you!

Dante must be installed alongside Maw, cloned to the same directory

Requirements

• Linux with cuda drivers installed
• NVIDIA gpu with 24GB vram
• A decent amount of storage
• Python3.12 and the venv package

Install

git clone https://github.com/Ednaordinary/MawDiscord/

cd MawDiscord

mkdir characters

mkdir servers

python3 -m venv venv

cd venv

source bin/activate

cd ..

pip install -r requirements.txt

Merge the following PRs into your environment:

• huggingface/transformers#31301
• nextcord/nextcord#1160

Place your bot token as DISCORD_TOKEN in a .env file

Run

cd venv

source bin/activate if you haven't already activated the environment

cd ..

python3 ./main.py