Skip to content

Fully local AI waifu. Vtube Studio, Discord bot, Oobabooga, and much more. Even has a browser interface!

License

Notifications You must be signed in to change notification settings

SugarcaneDefender/z-waif

Repository files navigation

z-waif

Fully local & open source AI Waifu. VTube Studio, Discord, Minecraft, custom made RAG (long term memory), alarm, and plenty more! Has a WebUI and hotkey shortcuts.

Uses Oobabooga, RVC, and Whisper to run AI.

Requires Windows 10/11 and a CUDA (NVidia) GPU with atleast 12GB+ of video memory.

drawing drawing
drawing drawing

YouTube Showcase:

IMAGE ALT TEXT

YouTube Install Tutorial:

IMAGE ALT TEXT

Changelog

v1.1

  • Visual System
    • Toggleable as a module
    • Able to take new images or upload them directly for the AI to see
    • Runs using Ooba, like with the text
      • Can set the port to the existing, default one, or load another instance to dual wield
    • Option to see images before being sent
      • Can retake them
      • Use C/X on the keyboard to confirm
    • Automatically shrinks images to a proper size
  • Fixed bits of the Minecraft module
    • Configurable "MinecraftUsername" to set your AI's name (stops feedback loops)
    • Configurable "MinecraftUsernameFollow" to set who your AI follows when doing "#follow"

---.---.---.---

V1.0

  • Initial public release of Z-Waif. Contains:
    • WebUI
    • RAG
    • Discord
    • Semi-Minecraft Functionality
    • VTuber Emotes
    • Hotkeys
    • Various other initial release items

Links

Here is some documentation that you can look at. I am still in the process of making tutorials and documentation!

Credit to this other AI waifu project for making the original base code/skeleton used here!

Current To-Do

  • Make the RAG/Long Term Memory be multiprocessed for better performance
  • Fix repetition issues at the end of speech to text Whisper by manually removing
  • Look more into optimal LLMs and configs
  • Fix issues where leaving the bot on for a while can cause a bit more lag between messages
  • Fix issues where leaving the WebUI open a long time can freeze it and spike CPU usage
  • Create more Youtube tutorials and other related content
  • Create more documentation, both in the ReadMe and in the Google Doc

About

Fully local AI waifu. Vtube Studio, Discord bot, Oobabooga, and much more. Even has a browser interface!

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published