A collection of chat clients featured on solidrust.net.
- Streamlit Clients used with Requirements
- Gradio Clients used with Requirements
- Desktop Clients used with Requirements
All the configuration for the clients is done in the config.yaml file. Used the provided example to create your own.
As we have migrated to Ansible and primarily use a systemd service template in linux, these legacy launchers are provided as an example.
- Launch ALL intends to launch a list of chat clients all at once.
- Launch is intended to be called by Launch ALL, but can be used to launch a specific chat app.
- Launch Custom is intended to launch clients using attitional parameters. It was made to enable developing a newer pattern of client (gradio).
- Launch Chat was an earlier version of Launch Custom, that was used before migration to ansible.
- Terminate kill all running caht clients (by way of nuking all screen sessions).
- Prompt Formatters functions for abstracting the various types of model prompt templates.
- WIP Conversation Manager class of functions to manage chat history.
We have developped several supplementary example apps that intent to be integrated into the various chat clients. Some of these projects are:
- text-to-speech Production ready text-to-speech example.
- speech-to-text Production ready speech to text example.
- vector-search Example of using a vector store as long-term memory.
- assistants Framework example for a customized self-hosted personal assistant.
- agents Agent framework examples, using AutoGEN, CrewAI, ect..
- Inference Backends collection of launchers for verious self-hosted inference backends for supporting these Chat Clients.