A streamlined and versatile chatbot interface supporting various language models such as OpenAI GPT, Ollama Llama, and others. Designed for flexibility and ease of use, the project provides a Gradio-based frontend for seamless interactions.
- Multi-model support: Compatible with OpenAI GPT, Ollama Llama, Mistral, and Qwen models.
- Dynamic model management: Automatically verifies and downloads models when needed.
- Streamed responses: Real-time streamed output for enhanced user experience.
- Custom prompts: System prompt management through
system_prompt.txt
.
Ensure you have the following installed:
- Python 3.8+
- Required Python libraries (see
requirements.txt
) - Ollama (if using Llama models): Download here
-
Clone the repository:
git clone https://github.com/GiulioRusso/ChatLLM.git cd ChatLLM
-
Install dependencies:
pip install -r requirements.txt
-
Ensure Ollama is installed and running if using Llama models.
-
Open the Jupyter Notebook:
jupyter-notebook main.ipynb
-
Place your system prompt file in the
prompts
folder assystem_prompt.txt
. -
Run the notebook and interact with the chatbot interface.
- Add support for Claude models.
- Implement a file upload section for interactive file processing.
- Add functionality for image generation using integrated models.