docker-ollama

Docker compose setup for Ollama and Open WebUI

CPU installation

docker compose up -d

NVIDIA GPU installation in Ubuntu

First of all, make sure you have the nVidia drivers install. You may follow this guide.

Then, install the NVIDIA Container Toolkit package:

sudo bash scripts/nvidia.sh

Finally, run the docker compose:

docker compose -f docker-compose.yml -f docker-compose.gpu.yml up -d