Personal OCI image of ollama with ROCm support enabled. Tested on default configuration (default AMD driver, SELinux enabled, ...) Fedora 39 with podman, podman-compose and AMD 6700XT.
Contains a fix for AMD 6700XT, which will possibly break it for other GPUs.
If you want to use this image with another GPU, you will likely want to remove ENV HSA_OVERRIDE_GFX_VERSION=10.3.0 from /Dockerfile.
You need to allow rootless podman containers to use devices:
sudo setsebool container_use_devices=truedocker compose up -d --build
docker compose exec ollama ollama run mistral