Skip to content

Latest commit

 

History

History
16 lines (15 loc) · 717 Bytes

README.md

File metadata and controls

16 lines (15 loc) · 717 Bytes
Raw

BricksLLM Docker

This repository serves as a quick way to try out/develop BricksLLM AI gateway using the docker compose. It helps set up dependencies such as

  • Postgresql - BricksLLM uses Postgresql for storing gateway configurations.
  • Redis - It is used for caching purposes such as rating limiting and cost controlling API calls to third party LLM models.

Prerequisites

Getting started

First set up your OpenAI credential

export OPENAI_API_KEY=YOUR_OPENAI_API_KEY

Then run docker-compose

docker-compose up -d