We will use ollama to interact with open-source LLMs.
Please install ollama from here: https://ollama.com/download
Note — You will need macOS 11 Big Sur (or later) or Windows 10 (or later).
Run the code in notebook test_ollama.ipynb to verify that you can access the ollama API on your computer through python