How to setup with LM Studio

Jump to bottom

Long Huynh edited this page Jul 12, 2024 · 6 revisions

Go to https://lmstudio.ai/ and download the application based on your operating system.

CleanShot 2024-07-12 at 14 45 42@2x

Search for a model to download.

CleanShot 2024-07-12 at 14 46 49@2x

CleanShot 2024-07-12 at 14 48 40@2x

After your model finished downloading, go to 'Local Server.'

CleanShot 2024-07-12 at 14 52 28@2x

Go to 'Local Inference Server'. Adjust 'Server Port' if needed. Start Server.

Make sure CORS is on for streaming.

Go to Obsidian > BMO Chatbot > REST API Connection > REST API URL and insert the server url (e.g. http://localhost:1234/v1). NOTE: The REST API URL uses /chat/completions endpoints.

CleanShot 2024-07-12 at 14 58 23@2x

Select your model and start chatting.

CleanShot 2024-07-12 at 15 00 03@2x