Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add LM Studio Support #1805

Merged
merged 4 commits into from
Jan 11, 2025
Merged

Add LM Studio Support #1805

merged 4 commits into from
Jan 11, 2025

Conversation

NolanTrem
Copy link
Collaborator

@NolanTrem NolanTrem commented Jan 11, 2025

Important

Integrates LM Studio with new configuration, version updates, and environment variables in Docker Compose files.

  • Configuration:
    • Add lm_studio.toml for LM Studio configuration with settings for agent, completion, embedding, database, orchestration, and ingestion.
  • Version Updates:
    • Update version in package.json from 0.4.12 to 0.4.14.
    • Update version in pyproject.toml from 3.3.26 to 3.3.27.
    • Update litellm dependency version in pyproject.toml to ^1.57.7.
  • Environment Variables:
    • Add LM_STUDIO_API_BASE environment variable in compose.yaml, compose.full.yaml, and compose.full_with_replicas.yaml.

This description was created by Ellipsis for 66c0763. It will automatically update as commits are pushed.

Copy link
Contributor

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❌ Changes requested. Reviewed everything up to 66c0763 in 33 seconds

More details
  • Looked at 143 lines of code in 6 files
  • Skipped 2 files when reviewing.
  • Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_YcDbJ7Wz35zsDw75


Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[embedding]
provider = "litellm"
base_model = "lm_studio/text-embedding-nomic-embed-text-v1.5"
base_dimension = nan
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

'base_dimension' should be a numeric value or 'null', not 'nan'.

@NolanTrem NolanTrem changed the title LM Studio Add LM Studio Support Jan 11, 2025
@NolanTrem NolanTrem merged commit 84f5273 into main Jan 11, 2025
15 checks passed
@NolanTrem NolanTrem deleted the Nolan/LMStudio branch January 11, 2025 00:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant