Publish llama-index plugin #924
Conversation
🦋 Changeset detectedLatest commit: 69526ae The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
| "name": "livekit-plugins-<name>", | ||
| "private": true | ||
| } | ||
| Chat Engine can be used as an LLM within the frame work. |
There was a problem hiding this comment.
ChatEngine isn't the recommended way tho. Since this one doesn't support function calls (It is using the LLM from lama_index)
There was a problem hiding this comment.
This one: https://github.com/livekit/agents/blob/main/examples/voice-pipeline-agent/llamaindex-rag/query_engine.py
and this one https://github.com/livekit/agents/blob/main/examples/voice-pipeline-agent/llamaindex-rag/retrieval.py
are more appropriate, but it depends on the needs.
The ChatEngine is also doing some "context" management (like keeping the previous rag search of the prior question etc.). They all have pros and cons
There was a problem hiding this comment.
I see, you have an example for it, I'm just documenting it. should we not point folks down that path?
No description provided.