Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix(assistant): summary now can output 2000 tokens (#2440)
This pull request increases the token limit for the summary output to 2000 in order to accommodate larger documents. <!-- ELLIPSIS_HIDDEN --> ---- | <a href="https://ellipsis.dev" target="_blank"><img src="https://avatars.githubusercontent.com/u/80834858?s=400&u=31e596315b0d8f7465b3ee670f25cea677299c96&v=4" alt="Ellipsis" width="30px" height="30px"/></a> | 🚀 This PR description was created by [Ellipsis](https://www.ellipsis.dev) for commit 4412ecd. | |--------|--------| ### Summary: This PR increases the token limit for the summary output to 2000 in the `SummaryAssistant` class to accommodate larger documents. **Key points**: - Increased `max_tokens` parameter in `ChatLiteLLM` instance to 2000 in `process_assistant` function of `SummaryAssistant` class in `/backend/modules/assistant/ito/summary.py` file. ---- Generated with ❤️ by [ellipsis.dev](https://www.ellipsis.dev) <!-- ELLIPSIS_HIDDEN -->
- Loading branch information