Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LLM Chatbots with Personas #3

Merged
merged 19 commits into from
Dec 21, 2023
Merged

LLM Chatbots with Personas #3

merged 19 commits into from
Dec 21, 2023

Conversation

NeonDaniel
Copy link
Member

@NeonDaniel NeonDaniel commented Dec 12, 2023

Description

Enable an LLM to connect to the /chatbots vhost with multiple personas

Issues

Other Notes

Planning discussion documented: https://gist.github.com/NeonDaniel/a89542f2f6239cfe342ccea29bd1d0cc

NeonDaniel added a commit to NeonGeckoCom/neon-llm-chatgpt that referenced this pull request Dec 13, 2023
Add default `llm_bots` configuration to Docker
Implement persona support from NeonGeckoCom/neon-llm-core#3
llm_bots:
<LLM Name>:
- name: Assistant
description: You are a personal assistant who responds in 40 words or less
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From persona-private:

  short_response: True  # If true, limit to 60 words
  base_prompt: You are a smart city manager...  # Base personality prompt to which response length can be added
  imagination: False  # If true, allow for non-factual information in responses

Copy link
Member Author

@NeonDaniel NeonDaniel Dec 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Leave the internals to name and description; UI can accept these other params but will generate a description to be stored. Possibly add temperature

@NeonDaniel NeonDaniel marked this pull request as ready for review December 14, 2023 18:29
@NeonDaniel NeonDaniel force-pushed the FEAT_ConfigureChatbotPersonas branch from ee1d9d9 to d607563 Compare December 15, 2023 01:04
@NeonDaniel NeonDaniel merged commit 6b3bd94 into dev Dec 21, 2023
3 checks passed
@NeonDaniel NeonDaniel deleted the FEAT_ConfigureChatbotPersonas branch December 21, 2023 00:20
NeonDaniel added a commit to NeonGeckoCom/neon-llm-chatgpt that referenced this pull request Dec 28, 2023
* Minor logging and formatting changes
Add default `llm_bots` configuration to Docker
Implement persona support from NeonGeckoCom/neon-llm-core#3

* Update neon-llm-core dependency for chatbot support
Update default configuration and document llm bots

* Resolve license test failures

---------

Co-authored-by: Daniel McKnight <daniel@neon.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant