Skip to content

v1.0

Latest
Latest
Compare
Choose a tag to compare
@Adriankhl Adriankhl released this 30 May 13:46
· 11 commits to main since this release
v1.0
4fa6fe8

I think this plugin has sufficient basic features needed in a LLM framework, so it is the time to bump it to v1.0

  • Breaking change: replace Should Output Bos and Should Output Eos by Should Output Special
  • A LLM_LEGAL.md to document information about legal issues on using LLM in games
  • macOS build: support is on best effort basis since I don't have a mac myself
  • store_text_finished signal for LlmDB node
  • create function and LlmDBMetaDataType enum for LlmDB node
  • Add Main GPU and Split Mode to control which gpu (if you have multiple) should be used in computation, this is also needed as a workaround if you have multiple drivers install for a single GPU (my fix is still under review on the upstream llama.cpp repo)
  • Bug fixes
Assets 4
Loading