Integrate with LM Studio

[Squallpka1]

Try this on 'https://huggingface.co/spaces/LinkSoul/AutoAgents'. 4 chats and blew my 0.50 credit from OpenAI. Its just a test to see how this work.

I just wonder if we can have text box inside this huggingface site that use LM Studio because I use LM Studio and its such a very easy to get and use LLM. Its also have function as a local server. If i just can connect this IP server to the huggingface that you guys build there will be awesome.

[TheMindExpansionNetwork]

With you trying to figure it out

[showkeyjar]

I have been tried to integrate with LM Studio, it doesn't work as expected,

when it send role and plan info to LLMs, models returns nothing,

more funny, I also integrated AutoGPT with LM Studio, it still can not work,

because I found the model cannot accurately select actions, it cause AutoGPT can not found action to execute.

I use TheBloke/Llama-2-13B-chat-GGUF, maybe it has something to do with the model I chose.

Looking forward to more powerful models to choose from.