Message Attachment Image Recognition

[kevinthedang]

Changes

• Allows Image Recognition for the Llava Model and other models alike that allow image recognition.
• Normal queries can be made without attachments.
• Important Note: The Application is likely to provide hallucinations for back-to-back image queries.
  • Workaround: Reducing the Message Capacity can help prevent these hallucinations. Probably 2 or 3 max messages?

[JT2M0L3Y]

From the testing environment, this appears to work.

Can you speak a bit more to the need to store the response from the image url in a buffer and then convert it to Base64 before passing it to Ollama?

In other words, was this a requirement of discord for image processing or required to send to llava for interpretation?

[kevinthedang]

The requirements are for Ollama in general for chat generations.

I thought the URL would be taken but it rejects it. It won't even take Uint8Array[] either. So base64 strings were all that I could use.

Also there are some Logs that need to be taken out before merging.

cc: @JT2M0L3Y

[JT2M0L3Y]

Cleaner! 👍