New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MiniGPT-v2 support #18

Open

balisujohn opened this issue Oct 16, 2023 · 1 comment

balisujohn commented Oct 16, 2023

Posting to gauge/express interested in MiniGPT-v2 support being added.

Owner

Maknee commented Oct 17, 2023

Interesting, authors released MiniGPT-v2 as an improvement on minigpt4

I don't have time currently to update the repo to support MiniGPT-v2, but it should be relatively easy to add support for it since the code is using the base model for minigpt4

There's couple things I have in mind to support MiniGPT-v2.

test out support for llama 2 chat model with minigpt4
convert the minigpt-v2 model to ggml (the convert.py should automatically do this without any problems)

Most of the work would be with the gui and adding support to the C++ side to handle

add support to draw on the image
for each task, add the appropriate api for minigpt to handle (Grounding, Refer, Detection, Identify, VQA)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment