Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add tests for multi-image VLM prompts, and for followup prompts #49

Open
neilmehta24 opened this issue Nov 27, 2024 · 1 comment
Open

Add tests for multi-image VLM prompts, and for followup prompts #49

neilmehta24 opened this issue Nov 27, 2024 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@neilmehta24
Copy link
Member

We have tests for single image prompts and text-only prompts in test_vision_models.py. We should add tests for continued conversations which may have multiple images as part of the conversation.
@neilmehta24 neilmehta24 added enhancement New feature or request good first issue Good for newcomers labels Nov 30, 2024
YorkieDev pushed a commit to YorkieDev/mlx-engine that referenced this issue Dec 26, 2024
Add tests for multi-image VLM prompts and followup conversations
b5938ac 
- Added new test file for multi-image and conversation testing
- Supports testing multiple images in single prompt
- Added conversation follow-up testing capability
- Improved path handling and error reporting
- Added automatic test image downloading
- Addresses issue lmstudio-ai#49
@YorkieDev YorkieDev mentioned this issue Dec 26, 2024
Open
@YorkieDev
Copy link

Should be solved by #67

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@YorkieDev @neilmehta24