Skip to content

πŸ”¬Challenge on VQA and synthetic GI images for enhanced diagnostic AI | 🌐 imageclef.org/2025/medical/vqa | πŸ‡ͺπŸ‡Έ CLEF 2025, Madrid

Notifications You must be signed in to change notification settings

simula/ImageCLEFmed-MEDVQA-GI-2025

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

13 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

🌟 ImageCLEFmed-MEDVQA-GI-2025 🌟

Registraion

The ImageCLEFmed-MEDVQA-GI (3rd edition) challenge πŸ”¬ focuses on integrating Visual Question Answering (VQA) with synthetic gastrointestinal (GI) data πŸ₯ to enhance diagnostic accuracy πŸƒβ€β™‚οΈπŸ’‘ and AI learning algorithms πŸ€–.

This year's challenge includes two exciting subtasks πŸš€ designed to push the boundaries of image analysis πŸ–ΌοΈ and synthetic medical image generation 🧬, aiming to improve diagnostic processes 🏨 and patient outcomes πŸ’–.


🎯 Task Descriptions

πŸ” Subtask 1: Algorithm Development for Question Interpretation and Response

πŸ’‘ Goal: Develop algorithms πŸ€– that can accurately interpret and answer πŸ—£οΈ questions based on GI images πŸ₯. These questions may involve identifying abnormalities ⚠️, counting objects πŸ”’, or describing image content πŸ“.

✨ Focus: Create robust systems that combine image πŸ–ΌοΈ and text understanding πŸ—¨οΈ to assist medical diagnostics 🏨.

πŸ’¬ Example Questions:

  • πŸ”’ How many polyps are in the image?
  • ⚑ Are there any abnormalities in the image?
  • 🏷️ What disease is visible in the image?

🎨 Subtask 2: Creation of High-Fidelity Synthetic GI Images

πŸ–ŒοΈ Goal: Generate synthetic GI images 🧬 that are indistinguishable from real medical images πŸ₯, rich in detail and variability.

🌱 Why? Provide privacy-preserving alternatives πŸ”’ to real patient data and support diagnostic systems πŸ’‘.


πŸ“‚ Data

The 2025 dataset πŸ—ƒοΈ is an extended version of the HyperKvasir dataset πŸ”— (datasets.simula.no/hyper-kvasir) and includes:

  • πŸ₯ GI images with detailed VQA annotations πŸ“
  • 🌟 New synthetic image data simulating realistic diagnostic scenarios
  • 🎯 Segmentation masks for key elements like polyps 🩺 and instruments πŸ› οΈ

πŸ“₯ Datasets

  • πŸƒ Development Dataset: Download Here
  • πŸ•‘ Test Dataset: Coming Soon ⏳

πŸ§ͺ Evaluation Methodology

πŸƒ Subtask 1: Question Interpretation and Response

  • πŸ“Š Metrics: 🎯 Accuracy, πŸ” Precision, ♻️ Recall, and πŸ† F1 Score.
  • πŸ“œ Evaluation: Based on correctness βœ… and relevance πŸ“ of answers using the provided questions πŸ’¬ and images πŸ–ΌοΈ.

πŸ–ΌοΈ Subtask 2: Synthetic Image Quality

  • πŸ‘€ Subjective Evaluation: 🩺 Expert reviewers will assess realism 🌟 and diagnostic utility πŸ₯.
  • 🎯 Objective Evaluation:
    • πŸ“‰ FrΓ©chet Inception Distance (FID): Similarity between synthetic and real images.
    • πŸ—οΈ Structural Similarity Index Measure (SSIM): Resemblance in structure πŸ›οΈ.

πŸ† Online Leaderboard

πŸš€ Compete in real-time with a dynamic leaderboard πŸ“ˆ showing participants' performance!
πŸ’‘ Iterate, Improve & Win! πŸ…


πŸ—“οΈ Preliminary Schedule

  • πŸ“… 20 December 2024: πŸ“ Registration opens
  • πŸ“… 14 February 2025: πŸƒ Release of training & validation datasets
  • πŸ“… 14 March 2025: ⏳ Test datasets released
  • πŸ“… 25 April 2025: πŸšͺ Registration closes
  • πŸ“… 10 May 2025: ⏲️ Run submission deadline
  • πŸ“… 17 May 2025: πŸ† Processed results released
  • πŸ“… 30 May 2025: ✍️ Participant papers submission [CEUR-WS]
  • πŸ“… 27 June 2025: πŸ’Œ Notification of acceptance
  • πŸ“… 7 July 2025: πŸ–¨οΈ Camera-ready paper submission [CEUR-WS]
  • πŸ›οΈ 9-12 September 2025: 🌍 CLEF 2025, Madrid, Spain πŸ‡ͺπŸ‡Έ

πŸ’Ό Organizers

✨ For any queries, feel free to reach out to our amazing team:


πŸ”— For More Details & Registration

🌐 Visit: πŸ‘‰ imageclef.org/2025

πŸ’₯ Join the challenge, push the boundaries, and make a difference in medical AI! πŸš€πŸ§¬

About

πŸ”¬Challenge on VQA and synthetic GI images for enhanced diagnostic AI | 🌐 imageclef.org/2025/medical/vqa | πŸ‡ͺπŸ‡Έ CLEF 2025, Madrid

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •