The ImageCLEFmed-MEDVQA-GI (3rd edition) challenge π¬ focuses on integrating Visual Question Answering (VQA) with synthetic gastrointestinal (GI) data π₯ to enhance diagnostic accuracy πββοΈπ‘ and AI learning algorithms π€.
This year's challenge includes two exciting subtasks π designed to push the boundaries of image analysis πΌοΈ and synthetic medical image generation π§¬, aiming to improve diagnostic processes π¨ and patient outcomes π.
π‘ Goal: Develop algorithms π€ that can accurately interpret and answer π£οΈ questions based on GI images π₯. These questions may involve identifying abnormalities
β¨ Focus: Create robust systems that combine image πΌοΈ and text understanding π¨οΈ to assist medical diagnostics π¨.
- π’ How many polyps are in the image?
- β‘ Are there any abnormalities in the image?
- π·οΈ What disease is visible in the image?
ποΈ Goal: Generate synthetic GI images 𧬠that are indistinguishable from real medical images π₯, rich in detail and variability.
π± Why? Provide privacy-preserving alternatives π to real patient data and support diagnostic systems π‘.
The 2025 dataset ποΈ is an extended version of the HyperKvasir dataset π (datasets.simula.no/hyper-kvasir) and includes:
- π₯ GI images with detailed VQA annotations π
- π New synthetic image data simulating realistic diagnostic scenarios
- π― Segmentation masks for key elements like polyps π©Ί and instruments π οΈ
- π Development Dataset: Download Here
- π Test Dataset: Coming Soon β³
- π Metrics: π― Accuracy, π Precision, β»οΈ Recall, and π F1 Score.
- π Evaluation: Based on correctness β and relevance π of answers using the provided questions π¬ and images πΌοΈ.
- π Subjective Evaluation: π©Ί Expert reviewers will assess realism π and diagnostic utility π₯.
- π― Objective Evaluation:
- π FrΓ©chet Inception Distance (FID): Similarity between synthetic and real images.
- ποΈ Structural Similarity Index Measure (SSIM): Resemblance in structure ποΈ.
π Compete in real-time with a dynamic leaderboard π showing participants' performance!
π‘ Iterate, Improve & Win! π
- π 20 December 2024: π Registration opens
- π 14 February 2025: π Release of training & validation datasets
- π 14 March 2025: β³ Test datasets released
- π 25 April 2025: πͺ Registration closes
- π 10 May 2025: β²οΈ Run submission deadline
- π 17 May 2025: π Processed results released
- π 30 May 2025: βοΈ Participant papers submission [CEUR-WS]
- π 27 June 2025: π Notification of acceptance
- π 7 July 2025: π¨οΈ Camera-ready paper submission [CEUR-WS]
- ποΈ 9-12 September 2025: π CLEF 2025, Madrid, Spain πͺπΈ
β¨ For any queries, feel free to reach out to our amazing team:
- π¨βπ¬ Steven A. Hicks π§ steven@simula.no
- π§βπ» Michael A. Riegler π§ michael@simula.no
- π§βπ¬ Vajira Thambawita π§ vajira@simula.no
- π¨βπ« PΓ₯l Halvorsen π§ paalh@simula.no
- π§βπ Sushant Gautam π§ sushant@simula.no
π Visit: π imageclef.org/2025
π₯ Join the challenge, push the boundaries, and make a difference in medical AI! ππ§¬