blip2_pretrain_flant5xl_highres.yaml missing.

[nicholscrawford]

Hi, I'm trying to replicate the VNLI results. When running itm_vqa_blip2_train.py it's expecting a model config file for blip2, which isn't included in the repository. Is that available somewhere?

FileNotFoundError: [Errno 2] No such file or directory: 
'/home/nicholscrawfordtaylor/code/wysiwyr/blip2_pretrain_flant5xl_highres.yaml'

[yonatanbitton]

Thanks for your interest. We do plan to publish the training dataset soon, and this way you can reproduce the VNLI training with BLIP2 or any more updated VLM available.

Updated the BLIP2 fine-tuning instructions here (including the YAML file reference you mentioned): https://github.com/yonatanbitton/wysiwyr/blob/main/README.md#reproducing-results-for-the-end-to-end-vnli-method