ICLR 2025

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Haotian Zhang, Mingfei Gao, Zhe Gan, Philipp Dufter, Nina Wenzel, Forrest Huang, Dhruti Shah, Xianzhi Du, Bowen Zhang, Yanghao Li, Sam Dodge, Keen You, Zhen Yang, Aleksei Timofeev, Mingze Xu, Hong-You Chen, Jean-Philippe Fauconnier, Zhengfeng Lai, Haoxuan You, Zirui Wang, Afshin Dehghan, Peter Grasch, Yinfei Yang

Paper ↗Project ↗Cite

Data and training recipes for multimodal models with stronger text-rich image understanding, grounding, and multi-image reasoning.

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning — overview figure

BibTeX citation

@inproceedings{mm1_52025,
  title = {MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning},
  author = {Haotian Zhang and Mingfei Gao and Zhe Gan and Philipp Dufter and Nina Wenzel and Forrest Huang and Dhruti Shah and Xianzhi Du and Bowen Zhang and Yanghao Li and Sam Dodge and Keen You and Zhen Yang and Aleksei Timofeev and Mingze Xu and Hong-You Chen and Jean-Philippe Fauconnier and Zhengfeng Lai and Haoxuan You and Zirui Wang and Afshin Dehghan and Peter Grasch and Yinfei Yang},
  booktitle = {ICLR},
  year = {2025},
  url = {https://arxiv.org/abs/2409.20566}
}