Iโm Xuejun Zhang, a senior double majoring in Electrical and Computer Engineering at Shanghai Jiao Tong University and Data Science at University of Michigan. Currently serving as an undergraduate research assistant in the SLED Research Lab advised by Prof. Joyce Chai, Iโll be joining UIUC as a CS PhD student in the fall under the guidance of Prof. Heng Ji.
My research explores the fundamental question of whether artificial intelligence can achieve true understanding, with a focus on multimodal learning and natural language processing (NLP). I am particularly interested in:
- Evaluation of Multimodal Understanding: Developing systematic evaluation methodologies to expose limitations in how models process and integrate information across modalities.
- Alignment and Model Capabilities: Investigating methods for aligning models toward different forms of understanding while preserving their core capabilities.
- Mechanistic Interpretability: Analyzing the internal mechanisms of neural networks to understand how they construct representations and process multimodal information.
๐ฅ News
- 2024.06: ย ๐๐ Our new work โMulti-Object Hallucination in Vision-Language Modelsโ is accepted by ALVR@ACL 2024 and is now on arxiv!**
Click here to read the paper on arxiv - 2024.09: ย ๐๐ โMulti-Object Hallucination in Vision-Language Modelsโ is accepted by NeurIPS 2024!
๐ Publications
Multi-Object Hallucination in Vision-Language Models
Xuweiyi Chen*, Ziqiao Ma*, Xuejun Zhang*, Sihan Xu, Shengyi Qian, Jianing Yang, David F. Fouhey, Joyce Chai
๐ Honors and Awards
- 2022.11: First Place in Tennis Team Event at the 49th Shanghai Jiao Tong University Sports Meet
- 2022.12: 2021-2022 Academic Year Merit Scholarship at Shanghai Jiao Tong University
- 2023.5: Outstanding Winner and AMS Award in Interdisciplinary Contest In Modeling
- 2023.5: Runner-up in Tennis Team Event at the 2023 Shanghai Jiao Tong University General Cup
- 2023.7: Future Technology Taihu Scholarship
- 2023.12: Deanโs Honor List & University Honors
- 2024.5: Deanโs Honor List & University Honors (Every semester at Umich)
- 2024.10: NeurIPS 2024 Scholar Award
๐ Educations
- 2021.09 - 2025.06 (now): Shanghai Jiaotong University.
- 2023.08 - 2025.05 (now): University of Michigan.
๐ป Positions and Public Service
- 2022.08-2022.12: Teaching Assistant of Academic Writing.
- 2022.02-Present: Advisor of UMJI Advising Center
- Reviewer of ARR
- Reviewer of ICLR2025
๐Happy to share my first paper "Multi-Object Hallucination in Vision-Language Models" in #ALVR at #ACL2024! Do VLMs hallucinate more in multi-object scenes? Shortcuts? Spurious correlations? What factors contribute to their hallucinations? ๐
— Xuejun Zhang (@eva_xuejunzhang) July 9, 2024
๐https://t.co/5VsTym5BR3 ๐งต[1/n] pic.twitter.com/CXboiIKL0s