Here is Xuejun Zhang. I am a senior double majoring in Electrical and Computer Engineering at Shanghai Jiao Tong University and Data Science at University of Michigan. I am an undergraduate research assistant in SLED Research Lab advised by Professor Joyce Chai.
My research explores the fundamental question of whether artificial intelligence can achieve true understanding, with a focus on multimodal learning and natural language processing (NLP). I am particularly interested in:
- Evaluation of Multimodal Understanding: Developing systematic evaluation methodologies to expose limitations in how models process and integrate information across modalities.
- Alignment and Model Capabilities: Investigating methods for aligning models toward different forms of understanding while preserving their core capabilities.
- Mechanistic Interpretability: Analyzing the internal mechanisms of neural networks to understand how they construct representations and process multimodal information.
I’m actively seeking a PhD position starting in Fall 2025!
🔥 News
- 2024.06: 🎉🎉 Our new work “Multi-Object Hallucination in Vision-Language Models” is accepted by ALVR@ACL 2024 and is now on arxiv!**
Click here to read the paper on arxiv - 2024.09: 🎉🎉 “Multi-Object Hallucination in Vision-Language Models” is accepted by NeurIPS 2024!
📝 Publications
Multi-Object Hallucination in Vision-Language Models
Xuweiyi Chen*, Ziqiao Ma*, Xuejun Zhang*, Sihan Xu, Shengyi Qian, Jianing Yang, David F. Fouhey, Joyce Chai
🎖 Honors and Awards
- 2022.11: First Place in Tennis Team Event at the 49th Shanghai Jiao Tong University Sports Meet
- 2022.12: 2021-2022 Academic Year Merit Scholarship at Shanghai Jiao Tong University
- 2023.5: Outstanding Winner and AMS Award in Interdisciplinary Contest In Modeling
- 2023.5: Runner-up in Tennis Team Event at the 2023 Shanghai Jiao Tong University General Cup
- 2023.7: Future Technology Taihu Scholarship
- 2023.12: Dean’s Honor List & University Honors
- 2024.5: Dean’s Honor List & University Honors (Every semester at Umich)
📖 Educations
- 2021.09 - 2025.06 (now): Shanghai Jiaotong University.
- 2023.08 - 2025.05 (now): University of Michigan.
💻 Positions and Public Service
- 2022.08-2022.12: Teaching Assistant of Academic Writing.
- 2022.02-Present: Advisor of UMJI Advising Center
- Reviewer of ARR
- Reviewer of ICLR2025
🎉Happy to share my first paper "Multi-Object Hallucination in Vision-Language Models" in #ALVR at #ACL2024! Do VLMs hallucinate more in multi-object scenes? Shortcuts? Spurious correlations? What factors contribute to their hallucinations? 👀
— Xuejun Zhang (@eva_xuejunzhang) July 9, 2024
🔗https://t.co/5VsTym5BR3 🧵[1/n] pic.twitter.com/CXboiIKL0s