Here is Xuejun Zhang.
I am a senior majoring Electrical and Computer Engineering at Shanghai Jiao Tong University and Data Science at University of Michigan. I am an undergraduate research assistant in SLED Research Lab advised by professor Joyce Chai.
My research is driven by a deep curiosity to explore intelligence, mainly focusing on natural language processing (NLP) and multimodal learning. Currently, I am particularly interested in:
-
Alignment between Modalities: Investigating methods to achieve precise alignment across different modalities, bridging the inherent differences in modality-specific feature spaces.
-
Mechanistic Understanding of Models: Analyzing the internal workings of machine learning models to enhance their interpretability and reliability.
-
Inference Time Learning: Exploring techniques like in-context learning, one-shot, and few-shot learning to understand and improve model performance across varied tasks.
I’m actively seeking a PhD position starting in Fall 2025!
🔥 News
- 2024.06: 🎉🎉 Our new work “Multi-Object Hallucination in Vision-Language Models” is accepted by ALVR@ACL 2024 and is now on arxiv!**
Click here to read the paper on arxiv - 2024.09: 🎉🎉 “Multi-Object Hallucination in Vision-Language Models” is accepted by NeurIPS 2024!
📝 Publications
Multi-Object Hallucination in Vision-Language Models
Xuweiyi Chen*, Ziqiao Ma*, Xuejun Zhang*, Sihan Xu, Shengyi Qian, Jianing Yang, David F. Fouhey, Joyce Chai
🎖 Honors and Awards
- 2022.11: First Place in Tennis Team Event at the 49th Shanghai Jiao Tong University Sports Meet
- 2022.12: 2021-2022 Academic Year Merit Scholarship at Shanghai Jiao Tong University
- 2023.5: Outstanding Winner and AMS Award in Interdisciplinary Contest In Modeling
- 2023.5: Runner-up in Tennis Team Event at the 2023 Shanghai Jiao Tong University General Cup
- 2023.7: Future Technology Taihu Scholarship
- 2023.12: Dean’s Honor List & University Honors
- 2024.5: Dean’s Honor List & University Honors (Every semester at Umich)
📖 Educations
- 2021.09 - 2025.06 (now):, Shanghai Jiaotong University.
- 2023.08 - 2025.05 (now):, University of Michigan.
💻 Positions and Public Service
- 2022.08-2022.12: Teaching Assistant of Academic Writing.
- 2022.02-Present: Advisor of UMJI Advising Center
- Reviewer of ARR
- Reviewer of ICLR2025
🎉Happy to share my first paper "Multi-Object Hallucination in Vision-Language Models" in #ALVR at #ACL2024! Do VLMs hallucinate more in multi-object scenes? Shortcuts? Spurious correlations? What factors contribute to their hallucinations? 👀
— Xuejun Zhang (@eva_xuejunzhang) July 9, 2024
🔗https://t.co/5VsTym5BR3 🧵[1/n] pic.twitter.com/CXboiIKL0s