Xinghao Chen

xing-hao.chen@connect.polyu.hk

prof_pic.jpg

I am Xinghao Chen, a joint Ph.D. candidate in Computer Science at The Hong Kong Polytechnic University and Eastern Institute of Technology, Ningbo. I am fortunate to be advised by Prof. Wenjie Li and Prof. Xiaoyu Shen. I received my B.S. in Intelligent Science and Technology from Nankai University in 2023. I am currently a research intern at Tencent Youtu Lab, working with Dr. Junnan Dong. For more details, please see my CV.

My research explores how large language models can reason more efficiently through compressed reasoning and abstract latent representations. Inspired by how humans can think without verbalizing every step, I have recently been focusing on the following directions:

  • Thought Compression & Distillation: effective chain-of-thought distillation ([ACL’25]), condition-aware reasoning compression ([EMNLP’26]), reasoning efficiency, etc.
  • Latent-Space Reasoning: latent reasoning landscape and taxonomy ([EMNLP’26]), effective supervision for latent chain-of-thought ([ICML’26]), continuous thought representations, etc.
  • Applications (Efficiency): visual layer selection for multimodal LLMs ([EMNLP’25]), visual token pruning ([CVPR’26]), memory-augmented agents, KV-cache compression and reuse, etc.

News

Sep 03, 2026 Got two papers accepted by EMNLP 2026 (1 Main + 1 Findings) 🎉
Apr 30, 2026 Got one paper accepted by ICML 2026 🎉
Feb 20, 2026 Got one paper accepted by CVPR 2026 🎉
Aug 01, 2025 Got two papers accepted by EMNLP 2025 (1 Oral + 1 Findings) 🎉
May 15, 2025 Released our survey Reasoning Beyond Language on latent reasoning 🎉
May 01, 2025 Got one paper accepted by ACL 2025 (Findings) 🎉
Oct 01, 2024 Got one paper accepted by EMNLP 2024 (1 Main) 🎉

Selected Publications

(*) Equal Contribution. (†) Corresponding Author.

  1. What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis
    Xinghao Chen, C. T. Leong, Wenjin Guo, Jian Wang, Wenjie Li, and Xiaoyu Shen†
    In Forty-Third International Conference on Machine Learning, 2026
  2. Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
    Xinghao Chen*, Anhao Zhao*, Heming Xia, Xuan Lu, Hanlin Wang, Yanjun Chen, Wei Zhang, Jian Wang†, Wenjie Li, and Xiaoyu Shen†
    In Findings of the 2026 Conference on Empirical Methods in Natural Language Processing, 2026
  3. ACL
    cot-distillation.png
    Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
    Xinghao Chen, Zhijing Sun, Wenjin Guo, Miaoran Zhang, Yanjun Chen, Yirong Sun, Hui Su, Yijie Pan, Dietrich Klakow, Wenjie Li†, and Xiaoyu Shen†
    In Findings of the 2025 Annual Meeting of the Association for Computational Linguistics, 2025
  4. When Compression Helps and When It Hurts: Condition-Aware Analysis of Chain-of-Thought Distillation
    S. Lyu*, Xinghao Chen*, Zhijing Sun, Tianle Liu, Dawei Zhu, and Xiaoyu Shen
    In The 2026 Conference on Empirical Methods in Natural Language Processing, 2026
  5. UTPTrack: Towards Simple and Unified Token Pruning for Visual Tracking
    Hao Wu*, Xudong Wang*, Jialiang Zhang, Junlong Tong, Xinghao Chen, Junyan Lin, Yunpu Ma, and Xiaoyu Shen†
    In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026
  6. Rethinking Visual Layer Selection in Multimodal LLMs
    Haoran Chen*, Junyan Lin*, Xinghao Chen, Yue Fan, Xin Jin, Hui Su, Jianfeng Dong, Jinlan Fu, and Xiaoyu Shen
    In The 2025 Conference on Empirical Methods in Natural Language Processing, 2025
  7. MultiConIR: Towards Multi-Condition Information Retrieval
    Xuan Lu, Sifan Liu, Bochao Yin, Yongqi Li, Xinghao Chen, Hui Su, Yaohui Jin, Wenjun Zeng, and Xiaoyu Shen
    In Findings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
  8. The Accuracy Paradox in RLHF: When Better Reward Models Don’t Yield Better Language Models
    Yanjun Chen, Dawei Zhu, Yirong Sun, Xinghao Chen, Wei Zhang, and Xiaoyu Shen
    In The 2024 Conference on Empirical Methods in Natural Language Processing, 2024