张智龙 Zhilong Zhang M.Sc. Student, LAMDA Group School of Artificial Intelligence National Key Laboratory for Novel Software Technology Nanjing University, Nanjing 210023, China Supervisor: Prof. Yang Yu Email: zhangzl@lamda.nju.edu.cn Laboratory: Shaoyifu Building, Nanjing University Xianlin Campus

Biography

Currently I am a first-year Ph.D. student of School of Artificial Intelligence in Nanjing University and a member of LAMDA Group, led by professor Zhi-Hua Zhou.

I received my B.Sc. degree in Computer Science and Technology from School of Artificial Intelligence, Nanjing University in June 2022. In September 2022, I was admitted to pursue a M.Sc. degree in Nanjing University, under the supervision of Professor Yang Yu.

Research Interests

My research interest includes Reinforcement Learning and its applications. Recently, I am interested in

• World Model Learning

• Imitation Learning

• Embodied AI

Journal Papers

• Adversarial Imitation Learning with General Function Approximation: Theoretical Analysis and Practical Algorithms.
  Tian Xu*, Zhilong Zhang*, Zuxuan Chen, Ruishuo Chen, Yihao Sun, Yang Yu. Transactions on Pattern Analysis and Machine Intelligence (TPAMI).

* Equal Contribution.

Conference Papers

• Hierarchical Value-Decomposed Offline Reinforcement Learning for Whole-Body Control
  Zhilong Zhang*, Yunpeng Mei*, Xinghao Du*, Hongjie Cao*, Haonan Wang, Pengyuan Min, Chenyu Wang, Pengfei Chen, Chenbo Xin, Yijie Wang, Wenyu Luo, Yihao Sun, Yidi Wang, Lei Yuan, Gang Wang, Yang Yu.
  In Proceedings of the 14th International Conference on Learning Representations (ICLR'26), 2026.

• WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-making
  Zhilong Zhang*, *Ruifeng Chen*, *Junyin Ye*, Yihao Sun, Pengyuan Wang, Jingcheng Pang, Kaiyuan Li, Tianshuo Liu, Haoxin Lin, Yang Yu, Zhi-Hua Zhou.
  In Proceedings of the 39th Advances in Neural Information Processing Systems (NeurIPS'25) (Workshop EWM), 2025.

• Improving Reward Model Generalization from Adversarial Process Enhanced Preferences
  Zhilong Zhang*, Tian Xu*, Xinghao Du*, Xingchen Cao, Yihao Sun, and Yang Yu.
  In Proceedings of the 41th International Conference on Machine Learning (ICML'25), 2025.

• Flow to better: Offline preference-based reinforcement learning via preferred trajectory generation
  Zhilong Zhang*, Yihao Sun* , Junyin Ye, Tianshuo Liu, Jiaji Zhang, and Yang Yu.
  In Proceedings of the 12th International Conference on Learning Representations (ICLR'24), 2024.

• Provably and Practically Efficient Adversarial Imitation Learning with General Function Approximation
  Tian Xu*, Zhilong Zhang*, Ruishuo Chen, Yihao Sun, and Yang Yu.
  In Proceedings of the 38th Advances in Neural Information Processing Systems (NeurIPS'24), 2024.

• ADM-v2: Pursuing Full-Horizon Roll-out in Dynamics Models for Offline Policy Learning and Evaluation
  Haoxin Lin*, Siyuan Xiao*, Yi-Chen Li, Zhilong Zhang, Yihao Sun, Chengxing Jia, Yang Yu
  In Proceedings of the 14th International Conference on Learning Representations (ICLR'26), 2026.

• Any-step Dynamics Model Improves Future Predictions for Online and Offline Reinforcement Learning
  Haoxin Lin, Yu-Yan Xu, Yihao Sun, Zhilong Zhang, Yi-Chen Li, Chengxing Jia, Junyin Ye, Jiaji Zhang, Yang Yu.
  In Proceedings of the 13th International Conference on Learning Representations (ICLR'25), 2025.

• Semantic Skill Extraction via Vision-Language Model Guidance for Efficient Reinforcement Learning
  Tian-Shuo Liu, Xu-Hui Liu, Ruifeng Chen, Lixuan Jin, Pengyuan Wang, Zhilong Zhang, Yang Yu In Proceedings of the 13th International Conference on Learning Representations (ICLR'25), 2025.

• Limited Preference Aided Imitation Learning from Imperfect Demonstrations
  Xingchen Cao, Fan-Ming Luo, Junyin Ye, Tian Xu, Zhilong Zhang, Yang Yu.
  In Proceedings of the 40th International Conference on Machine Learning (ICML'24), 2024.

• Energy-Guided Diffusion Sampling for Offline-to-Online Reinforcement Learning
  Xu-Hui Liu, Tian-Shuo Liu, Shengyi Jiang, Ruifeng Chen, Zhilong Zhang, Xinwei Chen, Yang Yu.
  In Proceedings of the 40th International Conference on Machine Learning (ICML'24), 2024.

• Stable Continual Reinforcement Learning via Diffusion-based Trajectory Replay
  Feng Chen, Fuguang Han, Cong Guan, Lei Yuan, Zhilong Zhang, Yang Yu, and Zongzhang Zhang.
  In Proceedings of the 12th International Conference on Learning Representations (ICLR'24) (Workshop GenAI4DM), 2024.

Service

Reviewer

NeurIPS (2024, 2025), ICML (2024, 2025, 2026), ICLR (2025, 2026), TPAMI.

Correspondence

Email: zhangzl@lamda.nju.edu.cn

Laboratory: A201, Shaoyifu Building, Xianlin Campus of Nanjing University

Address: National Key Laboratory for Novel Software Technology, Nanjing University, Xianlin Campus Mailbox 603, 163 Xianlin Avenue, Qixia District, Nanjing 210023, China
(南京市栖霞区仙林大道163号, 南京大学仙林校区603信箱, 软件新技术国家重点实验室, 210023.)