Hi, I am an AI researcher at Alaya Lab. I received my Ph.D. from the University of Tokyo, where I was advised by Prof. Yoichi Sato. My current research focuses on AI for gaming, especially using video generation models to build playable game experiences.
My research interests are centered around video generation, video understanding, and embodied AI. In the past, I was working on hand pose estimation and gaze estimation tasks.
π₯ News
- [September, 2026]: Β π Two papers have been accepted by CoRL and NeurIPS.
- [March, 2026]: Β π Joined Alaya Lab as AI Researcher.
- [March, 2026]: Β π Received Ph.D. in Information Science from the University of Tokyo.
- [February, 2026]: Β π Two papers have been accepted by CVPR 2026.
- [June, 2025]: Β π One paper has been accepted by ICCV 2025.
π Publications

AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark
Ruicong Liu*, Liangyang Ouyang*, Fengbo Lan, Zhixiang Wang, Kaipeng Zhang
Project page | Paper | Code

Predictive Representation Learning for Manipulation via Streaming Egocentric 3D Hand Forecasting
Ruicong Liu, Yifei Huang, Liangyang Ouyang, Caixin Kang, Yoichi Sato
10th Annual Conference on Robot Learning (CoRL), 2026
Project page | Paper | Code | Dataset


UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking
Xuangeng Chu*, Ruicong Liu* β , Yifei Huang, Yun Liu, Yichen Peng, Bo Zheng
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Project page | Paper | Code

From Gaze Jitter to Domain Adaptation: Generalizing Gaze Estimation by Manipulating High-Frequency Components
Ruicong Liu, Haofei Wang, Feng Lu
International Journal of Computer Vision (IJCV), 2024
Paper



PnP-GA+: Plug-and-Play Domain Adaptation for Gaze Estimation using Model Variants
Ruicong Liu, Yunfei Liu, Haofei Wang, Feng Lu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Paper


π» Experiences

Visiting Scholar - CVML@NUS
National University of Singapore
March 2024 - November 2024
Services:
- Conference Reviewer: CVPR, ECCV, ICCV, NeurIPS, ACM MM, WACV, BMVC
- Journal Reviewer: TMM, TCSVT, TIP, TOMM
π Awards
- JSPS Research Fellowship for Young Scientists DC2, 2025
- Outstanding Masterβs Thesis at BSIG 2024.
- CVPR Outstanding Reviewer Award, 2024.
- SPRING GX Project, 2024.
- The University of Tokyo Doctoral Fellowship (IIW), 2023.
- Outstanding Graduate Student of Beihang University, 2023.
- Bachelor of Honours of Shandong University, 2020.
- Outstanding Graduate Student of Shandong University, 2020.
- National Scholarship, the Ministry of Education of China, 2017.
π Educations
- 2023.04 - 2026.03, Ph.D. in Information Science @ Institute of Industrial Science, the University of Tokyo.
- 2020.09 - 2023.01, M.E. in Computer Technology @ State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University.
- 2016.09 - 2020.06, B.E. in Softerware Engineering @ School of Software Engineering, Shandong University.