Hi, I am an AI researcher at Alaya Lab. I received my Ph.D. from the University of Tokyo, where I was advised by Prof. Yoichi Sato. My current research focuses on AI for gaming, especially using video generation models to build playable game experiences.

My research interests are centered around video generation, video understanding, and embodied AI. In the past, I was working on hand pose estimation and gaze estimation tasks.

πŸ”₯ News


  • [September, 2026]: Β πŸŽ‰ Two papers have been accepted by CoRL and NeurIPS.
  • [March, 2026]: Β πŸŽ‰ Joined Alaya Lab as AI Researcher.
  • [March, 2026]: Β πŸŽ‰ Received Ph.D. in Information Science from the University of Tokyo.
  • [February, 2026]: Β πŸŽ‰ Two papers have been accepted by CVPR 2026.
  • [June, 2025]: Β πŸŽ‰ One paper has been accepted by ICCV 2025.

πŸ“ Publications


Preprint
sym

AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark

Ruicong Liu*, Liangyang Ouyang*, Fengbo Lan, Zhixiang Wang, Kaipeng Zhang
Project page | Paper | Code

CoRL 2026
sym

Predictive Representation Learning for Manipulation via Streaming Egocentric 3D Hand Forecasting

Ruicong Liu, Yifei Huang, Liangyang Ouyang, Caixin Kang, Yoichi Sato
10th Annual Conference on Robot Learning (CoRL), 2026
Project page | Paper | Code | Dataset

NeurIPS 2026
sym

SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generation

Liangyang Ouyang, Ruicong Liu†, Caixin Kang, Yifei Huang, Yoichi Sato
The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS), 2026
Paper | Code | Dataset

CVPR 2026
sym

UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking

Xuangeng Chu*, Ruicong Liu* †, Yifei Huang, Yun Liu, Yichen Peng, Bo Zheng
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Project page | Paper | Code

IJCV
sym

From Gaze Jitter to Domain Adaptation: Generalizing Gaze Estimation by Manipulating High-Frequency Components

Ruicong Liu, Haofei Wang, Feng Lu
International Journal of Computer Vision (IJCV), 2024
Paper

ECCV 2024
sym

ActionVOS: Actions as Prompts for Video Object Segmentation

Liangyang Ouyang, Ruicong Liu, Yifei Huang, Ryosuke Furuta, Yoichi Sato
European Conference on Computer Vision (ECCV), 2024 Oral, top 2%
Paper | Video | Code

CVPR 2024
sym

Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation

Ruicong Liu, Takehiko Ohkawa, Mingfang Zhang, Yoichi Sato
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Paper | Video | Code

TPAMI
sym

PnP-GA+: Plug-and-Play Domain Adaptation for Gaze Estimation using Model Variants

Ruicong Liu, Yunfei Liu, Haofei Wang, Feng Lu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Paper

AAAI 2024
sym

UVAGaze: Unsupervised 1-to-2 Views Adaptation for Gaze Estimation

Ruicong Liu, Feng Lu
AAAI Conference on Artificial Intelligence (AAAI), 2024
Paper | Code

ICCV 2021
sym

Generalizing gaze estimation with outlier-guided collaborative adaptation

Yunfei Liu*, Ruicong Liu*, Haofei Wang, Feng Lu
IEEE/CVF International Conference on Computer Vision (ICCV), 2021
Paper | Code

πŸ’» Experiences


sym

Visiting Scholar - CVML@NUS

National University of Singapore
March 2024 - November 2024

Services:

  • Conference Reviewer: CVPR, ECCV, ICCV, NeurIPS, ACM MM, WACV, BMVC
  • Journal Reviewer: TMM, TCSVT, TIP, TOMM

πŸ† Awards


πŸ“– Educations


  • 2023.04 - 2026.03, Ph.D. in Information Science @ Institute of Industrial Science, the University of Tokyo.
  • 2020.09 - 2023.01, M.E. in Computer Technology @ State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University.
  • 2016.09 - 2020.06, B.E. in Softerware Engineering @ School of Software Engineering, Shandong University.