Hi, I am a Ph.D. student at Sato lab, the University of Tokyo, supervised by Prof. Yoichi Sato. I got my M.E. degree from State Key Laboratory of VR Technology and Systems, Beihang University in 2023, advised by Prof. Feng Lu (PHI-AI). Previously, I received my B.E. degree in Software Engineering from Shandong University in 2020.

My research interests are centered around video understanding and human-computer interaction. Currently, my work focuses primarily on egocentric vision and its applications, particularly in embodied AI. In the past, I have researched hand pose estimation and gaze estimation tasks.

🔥 News

[February, 2026]: 🎉 Two papers have been accepted by CVPR 2026.
[June, 2025]: 🎉 One paper has been accepted by ICCV 2025.
[December, 2024]: 🎉 I am luckily accepted by JSPS Research Fellowship for Young Scientists DC2.
[August, 2024]: 🎉 One paper has been accepted by IJCV.
[August, 2024]: 🎉 Our AssemblyHands-S2D challenge has been open.
[July, 2024]: 🎉 Two ECCV papers have been accepted. One of them is accepted as Oral presentation!
[February, 2024]: 🎉 Our S2DHand has been accepted by CVPR 2024.
[December, 2023]: 🎉 Our PnP-GA+ has been accepted by TPAMI.

📝 Publications

Preprint

SFHand: A Streaming Framework for Language-guided 3D Hand Forecasting and Embodied Manipulation

Ruicong Liu, Yifei Huang, Liangyang Ouyang, Caixin Kang, Yoichi Sato
Paper | Code | Dataset

CVPR 2026

UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking

Xuangeng Chu*, Ruicong Liu^{* †}, Yifei Huang, Yun Liu, Yichen Peng, Bo Zheng
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Paper

CVPR 2026

Yichen Peng, Jyun-Ting Song, Siyeol Jung, RUOFAN LIU, Haiyang Liu, Xuangeng Chu, Ruicong Liu, Erwin Wu, Hideki Koike, Kris Kitani
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026

ICCV 2025

Egocentric Inertial Localization with Vision-Language Informed Action Cues

Mingfang Zhang, Ryo Yonetani, Yifei Huang, Liangyang Ouyang, Ruicong Liu, Yoichi Sato
IEEE/CVF International Conference on Computer Vision (ICCV), 2025
Paper | Code

IJCV

From Gaze Jitter to Domain Adaptation: Generalizing Gaze Estimation by Manipulating High-Frequency Components

Ruicong Liu, Haofei Wang, Feng Lu
International Journal of Computer Vision (IJCV), 2024
Paper

ECCV 2024

ActionVOS: Actions as Prompts for Video Object Segmentation

Liangyang Ouyang, Ruicong Liu, Yifei Huang, Ryosuke Furuta, Yoichi Sato
European Conference on Computer Vision (ECCV), 2024 Oral, top 2%
Paper | Video | Code

ECCV 2024

Masked Video and Body-worn IMU Autoencoder for Egocentric Action Recognition

Mingfang Zhang, Yifei Huang, Ruicong Liu, Yoichi Sato
European Conference on Computer Vision (ECCV), 2024
Paper | Video | Code

CVPR 2024

Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation

Ruicong Liu, Takehiko Ohkawa, Mingfang Zhang, Yoichi Sato
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Paper | Video | Code

TPAMI

PnP-GA+: Plug-and-Play Domain Adaptation for Gaze Estimation using Model Variants

Ruicong Liu, Yunfei Liu, Haofei Wang, Feng Lu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Paper

AAAI 2024

UVAGaze: Unsupervised 1-to-2 Views Adaptation for Gaze Estimation

Ruicong Liu, Feng Lu
AAAI Conference on Artificial Intelligence (AAAI), 2024
Paper | Code

ICCV 2021

Generalizing gaze estimation with outlier-guided collaborative adaptation

Yunfei Liu*, Ruicong Liu*, Haofei Wang, Feng Lu
IEEE/CVF International Conference on Computer Vision (ICCV), 2021
Paper | Code

💻 Experiences

Visiting Scholar - CVML@NUS

National University of Singapore
March 2024 - November 2024

Services:

Conference Reviewer: CVPR, ECCV, ICCV, NeurIPS, ACM MM, WACV, BMVC
Journal Reviewer: TMM, TCSVT, TIP, TOMM

🏆 Awards

JSPS Research Fellowship for Young Scientists DC2, 2025
Outstanding Master’s Thesis at BSIG 2024.
CVPR Outstanding Reviewer Award, 2024.
SPRING GX Project, 2024.
The University of Tokyo Doctoral Fellowship (IIW), 2023.
Outstanding Graduate Student of Beihang University, 2023.
Bachelor of Honours of Shandong University, 2020.
Outstanding Graduate Student of Shandong University, 2020.
National Scholarship, the Ministry of Education of China, 2017.

📖 Educations

2023.04 - Present, Ph.D. in Information Science @ Institute of Industrial Science, the University of Tokyo.
2020.09 - 2023.01, M.E. in Computer Technology @ State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University.
2016.09 - 2020.06, B.E. in Softerware Engineering @ School of Software Engineering, Shandong University.

Ruicong Liu