Hi, I am a PhD student at Sato lab, the University of Tokyo, supervised by Prof. Yoichi Sato. I got my M.Eng. degree from Beihang University in 2023, advised by Prof. Feng Lu (PHI-AI). Previously, I received my B.Eng. degree in Software Engineering from Shandong University in 2020.

My research interests lie in human computer interaction, computer vision, and AR/MR. Currently my research mainly focuses on egocentric vision and hand-related tasks. Previously, I was studying gaze estimation during my master program.

๐Ÿ”ฅ News


  • [August, 2024]: ย ๐ŸŽ‰ One paper has been accepted by IJCV.
  • [August, 2024]: ๐ŸŽ‰ Our AssemblyHands-S2D challenge has been open.
  • [July, 2024]: ๐ŸŽ‰ Two ECCV papers have been accepted. One of them is accepted as Oral presentation!
  • [March, 2024]: ย ๐ŸŽ‰ I start my internship at CVML@NUS.
  • [February, 2024]: ย ๐ŸŽ‰ Our S2DHand has been accepted by CVPR 2024.
  • [December, 2023]: ย ๐ŸŽ‰ Our PnP-GA+ has been accepted by TPAMI.
  • [December, 2023]: ย ๐ŸŽ‰ Our UVAGaze has been accepted by AAAI 2024.

๐Ÿ“ Publications


IJCV
sym

From Gaze Jitter to Domain Adaptation: Generalizing Gaze Estimation by Manipulating High-Frequency Components

Ruicong Liu, Haofei Wang, Feng Lu
International Journal of Computer Vision (IJCV), 2024
Paper


ECCV 2024
sym

ActionVOS: Actions as Prompts for Video Object Segmentation

Liangyang Ouyang, Ruicong Liu, Yifei Huang, Ryosuke Furuta, Yoichi Sato
European Conference on Computer Vision (ECCV), 2024 Oral, top 2%
Paper | Video | Code


ECCV 2024
sym

Masked Video and Body-worn IMU Autoencoder for Egocentric Action Recognition

Mingfang Zhang, Yifei Huang, Ruicong Liu, Yoichi Sato
European Conference on Computer Vision (ECCV), 2024
Paper | Video | Code


CVPR 2024
sym

Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation

Ruicong Liu, Takehiko Ohkawa, Mingfang Zhang, Yoichi Sato
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Paper | Video | Code


TPAMI
sym

PnP-GA+: Plug-and-Play Domain Adaptation for Gaze Estimation using Model Variants

Ruicong Liu, Yunfei Liu, Haofei Wang, Feng Lu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Paper


AAAI 2024
sym

UVAGaze: Unsupervised 1-to-2 Views Adaptation for Gaze Estimation

Ruicong Liu, Feng Lu
AAAI Conference on Artificial Intelligence (AAAI), 2024
Paper | Code


ICCV 2021
sym

Generalizing gaze estimation with outlier-guided collaborative adaptation

Yunfei Liu*, Ruicong Liu*, Haofei Wang, Feng Lu
IEEE/CVF International Conference on Computer Vision (ICCV), 2021
Paper | Code


๐Ÿ’ป Experiences


sym

Visiting Scholar - CVML@NUS

National University of Singapore
March 2024 - Present


Services:

  • Conference Reviewer: CVPR, ECCV, BMVC
  • Journal Reviewer: TMM

๐Ÿ† Awards


  • Outstanding Masterโ€™s Thesis at BSIG 2024.
  • CVPR Outstanding Reviewer Award, 2024.
  • SPRING GX Project, 2024.
  • The University of Tokyo Doctoral Fellowship (IIW), 2023.
  • Outstanding Graduate Student of Beihang University, 2023.
  • Bachelor of Honours of Shandong University, 2020.
  • Outstanding Graduate Student of Shandong University, 2020.
  • National Scholarship, the Ministry of Education of China, 2017.

๐Ÿ“– Educations


  • 2023.04 - Present, Ph.D. in Information Science @ Institute of Industrial Science, the University of Tokyo.
  • 2020.09 - 2023.01, M.Eng. in Computer Technology @ School of Computer Science and Engineering, State Key Labratory of Virtual Reality Technology and Systems, Beihang University.
  • 2016.09 - 2020.06, B.Eng. in Softerware Engineering @ School of Software Engineering, Shandong University.