Yichao Yan

Assistant Professor, AI Institute, Shanghai Jiao Tong University

Google Scholar Github

Email: yanyichao(at)sjtu.edu.cn

Office: 5-510, Software building, Shanghai Jiao Tong University.

Facilities

We have a light stage and several motion capture devices.

Opening Positions

Looking for self-motivated students working with me in computer vision. For prospective students, please send your resume and transcript to my email.

Biography

Since May. 2021, I am a tenure-track assistant professor at Shanghai Jiao Tong University. I received my PhD degree from Shanghai Jiao Tong University in 2019, supervised by Professor Xiaokang Yang. I received M. E. from École Centrale de Lyon in France. I received B. E. from Shanghai Jiao Tong University in 2013. I was a research scientist at the Inception Institute of Artificial Intelligence (IIAI) from June 2019 to April 2021.

I am interested in computer vision and machine learning problems. Typically, I am working on (1） Digital Human Generation/Editing/Rendering (2) Person Re-identification (3) Video Analysis

Updates

• 02/2024, Four papers on human interaction generation, face reconstruction and editing are accepted by CVPR 2024.
• 02/2024, One paper on human action recognition is accepted by TPAMI.
• 11/2023, 团队获得第十八届“挑战杯”数字人专项赛特等奖.
• 09/2023, We will organize a workshop “AI for Digital Human” on AAAI 2024.
• 09/2023, One paper on NeRF-based visual localization is accepted by NeurIPS 2023.
• 07/2023, One paper on human action generation is accepted by ICCV 2023.
• 06/2023, We win the championship of the 2023 Ego4D Challenge in the Episodic memory: PACO Zero-Shot track.
• 04/2023, Our survey paper on digital human generation is accepted by SCIENTIA SINICA Informationis.
• 03/2023, Three papers on 3D digital human generation/reconstruction are accepted by CVPR 2023.
• 02/2023, One paper is accepted by TIP, one paper is accepted by IJCV.
• 09/2022, One paper is accepted by NeurIPS 2022.
• 07/2022, One paper is accepted by IJCV.
• 07/2022, I receive CCF-阿里巴巴创新研究计划青年科学基金.
• 07/2022, One paper is accepted by ECCV 2022.
• 12/2021, One paper is accepted by AAAI 2022.
• 12/2021, I receive Huawei-MindSpore学术奖励基金.
• 09/2021, I serve as an SPC member for AAAI22.
• 05/2021, I join the AI Institute of Shanghai Jiao Tong University as an assistant professor.
• 11/2020, I receive the Excellent Doctoral Dissertation Award from CSIG.

Publications

• 3D-Aware Face Editing via Warping-Guided Latent Direction Learning.
  Yuhao Cheng, Zhuo Chen, Xingyu Ren, Wenhan Zhu, Zhengqin Xu, Di Xu, Changpeng Yang, Yichao Yan.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [project]

• Inter-X: Towards Versatile Human-Human Interaction Analysis.
  Liang Xu, Xintao Lv, Yichao Yan, Xin Jin, Shuwen Wu, Congsheng Xu, Yifan Liu, Yizhou Zhou, Fengyun Rao, Xingdong Sheng, Yunhui Liu, Wenjun Zeng, Xiaokang Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [paper] [project]

• ReGenNet: Towards Human Action-Reaction Synthesis.
  Liang Xu, Yizhou Zhou, Yichao Yan, Xin Jin, Wenhan Zhu, Fengyun Rao, Xiaokang Yang, Wenjun Zeng.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [paper] [project]

• Monocular Identity-Conditioned Facial Reflectance Reconstruction.
  Xingyu Ren, Jiankang Deng, Yuhao Cheng, Jia Guo, Chao Ma, Yichao Yan, Wenhan Zhu, Xiaokang Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [project]

• A Coding Framework and Benchmark towards Low-Bitrate Video Understanding.
  Yuan Tian, Guo Lu, Yichao Yan, Guangtao Zhai, Li Chen, Zhiyong Gao.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.
  [paper]

• Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation.
  Yuhao Cheng, Yichao Yan, Wenhan Zhu, Ye Pan, Bowen Pan, Xiaokang Yang.
  ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2024.
  [paper]

• NeRF-IBVS: Visual Servo Based on NeRF for Visual Localization and Navigation.
  Yuanze Wang, Yichao Yan, Dianxi Shi, Wenhan Zhu, Jianqiang Xia, Jianqiang Xia, Tan Jeff, Songchang Jin, Ke Gao, Xiaobo Li, Xiaokang Yang.
  Conference on Neural Information Processing Systems (NeurIPS), 2023.
  [paper]

• ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation.
  Liang Xu, Ziyang Song, Dongliang Wang, Jing Su, Zhicheng Fang, Chenjing Ding, Weihao Gan, Yichao Yan, Xin Jin, Xiaokang Yang, Wenjun Zeng, Wei Wu.
  International Conference on Computer Vision (ICCV), 2023.
  [paper] [project]

• A survey on generative 3D digital humans based on neural networks: representation, rendering and learning. (In Chinese)
  基于神经网络的生成式三维数字人研究综述:表示、渲染与学习.
  Yichao Yan, Yuhao Cheng, Zhuo Chen, Yicong Peng, Sijing Wu, Weitian Zhang, Junjie Li, Yixuan Li, Jingnan Gao, Weixia Zhang, Guangtao Zhai, Xiaokang Yang.
  中国科学：信息科学，SCIENTIA SINICA Informationis, (2023)
  [paper]

• 行人再识别技术研究进展综述.
  张永飞,杨航远,张雨佳,豆朝鹏,廖胜才,郑伟诗,张史梁,叶茫,晏轶超,李俊杰,王生进.
  中国图象图形学报, 2023.
  [paper]

• Improving Fairness in Facial Albedo Estimation via Visual-Textual Cues.
  YXingyu Ren, Jiankang Deng, Chao Ma, Yichao Yan, Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• 3D-Aware Face Swapping.
  Yixuan Li, Chao Ma, Yichao Yan, Wenhan Zhu, Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• GANHead: Towards Generative Animatable Neural Head Avatars.
  Sijing Wu, Yichao Yan, Yunhao Li, Yuhao Cheng, Wenhan Zhu, Ke Gao, XiaoBo Li, Guangtao Zhai.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• StyleVR: Stylizing Character Animations with Normalizing Flows.
  Bin Ji, Ye Pan, Yichao Yan, Ruizhao Chen, Xiaokang Yang.
  IEEE Transactions on Visualization and Computer Graphics(TVCG), 2023.
  [paper]

• Efficient Person Search: An Anchor-Free Approach.
  Yichao Yan, Jinpeng Li, Jie Qin, Shengcai Liao, Xiaokang Yang.
  International Journal of Computer Vision (IJCV), 2023.
  [paper] [code]

• CLSA: A Contrastive Learning Framework with Selective Aggregation for Video Rescaling.
  Yuan Tian, Yichao Yan, Guangtao Zhai, Li Chen, Zhiyong Gao.
  IEEE Transactions on Image Processing (TIP), 2023.
  [paper]

• CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation.
  Yicong Peng, Yichao Yan, Shengqi Liu, Yuhao Cheng, Shanyan Guan, Bowen Pan, Guangtao Zhai, Xiaokang Yang.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  [paper] [project]

• EAN: Event Adaptive Network for Enhanced Action Recognition.
  Yuan Tian, Yichao Yan, Xiongkuo Min, Guo Lu, Guangtao Zhai, Guodong Guo, Zhiyong Gao.
  International Journal of Computer Vision (IJCV), 2022.
  [paper] [code]

• Domain Adaptive Person Search.
  Junjie Li, Yichao Yan, Guanshuo Wang, Fufu Yu, Qiong Jia, Shouhong Ding.
  European Conference on Computer Vision (ECCV Oral), 2022.
  [paper] [code]

• Exploring Visual Context for Weakly Supervised Person Search.
  Yichao Yan*, Jinpeng Li*, Shengcai Liao, Jie Qin, Bingbing Ni, Xiaokang Yang, Ling Shao.
  AAAI Conference on Artificial Intelligence (AAAI), 2022.
  [paper] [code]

• Anchor-Free Person Search.
  Yichao Yan*, Jinpeng Li*, Jie Qin, Song Bai, Shengcai Liao, Li Liu, Fan Zhu, Ling Shao.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021.
  [paper] [code]

• Learning Multi-Attention Context Graph for Group-Based Re-Identification.
  Yichao Yan*, Jie Qin*, Bingbing Ni, Jiaxin Chen, Li Liu, Fan Zhu, Wei-Shi Zheng, Xiaokang Yang, Ling Shao.
  IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 2020.
  [paper] [code]

• Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification.
  Yichao Yan*, Jie Qin*, Jiaxin Chen, Li Liu, Fan Zhu, Ying Tai, Ling Shao.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
  [paper] [code]

• Learning Context Graph for Person Search.
  Yichao Yan*, Qiang Zhang*, Bingbing Ni, Minghao Xu, and Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019, Oral.
  [paper] [code]

• Fine-grained Video Captioning via Graph-based Multi-granularity Interaction Learning.
  Yichao Yan*, Ning Zhuang*, Bingbing Ni*, Jian Zhang, Minghao Xu, Qiang Zhang, Zheng Zhang, Shuo Cheng, Qi Tian, Xiaokang Yang, Wenjun Zhang.
  IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 2019.
  [paper]

• Person Re-Identification via Recurrent Feature Aggregation.
  Yichao Yan, Bingbing Ni, Zhichao Song, Chao Ma, Yan Yan and Xiaokang Yang.
  European Conference on Computer Vision (ECCV), 2016.
  [paper] [code] [data&model]

• Cross-modality motion parameterization for fine-grained video prediction.
  Yichao Yan, Bingbing Ni, Wendong Zhang, Jun Tang, Xiaokang Yang.
  Computer Vision and Image Understanding (CVIU) 2019.
  [paper]

• Structure-Constrained Motion Sequence Generation.
  Yichao Yan, Bingbing Ni, Wendong Zhang, Jingwei Xu, Xiaokang Yang.
  IEEE Transactions on Multimedia (TMM) 2018.
  [paper]

• Pose transferrable person re-identification.
  Jinxian Liu*, Bingbing Ni*, Yichao Yan*, Peng Zhou, Shuo Cheng, Jianguo Hu.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.
  [paper]

• Multi-level attention model for person re-identification.
  Yichao Yan, Bingbing Ni, Jinxian Liu, Xiaokang Yang.
  Pattern Recognition Letters (PRL)2018.
  [paper]

• Video summarization via semantic attended networks.
  Huawei Wei, Bingbing Ni, Yichao Yan, Huanyu Yu, Xiaokang Yang, Chen Yao.
  Thirty-Second AAAI Conference on Artificial Intelligence (AAAI) 2018.
  [paper]

• Skeleton-aided articulated motion generation.
  Yichao Yan, Jingwei Xu, Bingbing Ni, Wendong Zhang and Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Fine-grained recognition via attribute-guided attentive feature aggregation.
  Yichao Yan, Bingbing Ni and Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Deep Cross-Modality Alignment for Multi-Shot Person Re-IDentification.
  Zhichao Song, Bingbing Ni, Yichao Yan, Zhe Ren, Yi Xu, Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Predicting Human Interaction via Relative Attention Model.
  Yichao Yan, Bingbing Ni and Xiaokang Yang.
  International Joint Conference on Artificial Intelligence (IJCAI), 2017.
  [paper]

• Image Matching via Loopy RNN.
  Donghao Luo, Bingbing Ni, Yichao Yan and Xiaokang Yang.
  International Joint Conference on Artificial Intelligence (IJCAI), 2017.
  [paper]