Yichao Yan

Assistant Professor, AI Institute, Shanghai Jiao Tong University

Google Scholar Github

Email: yanyichao(at)sjtu.edu.cn

Office: 5-510, Software building, Shanghai Jiao Tong University.

Facilities

We have a light stage and a motion/volume capture device. We have abundant GPUs.

Opening Positions

I am a co-chair of the SJTU [AIGC Class]. Looking for self-motivated undergraduate and graduate students to work with me in computer vision, AIGC, and 3D modeling. For prospective students, please send your resume and transcript to my email.

Biography

Since May. 2021, I am a tenure-track assistant professor at Shanghai Jiao Tong University. I received my PhD degree from Shanghai Jiao Tong University in 2019, supervised by Professor Xiaokang Yang. I received M. E. from École Centrale de Lyon in France. I received B. E. from Shanghai Jiao Tong University in 2013. I was a research scientist at the Inception Institute of Artificial Intelligence (IIAI) from June 2019 to April 2021.

I am interested in computer vision problems. Typically, I am working on (1) 3D face/body modeling (2) Human motion generation and analysis (3) AIGC.

Updates

• 09/2024, One paper on inverse rendering is accepted by NeurIPS 2024.
• 09/2024, One paper on video anomaly detection is accepted by TCSVT.
• 07/2024, Three papers on avatar generation, face animation, and diffusion model are accepted by ACM Multimedia 2024.
• 07/2024, Two papers on 4D face reconstruction and human-object interaction are accepted by ECCV 2024.
• 02/2024, Four papers on human interaction generation, face reconstruction and editing are accepted by CVPR 2024.
• 02/2024, One paper on human action recognition is accepted by TPAMI.
• 11/2023, 团队获得第十八届“挑战杯”数字人专项赛特等奖.
• 09/2023, We will organize a workshop “AI for Digital Human” on AAAI 2024.
• 09/2023, One paper on NeRF-based visual localization is accepted by NeurIPS 2023.
• 07/2023, One paper on human action generation is accepted by ICCV 2023.
• 06/2023, We win the championship of the 2023 Ego4D Challenge in the Episodic memory: PACO Zero-Shot track.
• 03/2023, Three papers on 3D digital human generation/reconstruction are accepted by CVPR 2023.

Preprints

• EvaSurf: Efficient View-Aware Implicit Textured Surface Reconstruction on Mobile Devices.
  Jingnan Gao, Zhuo Chen, Yichao Yan, Bowen Pan, Zhe Wang, Jiangjing Lyu, Xiaokang Yang
  arXiv Preprint, 2023.
  [project]

• Generalizable person search on open-world user-generated video content.
  Junjie Li, Guanshuo Wang, Yichao Yan, Fufu Yu, Qiong Jia, Jie Qin, Shouhong Ding, Xiaokang Yang
  arXiv Preprint, 2023.
  [paper]

• Rethinking Clothes Changing Person ReID: Conflicts, Synthesis, and Optimization.
  Junjie Li, Guanshuo Wang, Fufu Yu, Yichao Yan, Qiong Jia, Shouhong Ding, Xingdong Sheng, Yunhui Liu, Xiaokang Yang
  arXiv Preprint, 2024.
  [paper]

Publications

• Multi-times Monte Carlo Rendering for Inter-reflection Reconstruction.
  Tengjie Zhu, Zhuo Chen, Jingnan Gao, Yichao Yan, Xiaokang Yang
  Conference on Neural Information Processing Systems (NeurIPS), 2024.
  [project]

• IPAD: Industrial Process Anomaly Detection Dataset.
  Jinfan Liu, Yichao Yan, Junjie Li, Weiming Zhao, Pengzhi Chu, Xingdong Sheng, Yunhui Liu, Xiaokang Yang
  IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2024.
  [project]

• E^3Gen: Efficient, Expressive and Editable Avatars Generation.
  Weitian Zhang, Yichao Yan, Yunhui Liu, Xingdong Sheng, Xiaokang Yang.
  ACM Multimedia, 2024.
  [project]

• Infusion: Preventing Customized Text-to-Image Diffusion from Overfitting.
  Weili Zeng, Yichao Yan, Qi Zhu, Zhuo Chen, Pengzhi Chu, Weiming Zhao, Xiaokang Yang.
  ACM Multimedia, 2024.
  [project]

• MMHead: Towards Fine-grained Multi-modal 3D Facial Animation.
  Sijing Wu, Yunhao Li, Yichao Yan, Huiyu Duan, Ziwei Liu, Guangtao Zhai.
  ACM Multimedia, 2024.

• Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture.
  Xuanchen Li, Yuhao Cheng, Xingyu Ren, Haozhe Jia, Di Xu, Wenhan Zhu, Yichao Yan.
  European Conference on Computer Vision (ECCV), 2024.
  [project]

• HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects.
  Xintao Lv, Liang Xu, Yichao Yan, Xin Jin, Congsheng Xu, Shuwen Wu, Yifan Liu, Lincheng Li, Mengxiao Bi, Wenjun Zeng, Xiaokang Yang.
  European Conference on Computer Vision (ECCV), 2024.
  [project]

• HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks.
  Zhuo Chen, Xudong Xu, Yichao Yan, Ye Pan, Wenhan Zhu, Wayne Wu, Bo Dai, and Xiaokang Yang.
  IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2024.
  [project]

• 3D-Aware Face Editing via Warping-Guided Latent Direction Learning.
  Yuhao Cheng, Zhuo Chen, Xingyu Ren, Wenhan Zhu, Zhengqin Xu, Di Xu, Changpeng Yang, Yichao Yan.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [project]

• Inter-X: Towards Versatile Human-Human Interaction Analysis.
  Liang Xu, Xintao Lv, Yichao Yan, Xin Jin, Shuwen Wu, Congsheng Xu, Yifan Liu, Yizhou Zhou, Fengyun Rao, Xingdong Sheng, Yunhui Liu, Wenjun Zeng, Xiaokang Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [paper] [project]

• ReGenNet: Towards Human Action-Reaction Synthesis.
  Liang Xu, Yizhou Zhou, Yichao Yan, Xin Jin, Wenhan Zhu, Fengyun Rao, Xiaokang Yang, Wenjun Zeng.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [paper] [project]

• Monocular Identity-Conditioned Facial Reflectance Reconstruction.
  Xingyu Ren, Jiankang Deng, Yuhao Cheng, Jia Guo, Chao Ma, Yichao Yan, Wenhan Zhu, Xiaokang Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [project]

• A Coding Framework and Benchmark towards Low-Bitrate Video Understanding.
  Yuan Tian, Guo Lu, Yichao Yan, Guangtao Zhai, Li Chen, Zhiyong Gao.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.
  [paper]

• Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation.
  Yuhao Cheng, Yichao Yan, Wenhan Zhu, Ye Pan, Bowen Pan, Xiaokang Yang.
  ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2024.
  [paper]

• NeRF-IBVS: Visual Servo Based on NeRF for Visual Localization and Navigation.
  Yuanze Wang, Yichao Yan, Dianxi Shi, Wenhan Zhu, Jianqiang Xia, Jianqiang Xia, Tan Jeff, Songchang Jin, Ke Gao, Xiaobo Li, Xiaokang Yang.
  Conference on Neural Information Processing Systems (NeurIPS), 2023.
  [paper]

• ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation.
  Liang Xu, Ziyang Song, Dongliang Wang, Jing Su, Zhicheng Fang, Chenjing Ding, Weihao Gan, Yichao Yan, Xin Jin, Xiaokang Yang, Wenjun Zeng, Wei Wu.
  International Conference on Computer Vision (ICCV), 2023.
  [paper] [project]

• A survey on generative 3D digital humans based on neural networks: representation, rendering and learning. (In Chinese)
  基于神经网络的生成式三维数字人研究综述:表示、渲染与学习.
  Yichao Yan, Yuhao Cheng, Zhuo Chen, Yicong Peng, Sijing Wu, Weitian Zhang, Junjie Li, Yixuan Li, Jingnan Gao, Weixia Zhang, Guangtao Zhai, Xiaokang Yang.
  中国科学：信息科学，SCIENTIA SINICA Informationis, (2023)
  [paper]

• 行人再识别技术研究进展综述.
  张永飞,杨航远,张雨佳,豆朝鹏,廖胜才,郑伟诗,张史梁,叶茫,晏轶超,李俊杰,王生进.
  中国图象图形学报, 2023.
  [paper]

• Improving Fairness in Facial Albedo Estimation via Visual-Textual Cues.
  YXingyu Ren, Jiankang Deng, Chao Ma, Yichao Yan, Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• 3D-Aware Face Swapping.
  Yixuan Li, Chao Ma, Yichao Yan, Wenhan Zhu, Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• GANHead: Towards Generative Animatable Neural Head Avatars.
  Sijing Wu, Yichao Yan, Yunhao Li, Yuhao Cheng, Wenhan Zhu, Ke Gao, XiaoBo Li, Guangtao Zhai.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [paper] [project]

• StyleVR: Stylizing Character Animations with Normalizing Flows.
  Bin Ji, Ye Pan, Yichao Yan, Ruizhao Chen, Xiaokang Yang.
  IEEE Transactions on Visualization and Computer Graphics(TVCG), 2023.
  [paper]

• Efficient Person Search: An Anchor-Free Approach.
  Yichao Yan, Jinpeng Li, Jie Qin, Shengcai Liao, Xiaokang Yang.
  International Journal of Computer Vision (IJCV), 2023.
  [paper] [code]

• CLSA: A Contrastive Learning Framework with Selective Aggregation for Video Rescaling.
  Yuan Tian, Yichao Yan, Guangtao Zhai, Li Chen, Zhiyong Gao.
  IEEE Transactions on Image Processing (TIP), 2023.
  [paper]

• CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation.
  Yicong Peng, Yichao Yan, Shengqi Liu, Yuhao Cheng, Shanyan Guan, Bowen Pan, Guangtao Zhai, Xiaokang Yang.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  [paper] [project]

• EAN: Event Adaptive Network for Enhanced Action Recognition.
  Yuan Tian, Yichao Yan, Xiongkuo Min, Guo Lu, Guangtao Zhai, Guodong Guo, Zhiyong Gao.
  International Journal of Computer Vision (IJCV), 2022.
  [paper] [code]

• Domain Adaptive Person Search.
  Junjie Li, Yichao Yan, Guanshuo Wang, Fufu Yu, Qiong Jia, Shouhong Ding.
  European Conference on Computer Vision (ECCV Oral), 2022.
  [paper] [code]

• Exploring Visual Context for Weakly Supervised Person Search.
  Yichao Yan*, Jinpeng Li*, Shengcai Liao, Jie Qin, Bingbing Ni, Xiaokang Yang, Ling Shao.
  AAAI Conference on Artificial Intelligence (AAAI), 2022.
  [paper] [code]

• Anchor-Free Person Search.
  Yichao Yan*, Jinpeng Li*, Jie Qin, Song Bai, Shengcai Liao, Li Liu, Fan Zhu, Ling Shao.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021.
  [paper] [code]

• Learning Multi-Attention Context Graph for Group-Based Re-Identification.
  Yichao Yan*, Jie Qin*, Bingbing Ni, Jiaxin Chen, Li Liu, Fan Zhu, Wei-Shi Zheng, Xiaokang Yang, Ling Shao.
  IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 2020.
  [paper] [code]

• Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification.
  Yichao Yan*, Jie Qin*, Jiaxin Chen, Li Liu, Fan Zhu, Ying Tai, Ling Shao.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
  [paper] [code]

• Learning Context Graph for Person Search.
  Yichao Yan*, Qiang Zhang*, Bingbing Ni, Minghao Xu, and Xiaokang Yang.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019, Oral.
  [paper] [code]

• Fine-grained Video Captioning via Graph-based Multi-granularity Interaction Learning.
  Yichao Yan*, Ning Zhuang*, Bingbing Ni*, Jian Zhang, Minghao Xu, Qiang Zhang, Zheng Zhang, Shuo Cheng, Qi Tian, Xiaokang Yang, Wenjun Zhang.
  IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 2019.
  [paper]

• Person Re-Identification via Recurrent Feature Aggregation.
  Yichao Yan, Bingbing Ni, Zhichao Song, Chao Ma, Yan Yan and Xiaokang Yang.
  European Conference on Computer Vision (ECCV), 2016.
  [paper] [code] [data&model]

• Cross-modality motion parameterization for fine-grained video prediction.
  Yichao Yan, Bingbing Ni, Wendong Zhang, Jun Tang, Xiaokang Yang.
  Computer Vision and Image Understanding (CVIU) 2019.
  [paper]

• Structure-Constrained Motion Sequence Generation.
  Yichao Yan, Bingbing Ni, Wendong Zhang, Jingwei Xu, Xiaokang Yang.
  IEEE Transactions on Multimedia (TMM) 2018.
  [paper]

• Pose transferrable person re-identification.
  Jinxian Liu*, Bingbing Ni*, Yichao Yan*, Peng Zhou, Shuo Cheng, Jianguo Hu.
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.
  [paper]

• Multi-level attention model for person re-identification.
  Yichao Yan, Bingbing Ni, Jinxian Liu, Xiaokang Yang.
  Pattern Recognition Letters (PRL)2018.
  [paper]

• Video summarization via semantic attended networks.
  Huawei Wei, Bingbing Ni, Yichao Yan, Huanyu Yu, Xiaokang Yang, Chen Yao.
  Thirty-Second AAAI Conference on Artificial Intelligence (AAAI) 2018.
  [paper]

• Skeleton-aided articulated motion generation.
  Yichao Yan, Jingwei Xu, Bingbing Ni, Wendong Zhang and Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Fine-grained recognition via attribute-guided attentive feature aggregation.
  Yichao Yan, Bingbing Ni and Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Deep Cross-Modality Alignment for Multi-Shot Person Re-IDentification.
  Zhichao Song, Bingbing Ni, Yichao Yan, Zhe Ren, Yi Xu, Xiaokang Yang.
  Proceedings of the 25th ACM international conference on Multimedia (ACM MM) 2017.
  [paper]

• Predicting Human Interaction via Relative Attention Model.
  Yichao Yan, Bingbing Ni and Xiaokang Yang.
  International Joint Conference on Artificial Intelligence (IJCAI), 2017.
  [paper]

• Image Matching via Loopy RNN.
  Donghao Luo, Bingbing Ni, Yichao Yan and Xiaokang Yang.
  International Joint Conference on Artificial Intelligence (IJCAI), 2017.
  [paper]