About me

I am currently a Ph.D student in Department of Computer Science at UNC at Chapel Hill, advised by Prof. Gedas Bertasius. My current research interests lie in multimodal video understanding, including video-language (VidL) pretraining, video LLM, video continual learning, and video generation.

Prior to joining Gedas's Group, I worked with Prof. Dinggang Shen and Prof. Pew-Thian Yap at UNC on medical imaging. I obtained both my B.S. degree in Information Security in 2016 and M.S. degree in ECE in 2019 at Shanghai JiaoTong University. During my M.S. study, I worked with Prof. Shilin Wang.

Experiences

• 2024/08 - present Bytedance on foundation VideoGen.
• 2023/01 - 2024/07 Visiting Researcher at Meta FAIR. Mentor: Lorenzo Torresani
• 2022/05 - 2022/08 Applied Scientist Intern at Amazon AWS AI.
  Mentor: Bing Shuai & Mingze Xu
• 2021/05 - 2021/08 Applied Scientist Intern at Amazon AWS AI. Mentor: Mingze Xu & Yuanjun Xiong

Publications

Check recent publications on my Google Scholar.

• 4DIFF: 3D-Aware Diffusion Model for Third-to-First Viewpoint Translation
  Feng Cheng, Mi (Romy) Luo, Huiyu Wang, Alex Dimakis, Lorenzo Torresani, Gedas Bertasius, Kristen Grauman
  ECCV 2024

• DAM: Dynamic Adapter Merging for Continual Video QA Learning
  Feng Cheng, Ziyang Wang, Yi-Lin Sung, Yan-Bo Lin, Mohit Bansal, Gedas Bertasius
  Preprint [code]

• Loconet: Long-short context network for active speaker detection
  Xizi Wang, Feng Cheng, Gedas Bertasius, David Crandall
  CVPR 2024 [code]

• Ego-exo4d: Understanding Skilled Human Activity from First-and Third-Person Perspectives
  Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani,
  Feng Cheng, ... , Michael Wray
  CVPR 2024 (Oral) [project website] [blog] [video]

• Unified Coarse-to-Fine Alignment for Video-Text Retrieval
  Ziyang Wang, Yi-Lin Sung, Feng Cheng, Gedas Bertasius, Mohit Bansal
  ICCV 2023 [Code]

• VindLU: A Recipe for Effective Video-and-Language Pretraining
  Feng Cheng, Xizi Wang, Jie Lei, David Crandall, Mohit Bansal, Gedas Bertasius
  CVPR 2023 [Code]

• TALLFormer: Temporal Action Localization with Long-memory Transformer
  Feng Cheng, Gedas Bertasius
  ECCV 2022 [Code]

• Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models
  Feng Cheng, Mingze Xu, Yuanjun Xiong, Hao Chen, Xinyu Li, Wei Li, Wei Xia
  CVPR 2022 (Oral) [Code]

• High-Resolution 3D Magnetic Resonance Fingerprinting With a Graph Convolutional Network
  Feng Cheng, Yilin Liu, Yong Chen, Pew-Thian Yap
  IEEE Transactions on Medical Imaging (2022)

• Spatio-Temporal Fusion based Convolutional Sequence Learning for Lip Reading
  Xingxuan Zhang, Feng Cheng, and Shi-Lin Wang
  ICCV 2019

• Acceleration of High-Resolution 3D MR Fingerprinting via a Graph Convolutional Network
  Feng Cheng, Yong Chen, Xiaopeng Zong, Weili Lin, Pew-Thian Yap, Dinggang Shen
  MICCAI 2020