I am currently a Lecturer at the ReLER lab, University of Technology Sydney. My research interests include video representation learning, unsupervised learning, self-supervised learning, few-shot learning, transfer learning.

I received my Ph.D. degree in University of Technology Sydney, advised by Prof. Yi Yang. I graduated from Zhejiang University with a bachelor’s degree.

Updates

• Mar 2021. I received the Google Research Scholar Award on Sign Language Translation.
• Dec 2020. We will organize the Long-form Video Understanding workshop at CVPR’21.
• Dec 2020. We will organize the Workshop on Neural Architecture Search: 1st lightweight NAS challenge and moving beyond at CVPR’21.
• June 2020. We ranked first on both seen and unseen test sets in EPIC-Kitchen Action Recognition 2020. See our technical report. More details can be found here.

Publications

• Faster Meta Update Strategy for Noise-Robust Deep Learning
  Youjiang Xu, Linchao Zhu, Lu Jiang, Yi Yang
  CVPR 2021 (Oral) [PDF] [Supp]

• OpenMix: Reviving Known Knowledge for Discovering Novel Visual Categories in An Open World
  Zhun Zhong, Linchao Zhu, Zhiming Luo, Shaozi Li, Yi Yang, Nicu Sebe
  CVPR 2021 [PDF]

• T2VLAD: Global-Local Sequence Alignment for Text-Video Retrieval
  Xiaohan Wang, Linchao Zhu, Yi Yang
  CVPR 2021 [PDF]

• Instance-Invariant Domain Adaptive Object Detection via Progressive Disentanglement
  Aming Wu, Yahong Han, Linchao Zhu, Yi Yang
  TPAMI, DOI: 10.1109/TPAMI.2021.3060446 [PDF]

• Holistic LSTM for Pedestrian Trajectory Prediction
  Ruijie Quan, Linchao Zhu, Yu Wu, Yi Yang
  TIP, DOI: 10.1109/TIP.2021.3058599 [PDF]

• Temporal Cross-Layer Correlation Mining for Action Recognition
  Linchao Zhu, Hehe Fan, Yawei Luo, Mingliang Xu, Yi Yang
  TMM, DOI: 10.1109/TMM.2021.3057503 [PDF]

• Learning to Anticipate Egocentric Actions by Imagination
  Yu Wu, Linchao Zhu, Xiaohan Wang, Yi Yang, and Fei Wu
  TIP, DOI: 10.1109/TIP.2020.3040521 [PDF]

• Symbiotic Attention for Egocentric Action Recognition with Object-centric Alignment
  Xiaohan Wang, Linchao Zhu, Yu Wu, Yi Yang
  TPAMI, DOI: 10.1109/TPAMI.2020.3015894 [PDF][Bibtex]

• Label Independent Memory for Semi-Supervised Few-shot Video Classification
  Linchao Zhu, Yi Yang
  TPAMI, DOI: 10.1109/TPAMI.2020.3007511, 2020 [PDF][Bibtex]

• SF-Net: Single-Frame Supervision for Temporal Action Localization
  Fan Ma, Linchao Zhu, Yi Yang, Shengxin Zha, Gourab Kundu, Matt Feiszli, Zheng Shou
  ECCV 2020 (Spotlight) [PDF][Code]

• Motion-Excited Sampler: Video Adversarial Attack with Sparked Prior
  Hu Zhang, Linchao Zhu, Yi Zhu, Yi Yang
  ECCV 2020 [PDF][Code]

• Learning to Transfer Learn: Reinforcement Learning-Based Selection for Adaptive Transfer Learning
  Linchao Zhu, Sercan O. Arık, Yi Yang, Tomas Pfister
  ECCV 2020 [PDF] [Code]

• ActBERT: Learning Global-Local Video-Text Representations
  Linchao Zhu, Yi Yang
  CVPR 2020 (Oral) [PDF]

• Inflated Episodic Memory with Region Self-Attention for Long-Tailed Visual Recognition
  Linchao Zhu, Yi Yang
  CVPR 2020 [PDF]

• Gated Channel Transformation for Visual Recognition
  Zongxin Yang, Linchao Zhu, Yu Wu, Yi Yang
  CVPR 2020 [Arxiv][Code]

• Semantic Correspondence as an Optimal Transport Problem
  Yanbin Liu, Linchao Zhu, Makoto Yamada, Yi Yang
  CVPR 2020 [PDF][Code]

• Learning Filter Pruning Criteria for Deep Convolutional Neural Networks Acceleration
  Yang He, Yuhang Ding, Ping Liu, Linchao Zhu, Hanwang Zhang, Yi Yang
  CVPR 2020 [PDF]

• Recurrent Attention Network with Reinforced Generator for Visual Dialog
  Hehe Fan, Linchao Zhu, Yi Yang and Fei Wu
  TOMM 2020 [PDF] [Bibtex]

• Symbiotic Attention with Privileged Information for Egocentric Action Recognition
  Xiaohan Wang, Yu Wu, Linchao Zhu, Yi Yang
  AAAI 2020 (Oral) [PDF]

• FASTER Recurrent Networks for Video Classification
  Linchao Zhu, Laura Sevilla-Lara, Du Tran, Matt Feiszli, Yi Yang, Heng Wang
  AAAI 2020 [PDF]

• Connective Cognition Network for Directional Visual Commonsense Reasoning
  Aming Wu, Linchao Zhu, Yahong Han, Yi Yang
  NeurIPS 2019 [PDF Code]

• Dual Attention Matching for Audio-Visual Event Localization
  Yu Wu, Linchao Zhu, Yan Yan, Yi Yang
  ICCV 2019 (Oral) [PDF]

• Entangled Transformer for Image Captioning
  Guang Li, Linchao Zhu, Ping Liu, Yi Yang
  ICCV 2019 [PDF]

• Auto-ReID: Searching for a Part-Aware ConvNet for Person Re-Identification
  Ruijie Quan, Xuanyi Dong, Yu Wu, Linchao Zhu, Yi Yang
  ICCV 2019 [PDF]

• Sim-Real Joint Reinforcement Transfer for 3D Indoor Navigation
  Fengda Zhu, Linchao Zhu, Yi Yang
  CVPR 2019 [PDF]

• Cubic LSTMs for Video Prediction
  Hehe Fan, Linchao Zhu, Yi Yang
  AAAI 2019 [PDF]

• Compound Memory Networks for Few-shot Video Classification
  Linchao Zhu, Yi Yang
  ECCV 2018 [PDF], [train.list, val.list, test.list]

• Decoupled Novel Object Captioner
  Yu Wu, Linchao Zhu, Lu Jiang, Yi Yang
  ACM MM 2018 [PDF Code]

• Fast Parameter Adaptation for Few-shot Image Captioning and Visual Question Answering
  Xuanyi Dong, Linchao Zhu, De Zhang, Yi Yang, Fei Wu
  ACM MM 2018 [PDF Code]

• Watching a Small Portion could be as Good as Watching All:
  Towards Efficient Video Classification
  Hehe Fan, Zhongwen Xu, Linchao Zhu, Chenggang Yan, Jianjun Ge, Yi Yang
  IJCAI 2018 [PDF Code]

• Bidirectional Multirate Reconstruction for Temporal Modeling in Videos
  Linchao Zhu, Zhongwen Xu, Yi Yang
  CVPR 2017 (Spotlight) [PDF Code]

• Few-Shot Object Recognition from Machine-Labeled Web Images
  Zhongwen Xu*, Linchao Zhu*, Yi Yang
  CVPR 2017 (Spotlight), * indicates equal contributions [PDF Code]

• Uncovering Temporal Context for Video Question Answering
  Linchao Zhu, Zhongwen Xu, Yi Yang, Alex G. Hauptmann
  IJCV, DOI: 10.1007/s11263-017-1033-7, 2017 [PDF] [Project] [Bibtex]

• Recognizing an action using its name: A knowledge-based approach
  Chuang Gan, Yi Yang, Linchao Zhu, Deli Zhao, Yueting Zhuang
  IJCV, DOI: 10.1007/s11263-016-0893-6, 2016 [PDF]

Preprints

• SemGloVe: Semantic Co-occurrences for GloVe from BERT
  Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu and Yi Yang
  [Arxiv]

• Feature Robust Optimal Transport for High-dimensional Data
  Mathis Petrovich, Chao Liang, Yanbin Liu, Yao-Hung Hubert Tsai, Linchao Zhu, Yi Yang, Ruslan Salakhutdinov, Makoto Yamada
  [Arxiv]

• Meta Filter Pruning to Accelerate Deep Convolutional Neural Networks
  Yang He, Ping Liu, Linchao Zhu, Yi Yang
  [Arxiv]

Competitions

• We ranked first in EPIC-Kitchen Action Recognition 2020. See our report for more details.

• We ranked first in EPIC-Kitchen Action Recognition 2019. See our report.

• Our report on ActivityNet Trimmed Action Recognition 2017.

• Our report on Google YouTube8M Classification 2017.

• We got the first place on the video localization task in TRECVID 2016 competition. See our report.

• We got the first place on the Action Recognition task in THUMOS 2015. See our notebook paper.