Zi-Yuan Hu (胡梓渊, Henry)

Email1: henryhuzy AT gmail.com

Email2: zyhu22 AT cse.cuhk.edu.hk

Address: Department of Computer Science and Engineering,
The Chinese University of Hong Kong (CUHK CSE)



Hi, welcome to my personal website! Feel free to contact me:)

I am a third-year Ph.D. student of CUHK LaVi Lab (Language and Vision Lab), supervised by
Prof. Liwei Wang (Asst. Prof.) and Prof. Michael R. Lyu (Prof., IEEE Fellow, AAAS Fellow, ACM Fellow, HKAES Fellow). Before that, I received my B.E. degree at Sun Yat-sen University in 2022.

Just look me up on:

News

  • [09/2024] Our works "Visual Table" and "TG-Vid" are accepted by EMNLP.
  • [10/2023] Our work on comprehevsive Chinese Language Model Evalution Platform (CLEVA) is accepted by EMNLP.
  • [09/2023] Glad to server as a TA for AIST 1000 Introduction to Artificial Intelligence and Machine Learning.
  • [07/2023] Our work on Vision-Language Parameter-Efficient Tuning (VL-PET) is accepted by ICCV.
  • [05/2023] Welcome everyone to share research trends in LLM-guided multimodal learning at Awesome-Multimodal-LLM.
  • [01/2023] Happy to server as a TA for CSCI 3320 Fundamentals of Machine Learning.
  • [09/2022] Start my Ph.D. life at CUHK CSE.
  • [07/2022] Our team won the 1st place in LIC 2022 Challenge. [CUHK CSE News]
  • [07/2022] Our work on Graph Contrastive Learning is accepted by TNNLS.
  • [06/2022] Graduate from SYSU CSE with Outstanding Graduate Thesis and several awards.

Research Interests

  • Multimodal Learning, especially Vision-and-Language Learning
  • Natural Language Processing (NLP), especially Parameter-Efficient Tuning

Selected Publications

* indicates equal contribution.
  • "Enhancing Temporal Modeling of Video LLMs via Time Gating"
    Zi-Yuan Hu, Yiwu Zhong, Shijia Huang, Michael R. Lyu, Liwei Wang
  • "Beyond Embeddings: The Promise of Visual Table in Visual Reasoning"
    Yiwu Zhong*, Zi-Yuan Hu*, Michael R. Lyu, Liwei Wang
  • "CLEVA: Chinese Language Models EVAluation Platform"
    Yanyang Li, Jianqiao Zhao, Duo Zheng, Zi-Yuan Hu, Zhi Chen, Xiaohui Su, Yongfeng Huang, Shijia Huang, Dahua Lin, Michael R. Lyu, Liwei Wang
    • (EMNLP 2023 System Demonstration)
    • [paper][code]
  • "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
    Zi-Yuan Hu, Yanyang Li, Michael R. Lyu, Liwei Wang

Academic Services

  • Conference Reviewer: CVPR, ACL
  • Journal Reviewer: IJCV

Education

  • The Chinese University of Hong Kong (CUHK)
    • Aug. 2022 -- Present
    • Ph.D. in Computer Science and Engineering
  • Sun Yat-sen University (SYSU)
    • Sep. 2018 –- Jun. 2022
    • B.Eng. in Software Engineering

Honors and Awards

  • 1st place, Language and Intelligence Challenge (LIC), 2022
  • Outstanding Graduate Thesis, SYSU, 2022
  • Academic Innovation Scholarship (Top 2%), SYSU, 2021
  • Academic Competition Scholarship (Top 2%), SYSU, 2021
  • National Scholarship (Top 2%), Ministry of Education of China, 2020
  • The First Prize Scholarship (Top 5%), SYSU, 2020
  • National Scholarship (Top 2%), Ministry of Education of China, 2019
  • The First Prize Scholarship (Top 5%), SYSU, 2019

Teaching Experience

  • AIST 1000 Introduction to Artificial Intelligence and Machine Learning (TA), CUHK, Fall 2024
  • CSCI 3320 Fundamentals of Machine Learning (TA), CUHK, Spring 2024
  • AIST 1000 Introduction to Artificial Intelligence and Machine Learning (TA), CUHK, Fall 2023
  • CSCI 3320 Fundamentals of Machine Learning (TA), CUHK, Spring 2023