Menu
Home
Google Scholar
LinkedIn

Qi, Zhongang (祁仲昂)

alt text 

I am currently a Principal Researcher at Huawei Noah’s Ark Lab, leading an effort on multimodal large language model and controllable visual content generation. I received the B.S. and Ph.D degrees in information science and electronic engineering from Zhejiang University, supervised by Prof. Zhongfei (Mark) Zhang. I was a Postdoctoral Researcher with the School of Electrical Engineering and Computer Science, Oregon State University, supervised by Prof. Fuxin Li. Before joining Huawei, I was a Principal Researcher in ARC Lab, Tencent PCG .

E-mail: zhongangqi[at]gmail.com

Selected Publications

Multimodal LLM & Multimodal/Cross-modal Learning

  1. Yinan Zhou, Yuxin Chen, Haokun Lin, Shuyu Yang, Li Zhu, Zhongang Qi*, Chen Ma, Ying Shan, "DOGE: Towards Versatile Visual Document Grounding and Referring", in arXiv:2411.17125. (*Corresponding author) [pdf]

  2. Tao Zhang, Ziqi Zhang, Zongyang Ma, Yuxin Chen, Zhongang Qi, Chunfeng Yuan, Bing Li, Junfu Pu, Yuxuan Zhao, Zehua Xie, Jin Ma, Ying Shan, Weiming Hu, "mR2AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA", in arXiv:2411.15041. [pdf]

  3. Ye Liu, Zongyang Ma, Zhongang Qi*, Yang Wu, Ying Shan, Chang Wen Chen, "E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding", in NeurIPS 2024. (*Corresponding author) [pdf]

  4. Tao Yang, Yingmin Luo, Zhongang Qi*, Yang Wu, Ying Shan, Chang Wen Chen, "PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM", in arXiv:2406.02884. (*Corresponding author) [pdf]

  5. Chaolei Tan, Zihang Lin, Junfu Pu, Zhongang Qi, Wei-Yi Pei, Zhi Qu, Yexin Wang, Ying Shan, Wei-Shi Zheng, Jian-Fang Hu, “SynopGround: A Large-Scale Dataset for Multi-Paragraph Video Grounding from TV Dramas and Synopses'', in ACM MM 2024.

  6. Zongyang Ma, Ziqi Zhang, Yuxin Chen, Zhongang Qi, Chunfeng Yuan, Bing Li, Yingmin Luo, Xu Li, Xiaojuan Qi, Ying Shan, Weiming Hu, “EA-VTR: Event-Aware Video-Text Retrieval'', in ECCV 2024.

  7. Yuxin Chen, Zongyang Ma, Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Bing Li, Junfu Pu, Ying Shan, Xiaojuan Qi, Weiming Hu, “How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval?'', in CVPR 2024.

  8. Ziqi Zhang, Zongyang Ma, Chunfeng Yuan, Yuxin Chen, Peijin Wang, Zhongang Qi, Chenglei Hao, Bing Li, Ying Shan, Weiming Hu, Stephen Maybank, “Chinese Title Generation for Short Videos: Dataset, Metric and Algorithm'', in TPAMI 2024.

  9. Zongyang Ma, Ziqi Zhang, Yuxin Chen, Zhongang Qi, Yingmin Luo, Zekun Li, Chunfeng Yuan, Bing Li, Xiaohu Qie, Ying Shan, Weiming Hu, “Order-Prompted Tag Sequence Generation for Video Tagging'', in ICCV 2023.

  10. Yuxuan Zhao, Jin Ma, Zhongang Qi, Zehua Xie, Yu Luo, Qiusheng Kang, Ying Shan, “VTLayout: A Multi-Modal Approach for Video Text Layout'', in ACM MM 2023.

  11. Yuxin Chen, Zongyang Ma, Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Ying Shan, Bing Li, Weiming Hu, Xiaohu Qie, Jianping Wu, “ViLEM: Visual-Language Error Modeling for Image-Text Retrieval'', in CVPR 2023.

  12. Yizhen Chen, Jie Wang, Lijian Lin, Zhongang Qi*, Jin Ma, Ying Shan, “Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval'', in AAAI 2023. (*Corresponding author)

  13. Yuxin Chen, Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Jie Wang, Ying Shan, Bing Li, Weiming Hu, Xiaohu Qie, Jianping Wu, “DARTScore: DuAl-Reconstruction Transformer for Video Captioning Evaluation'', in IEEE Transactions on Circuits and Systems for Video Technology, 2023.

  14. Tao Yang, Fan Wang, Junfan Lin, Zhongang Qi, Yang Wu, Jing Xu, Ying Shan, Changwen Chen, “Toward Human Perception-Centric Video Thumbnail Generation'', in ACM MM 2023.

  15. Di Jin, Zhongang Qi, Yingmin Luo, Ying Shan, “TransFusion: Multi-Modal Fusion for Video Tag Inference via Translation-based Knowledge Embedding'', in ACM MM 2021.

  16. Xiao Wang*, Weirong Ye*, Zhongang Qi, Xun Zhao, Guangge Wang, Ying Shan, Hanzi Wang, “Semantic-Guided Relation Propagation Network for Few-shot Action Recognition'', in ACM MM 2021.

  17. Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Ying Shan, Bing Li, Ying Deng, Weiming Hu, “Open-book Video Captioning with Retrieve-Copy-Generate Network'', in CVPR 2021.

Controllable Visual Content Generation

  1. Songsong Yu, Yuxin Chen, Zhongang Qi*, Zeke Xie, Yifan Wang, Lijun Wang, Ying Shan, Huchuan Lu, "Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversion", in CVPR 2025. (*Corresponding author)

  2. Jiangshan Wang, Junfu Pu, Zhongang Qi*, Jiayi Guo, Yue Ma, Nisha Huang, Yuxin Chen, Xiu Li, Ying Shan, "Taming Rectified Flow for Inversion and Editing", in arXiv:2411.04746. (*Corresponding author) [pdf]

  3. Tao Wu, Yong Zhang, Xiaodong Cun, Zhongang Qi*, Junfu Pu, Huanzhang Dou, Guangcong Zheng, Ying Shan, Xi Li, "VideoMaker: Zero-shot Customized Video Generation with the Inherent Force of Video Diffusion Models", in arXiv:2412.19645. (*Corresponding author) [pdf]

  4. Tao Wu, Yong Zhang, Xintao Wang, Xianpan Zhou, Guangcong Zheng, Zhongang Qi, Ying Shan, Xi Li, “CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilities'', in AAAI 2025. [pdf]

  5. Ziyang Yuan, Mingdeng Cao, Xintao Wang, Zhongang Qi, Chun Yuan, Ying Shan, "CustomNet: Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models", in ACM MM 2024. [pdf]

  6. Zhouxia Wang, Xintao Wang, Liangbin Xie, Zhongang Qi, Ying Shan, Wenping Wang, Ping Luo, "StyleAdapter: A Unified Stylized Image Generation Model", in International Journal of Computer Vision 2024.

  7. Zhen Li, Mingdeng Cao, Xintao Wang, Zhongang Qi, Ming-Ming Cheng, Ying Shan, “PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding'', in CVPR 2024.

  8. Tao Wu, Xuewei Li, Zhongang Qi*, Di Hu, Xintao Wang, Ying Shan, Xi Li, “SphereDiffusion: Spherical Geometry-aware Distortion Resilient Diffusion Model'', in AAAI 2024. (*Corresponding author)

  9. Chong Mou, Xintao Wang, Liangbin Xie, Jian Zhang, Zhongang Qi, Ying Shan, Xiaohu Qie, “T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models'', in AAAI 2024.

  10. Mingdeng Cao, Xintao Wang, Zhongang Qi, Ying Shan, Xiaohu Qie, Yinqiang Zheng, “MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing'', in ICCV 2023.

  11. Guangcong Zheng, Xianpan Zhou, Xuewei Li, Zhongang Qi, Ying Shan, Xi Li, “LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation'', in CVPR 2023.

Explainable AI

  1. Li Fuxin, Zhongang Qi, Saeed Khorram, Vivswan Shitole, Prasad Tadepalli, Minsuk Kahng, Alan Fern, “From Heatmaps to Structured Explanations of Image Classifiers'', in Applied AI Letters, 2021.

  2. Liangbin Xie, Xintao Wang, Chao Dong, Zhongang Qi, Ying Shan, “Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution'', in NeurIPS 2021.

  3. Mandana Hamidi-Haines, Zhongang Qi, Alan Fern, Li Fuxin, Prasad Tadepalli, “User-Guided Global Explanations for Deep Image Recognition: A User Study'', in Applied AI Letters, 2021.

  4. Zhongang Qi, Saeed Khorram, Fuxin Li, “Embedding Deep Networks into Visual Explanations'', in Artificial Intelligence (AIJ), Volume 292, March 2021.

  5. Zhongang Qi, Saeed Khorram, Fuxin Li, “Visualizing Deep Networks by Optimizing with Integrated Gradients'', in AAAI 2020.

  6. Ziwen Chen, Wenxuan Wu, Zhongang Qi, Fuxin Li, “Visualizing Point Cloud Classifiers by Curvature Smoothing”, in BMVC 2020.

  7. Mandana Hamidi-Haines, Zhongang Qi, Alan Fern, Fuxin Li, Prasad Tadepalli, “Interactive Naming for Explaining Deep Neural Networks: A Formative Study'', in Joint Proceedings of the ACM IUI 2019 Workshops.

  8. Zhongang Qi, Fuxin Li, “Learning Explainable Embeddings for Deep Networks'', in NeurIPS 2017 workshop: Interpreting, Explaining and Visualizing Deep Learning - now what ?.

Other Vision Tasks

  1. Li Yang, Chunfeng Yuan, Ziqi Zhang, Zhongang Qi, Yan Xu, Wei Liu, Ying Shan, Bing Li, Weiping Yang, Peng Li, Yan Wang, Weiming Hu, “Exploiting Contextual Objects and Relations for 3D Visual Grounding'', in NeurIPS 2023.

  2. Xuewei Li, Tao Wu, Zhongang Qi, Gaoang Wang, Ying Shan, Xi Li, “SGAT4PASS: Spherical Geometry Aware Transformer for PAnoramic Semantic Segmentation'', in IJCAI 2023.

  3. Lijian Lin, Xintao Wang, Zhongang Qi, Ying Shan, “Accelerating the Training of Video Super-Resolution'', in AAAI 2023.

  4. Xixi Xu, Zhongang Qi*, Jianqi Ma, Honglun Zhang, Ying Shan, Xiaohu Qie, “BTS: A Bi-lingual Benchmark for Text Segmentation in the Wild'', in CVPR 2022. (*Corresponding author)

  5. Xingyi Li, Zhongang Qi, Xiaoli Fern, Fuxin Li, “ScaleNet - Improve CNNs through Recursively Rescaling Objects”, in AAAI 2020.

  6. Wenxuan Wu, Zhongang Qi, Fuxin Li, “PointConv: Deep Convolutional Networks on 3D Point Clouds'', in CVPR 2019.

Multimodal & Relational Data Mining

  1. Dan Zhang, Yangliao Geng, Wenwen Gong, Zhongang Qi, Zhiyu Chen, Xing Tang, Ying Shan, Yuxiao Dong, Jie Tang, “RecDCL: Dual Contrastive Learning for Recommendation'', in WWW 2024.

  2. Dan Zhang, Wenzheng Feng, Yuandong Wang, Zhongang Qi, Ying Shan, Jie Tang, “Dropconn: Dropout connection based random gnns for molecular property prediction'', in IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023.

  3. Zhongang Qi, Tianchun Wang, Guojie Song, Weisong Hu, Xi Li, Zhongfei (Mark) Zhang, “Deep Air Learning: Interpolation, Prediction, and Feature Analysis of Fine-grained Air Quality'', in IEEE Transactions on Knowledge and Data Engineering (TKDE), 2018.

  4. Yi Luo, Guojie Song, Pengyu Li, Zhongang Qi, “Multi-Task Medical Concept Normalization Using Multi-View Convolutional Neural Network'', in AAAI 2018.

  5. Yingming Li, Ming Yang, Zhongang Qi, Zhongfei (Mark) Zhang, “Bayesian Multi-task Relationship Learning with Link Structure'', in IEEE Transactions on Knowledge and Data Engineering (TKDE), 2016.

  6. Chengli Mei, Min Zhang, Zhongang Qi, Qi Bi, “Characterizing and Comparing User Location Preference in an Urban Mobile Network'', in Trustworthy Computing and Services, series Communications in Computer and Information Science, Springer Berlin Heidelberg, 2014.

  7. Yingming Li, Ming Yang, Zhongang Qi, Zhongfei (Mark) Zhang, “Bayesian Multi-task Relationship Learning with Link Structure'', in ICDM 2013.

  8. Yingming Li*, Zhongang Qi*, Zhongfei (Mark) Zhang, Ming Yang, “Learning with Limited and Noisy Tagging'', in ACM MM 2013. (*Contributed equally to this paper)

  9. Zhongang Qi, Ming Yang, Zhongfei (Mark) Zhang, Zhengyou Zhang, “Multi-View Learning from Imperfect Tagging'', in ACM MM 2012.

  10. Zhongang Qi, Ming Yang, Zhongfei (Mark) Zhang, Zhengyou Zhang, “Mining Noisy Tagging from Multi-label Space'', in CIKM 2012.

  11. Zhongang Qi, Ming Yang, Zhongfei (Mark) Zhang, Zhengyou Zhang, “Mining Partially Annotated Images'', in KDD 2011.