中科院自动化所副研究员，从事人工智能、脑科学、模式识别、AI for Brain、脑机智能领域的研究，在（基于fMRI、MEG、EEG数据的）神经编解码、多模态神经计算、视觉-语言-大脑联合建模、大模型评估与解释等方面发表了40多篇高水平研究论文，包括 Cell子刊/TPAMI/ICLR/AAAI/ACMMM/KDD 等。主持国家自然科学基金、国防项目、北京市-小米联合基金、中科院特别研究助理资助项目、中国人工智能学会—华为 MindSpore 学术奖励基金，科技创新2030—“新一代人工智能”重大项目子课题等项目。作为研发骨干参与科技创新2030—“脑科学与类脑研究”重大项目，国自然重点项目，科技部国家重点研发项目等。长期担任 TPAMI, NeuroImage, ICLR, CVPR，AAAI等期刊/会议的审稿人/程序委员，是中国自动化学会模式识别与机器智能专委会委员。多次受邀在国际顶级人脑图谱大会 (OHBM)、国际顶级多媒体大(ACMMM)、国际顶级人工智能大会（AAAI）做学术报告。曾获得中科院院长奖、北京市优秀毕业生、2021年AI华人新星百强、IEEE ICME 2019 最佳论文奖（亚军）、研究成果被《MIT Technology Review》等科技媒体头条报道。

News

• 01/2024: Our paper was accepted by ICLR 2024

• 08/2023: Our paper was accepted by iScience (Cell Press 旗下综合类子刊)

• 07/2023: Two papers were accepted by ACMMM 2023

• 03/2023: Our paper on “Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features” got accepted to [IEEE TPAMI]. The [Code], [Data] and [Video] have been released.[中科院报道] [机器之心] [Talk视频]

• 02/2023: Our paper on “Graph-Enhanced Emotion Neural Decoding” got accepted to [IEEE TMI]

• 02/2023: I will serve as a reviewer for ICCV-2023

• 11/2022：入选中国人工智能学会—华为 MindSpore 学术奖励基金

• 11/2022: I will serve as a reviewer for CVPR-2023

• 11/2022: Our paper on “Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity” got accepted to IEEE TNNLS

• 09/2022: I will serve as a reviewer for ICLR-2023

• 09/2022: I was funded by the National Natural Science Foundation of China(国自然青年基金)

• 07/2022: Our paper on “Multimodal Vigilance Estimation in RSVP-Based BCI” got accepted to ACMMM 2022

• 06/2022: Our paper on “Graph Emotion Decoding from Visually Evoked Neural Responses” got accepted to MICCAI 2022

• 03/2022: I will serve as a reviewer for ECCV-2022

• 11/2021: I will serve as a reviewer for CVPR-2022

• 11/2021: I was funded by the Special Research Assistant Program of the Chinese Academy of Sciences(中科院特别研究助理)

• 08/2021: I will serve as a PC member for AAAI-2022

• 08/2021: Our paper on “Semi-supervised Multi-modal Multi-Label Learning” got accepted to IEEE TMM

• 05/2021: Selected as Global Top 100 Chinese Rising Stars in Artificial Intelligence (AI华人新星百强) [百度] [光明网]

• 12/2020: Won Youth Outstanding Paper Award on WRCF–BCI Brain-Controlled Robot Competition (世界机器人大赛–BCI脑控机器人大赛青年优秀论文)

• 11/2020: Our paper on “Doubly Semi-supervised Multimodal Learning” got accepted to Information Fusion

• 09/2020: Our paper on “Multitask Structured Neural Decoding” got accepted to IEEE TNNLS

• 03/2020: Our paper on “Brain-inspired Dynamical DNN Channel Pruning” got accepted to IEEE TNNLS

• 11/2019: Our paper on “Conditional Generative Neural Decoding” got accepted to AAAI’20

• 07/2019: Our paper won ICME’19 Best Paper Runner-Up Award

Recent publications

[Google Scholar] [DBLP]

2024

• Changde Du, Kaicheng Fu, Bincheng Wen, Yi Sun, Jie Peng, Wei Wei, Ying Gao, Shengpei Wang, Chuncheng Zhang, Jinpeng Li, Shuang Qiu, Le Chang, Huiguang He. Human-like object concept representations emerge naturally in multimodal large language models. Under Review
  [PDF]

• Qiongyi Zhou, Changde Du, Shengpei Wang, Huiguang He. CLIP-MUSED: CLIP-Guided Multi-Subject Visual Neural Information Semantic Decoding. The Twelfth International Conference on Learning Representations (ICLR 2024)
  [PDF] [Code]

2023

• Changde Du, Kaicheng Fu, Bincheng Wen, Huiguang He. Topographic Representation of Visually Evoked Emotional Experiences in the Human Cerebral Cortex. iScience 2023(Cell Press 旗下综合类子刊). (Co-first author with Kaicheng Fu)
  [PDF] [Code] [Data]

• Changde Du, Kaicheng Fu, Jinpeng Li, Huiguang He. Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2023).
  [PDF] [PyTorch Code] [MindSpore Code] [Data] [中科院报道] [机器之心] [Talk视频]

• Yizhuo Lu, Changde Du, Qiongyi Zhou, Dianpeng Wang, Huiguang He. MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion. Proceedings of the 31th ACM international conference on Multimedia (ACMMM 2023) (Co-first author)
  [PDF] [Code] [Talk视频]

• Xiaoyu Chen, Changde Du, Qiongyi Zhou, Huiguang He. Auditory Attention Decoding with Task-Related Multi-View Contrastive Learning. Proceedings of the 31th ACM international conference on Multimedia (ACMMM 2023) (Co-first author)
  [PDF] [Code]

• Kaicheng Fu, Changde Du, Shengpei Wang, Huiguang He. Improved Video Emotion Recognition with Alignment of CNN and Human Brain Representations. IEEE Transactions on Affective Computing (TAFFC 2023),
  [PDF] [Code]

• Zhongyu Huang, Changde Du, Yingheng Wang, Kaicheng Fu, Huiguang He. Graph-Enhanced Emotion Neural Decoding. IEEE Transactions on Medical Imaging (TMI 2023)
  [PDF]

2022

• Kaicheng Fu, Changde Du, Shengpei Wang, Huiguang He. Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity. IEEE Transactions on Neural Networks and Learning Systems (TNNLS 2022), (Co-first author)
  [PDF] [Code]

• Xinyu Cheng, Wei Wei, Changde Du, Shuang Qiu, Sanli Tian, Xiaojun Ma, Huiguang He. VigilanceNet: Decouple Intra- and Inter-Modality Learning for Multimodal Vigilance Estimation in RSVP-Based BCI. Proceedings of the 30th ACM international conference on Multimedia (ACMMM 2022)
  [Code]

• Zhongyu Huang, Changde Du, Yingheng Wang, Huiguang He. Graph Emotion Decoding from Visually Evoked Neural Responses. International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022)
  [Code] [PDF]

• Qiongyi Zhou, Changde Du, Huiguang He. Exploring the brain-like properties of deep neural networks: a neural encoding perspective. Machine Intelligence Research (MIR)
  [PDF] [Code]

2021

• Dan Li, Changde Du, Haibao Wang, Qiongyi Zhou, Huiguang He. Deep Modality Assistance Co-Training Network for Semi-Supervised Multi-Label Semantic Decoding. IEEE Transactions on Multimedia (TMM), 10.1109/TMM.2021.3104980, 2021
  [PDF]

• Changde Du, Changying Du, Huiguang He. Multimodal Deep Generative Adversarial Models for Scalable Doubly Semi-supervised Learning. Information Fusion (Information Fusion) 68, 118-130, 2021
  [PDF]

• Dan Li, Changde Du, Shengpei Wang, Haibao Wang, Huiguang He. Multi-subject Data Augmentation for Target Subject Semantic Decoding with Deep Multi-view Adversarial Learning. Information Sciences (Information Sciences) 547, 1025-1044, 2021
  [PDF]

2020

• Changde Du, Changying Du, Lijie Huang, Huiguang He. Conditional Generative Neural Decoding with Structured CNN Feature Prediction. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2020, Spotlight) 34 (03), 2629-2636, 2020
  [PDF]

• Changde Du, Changying Du, Lijie Huang, Haibao Wang, Huiguang He. Structured Neural Decoding With Multitask Transfer Learning of Deep Neural Network Representations. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020
  [PDF] [Code] [Data] [自动化所] [中科院] [中国图像图形学会]

• Dan Li, Changde Du, Huiguang He. Semi-supervised Cross-modal Image Generation with Generative Adversarial Networks. Pattern Recognition (PR) 100, 107085, 2020
  [PDF]

• Zhiqiang Chen, Ting-Bing Xu, Changde Du, Cheng-Lin Liu, Huiguang He. Dynamical Channel Pruning by Conditional Accuracy Change for Deep Neural Networks. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 32, 799-813, 2020
  [PDF]

• Haibao Wang, Lijie Huang, Changde Du, Dan Li, Bo Wang, Huiguang He. Neural Encoding for Human Visual Cortex with Deep Neural Networks Learning “What” and “Where”. IEEE Transactions on Cognitive and Developmental Systems (TCDS), 2020
  [PDF] [Talk]

2019 and earlier

• Changde Du, Jinpeng Li, Lijie Huang, Huiguang He. Brain Encoding and Decoding in fMRI with Bidirectional Deep Generative Models. Engineering 5 (5), 948-953, 2019
  [PDF] [中文版]

• Changde Du, Changying Du, Huiguang He. Doubly Semi-Supervised Multimodal Adversarial Learning for Classification, Generation and Retrieval. 2019 IEEE International Conference on Multimedia and Expo (ICME 2019, Best Paper Runner-Up Award), 13-18, 2019
  [PDF] [Best Paper Runner-Up Award]

• Changde Du, Changying Du, Lijie Huang, Huiguang He. Reconstructing Perceived Images from Human Brain Activities with Bayesian Deep Multiview Learning. IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 30 (8), 2310-2323, 2018
  [PDF] [Code] [国家自然科学基金委] [中科院] [MIT Technology Review (麻省理工科技评论)]

• Changde Du, Changying Du, Hao Wang, Jinpeng Li, Wei-Long Zheng, Bao-Liang Lu, Huiguang He. Semi-supervised Deep Generative Modelling of Incomplete Multi-modality Emotional Data. Proceedings of the 26th ACM international conference on Multimedia (ACMMM 2018), 108-116, 2018
  [PDF] [Code]

• Changying Du, Changde Du, Xingyu Xie, Chen Zhang and Hao Wang. Multiview Adversarially Learned Inference for Cross-domain Joint Distribution Matching. In Proceedings of the 24th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2018, Long oral),
  [PDF]

• Changying Du, Xingyu Xie, Changde Du and Hao Wang. Redundancy-resistant Generative Hashing for Image Retrieval. In Proceedings of the 27th International Joint Conference on Artificial Intelligence and the 23rd European Conference on Artificial Intelligence (IJCAI 2018),
  [PDF]

• Jia He, Changying Du, Changde Du, Fuzhen Zhuang, Qing He, Guoping Long. Nonlinear Maximum Margin Multi-View Learning with Adaptive Kernel. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI 2017), 1830-1836, 2017
  [PDF]

• Changying Du, Changde Du, Guoping Long, Qing He, Yucheng Li. Online Bayesian Multiple Kernel Bipartite Ranking. Conference on Uncertainty in Artificial Intelligence (UAI 2016), 2016
  [PDF]

Academic Service

• Conference Reviewer: ICCV-2023, ICLR-2023, CVPR-2023/2022, AAAI-2022, ECCV-2022, etc.
• Journal Reviewer: TPAMI, TNNLS, NeuroImage, Human Brain Mapping, IEEE Trans. on Affective Computing (TAC), IEEE Trans. on Industrial Informatics(TII), Pattern Recognition (PR), etc.
• 中国自动化学会模式识别与机器智能专委会，委员
• 中国图象图形学学会视觉大数据专委会，委员
• 中国人工智能学会模式识别专委会，委员

Course

• <模式识别与机器学习>

Awards and Achievements

• 2021 Global Top 100 Chinese Rising Stars in Artificial Intelligence (AI华人新星百强) [Link]
• 2020 World Robot Competition Finals–BCI Brain-Controlled Robot Competition Youth Outstanding Paper Award Honorable Mention (世界机器人大赛–BCI脑控机器人大赛青年优秀论文，共十篇) [Link]
• 2019 ICME Best Paper Runner-Up Award (最佳论文奖亚军) [Link]
• 2019 CAS Presidential Scholarship (中国科学院院长奖)
• 2019 Beijing Outstanding Graduate Student Awards (北京市优秀毕业生)
• 2019 University of CAS Outstanding Graduate Student Awards (中国科学院大学优秀毕业生)
• 2018 PhD student National Scholarship (博士生国家奖学金)
• 2017 MIT Technology Review reported our neural decoding work (麻省理工科技评论) [Link]
• 2017 Third Prize of International Collegiate Competition for Brain-inspired Computing (国际大学生类脑计算大赛三等奖) [Link]
• 2017 CAS Institute of Automation “Pandeng” Scholarship
• 2017 Top 40 for the Baidu Scholarship (百度奖学金40强) [Link]
• 2017 University of CAS Merit Student

Fundings

• National Natural Science Foundation of China (国家自然科学基金委）
• 科技部国家重点研发
• Chinese Academy of Sciences(中科院)
• CAAI&HUAWEI (中国人工智能学会-华为公司)