Hey, I am Jintai Chen, a tenure-track assistant professor at HKUST, guangzhou campus.
Prior to that, I am a postdoctoral researcher at the University of Illinois at Urbana-Champaign, where I collaborated closely with Prof. Jimeng Sun. I obtained my Ph.D. from the College of Computer Science and Technology at Zhejiang University, under the supervision of Prof. Jian Wu. My research interests lie at the intersection of AI and healthcare, with a particular focus on developing generalizable and reliable foundation models to address real-world medical challenges, including clinical trial optimization, clinical predictive modeling, treatment recommendation, health monitoring, and biomedical discovery.
I am actively seeking highly motivated Ph.D. students, research assistants, and postdoctoral researchers with strong backgrounds in computer science, statistics, or other related subjects. Proficiency in coding is required.
For Ph.D. applications, please fill out the form.
For research assistant applications, please fill out the form.
For postdoc applications, please email me directly at jtchen147[AT]gmail[DOT]com.
For MPhil students, please contact me after passing the interview with the school’s Red Bird MPhil committee.
🔥 News
- 2024.08: Our paper Multi-rater Prompting for Ambiguous Medical Image Segmentation is accepted by BIBM 2024! Congratulations to Jinhong, and many thanks to all the co-authors!
- 2024.06: Our paper TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model is accepted by TOMM.
- 2024.06: Two papers are accepted by MICCAI 2024! Congratulations to all the co-authors!
- 2024.05: Two papers about tabular data prediction have been accepted by KDD 2024! Congratulations to Jiahuan, and many thanks to all the co-authors!
- 2024.04: Our paper Personalized Heart Disease Detection via ECG Digital Twin Generation is accepted by IJCAI 2024! Congratulations to Yaojun!
- 2024.01: Our paper Making Pre-trained Language Models Great on Tabular Prediction is accepted as ICLR 2024 spotlight paper! Congratulations to Jiahuan!
- 2024.01: Our article Congenital heart disease detection by pediatric electrocardiogram based deep learning integrated with human concepts is accepted by Nature Communications!
📄 Selected Publications
(*: Equal contribution; $\dagger$: Corresponding author(s))
TL;DR: Congenital heart disease is the most common category among congenital abnormalities, with an incidence rate approaching 1$\%$. Previously, ECGs were considered to have limited effectiveness in diagnosing congenital heart disease. AI demonstrated the value of ECGs in diagnosing congenital heart disease, which surpasses our previous cognition. While techniques like echocardiography and cardiac MRI are currently utilized for precise diagnosis, the cost-effectiveness and non-invasiveness of ECGs continue to harbor substantial potential for precise large-scale population screening and benefiting low-resourced regions.
Congenital Heart Disease Detection by Pediatric Electrocardiogram Based Deep Learning Integrated with Human Concepts [AI4H, AI4ECG, AI4Table] [Code], Jintai Chen$^*$, Shuai Huang$^*$, Ying Zhang$^*$, Qing Chang$^*$, Yixiao Zhang, Dantong Li, Jia Qiu, Lianting Hu, Xiaoting Peng, Yunmei Du, Yunfei Gao, Danny Chen, Abdelouahab Bellou$^\dagger$, Jian Wu$^\dagger$, Huiying Liang$^\dagger$, Nature Communications, 2024
- TL;DR: Traditional ECG devices can only offer electrocardiograms from a limited number of angles, constrained by electrode positioning. Our Electrocardio Panorama System breaks this barrier, allowing users to effortlessly observe ECG signals from any angle in real-time, based on their queries.
- Academic Impact: The benefits of our work are manifold: (i) panoramic observations of ECG signals; (ii) a unified representation of ECG signals captured by different ECG devices; (iii) Waveform-aligned Mixup for synthesizing new ECG cases (e.g., for data augmentation); (iv) reconstruction of corrupted ECG views; and (v) exploration of ECG theory.
- New Data Annotations: We provided ECG wave segmentation annotations for Tianchi ECG dataset and PTB dataset.
Electrocardio panorama: Synthesizing new ECG views with self-supervision [AI4H, AI4ECG] [Code and Data], Jintai Chen$^*$, Xiangshang Zheng$^*$, Hongyun Yu$^*$, Danny Z. Chen, Jian Wu$^\dagger$, International Joint Conference on Artificial Intelligence (IJCAI), 2021
TL;DR: Neurons in the nervous system transmit signals by releasing different neurotransmitters that match different receptors. Motivated by the concepts of competitive neural networks, prototype learning, hierarchical clustering algorithms, and capsule neural networks, we introduce a novel neural network architecture. This neural network is constructed by neurons capable of generating “transmitters” to send semantic information to other neurons and possessing receptors to receive specific types of “transmitters” from other neurons. By generating “transmitters” to convey semantic information and binding them to specific receptors in the subsequent layer, our approach achieves transparent semantic feature parsing, part-to-whole semantic integration, unsupervised semantics understanding, and object relationship digging.
A receptor skeleton for capsule neural networks, Jintai Chen, Hongyun Yu, Chengde Qian, Danny Z. Chen, Jian Wu$^\dagger$, International Conference on Machine Learning (ICML), 2021
TL;DR: Tabular data exhibits diversity in both feature and target definitions. How can we achieve transferability across such heterogeneity? We propose an approach to empower language models as a robust deep tabular prediction model. By training the language model to comprehend precise numeric values, our approach gains the capability to leverage tabular data from other domains to enhance predictions on EHR tables, where data availability is often limited.
Making Pre-trained Language Models Great on Tabular Prediction [AI4Table] [Code and Data], Jiahuan Yan, Bo Zheng, Hongxia Xu, Yiheng Zhu, Danny Chen, Jimeng Sun, Jian Wu$^\dagger$, Jintai Chen$^\dagger$, ICLR (SpotLight), 2024
TL;DR: This study transforms unstructured hand radiography images into a structured semantics represented as a table /graph, utilizing clinical prior information (the TW3 approach used in clinical practice). We then use a GNN to process such structured data, leading to impressive and interpretable bone age assessments. It’s noteworthy that many medical images are semi-structured data, and this paper introduces a potentially interpretable and efficient approach for processing such semi-structure.
Doctor imitator: Hand-radiography-based bone age assessment by imitating scoring methods [AI4H, AI4MIA], Jintai Chen, Bohan Yu, Biwen Lei, Ruiwei Feng, Danny Z. Chen, and Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI, Oral), 2020
-
ExcelFormer: Can a Deep Learning Model be a Sure Bet for Tabular Prediction? [AI4Table], Jintai Chen$^*$, Jiahuan Yan$^*$, Qiyuan Chen, Danny Ziyi Chen, Jian Wu, Jimeng Sun$^\dagger$, KDD 2024
-
SERVAL: Synergy Learning between Vertical Models and LLMs towards Oracle-Level Zero-shot Medical Prediction [AI4H, AI4Table], Jiahuan Yan, Jintai Chen$^\dagger$, Chaowen Hu, Bo Zheng, Yaojun Hu, Jimeng Sun, Jian Wu, 2024
-
TeleOR: Real-time Telemedicine System for Full-Scene Operating Room[AI4H, AI4MIA], Yixuan Wu$^*$, Kaiyuan Hu$^*$, Qian Shao, Jintai Chen$^\dagger$, Danny Z. Chen7, and Jian Wu$^\dagger$, MICCAI 2024
-
LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation, Jinhong Wang, Jintai Chen$^\dagger$, Danny Chen, Jian Wu$^\dagger$, MICCAI 2024
-
TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model [AI4H, AI4CT], Yue Wang$^*$, Tianfan Fu$^*$, Yinlong Xu, Zihan Ma, Hongxia Xu, Bang Du, Yingzhou Lu, Honghao Gao$^\dagger$, Jian Wu, Jintai Chen$^\dagger$, TOMM, 2024
-
Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction [AI4H, AI4CT], Yingzhou Lu, Tianyi Chen, Nan Hao, Capucine Van Rechem, Jintai Chen, Tianfan Fu$^\dagger$, Health Data Science, 2024
-
Personalized Heart Disease Detection via ECG Digital Twin Generation [AI4H, AI4ECG], Yaojun Hu, Jintai Chen$^\dagger$, Lianting Hu, Dantong Li, Jiahuan Yan, Haochao Ying, Huiying Liang, Jian Wu, International Joint Conference on Artificial Intelligence (IJCAI), 2024
-
A survey on multimodal large language models for autonomous driving, Can Cui$^*$, Yunsheng Ma$^*$, Xu Cao$^*$, Wenqian Ye$^*$, Yang Zhou, Kaizhao Liang, Jintai Chen, Juanwu Lu, Zichong Yang, Kuei-Da Liao, Tianren Gao, Erlong Li, Kun Tang, Zhipeng Cao, Tong Zhou, Ao Liu, Xinrui Yan, Shuqi Mei, Jianguo Cao$^\dagger$, Ziran Wang$^\dagger$, Chao Zheng$^\dagger$, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV-Workshop), 2024
-
Polygonal Approximation Learning for Convex Object Segmentation in Biomedical Images with Bounding Box Supervision [AI4H, AI4MIA][Code], Wenhao Zheng, Jintai Chen, Kai Zhang, Jiahuan Yan, Jinhong Wang, Yi Cheng, Bang Du, Danny Z Chen, Honghao Gao, Jian Wu, Hongxia Xu$^\dagger$, IEEE Journal of Biomedical and Health Informatics, 2023
-
Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classification [AI4H] [Code], Jiahuan Yan, Haojun Gao, Zhang Kai, Weize Liu, Danny Chen, Jian Wu$^\dagger$, Jintai Chen$^\dagger$, Findings of Empirical Methods in Natural Language Processing (EMNLP-Findings), 2023
-
GCL: Gradient-Guided Contrastive Learning for Medical Image Segmentation with Multi-Perspective Meta Labels [AI4H, AI4MIA], Yixuan Wu, Jintai Chen$^\dagger$, Jiahuan Yan, Yiheng Zhu, Danny Chen, Jian Wu$^\dagger$, ACM International Conference on Multimedia, 2023
-
Ord2Seq: Regarding Ordinal Regression as Label Sequence Prediction [AI4H, AI4MIA] [Code], Jinhong Wang$^*$, Yi Cheng$^*$, Jintai Chen$^\dagger$, Tingting Chen, Danny Chen, Jian Wu$^\dagger$, IEEE/CVF International Conference on Computer Vision (ICCV), 2023
-
TabCaps: A capsule neural network for tabular data classification with BoW Routing [AI4Table] [Code], Jintai Chen, Kuanlun Liao, Yanwen Fang, Danny Ziyi Chen, Jian Wu$^\dagger$, International Conference on Learning Representations (ICLR), 2023
-
Cross-layer retrospective retrieving via layer attention , Yanwen Fang, Yuxi Cai, Jintai Chen, Jingyu Zhao, Guangjian Tian, Guodong Li$^\dagger$, International Conference on Learning Representations (ICLR), 2023
-
ME-GAN: Learning panoptic electrocardio representations for multi-view ECG synthesis conditioned on heart diseases [AI4H, AI4ECG], Jintai Chen$^*$, Kuanlun Liao$^*$, Kun Wei, Haochao Ying$^\dagger$, Danny Z Chen, Jian Wu, International Conference on Machine Learning (ICML), 2022
-
T2G-Former: Organizing tabular features into relation graphs promotes heterogeneous feature interaction [AI4Table] [Code], Jiahuan Yan$^*$, Jintai Chen$^*$, Yixuan Wu, Danny Ziyi Chen, Jian Wu$^\dagger$, AAAI Association for the Advancement of Artificial Intelligence (AAAI, Oral), 2023
-
DANETs: Deep abstract networks for tabular data classification and regression [AI4Table] [Code], Jintai Chen, Kuanlun Liao, Yao Wan, Danny Ziyi Chen, Jian Wu$^\dagger$, AAAI Association for the Advancement of Artificial Intelligence (AAAI), 2022
-
Robust training of graph neural networks via noise governance, Siyi Qian, Haochao Ying$^\dagger$, Renjun Hu, Jingbo Zhou, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, ACM International Conference on Web Search and Data Mining (WSDM), 2023
-
Self-learning and one-shot learning based single-slice annotation for 3D medical image segmentation [AI4H, AI4MIA], Yixuan Wu, Bo Zheng, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI, Oral), 2022
-
D-Former: A U-shaped dilated Transformer for 3D medical image segmentation [AI4H, AI4MIA], Yixuan Wu, Kuanlun Liao, Jintai Chen, Danny Z Chen, Jinhong Wang, Honghao Gao, Jian Wu$^\dagger$, Neural Computing and Applications, 2022
-
Identifying electrocardiogram abnormalities using a handcrafted-rule-enhanced neural network [AI4H, AI4ECG], Yuexin Bian, Jintai Chen, Xiaojun Chen, Xiaoxian Yang, Danny Z. Chen, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2022.
-
A corresponding region fusion framework for multi-modal cervical lesion detection [AI4H, AI4MIA], Tingting Chen, Wenhao Zheng, Heping Hu, Chunhua Luo, Jintai Chen, Chunnv Yuan, Weiguo Lu, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2022
-
ChroNet: A multi-task learning based approach for prediction of multiple chronic diseases [AI4H, AI4Table], Ruiwei Feng, Yan Cao, Xuechen Liu, Tingting Chen, Jintai Chen, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, Multimedia Tools and Applications, 2021
-
A semi-supervised deep convolutional framework for signet ring cell detection [AI4H, AI4MIA] [Code], Haochao Ying, Qingyu Song, Jintai Chen, Tingting Liang, Jingjing Gu, Fuzhen Zhuang, Danny Z Chen, Jian Wu$^\dagger$, Neurocomputing, 2021
-
Interactive few-shot learning: Limited supervision, better medical image segmentation [AI4H, AI4MIA], Ruiwei Feng$^*$, Xiangshang Zheng$^*$, Tianxiang Gao$^*$, Jintai Chen, Wenzhe Wang, Danny Z Chen, Jian Wu$^\dagger$, IEEE Transactions on Medical Imaging (TMI), 2021
-
A transfer learning based super-resolution microscopy for biopsy slice images: the joint methods perspective [AI4H, AI4MIA], Jintai Chen$^*$, Haochao Ying$^*$, Xuechen Liu$^*$, Jingjing Gu, Ruiwei Feng, Tingting Chen, Honghao Gao$^\dagger$, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2020
-
A hierarchical graph network for 3D object detection on point clouds, Jintai Chen$^*$, Biwen Lei$^*$, Qingyu Song$^*$, Haochao Ying, Danny Z Chen, Jian Wu$^\dagger$, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
-
Flow-Mixup: Classifying multi-labeled medical images with corrupted labels [AI4MIA, AI4ECG], Jintai Chen, Hongyun Yu, Ruiwei Feng, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Bioinformatics and Biomedicine (BIBM), 2020
-
A deep learning approach for colonoscopy pathology WSI analysis: Accurate segmentation and classification [AI4H, AI4MIA], Ruiwei Feng, Xuechen Liu, Jintai Chen, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, IEEE Journal of Biomedical and Health Informatics (J-BHI), 2020
-
A fully 3D cascaded framework for pancreas segmentation [AI4H, AI4MIA], Wenzhe Wang, Qingyu Song, Ruiwei Feng, Tingting Chen, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Symposium on Biomedical Imaging (ISBI), 2020
-
SSN: A stair-shape network for real-time polyp segmentation in colonoscopy images [AI4H, AI4MIA], Ruiwei Feng, Biwen Lei, Wenzhe Wang, Tingting Chen, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Symposium on Biomedical Imaging (ISBI), 2020
-
LSRC: A long-short range context-fusing framework for automatic 3D vertebra localization [AI4H, AI4MIA], Jintai Chen$^*$, Yanjie Wang$^*$, Ruoqian Guo$^*$, Bohan Yu, Tingting Chen, Wenzhe Wang, Ruiwei Feng, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2019
-
Multi-view learning with feature level fusion for cervical dysplasia diagnosis [AI4H, AI4MIA], Tingting Chen, Xinjun Ma, Xuechen Liu, Wenzhe Wang, Ruiwei Feng, Jintai Chen, Chunnv Yuan, Weiguo Lu, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2019
🎖 Awards
- 2023.04, Excellent Doctoral Graduates of Zhejiang Province, China (Top 1%)
- 2023.04, Excellent Doctoral Graduates of Zhejiang University (Top 1%)
- 2023.04, 产学研合作创新成果奖,浙江省产学研合作创新与促进奖
- 2023.02, 医学影像智能处理关键技术创新与应用, 产学研合作创新成果二等奖, 中国产学研合作促进会
- 2023.02, 科技进步二等奖,中国电子学会
- 2022.10, Huawei Fundamental Research Scholarship (Top 3%)
- 2021.10, Tencent Doctoral Scholarship (Top 1%)
- 2021.10, National Scholarship of China (Top 1%)
- 2020.10, Outstanding Doctoral Student Scholarship (Top 3%)
- 2019.10, Doctoral Freshman Scholarship (Top 3%)
- 2016.10, Chinese Bank Scholarship (Undergraduate) (Top 1%)
- 2015.10, National Scholarship (Undergraduate) (Top 1%)
💬 Talks
- 2022.11, How to Excel in AI-for-healthcare Researches, @ Shanghai University
- 2022.10, ECG Signal Processing and Synthesis for Computer-Aided Heart Disease Diagnosis, @ Carnegie Mellon University
- 2022.10, ECG Synthesis for New View and New Data, @ Shanghai AI Lab
- 2022.09, Part-Hierarchy Learning, @ ByteDance
- 2022.06, Supervised Tabular Learning, @ UberAI
- 2021.10, Domain Mixup for Distant Transfer Learning, @ Shanghai Jiaotong University
🔎 Professional Services
- Reviewer @ ML Conferences: NeurIPS, ICLR, ICML;
- Reviewer @ AI Conferences: AAAI, IJCAI, AISTATS;
- Reviewer @ CV Conferences: CVPR, ICCV, ECCV;
- Reviewer @ DM Conferences: KDD;
- Reviewer @ NLP Conferences: ACL, EMNLP;
- Reviewer @ AI4H Conferences: MICCAI, ISBI;
- Review for Journals: TPAMI, TNNLS, TCBB, JBHI, Frontiers in Public Health, JBSM, TCDS, Frontiers in Genetics, Scienstific Report