Hey, I am Jintai Chen, a postdoctoral researcher at the University of Illinois at Urbana-Champaign, Illinois, USA.
Before that, I graduated with a Ph.D. degree from the College of Computer Science and Technology, Zhejiang University. I am broadly fascinated by the intersection of AI and healthcare/bioscience, especially the field of AI for healthcare (AI4H), with a specific emphasis on designing machine learning algorithms informed by medical knowledge and utilizing machine learning for uncovering insights in medical data. My research extensively delves into various facets including AI for medical imaging analysis (AI4MIA), AI for electrocardiograms (AI4ECG), AI for EHR table analysis (AI4Table), and AI for clinical trials (AI4CT). My methodological interests revolve around deep tabular models, generative AI for digital twin creation, and exploring deep learning approaches tailored for scenarios with limited data availability.
I am an amateur snooker player and a big fan of Ronnie O’Sullivan, and I also enjoy painting in my leisure time.
🔥 News
- 2024.04: Our paper Personalized Heart Disease Detection via ECG Digital Twin Generation is accepted by IJCAI 2024!
- 2024.01: Our paper Making Pre-trained Language Models Great on Tabular Prediction is accepted as ICLR 2024 spotlight paper!
- 2024.01: Our article Congenital heart disease detection by pediatric electrocardiogram based deep learning integrated with human concepts is accepted by Nature Communications!
- 2023.07: Our paper GCL: Gradient-Guided Contrastive Learning for Medical Image Segmentation with Multi-Perspective Meta Labels is accepted by ACMMM 2023!
- 2023.07: Our paper Ord2Seq: Regarding Ordinal Regression as Label Sequence Prediction is accepted by ICCV 2023!
📄 Selected Publications
(*: Equal contribution; $\dagger$: Corresponding author(s))
TL;DR: Congenital heart disease is the most common category among congenital abnormalities, with an incidence rate approaching 1$\%$. Previously, ECGs were considered to have limited effectiveness in diagnosing congenital heart disease. AI demonstrated the value of ECGs in diagnosing congenital heart disease, which surpasses our previous cognition. While techniques like echocardiography and cardiac MRI are currently utilized for precise diagnosis, the cost-effectiveness and non-invasiveness of ECGs continue to harbor substantial potential for precise large-scale population screening and benefiting low-resourced regions.
Congenital Heart Disease Detection by Pediatric Electrocardiogram Based Deep Learning Integrated with Human Concepts [AI4H, AI4ECG, AI4Table] [Code], Jintai Chen$^*$, Shuai Huang$^*$, Ying Zhang$^*$, Qing Chang$^*$, Yixiao Zhang, Dantong Li, Jia Qiu, Lianting Hu, Xiaoting Peng, Yunmei Du, Yunfei Gao, Danny Chen, Abdelouahab Bellou$^\dagger$, Jian Wu$^\dagger$, Huiying Liang$^\dagger$, Nature Communications, 2024
- TL;DR: Traditional ECG devices can only offer electrocardiograms from a limited number of angles, constrained by electrode positioning. Our Electrocardio Panorama System breaks this barrier, allowing users to effortlessly observe ECG signals from any angle in real-time, based on their queries.
- Academic Impact: The benefits of our work are manifold: (i) panoramic observations of ECG signals; (ii) a unified representation of ECG signals captured by different ECG devices; (iii) Waveform-aligned Mixup for synthesizing new ECG cases (e.g., for data augmentation); (iv) reconstruction of corrupted ECG views; and (v) exploration of ECG theory.
- New Data Annotations: We provided ECG wave segmentation annotations for Tianchi ECG dataset and PTB dataset.
Electrocardio panorama: Synthesizing new ECG views with self-supervision [AI4H, AI4ECG] [Code and Data], Jintai Chen$^*$, Xiangshang Zheng$^*$, Hongyun Yu$^*$, Danny Z. Chen, Jian Wu$^\dagger$, International Joint Conference on Artificial Intelligence (IJCAI), 2021
TL;DR: Neurons in the nervous system transmit signals by releasing different neurotransmitters that match different receptors. Motivated by the concepts of competitive neural networks, prototype learning, hierarchical clustering algorithms, and capsule neural networks, we introduce a novel neural network architecture. This neural network is constructed by neurons capable of generating “transmitters” to send semantic information to other neurons and possessing receptors to receive specific types of “transmitters” from other neurons. By generating “transmitters” to convey semantic information and binding them to specific receptors in the subsequent layer, our approach achieves transparent semantic feature parsing, part-to-whole semantic integration, unsupervised semantics understanding, and object relationship digging.
A receptor skeleton for capsule neural networks, Jintai Chen, Hongyun Yu, Chengde Qian, Danny Z. Chen, Jian Wu$^\dagger$, International Conference on Machine Learning (ICML), 2021
TL;DR: Tabular data exhibits diversity in both feature and target definitions. How can we achieve transferability across such heterogeneity? We propose an approach to empower language models as a robust deep tabular prediction model. By training the language model to comprehend precise numeric values, our approach gains the capability to leverage tabular data from other domains to enhance predictions on EHR tables, where data availability is often limited.
Making Pre-trained Language Models Great on Tabular Prediction [AI4Table] [Code and Data], Jiahuan Yan, Bo Zheng, Hongxia Xu, Yiheng Zhu, Danny Chen, Jimeng Sun, Jian Wu$^\dagger$, Jintai Chen$^\dagger$, ICLR (SpotLight), 2024
TL;DR: This study transforms unstructured hand radiography images into a structured semantics represented as a table /graph, utilizing clinical prior information (the TW3 approach used in clinical practice). We then use a GNN to process such structured data, leading to impressive and interpretable bone age assessments. It’s noteworthy that many medical images are semi-structured data, and this paper introduces a potentially interpretable and efficient approach for processing such semi-structure.
Doctor imitator: Hand-radiography-based bone age assessment by imitating scoring methods [AI4H, AI4MIA], Jintai Chen, Bohan Yu, Biwen Lei, Ruiwei Feng, Danny Z. Chen, and Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI, Oral), 2020
-
SERVAL: Synergy Learning between Vertical Models and LLMs towards Oracle-Level Zero-shot Medical Prediction [AI4H, AI4Table], Jiahuan Yan, Jintai Chen$^\dagger$, Chaowen Hu, Bo Zheng, Yaojun Hu, Jimeng Sun, Jian Wu, 2024
-
TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model [AI4H, AI4CT], Yue Wang$^*$, Yingzhou Lu$^*$, Yinlong Xu, Zihan Ma, Hongxia Xu, Bang Du, Tianfan Fu, Honghao Gao$^\dagger$, Jian Wu, Jintai Chen$^\dagger$, TOMM, 2024
-
Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction [AI4H, AI4CT], Yingzhou Lu, Tianyi Chen, Nan Hao, Capucine Van Rechem, Jintai Chen, Tianfan Fu$^\dagger$, Health Data Science, 2024
-
Personalized Heart Disease Detection via ECG Digital Twin Generation [AI4H, AI4ECG], Yaojun Hu, Jintai Chen$^\dagger$, Lianting Hu, Dantong Li, Jiahuan Yan, Haochao Ying, Huiying Liang, Jian Wu, International Joint Conference on Artificial Intelligence (IJCAI), 2024
-
A survey on multimodal large language models for autonomous driving, Can Cui$^*$, Yunsheng Ma$^*$, Xu Cao$^*$, Wenqian Ye$^*$, Yang Zhou, Kaizhao Liang, Jintai Chen, Juanwu Lu, Zichong Yang, Kuei-Da Liao, Tianren Gao, Erlong Li, Kun Tang, Zhipeng Cao, Tong Zhou, Ao Liu, Xinrui Yan, Shuqi Mei, Jianguo Cao$^\dagger$, Ziran Wang$^\dagger$, Chao Zheng$^\dagger$, IEEE/CVF Winter Conference on Applications of Computer Vision (WACV-Workshop), 2024
-
Polygonal Approximation Learning for Convex Object Segmentation in Biomedical Images with Bounding Box Supervision [AI4H, AI4MIA][Code], Wenhao Zheng, Jintai Chen, Kai Zhang, Jiahuan Yan, Jinhong Wang, Yi Cheng, Bang Du, Danny Z Chen, Honghao Gao, Jian Wu, Hongxia Xu$^\dagger$, IEEE Journal of Biomedical and Health Informatics, 2023
-
Text2Tree: Aligning Text Representation to the Label Tree Hierarchy for Imbalanced Medical Classification [AI4H] [Code], Jiahuan Yan, Haojun Gao, Zhang Kai, Weize Liu, Danny Chen, Jian Wu$^\dagger$, Jintai Chen$^\dagger$, Findings of Empirical Methods in Natural Language Processing (EMNLP-Findings), 2023
-
GCL: Gradient-Guided Contrastive Learning for Medical Image Segmentation with Multi-Perspective Meta Labels [AI4H, AI4MIA], Yixuan Wu, Jintai Chen$^\dagger$, Jiahuan Yan, Yiheng Zhu, Danny Chen, Jian Wu$^\dagger$, ACM International Conference on Multimedia, 2023
-
Ord2Seq: Regarding Ordinal Regression as Label Sequence Prediction [AI4H, AI4MIA] [Code], Jinhong Wang$^*$, Yi Cheng$^*$, Jintai Chen$^\dagger$, Tingting Chen, Danny Chen, Jian Wu$^\dagger$, IEEE/CVF International Conference on Computer Vision (ICCV), 2023
-
TabCaps: A capsule neural network for tabular data classification with BoW Routing [AI4Table] [Code], Jintai Chen, Kuanlun Liao, Yanwen Fang, Danny Ziyi Chen, Jian Wu$^\dagger$, International Conference on Learning Representations (ICLR), 2023
-
Cross-layer retrospective retrieving via layer attention , Yanwen Fang, Yuxi Cai, Jintai Chen, Jingyu Zhao, Guangjian Tian, Guodong Li$^\dagger$, International Conference on Learning Representations (ICLR), 2023
-
EXCELFORMER: Deep learning model can excel on tabular prediction [AI4Table], Jintai Chen$^*$, Jiahuan Yan$^*$, Qiyuan Chen, Danny Ziyi Chen, Jian Wu, Jimeng Sun$^\dagger$, Preprint, Underreview.
-
ME-GAN: Learning panoptic electrocardio representations for multi-view ECG synthesis conditioned on heart diseases [AI4H, AI4ECG], Jintai Chen$^*$, Kuanlun Liao$^*$, Kun Wei, Haochao Ying$^\dagger$, Danny Z Chen, Jian Wu, International Conference on Machine Learning (ICML), 2022
-
T2G-Former: Organizing tabular features into relation graphs promotes heterogeneous feature interaction [AI4Table] [Code], Jiahuan Yan$^*$, Jintai Chen$^*$, Yixuan Wu, Danny Ziyi Chen, Jian Wu$^\dagger$, AAAI Association for the Advancement of Artificial Intelligence (AAAI, Oral), 2023
-
DANETs: Deep abstract networks for tabular data classification and regression [AI4Table] [Code], Jintai Chen, Kuanlun Liao, Yao Wan, Danny Ziyi Chen, Jian Wu$^\dagger$, AAAI Association for the Advancement of Artificial Intelligence (AAAI), 2022
-
Robust training of graph neural networks via noise governance, Siyi Qian, Haochao Ying$^\dagger$, Renjun Hu, Jingbo Zhou, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, ACM International Conference on Web Search and Data Mining (WSDM), 2023
-
Self-learning and one-shot learning based single-slice annotation for 3D medical image segmentation [AI4H, AI4MIA], Yixuan Wu, Bo Zheng, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI, Oral), 2022
-
D-Former: A U-shaped dilated Transformer for 3D medical image segmentation [AI4H, AI4MIA], Yixuan Wu, Kuanlun Liao, Jintai Chen, Danny Z Chen, Jinhong Wang, Honghao Gao, Jian Wu$^\dagger$, Neural Computing and Applications, 2022
-
Identifying electrocardiogram abnormalities using a handcrafted-rule-enhanced neural network [AI4H, AI4ECG], Yuexin Bian, Jintai Chen, Xiaojun Chen, Xiaoxian Yang, Danny Z. Chen, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2022.
-
A corresponding region fusion framework for multi-modal cervical lesion detection [AI4H, AI4MIA], Tingting Chen, Wenhao Zheng, Heping Hu, Chunhua Luo, Jintai Chen, Chunnv Yuan, Weiguo Lu, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2022
-
ChroNet: A multi-task learning based approach for prediction of multiple chronic diseases [AI4H, AI4Table], Ruiwei Feng, Yan Cao, Xuechen Liu, Tingting Chen, Jintai Chen, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, Multimedia Tools and Applications, 2021
-
A semi-supervised deep convolutional framework for signet ring cell detection [AI4H, AI4MIA] [Code], Haochao Ying, Qingyu Song, Jintai Chen, Tingting Liang, Jingjing Gu, Fuzhen Zhuang, Danny Z Chen, Jian Wu$^\dagger$, Neurocomputing, 2021
-
Interactive few-shot learning: Limited supervision, better medical image segmentation [AI4H, AI4MIA], Ruiwei Feng$^*$, Xiangshang Zheng$^*$, Tianxiang Gao$^*$, Jintai Chen, Wenzhe Wang, Danny Z Chen, Jian Wu$^\dagger$, IEEE Transactions on Medical Imaging (TMI), 2021
-
A transfer learning based super-resolution microscopy for biopsy slice images: the joint methods perspective [AI4H, AI4MIA], Jintai Chen$^*$, Haochao Ying$^*$, Xuechen Liu$^*$, Jingjing Gu, Ruiwei Feng, Tingting Chen, Honghao Gao$^\dagger$, Jian Wu$^\dagger$, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 2020
-
A hierarchical graph network for 3D object detection on point clouds, Jintai Chen$^*$, Biwen Lei$^*$, Qingyu Song$^*$, Haochao Ying, Danny Z Chen, Jian Wu$^\dagger$, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
-
Flow-Mixup: Classifying multi-labeled medical images with corrupted labels [AI4MIA, AI4ECG], Jintai Chen, Hongyun Yu, Ruiwei Feng, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Bioinformatics and Biomedicine (BIBM), 2020
-
A deep learning approach for colonoscopy pathology WSI analysis: Accurate segmentation and classification [AI4H, AI4MIA], Ruiwei Feng, Xuechen Liu, Jintai Chen, Danny Z Chen, Honghao Gao, Jian Wu$^\dagger$, IEEE Journal of Biomedical and Health Informatics (J-BHI), 2020
-
A fully 3D cascaded framework for pancreas segmentation [AI4H, AI4MIA], Wenzhe Wang, Qingyu Song, Ruiwei Feng, Tingting Chen, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Symposium on Biomedical Imaging (ISBI), 2020
-
SSN: A stair-shape network for real-time polyp segmentation in colonoscopy images [AI4H, AI4MIA], Ruiwei Feng, Biwen Lei, Wenzhe Wang, Tingting Chen, Jintai Chen, Danny Z Chen, Jian Wu$^\dagger$, International Symposium on Biomedical Imaging (ISBI), 2020
-
LSRC: A long-short range context-fusing framework for automatic 3D vertebra localization [AI4H, AI4MIA], Jintai Chen$^*$, Yanjie Wang$^*$, Ruoqian Guo$^*$, Bohan Yu, Tingting Chen, Wenzhe Wang, Ruiwei Feng, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2019
-
Multi-view learning with feature level fusion for cervical dysplasia diagnosis [AI4H, AI4MIA], Tingting Chen, Xinjun Ma, Xuechen Liu, Wenzhe Wang, Ruiwei Feng, Jintai Chen, Chunnv Yuan, Weiguo Lu, Danny Z Chen, Jian Wu$^\dagger$, International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2019
🎖 Awards
- 2023.04, Excellent Doctoral Graduates of Zhejiang Province, China (Top 1%)
- 2023.04, Excellent Doctoral Graduates of Zhejiang University (Top 1%)
- 2022.10, Huawei Fundamental Research Scholarship (Top 3%)
- 2021.10, Tencent Doctoral Scholarship (Top 1%)
- 2021.10, National Scholarship of China (Top 1%)
- 2020.10, Outstanding Doctoral Student Scholarship (Top 3%)
- 2019.10, Doctoral Freshman Scholarship (Top 3%)
- 2016.10, Chinese Bank Scholarship (Undergraduate) (Top 1%)
- 2015.10, National Scholarship (Undergraduate) (Top 1%)
💬 Talks
- 2022.11, How to Excel in AI-for-healthcare Researches, @ Shanghai University
- 2022.10, ECG Signal Processing and Synthesis for Computer-Aided Heart Disease Diagnosis, @ Carnegie Mellon University
- 2022.10, ECG Synthesis for New View and New Data, @ Shanghai AI Lab
- 2022.09, Part-Hierarchy Learning, @ ByteDance
- 2022.06, Supervised Tabular Learning, @ UberAI
- 2021.10, Domain Mixup for Distant Transfer Learning, @ Shanghai Jiaotong University
🏫 Teaching
- Fall 2023, Frontiers of Medical Artificial Intelligence (lecture slice preparation, teaching assistant)
🔎 Reviews:
- Review for Conferences: ICLR, ICML, AAAI, IJCAI, CVPR, MICCAI, ISBI, NeurIPS, ICCV, ECCV, EMNLP.
- Review for Journals: TPAMI, TNNLS, TCBB, JBHI, Frontiers in Public Health, JBSM, TCDS, Frontiers in Genetics, Scienstific Report
🎒 Visiting
- 2021.06 - 2021.09, Medical Big Data Center, Guangdong Academy of Medical Sciences, had the honor of working with Prof. Huiying Liang, Shuai Huang, and Dantong Li.