Chuang Niu

CBIS 2141

110 8th St

Troy, NY 12180

I am a Research Scientist at Rensselaer Polytechnic Institute and serve as an Associate Director in AXIS Lab led by Prof. Ge Wang.I received my B.S. in biomedical engineering in 2015, and my Ph.D. in pattern recognition and machine intelligence in 2020, from Xidian University . I was a visiting student from 2019 to 2020 and a Postdoc from 2020 to 2023 at Rensselaer Polytechnic Institute .

My research interest is in Medical Multimodal Multitask Foundation Model (M3FM), self-supervised/unsupervised learning, weakly-supervised learning, representation learning, clustering, and biomedical imaging and analysis.

I have been working on weakly-supervised especially self-supervised learning algorithm development since 2018, with the applications in image segmentation, image classification/clustering, representation learning for object recognition and detection, medical CT imaging, and large foundation models for medical multimodal AI.

I firmly believe that AI is transforming and will continue to revolutionize healthcare by reducing costs, improving efficiency, enhancing quality, and addressing unmet needs for a better quality of life.

news

Dec 03, 2024	Our paper “Medical Multimodal Multitask Foundation Model for Lung Cancer Screening” was acceptable by Nature Communications.
Sep 24, 2024	Our Dynamic Template-Constrained LLM for Fully-Structured Radiology Reporting is available at here.
May 01, 2024	I serve as the Guest Editor of Self-Supervised Learning for Image Processing and Analysis.
Jan 03, 2023	I serve as an Associate Editor of Medical Physics.
Dec 18, 2022	Our Noise2Sim paper was accepted by IEEE TMI.
Nov 15, 2022	Our MeTAI paper was published in Nature Machine Intelligence.
Oct 31, 2022	Our SPICE paper was accepted by IEEE TIP.
Aug 27, 2022	I was selected as a distinguished reviewer by IEEE TMI.
Jul 01, 2022	I serve as a guest editor for the special issue “AI-based Image Analysis” .
Mar 17, 2021	Our SPICE method is ranked #1 on six image clustering benchmarks at paper-with-code .

selected publications (more)

Medical Multimodal Multitask Foundation Model for Lung Cancer Screening

Chuang Niu, Qing Lyu, Christopher Carothers, and 6 more authors

Accepted by Nature Communications, 2024

Bib Code

@article{M3FM,
  title = {Medical Multimodal Multitask Foundation Model for Lung Cancer Screening},
  author = {Niu, Chuang and Lyu, Qing and Carothers, Christopher and Kaviani, Parisa and Tan, Josh and Yan, Pingkun and Kalra, Mannudeep and Whitlow, Christopher and Wang, Ge},
  journal = {Accepted by Nature Communications},
  year = {2024},
  url = {https://arxiv.org/abs/2304.02649},
}

Development and Validation of a Dynamic-Template-Constrained Large Language Model for Generating Fully-Structured Radiology Reports

Chuang Niu, Parisa Kaviani, Qing Lyu, and 3 more authors

2024

Bib Code

@misc{llm,
  title = {Development and Validation of a Dynamic-Template-Constrained Large Language Model for Generating Fully-Structured Radiology Reports},
  author = {Niu, Chuang and Kaviani, Parisa and Lyu, Qing and Kalra, Mannudeep K. and Whitlow, Christopher T. and Wang, Ge},
  year = {2024},
  eprint = {2409.18319},
  archiveprefix = {arXiv},
  primaryclass = {cs.AI},
  url = {https://arxiv.org/abs/2409.18319},
}

Variable Discretization for Self-Supervised Learning

Chuang Niu, Wenjun Xia, and Ge Wang

In ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023

Bib Code

@inproceedings{niu2023,
  title = {Variable Discretization for Self-Supervised Learning},
  author = {Niu, Chuang and Xia, Wenjun and Wang, Ge},
  booktitle = {ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models},
  volume = {},
  pages = {},
  year = {2023},
  organization = {ICLR},
}

SPICE: Semantic Pseudo-labeling for Image Clustering

Chuang Niu, Hongming Shan, and Ge Wang

TIP, 2022

Bib Code

GATCluster: Self-supervised Gaussian-ATtention network for image Clustering

Chuang Niu, Jun Zhang, Ge Wang, and 1 more author

In European Conference on Computer Vision, 2020

Bib Code

@inproceedings{niu2020gatcluster,
  title = {{GATC}luster: Self-supervised {G}aussian-{AT}tention network for image {C}lustering},
  author = {Niu, Chuang and Zhang, Jun and Wang, Ge and Liang, Jimin},
  booktitle = {European Conference on Computer Vision},
  pages = {735--751},
  year = {2020},
  organization = {Springer},
}

Noise2sim–similarity-based self-learning for image denoising

Chuang Niu, and Ge Wang

arXiv preprint arXiv:2011.03384 (Accepted by TMI), 2020

Bib Code

@article{niu2020noise2sim,
  title = {Noise2sim--similarity-based self-learning for image denoising},
  author = {Niu, Chuang and Wang, Ge},
  journal = {arXiv preprint arXiv:2011.03384 (Accepted by TMI)},
  year = {2020},
}

Weakly supervised semantic segmentation for joint key local structure localization and classification of aurora image

Chuang Niu, Jun Zhang, Qian Wang, and 1 more author

IEEE Transactions on Geoscience and Remote Sensing, 2018

Bib Code

@article{niu2018weaklz,
  title = {Weakly supervised semantic segmentation for joint key local structure localization and classification of aurora image},
  author = {Niu, Chuang and Zhang, Jun and Wang, Qian and Liang, Jimin},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  volume = {56},
  number = {12},
  pages = {7133--7146},
  year = {2018},
  publisher = {IEEE},
}