The role of unpaired image-to-image translation for stain color normalization in colorectal cancer histology classification
- PMID: 37011426
- DOI: 10.1016/j.cmpb.2023.107511
The role of unpaired image-to-image translation for stain color normalization in colorectal cancer histology classification
Abstract
Background: Histological assessment of colorectal cancer (CRC) tissue is a crucial and demanding task for pathologists. Unfortunately, manual annotation by trained specialists is a burdensome operation, which suffers from problems like intra- and inter-pathologist variability. Computational models are revolutionizing the Digital Pathology field, offering reliable and fast approaches for challenges like tissue segmentation and classification. With this respect, an important obstacle to overcome consists in stain color variations among different laboratories, which can decrease the performance of classifiers. In this work, we investigated the role of Unpaired Image-to-Image Translation (UI2IT) models for stain color normalization in CRC histology and compared to classical normalization techniques for Hematoxylin-Eosin (H&E) images.
Methods: Five Deep Learning normalization models based on Generative Adversarial Networks (GANs) belonging to the UI2IT paradigm have been thoroughly compared to realize a robust stain color normalization pipeline. To avoid the need for training a style transfer GAN between each pair of data domains, in this paper we introduce the concept of training by exploiting a meta-domain, which contains data coming from a wide variety of laboratories. The proposed framework enables a huge saving in terms of training time, by allowing to train a single image normalization model for a target laboratory. To prove the applicability of the proposed workflow in the clinical practice, we conceived a novel perceptive quality measure, which we defined as Pathologist Perceptive Quality (PPQ). The second stage involved the classification of tissue types in CRC histology, where deep features extracted from Convolutional Neural Networks have been exploited to realize a Computer-Aided Diagnosis system based on a Support Vector Machine (SVM). To prove the reliability of the system on new data, an external validation set composed of N = 15,857 tiles has been collected at IRCCS Istituto Tumori "Giovanni Paolo II".
Results: The exploitation of a meta-domain consented to train normalization models that allowed achieving better classification results than normalization models explicitly trained on the source domain. PPQ metric has been found correlated to quality of distributions (Fréchet Inception Distance - FID) and to similarity of the transformed image to the original one (Learned Perceptual Image Patch Similarity - LPIPS), thus showing that GAN quality measures introduced in natural image processing tasks can be linked to pathologist evaluation of H&E images. Furthermore, FID has been found correlated to accuracies of the downstream classifiers. The SVM trained on DenseNet201 features allowed to obtain the highest classification results in all configurations. The normalization method based on the fast variant of CUT (Contrastive Unpaired Translation), FastCUT, trained with the meta-domain paradigm, allowed to achieve the best classification result for the downstream task and, correspondingly, showed the highest FID on the classification dataset.
Conclusions: Stain color normalization is a difficult but fundamental problem in the histopathological setting. Several measures should be considered for properly assessing normalization methods, so that they can be introduced in the clinical practice. UI2IT frameworks offer a powerful and effective way to perform the normalization process, providing realistic images with proper colorization, unlike traditional normalization methods that introduce color artifacts. By adopting the proposed meta-domain framework, the training time can be reduced, and the accuracy of downstream classifiers can be increased.
Keywords: Colorectal cancer; Computer-aided diagnosis; Generative adversarial network; Stain color normalization.
Copyright © 2023 The Author(s). Published by Elsevier B.V. All rights reserved.
Conflict of interest statement
Declaration of Competing Interest The authors declare that they have no competing interests.
Similar articles
-
Normalization of HE-stained histological images using cycle consistent generative adversarial networks.Diagn Pathol. 2021 Aug 6;16(1):71. doi: 10.1186/s13000-021-01126-y. Diagn Pathol. 2021. PMID: 34362386 Free PMC article.
-
Automatic normalized digital color staining in the recognition of abnormal blood cells using generative adversarial networks.Comput Methods Programs Biomed. 2023 Oct;240:107629. doi: 10.1016/j.cmpb.2023.107629. Epub 2023 May 30. Comput Methods Programs Biomed. 2023. PMID: 37301181
-
Stain color translation of multi-domain OSCC histopathology images using attention gated cGAN.Comput Med Imaging Graph. 2023 Jun;106:102202. doi: 10.1016/j.compmedimag.2023.102202. Epub 2023 Feb 24. Comput Med Imaging Graph. 2023. PMID: 36857953
-
Optimized detection and segmentation of nuclei in gastric cancer images using stain normalization and blurred artifact removal.Pathol Res Pract. 2023 Aug;248:154694. doi: 10.1016/j.prp.2023.154694. Epub 2023 Jul 16. Pathol Res Pract. 2023. PMID: 37494804 Review.
-
Generative Adversarial Networks in Digital Histopathology: Current Applications, Limitations, Ethical Considerations, and Future Directions.Mod Pathol. 2024 Jan;37(1):100369. doi: 10.1016/j.modpat.2023.100369. Epub 2023 Oct 27. Mod Pathol. 2024. PMID: 37890670 Review.
Cited by
-
Application of Machine Learning in Predicting Perioperative Outcomes in Patients with Cancer: A Narrative Review for Clinicians.Curr Oncol. 2024 May 11;31(5):2727-2747. doi: 10.3390/curroncol31050207. Curr Oncol. 2024. PMID: 38785488 Free PMC article. Review.
-
An Explainable Radiogenomic Framework to Predict Mutational Status of KRAS and EGFR in Lung Adenocarcinoma Patients.Bioengineering (Basel). 2023 Jun 21;10(7):747. doi: 10.3390/bioengineering10070747. Bioengineering (Basel). 2023. PMID: 37508774 Free PMC article.
-
Exploring the interplay between colorectal cancer subtypes genomic variants and cellular morphology: A deep-learning approach.PLoS One. 2024 Sep 10;19(9):e0309380. doi: 10.1371/journal.pone.0309380. eCollection 2024. PLoS One. 2024. PMID: 39255280 Free PMC article.
-
Deep learning model with pathological knowledge for detection of colorectal neuroendocrine tumor.Cell Rep Med. 2024 Oct 15;5(10):101785. doi: 10.1016/j.xcrm.2024.101785. Cell Rep Med. 2024. PMID: 39413732 Free PMC article.
-
Impact of H&E Stain Normalization on Deep Learning Models in Cancer Image Classification: Performance, Complexity, and Trade-Offs.Cancers (Basel). 2023 Aug 17;15(16):4144. doi: 10.3390/cancers15164144. Cancers (Basel). 2023. PMID: 37627172 Free PMC article.
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Medical