Detection, segmentation and classification of nuclei are fundamental analysis operations in digital pathology. Existing state-of-the-art approaches demand extensive amounts of supervised training data from pathologists and may still perform poorly in images from unseen tissue types. We propose an unsupervised approach for histopathology image segmentation that synthesizes heterogeneous sets of training image patches, of every tissue type. Although our synthetic patches are not always of high quality, we harness the motley crew of generated samples through a generally applicable importance sampling method.
This proposed approach, for the first time, re-weighs the training loss over synthetic data so that the ideal (unbiased) generalization loss over the true data distribution is minimized. This enables us to use a random polygon generator to synthesize approximate cellular structures (i.e., nuclear masks) for which no real examples are given in many tissue types, and hence, GAN-based methods are not suited. In addition, we propose a hybrid synthesis pipeline that utilizes textures in real histopathology patches and GAN models, to tackle heterogeneity in tissue textures. Compared with existing state-of-the-art supervised models, our approach generalizes significantly better on cancer types without training data. Even in cancer types with training data, our approach achieves the same performance without supervision cost.
In this dataset we release code and nucleus segmentations in whole slide tissue images with quality control results for over 5000 Whole Slide Images (WSI) in The Cancer Genome Atlas (TCGA) repository. There are two subsets of data: (1) automatic nucleus segmentation data of 5,060 whole slide tissue images of 10 cancer types, with quality control results, and (2) manual nucleus segmentation data of 1,356 image patches from the same 10 cancer types plus additional 4 cancer types.
These 5,060 Whole Slide Images (WSIs) are from the following 10 cancer types:
BLCA Bladder urothelial carcinoma
BRCA Breast invasive carcinoma
CESC Cervical squamous cell carcinoma and endocervical adenocarcinoma
GBM Glioblastoma Multiforme
LUAD Lung adenocarcinoma
LUSC Lung squamous cell carcinoma
PAAD Pancreatic adenocarcinoma
PRAD Prostate adenocarcinoma
SKCM Skin Cutaneous Melanoma
UCEC Uterine Corpus Endometrial Carcinoma
Note that you can also download segmentation data of following 4 cancer types, although they are not officially verified or released.
COAD Colon adenocarcinoma
READ Rectal adenocarcinoma
STAD Stomach adenocarcinoma
UVM Uveal Melanoma
Click the Download button to be redirected to Box for downloads. Note that Box has a 15GB at one time max download restriction.
|Data Type||Download all or Query/Filter|
|Tissue Slide Images (SVS, 1,200 GB)|
|List of histopathology slides (TXT, )|
|WSI quality control results (TXT, 151.4 KB)|
|Segmentation region checking results (TXT, 169.4 KB)|
Click the Versions tab for more info about data releases.
Note: Please contact firstname.lastname@example.org with any questions regarding usage.
Additional visual segmentation data can be found on PathDB
Manual nucleus segmentation data of 1,356 patches
These 1,356 patches are randomly extracted from all 14 cancer types mentioned above. This data contains original H&E stained histopathology image patches, and instance-level segmentation masks. Additional information is in the readme.txt file of this data. Download here
Citations & Data Usage Policy
These collections are freely available to browse, download, and use for commercial, scientific and educational purposes as outlined in the Creative Commons Attribution 3.0 Unported License. Questions may be directed to email@example.com. Please be sure to acknowledge both this data set and TCIA in publications by including the following citations in your work:
Le Hou, Rajarsi Gupta, John S. Van Arnam, Yuwei Zhang, Kaustubh Sivalenka, Dimitris Samaras, Tahsin M. Kurc, Joel H. Saltz (2019). Dataset of Segmented Nuclei in Hematoxylin and Eosin Stained Histopathology Images of 10 Cancer Types [Data set]. The Cancer Imaging Archive. https://doi.org/10.7937/tcia.2019.4a4dkp9u
Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository, Journal of Digital Imaging, Volume 26, Number 6, December, 2013, pp 1045-1057. (paper)
Hou, Le, Ayush Agarwal, Dimitris Samaras, Tahsin M. Kurc, Rajarsi R. Gupta, and Joel H. Saltz. "Robust Histopathology Image Analysis: To Label or to Synthesize?." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8533-8542. 2019. Open Access Here