Child pages
  • Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM)

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Excerpt

This CBIS-DDSM (Curated Breast Imaging Subset of DDSM) is an updated and standardized version of the  Digital Database for Screening Mammography (DDSM) .  The DDSM is a database of 2,620 scanned film mammography studies. It contains normal, benign, and malignant cases with verified pathology information. The scale of the database along with ground truth validation makes the DDSM a useful tool in the development and testing of decision support systems. The CBIS-DDSM collection includes a subset of the DDSM data selected and curated by a trained mammographer.  The images have been decompressed and converted to DICOM format.  Updated ROI segmentation and bounding boxes, and pathologic diagnosis for training data are also included.  A manuscript describing how to use this dataset in detail is available at https://www.nature.com/articles/sdata2017177.

Published research results from work in developing decision support systems in mammography are difficult to replicate due to the lack of a standard evaluation data set; most computer-aided diagnosis (CADx) and detection (CADe) algorithms for breast cancer in mammography are evaluated on private data sets or on unspecified subsets of public databases. Few well-curated public datasets have been provided for the mammography community. These include the DDSM, the Mammographic Imaging Analysis Society (MIAS) database, and the Image Retrieval in Medical Applications (IRMA) project. Although these public data sets are useful, they are limited in terms of data set size and accessibility.

For example, most researchers using the DDSM do not leverage all its images for a variety of historical reasons. When the database was released in 1997, computational resources to process hundreds or thousands of images were not widely available. Additionally, the DDSM images are saved in non-standard compression files that require the use of decompression code that has not been updated or maintained for modern computers. Finally, the ROI annotations for the abnormalities in the DDSM were provided to indicate a general position of lesions, but not a precise segmentation for them. Therefore, many researchers must implement segmentation algorithms for accurate feature extraction. This causes an inability to directly compare the performance of methods or to replicate prior results. The CBIS-DDSM collection addresses that challenge by publicly releasing an curated and standardized version of the DDSM for evaluation of future CADx and CADe systems (sometimes referred to generally as CAD) research in mammography.

Please note that the image data for this collection is structured such that each participant has multiple patient IDs.  For example, participant 00038 has 10 separate patient IDs which provide information about the scans within the IDs (e.g. Calc-Test_P_00038_LEFT_CC, Calc-Test_P_00038_RIGHT_CC_1).  This makes it appear as though there are 6,671 patients according to the DICOM metadata, but there are only 1,566 actual participants in the cohort.

For scientific and other inquiries about this dataset, please contact Dr. Daniel Rubin, Department of Biomedical Data Science, Radiology, and Medicine, Stanford University School of Medicine (dlrubin@stanford.edu). A manuscript describing the dataset in detail is under review in Scientific Data and will be linked here when published. contact contact the TCIA Helpdesk.


Localtab Group



Localtab
activetrue
titleData Access

Data Access

Choosing the Download option will provide you with a file to launch the TCIA Download Manager to download the entire collection. If you want to browse or filter the data to select only specific scans/studies please use the Search By Collection option.


Data Type
Download all or Query/Filter

Images (DICOM,

70

163.

5GB

6GB)

 

Image Added Image Modified

Click the  Download button to save a ".tcia" manifest file to your computer, which you must open with the NBIA Data Retriever .  

Mass-Training-Description (csv)
Calc-Training-Description (csv)
Mass-Test-Description (csv)
Calc-Test-Description (csv)



Click the Versions tab for more info about data releases.




Localtab
titleDetailed Description

Detailed Description


Collection Statistics

 


Modalities

MG

Number of

Patients1431

Participants

1,566*

Number of Studies

2841

6775

Number of Series

2841

6775

Number of Images

4067

10239

Image Size (GB)
70.5
163.6


 * The image data for this collection is structured such that each participant has multiple patient IDs.  For example, pat_id 00038 has 10 separate patient IDs which provide information about the scans within the IDs (e.g. Calc-Test_P_00038_LEFT_CC, Calc-Test_P_00038_RIGHT_CC_1)  This makes it appear as though there are 6,671 participants according to the DICOM metadata, but there are only 1,566 actual participants in the cohort.


The CBIS-DDSM contributors have provided the following additional options for subset download.


Data Type
Download all or Query/Filter
Mass-Training Full Mammogram Images (DICOM)
Mass-Training ROI and Cropped Images (DICOM)
Calc-Training Full Mammogram Images (DICOM)

Calc-Training ROI and Cropped Images (DICOM)

Mass-Training-Description (csv)
Calc-Training-Description (csv)
Mass-Test Full Mammogram Images (DICOM)
Mass-Test ROI and Cropped Images (DICOM)

Calc-Test Full Mammogram Images (DICOM)

Calc-

Traininig

Test ROI and Cropped Images (DICOM)

Mass-Test-Description (csv)
 

Calc-Test-Description (csv)



The CBIS-DDSM was created from DDSM by undertaking the following specific procedures: 


1) Removal of questionable mass cases

Not all DDSM ROI annotations include suspicious lesions. Due to this issue, a trained mammographer reviewed the questionable cases. In this process, 254 images were identified in which a mass was not clearly seen. These images were removed from the final data set.  


2) Image Decompression

DDSM images are distributed as lossless JPEG files (LJPEG); an obsolete image format. The only library capable of decompressing these images is the Stanford PVRG-JPEG Codec v1.1, which was last updated in 1993. To address this the PVRG-JPEG codec was modified to successfully compile on an OSX 10.10.5 (Yosemite) distribution using Apple GCC clang-602.0.53. The decompression code outputs data in 8-bit raw binary bitmaps. Python tools were developed to read this raw data and store it as 16-bit gray scale TIFF files. These files were later converted to DICOM.

This process is entirely lossless and preserved all information from the original DDSM files. 


3) Image Processing

The original DDSM files were distributed with a set of bash and C tools for Linux to perform image correction and metadata processing. These tools were very difficult to refactor for use on modern systems. To address this the tools were re-implemented in Python to be cross-platform and easy to understand for modern users. All images in the DDSM were derived from several different scanners at different institutions. The DDSM data descriptions provide methods to convert raw pixel data into 64-bit optical density values, which are standardized across all images. Optical density values were then re-mapped to 16-bit gray scale TIFF files.  The DDSM automatically clips optical density values to be between 0.05 and 3.0 for noise reduction. This clipping occurs in the CBIS-DDSM as well, but the new tools provide a flag to remove the clipping and retain the original optical density values. 


4) Image Cropping

Several CAD tasks require only analyzing abnormalities (the portion of the image in the ROI) without needing the full mammogram image. A set of convenience images are also provided, which are focused crops of abnormalities. Abnormalities were cropped by determining the bounding rectangle of the abnormality with respect to its ROI. The square crops were created by extending the shorter edge of the rectangle to be the same size as the long edge. The centroid of the abnormality is located in the center of these square crops.

 


5) Updating for precision segmentation

Mass margin and shape have long been proven to be significant indicators for diagnosis in mammography. Because of this, many methods are based on developing mathematical descriptions of the tumor outline. Due to the dependence of these methods on accurate ROI segmentation and the imprecise nature of many of the DDSM-provided annotations, a lesion segmentation algorithm (described below) was applied that is initialized by the general, original DDSM contours but is able to supply much more accurate ROIs. This was done only for masses and not calcifications. Lesion segmentation was accomplished by applying a modification to the local level set framework as presented in Chan and Vese11. Level set models follow a non-parametric deformable model, thus can handle topological changes during evolution11. Chan-Vese model is a region-based method that estimates spatial statistics of image regions and finds a minimal energy where the model best fits the image, resulting in convergence of the contour towards the desired object.  This modification of the local framework includes automated evaluation of the local region surrounding each contour point. For low contrast lesions, small local region is determined, and excessive curve evolution is thus prevented. On the other hand, for noisy or heterogeneous lesions, a relatively large local region is assigned to the contour point to prevent convergence of the level set contour into local minima.  Local frameworks require an initialization of the contour, and thus the original DDSM annotation was used as the level set segmentation initialization.

 


6) Standardized Train/Test splits

The data were split into a training set and a testing set based on the BIRADS category. This allows for an appropriate stratification for researchers working on CADe as well as CADx. The split was obtained using 20% of the cases for testing and the rest for training. The data were split for all mass cases and all calcification cases separately. Here “case” is used to indicate a particular abnormality, seen on both the CC and MLO views.

 

 






Localtab
titleCitations & Data Usage Policy

Citations & Data Usage Policy 

 This collection is freely available to browse, download, and use for commercial, scientific and educational purposes as outlined in the Creative Commons Attribution 3.0 Unported License.  See TCIA's Data Usage Policies and Restrictions for additional details. Questions may be directed to help@cancerimagingarchive.net.

Please be sure to include the following citations in your work if you use this data set:

Public collection license

Info
titleCBIS-DDSM Citation

 Rebecca Sawyer Lee, Francisco Gimenez, Assaf Hoogi , Daniel Rubin  (2016). Curated Breast Imaging Subset of DDSMDDSM [Dataset]. The Cancer Imaging Archive. httpDOI:  https://dx.doi.org/10.7937/K9/TCIA.2016.7O02S9CY




Info
titlePublication Citation

Coming SoonRebecca Sawyer Lee, Francisco Gimenez, Assaf Hoogi, Kanae Kawai Miyake, Mia Gorovoy & Daniel L. Rubin. (2017) A curated mammography data set for use in computer-aided detection and diagnosis research. Scientific Data volume 4, Article number: 170177 DOI: https://doi.org/10.1038/sdata.2017.177




Info
titleTCIA Citation

Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository, Journal of Digital Imaging, Volume 26, Number 6, December, 2013, pp 1045-1057. (paper). DOI: https://doi.org/10.1007/s10278-013-9622-7


Other Publications Using This Data

TCIA maintains a list of publications which that leverage our data. At this time we are not aware of any publications based on this data, including citations of this Collection. If you have a publication you'd like to add please contact the TCIA Helpdesk.

 

Some publications that have used this dataset as a resource include:

  1. Duggento et al. An Ad Hoc Random Initialization Deep Neural Network Architecture for Discriminating Malignant Breast Cancer Lesions in Mammographic Images Contrast Media Mol Imaging 2019 link to article
  2. Agarwal et al. Automatic mass detection in mammograms using deep convolutional neural networks Journal of Medical Imaging 2019 link to article
  3. Cha, et al.  Evaluation of data augmentation via synthetic images for improved breast mass detection on mammograms using deep learning. J Med Imaging (Bellingham) 2020 link to article
  4. Shen, et al. Unsupervised domain adaptation with adversarial learning for mass detection in mammogram Neurocomputing 2020 link to article

  5. Agarwal. An Augmentation in the Diagnostic Potency of Breast Cancer through A Deep Learning Cloud-Based AI Framework to Compute Tumor Malignancy & Risk International Research Journal of Innovations in Engineering and Technology (IRJIET) 2019 link to article

  6. Farhat. A study of machine learning and deep learning models for solving medical imaging problems 2019 link to article

  7. Ratner, Accelerating Machine Learning with Training Data Management 2019 link to article

  8. Tang, et al. Five Classifications of Mammography Images Based on Deep Cooperation Convolutional Neural Network American Scientific Research Journal for Engineering, Technology, and Sciences (ASRJETS) 2019 link to article 

  9. Umehara, et al. Super-Resolution Imaging of Mammograms Based on the Super-Resolution Convolutional Neural Network Open Journal of Medical Imaging 2017 link to article





Localtab
titleVersions

Version 1 (Current): Updated 2017/09/14

Localtab
titleVersions

Version 1 (Current): Updated 2016/08/31

 

Data Type
Download all or Query/Filter
Images (DICOM, xxGB)Image Removed Image Removed 

Mass-Training Full Mammogram Images

 

Data Type
Download all or Query/Filter
Images (DICOM, xxGB)Image Removed Image Removed 
Mass-Training ROI and Cropped Images

 


Data Type
Download all or Query/Filter
Images (DICOM,
xxGB
163.6GB)
 

Calc-Training Full Mammogram Images

 

 

 

(Requires the NBIA Data Retriever .)