Child pages
  • Standardization in Quantitative Imaging: A Multi-center Comparison of Radiomic Feature Values (Radiomic-Feature-Standards)

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 25 Next »

Summary

This dataset was used by the NCI's Quantitative Imaging Network (QIN) PET-CT Subgroup for their project titled: Multi-center Comparison of Radiomic Features from Different Software Packages on Digital Reference Objects and Patient Datasets.  The purpose of this project was to assess the agreement among radiomic features when computed by several groups by using different software packages under very tightly controlled conditions, which included common image data sets and standardized feature definitions.  The image datasets (and Volumes of Interest – VOIs) provided here are the same ones used in that project and reported in the publication listed below.  In addition, we have provided the individual feature value results for each image dataset and each software package that was used to create the summary tables (Tables 2, 3 and 4) in that publication.  For that project, nine common quantitative imaging features were selected for comparison including features that describe morphology, intensity, shape, and texture and that are described in detail in the International Biomarker Standardization Initiative (IBSI, https://arxiv.org/abs/1612.07003).

Acknowledgements 

The authors gratefully acknowledge the following sources of support:  

David Geffen School of Medicine at UCLA, Los Angeles, California, USA  and Stanford University School of Medicine, Stanford, CA, USA.  Special thanks to Michael McNitt-Gray, PhD from UCLA Department of Radiological Sciences and Sandy Napel, PhD from the Stanford Department of Radiology.


Data Access

Click the Download button to save a ".tcia" manifest file to your computer, which you must open with the NBIA Data Retriever. Click the Search button to open our Data Portal, where you can browse the data collection and/or download a subset of its contents.

Data TypeDownload all or Query/Filter
Images (DICOM, XX.X GB)

Click the Versions tab for more info about data releases.

Please contact help@cancerimagingarchive.net  with any questions regarding usage.

Detailed Description

Image Statistics


Modalities


Number of Patients


Number of Studies


Number of Series


Number of Images


Images Size (GB)


Patient IDs for the 3 DROs from (insert DOI)
Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-0.0-0.0
Phantom-100.0-1.0-1.0-1.0-9.0-0.0-100.0-10.0-50.0-0.0
Phantom-100.0-1.0-1.0-1.0-9.0-0.2-100.0-10.0-0.0-0.0
 
Patient IDs for the 10 LIDC-IDRI subjects (http://doi.org/10.7937/K9/TCIA.2015.LO9QL9SX)
LIDC-IDRI             LIDC-IDRI-0314
LIDC-IDRI             LIDC-IDRI-0325
LIDC-IDRI             LIDC-IDRI-0580
LIDC-IDRI             LIDC-IDRI-0766
LIDC-IDRI             LIDC-IDRI-0771
LIDC-IDRI             LIDC-IDRI-0811
LIDC-IDRI             LIDC-IDRI-0905
LIDC-IDRI             LIDC-IDRI-0963
LIDC-IDRI             LIDC-IDRI-0965
LIDC-IDRI             LIDC-IDRI-1012

There are three datasets provided – two image datasets and one dataset consisting of three excel spreadsheets containing feature values.

  • The first image dataset is a set of three Digital Reference Objects (DROs) used in the project, which are: (a) a sphere with uniform intensity, (b) a sphere with intensity variation (c) a nonspherical (but mathematically defined) object with uniform intensity. These DROs were created by the team at Stanford University and are described in (Jaggi A, Mattonen SA, McNitt-Gray M,Napel S. Stanford DRO Toolkit: digital reference objects for standardization of radiomic AQ: F features. Tomography. 2019;6:–.) and are a subset of the DROs described in (link to DRO wiki page). Each DRO is represented in both DICOM and NIfTI format and the VOI was provided in each format as well (DICOM Segmentation Object (DSO) as well as NIfTI segmentation boundary).
  • The second image dataset is a set of 10 patient CT scans which is a subset of the QIN multi-site collection of Lung CT data with Nodule Segmentations (http://doi.org/10.7937/K9/TCIA.2015.1BUVFJR7) created previously. Specifically, the same 10 cases selected from the LIDC-IDRI dataset that were used in that previous study were used in this study. As in that previous study, a single lesion from each case was identified for analysis. That previous study generated VOIs using algorithms from three academic institutions and each method performed three repeat runs on each nodule. For this study, and to eliminate one source of variability in our project, one of the VOIs previously created for each lesion was identified and all sites used that same VOI definition. The specific VOI chosen for each lesion was the first run of the first algorithm (algorithm 1, run 1). As in that prior project, both DICOM and NIfTI formats were created for each image dataset and the VOI was provided in each format as well (DICOM Segmentation Object (DSO) as well as NIfTI segmentation boundary).
  • The third dataset is a collection of three excel spreadsheets, each of which contains the raw feature values and the summary tables reported in the publication below.  These tables are:

DRO results: This contains the original feature values obtained for each software package for each DRO as well as the table summarizing results across software packages (Table 2 in the publication).

Patient Dataset results: This contains the original feature values for each software package for each patient dataset (1 lesion per case) as well as the table summarizing results across software packages and patient datasets (Table 3 in the publication).

Harmonized GLCM Entropy Results: This contains the values for the “Harmonized” GLCM Entropy feature for each patient dataset and each software package as well as the summary across software packages (Table 4 in the publication).

Citations & Data Usage Policy

Add any special restrictions in here.

These collections are freely available to browse, download, and use for commercial, scientific and educational purposes as outlined in the Creative Commons Attribution 3.0 Unported License. Questions may be directed to help@cancerimagingarchive.net. Please be sure to acknowledge both this data set and TCIA in publications by including the following citations in your work:

Data Citation

McNitt-Gray, M.*, Napel, S.*, Jaggi, A., Mattonen, S.A., Hadjiiski, L., Muzi, M., Goldgof, D., Balagurunathan, Y., Pierce, L.A., Kinahan, P.E., Jones, E.F., Nguyen, A., Virkud, A., Chan, H-P., Emaminejad, N., Wahi-Anwar, M., Daly, M., Abdalah, M., Yang, H., Lu, L., Lv, W., Rahmim, A., Gastounioti, A., Pati, S., Bakas, S., Kontos, D., Zhao, B., Kalpathy-Cramer, J., Farahani, K. (2020). Standardization in Quantitative Imaging: A Multi-center Comparison of Radiomic Features from Different Software Packages on Digital Reference Objects and Patient Datasets. Tomography, Feb, 2020.

*Authors contributed equally.

Publication Citation

Kalpathy-Cramer, J., Zhao, B., Goldgof, D., Gu, Y., Wang, X., Yang, H., … Napel, S. (2016). A Comparison of Lung Nodule Segmentation Algorithms: Methods and Results from a Multi-institutional Study. Journal of Digital Imaging. Springer Nature. http://doi.org/10.1007/s10278-016-9859-z

TCIA Citation

Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository, Journal of Digital Imaging, Volume 26, Number 6, December, 2013, pp 1045-1057. DOI: 10.1007/s10278-013-9622-7

Grant Citations

  • David Geffen School of Medicine at UCLA - U01CA181156
  • Stanford University School of Medicine – U01CA187947 and U24CA180927
  • University of Michigan - U01CA232931
  • University of Washington – R50CA211270, U01CA148131
  • University of South Florida - U24CA180927, U01CA200464
  • Moffitt Cancer Center – U01CA143062, U01CA200464, P30CA076292
  • UC San Francisco - U01CA225427
  • BC Cancer Research Centre - NSERC Discovery Grant: RGPIN-2019-06467
  • Columbia University- U01CA225431
  • Center for Biomedical Image Computing and Analytics at the University of Pennsylvania - U24CA189523, R01NS042645
  • Massachusetts General Hospital- U01CA154601, U24CA180927

In addition to the dataset citation above, please be sure to cite the following if you utilize these data in your research:

Analysis Citation

Jayashree Kalpathy-Cramer, Sandy Napel, Dmitry Goldgof, Binsheng Zhao. (2015). Multi-site collection of Lung CT data with Nodule Segmentations. The Cancer Imaging Archive. http://doi.org/10.7937/K9/TCIA.2015.1BUVFJR7

Other Publications Using This Data

TCIA maintains a list of publications which leverage TCIA data. If you have a manuscript you'd like to add please contact the TCIA Helpdesk.

Version 1 (Current): Updated 2020/03/XX

Data TypeDownload all or Query/Filter
Images (DICOM, xx.x GB)

(Requires NBIA Data Retriever.)

Segmentations (NIfTI, XX.X GB)

  • No labels