American Journal of Roentgenology, Vol 167, 851-854, Copyright © 1996 by American Roentgen Ray Society

ARTICLES

Analysis of interobserver and intraobserver variability in CT tumor measurements

KD Hopper, CJ Kasales, MA Van Slyke, TA Schwartz, TR TenHave and JA Jozefiak
Department of Radiology, Penn State University, Hershey 17033, USA.

OBJECTIVE: The purpose of this study was to evaluate the variability between radiologists interpreting thoracic and abdominal/pelvic CT scans in selecting specific sites of metastatic tumor for measurement (indicator lesions) and to assess interobserver and intraobserver variability in tumor measurement. MATERIALS AND METHODS: Three separate experienced radiologists were asked to review 24 combined thoracic and abdominal CT scans in patients with metastatic tumor. Each radiologist was asked to identify the indicator lesions representative of each patient's tumor bulk. In the second phase of the study, 105 specific foci on 26 combined thoracic and abdominal CT studies (including the original 24) were reviewed twice by the same three radiologists. Up to eight foci were randomly identified per patient, and each observer was asked to determine the slice with the maximum diameter for each tumor focus and to measure it in three dimensions (maximum diameter, its perpendicular, and length). RESULTS: A total of 132 tumor sites were present on the CT studies in phase I, all of which were chosen by at least one observer as an indicator lesion. Of the 116 of these that were separate and nonoverlapped, 57 (49%) were measured by only one observer, whereas 32 (28%) and 27 (23%) were measured by two or all three observers, respectively. Observers were more inclined to pick round or defined/well-defined lesions rather than irregular, oval, or poorly defined ones, although this tendency was not statistically significant. The second phase of the study showed considerable interobserver variability (15%) in CT tumor measurement, which was worse for poorly defined and irregular lesions. Intraobserver variability in measuring individual foci was less (6%). CONCLUSION: Radiologists interpreting thoracic and/or abdominal/pelvic CT scans for metastatic cancer should measure and report a significant number of each patient's tumor sites, especially larger ones in different anatomic areas. When interpreting a follow-up CT scan of a patient with metastatic cancer, the interpreting radiologist should remeasure the indicator lesions on the previous and on the follow-up CT scans, especially when the results will change the patient's treatment response category.
CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				R. Thiam, L. S. Fournier, L. Trinquart, J. Medioni, G. Chatellier, D. Balvay, B. Escudier, C. Dromain, C. A. Cuenod, and S. Oudard Optimizing the size variation threshold for the CT evaluation of response in metastatic renal cell carcinoma treated with sunitinib Ann. Onc., November 4, 2009; (2009) mdp466v1. [Abstract] [Full Text] [PDF]

				P. A. Tang, G. R. Pond, and E. X. Chen Influence of an independent review committee on assessment of response rate and progression-free survival in phase III clinical trials Ann. Onc., October 29, 2009; (2009) mdp478v1. [Abstract] [Full Text] [PDF]

				B. Zhao, L. P. James, C. S. Moskowitz, P. Guo, M. S. Ginsberg, R. A. Lefkowitz, Y. Qin, G. J. Riely, M. G. Kris, and L. H. Schwartz Evaluating Variability in Tumor Measurements from Same-day Repeat CT Scans of Patients with Non-Small Cell Lung Cancer Radiology, July 1, 2009; 252(1): 263 - 272. [Abstract] [Full Text] [PDF]

				W. Cai, A. Kassarjian, M. A. Bredella, G. J. Harris, H. Yoshida, V. F. Mautner, R. Wenzel, and S. R. Plotkin Tumor Burden in Patients with Neurofibromatosis Types 1 and 2 and Schwannomatosis: Determination on Whole-Body MR Images Radiology, March 1, 2009; 250(3): 665 - 673. [Abstract] [Full Text] [PDF]

				E. A. Perez, G. Lerzo, X. Pivot, E. Thomas, L. Vahdat, L. Bosserman, P. Viens, C. Cai, B. Mullaney, R. Peck, et al. Efficacy and Safety of Ixabepilone (BMS-247550) in a Phase II Study of Patients With Advanced Breast Cancer Resistant to an Anthracycline, a Taxane, and Capecitabine J. Clin. Oncol., August 10, 2007; 25(23): 3407 - 3414. [Abstract] [Full Text] [PDF]

				B. Zhao, L. H. Schwartz, C. S. Moskowitz, M. S. Ginsberg, N. A. Rizvi, and M. G. Kris Lung Cancer: Computerized Quantification of Tumor Response--Initial Results Radiology, December 1, 2006; 241(3): 892 - 898. [Abstract] [Full Text] [PDF]

				M P Sampat, G J Whitman, T W Stephens, L D Broemeling, N A Heger, A C Bovik, and M K Markey The reliability of measuring physical characteristics of spiculated masses on mammography Br. J. Radiol., December 1, 2006; 79(Special_Issue_2): S134 - S140. [Abstract] [Full Text] [PDF]

				P. J. Pickhardt, V. T. Lehman, T. C. Winter, and A. J. Taylor Polyp volume versus linear size measurements at CT colonography: implications for noninvasive surveillance of unresected colorectal lesions. Am. J. Roentgenol., June 1, 2006; 186(6): 1605 - 1610. [Abstract] [Full Text] [PDF]

				E. Galanis, J. C. Buckner, M. J. Maurer, R. Sykora, R. Castillo, K. V. Ballman, B. J. Erickson, and for the North central cancer treatment Group Validation of neuroradiologic response assessment in gliomas: Measurement by RECIST, two-dimensional, computer-assisted tumor area, and computer-assisted tumor volume methods Neuro-oncol, April 1, 2006; 8(2): 156 - 165. [Abstract] [Full Text] [PDF]

				S. G. Armato III, J. L. Ogarek, A. Starkey, N. J. Vogelzang, H. L. Kindler, M. Kocherginsky, and H. MacMahon Variability in mesothelioma tumor response classification. Am. J. Roentgenol., April 1, 2006; 186(4): 1000 - 1006. [Abstract] [Full Text] [PDF]

				B. Zhao, L. H. Schwartz, C. S. Moskowitz, L. Wang, M. S. Ginsberg, C. A. Cooper, L. Jiang, and J. P. Kalaigian Pulmonary Metastases: Effect of CT Section Thickness on Measurement--Initial Experience Radiology, March 1, 2005; 234(3): 934 - 939. [Abstract] [Full Text] [PDF]

				H. T. Winer-Muram, S. G. Jennings, C. A. Meyer, Y. Liang, A. M. Aisen, R. D. Tarver, and R. C. McGarry Effect of Varying CT Section Width on Volumetric Measurement of Lung Tumors and Application of Compensatory Equations Radiology, October 1, 2003; 229(1): 184 - 194. [Abstract] [Full Text] [PDF]

				L. H. Schwartz, M. Mazumdar, W. Brown, A. Smith, and D. M. Panicek Variability in Response Assessment in Solid Tumors: Effect of Number of Lesions Chosen for Measurement Clin. Cancer Res., October 1, 2003; 9(12): 4318 - 4323. [Abstract] [Full Text] [PDF]

				M. Markman The Myth of Measurable Disease in Ovarian Cancer J. Clin. Oncol., August 15, 2003; 21(16): 3013 - 3015. [Full Text] [PDF]

				J. J. Erasmus, G. W. Gladish, L. Broemeling, B. S. Sabloff, M. T. Truong, R. S. Herbst, and R. F. Munden Interobserver and Intraobserver Variability in Measurement of Non-Small-Cell Carcinoma Lung Lesions: Implications for Assessment of Tumor Response J. Clin. Oncol., July 1, 2003; 21(13): 2574 - 2582. [Abstract] [Full Text] [PDF]

				S. R. Prasad, K. S. Jhaveri, S. Saini, P. F. Hahn, E. F. Halpern, and J. E. Sumner CT Tumor Measurement for Therapeutic Response Assessment: Comparison of Unidimensional, Bidimensional, and Volumetric Techniques—Initial Observations Radiology, November 1, 2002; 225(2): 416 - 419. [Abstract] [Full Text] [PDF]

				L. H. Schwartz, M. S. Ginsberg, D. DeCorato, L. N. Rothenberg, S. Einstein, P. Kijewski, and D. M. Panicek Evaluation of Tumor Measurements in Oncology: Use of Film-Based and Electronic Techniques J. Clin. Oncol., May 10, 2000; 18(10): 2179 - 2184. [Abstract] [Full Text] [PDF]

				K. D. Hopper, K. Singapuri, and A. Finkel Body CT and Oncologic Imaging Radiology, April 1, 2000; 215(1): 27 - 40. [Abstract] [Full Text]

				W. L. Monsky, D. K. Heddens, G. M. Clark, D. D. Von Hoff, C. A. Coltman Jr, R. T. Dorr, and D. S. Alberts Comparison of Young Clinical Investigators’ Accuracy and Reproducibility When Measuring Pulmonary and Skin Surface Nodules Using a Circumferential Measurement Versus a Standard Caliper Measurement: American Association for Cancer Research/American Society of Clinical Oncology Clinical Trials Workshop J. Clin. Oncol., January 14, 2000; 18(2): 437 - 437. [Abstract] [Full Text] [PDF]

				L. N. Nazarian, J. H. Park, E. J. Halpern, L. Parker, P. T. Johnson, A. S. Lev-Toaff, and R. J. Wechsler Size of Colorectal Liver Metastases at Abdominal CT: Comparison of Precontrast and Postcontrast Studies Radiology, December 1, 1999; 213(3): 825 - 830. [Abstract] [Full Text]