AJR AJR-based Continuing Ed for Technologists
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Yankaskas, B. C.
Right arrow Articles by Kozar, R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Yankaskas, B. C.
Right arrow Articles by Kozar, R.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?
AJR 2001; 177:543-549
© American Roentgen Ray Society


Association of Recall Rates with Sensitivity and Positive Predictive Values of Screening Mammography

Bonnie C. Yankaskas1, Rebecca J. Cleveland2, Michael J. Schell3 and Robert Kozar1

1 Department of Radiology, CB 7515, Mason Farm Rd., University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-7515.
2 Department of Epidemiology, CB 7400, McGavran-Greenberg Hall, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-7400.
3 Lineberger Comprehensive Cancer Center, CB 7295, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-7295.

Received January 24, 2001; accepted after revision March 19, 2001.

 
Supported by grant NCI U01-CA-70040 from the National Cancer Institute.

Address correspondence to B. C. Yankaskas.


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. The performance of screening mammography is measured mainly by its sensitivity, positive predictive value, and cancer detection rate. Recall rates are also suggested as a surrogate measure. The main objective of this study was to measure the effect on sensitivity and positive predictive value as recall rates increase in the community practice of mammography.

MATERIALS AND METHODS. Mammography and pathology data are linked in the Carolina Mammography Registry, a population-based registry of screening mammography. Our mammography database is created from prospectively collected data from mammography facilities; the data include information on the woman and the imaging studies. Our pathology database is created from prospectively collected breast pathology data received from pathology sites and the Central Cancer Registry. Women in the registry who were 40 years old and older and who underwent screening mammography between January 1994 and June 1998 were included. "Recall rate" was defined as the percentage of screening studies for which further workup was recommended by the radiologist.

RESULTS. The study included 215,665 screening mammograms. The mean age of the women was 56 years. The recall rates of the average practice ranged from 1.9% to 13.4%. Sensitivity rose from a mean of 65% in the lowest recall rates to 80.2% at the highest level of recall rates. The positive predictive value of screening decreased from 7.2% in the lowest level of recall to 3.3% in the highest. As recall rates increased, sensitivity increased very little beyond a recall rate of 4.8%, and positive predictive value began decreasing significantly at a recall rate of 5.9%.

CONCLUSION. Practices with recall rates between 4.9% and 5.5% achieve the best trade-off of sensitivity and positive predictive value.


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Breast cancer is the most commonly diagnosed malignancy in women in the United States. Although the mortality rates are declining because of early detection and treatment at a more curable stage, 182,800 women in the United States are likely to be diagnosed with breast cancer in 2001 [1]. Screening mammography has been shown to be an effective means for detecting early-stage breast cancer in women and has resulted in a decrease in breast cancer mortality [2, 3].

The performance of mammography is often determined by examining accuracy indexes, including sensitivity, specificity, positive predictive value (PPV), and cancer detection rates. Additionally, recall rates are often calculated by mammography practices and are used as a surrogate measure of practice performance. Several studies have been conducted showing how these indexes relate to age, family, personal history of breast cancer, history of biopsy, breast parenchymal density, the number of reviewers, and the number of images [4,5,6,7,8,9,10,11,12]. Although guidelines suggest that setting a recall rate at less than 10% will translate into maximizing the trade-off between sensitivity and PPV [13, 14], no study to date has shown how recall rates affect sensitivity and PPV. We performed this analysis on prospectively collected screening assessment data from a broad representation of mammography facilities in community practice.

The objective of this study was to estimate the association of recall rate with PPV and sensitivity of screening mammography among a wide range of community-based mammography facilities that are linked to a population-based tumor registry for outcome data. Knowledge of how recall rates relate to both sensitivity and PPV, with information of other factors that are independently associated with these rates, should be a useful guide for practices to interpret their own recall rates as surrogate measures of the performance of screening mammography.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The Carolina Mammography Registry was created for the purpose of collecting population-based data for the study of screening mammography practice and performance in the community. The Carolina Mammography Registry is a member of the national Breast Cancer Surveillance Consortium. Full descriptions of the registry and the consortium have been published previously [15, 16]. The Carolina Mammography Registry collects prospective mammography data from mammography facilities and links these data to a breast pathology database that includes benign and malignant breast pathology records collected in an ongoing process from the pathology facilities themselves, from the North Carolina Central Cancer Registry, and from hospital and private pathology departments.

The study group included all screening mammography examinations for women living in North Carolina who underwent screening mammography in any participating facility between January 1994 and June 1998. We identified all standard two-view bilateral mammography examinations in the registry, then selected those that were performed as screening studies and excluded those that were diagnostic studies. Mammography was considered a screening study if the patient was classified as asymptomatic by the radiologist, the examination was bilateral, and the examination was conducted at least 9 months after previous mammography.

The mammography database contains data collected from all patients at the time their mammography is performed, including demographic information, history of breast procedures, reason for visit, hormone use, and family history of breast cancer (defined as a first-degree relative with premenopausal breast cancer). At each visit, the technologist and radiologist record information about the type of examination performed (screening, diagnostic, sonography, or other diagnostic imaging modalities), comparison with previous films, density of breast parenchyma, mammographic impression using the American College of Radiology Breast Imaging Reporting and Data System (BI-RADS) [17] and recommendations for type of follow-up study and follow-up time. Recommendations for follow-up care may include additional mammography at specified intervals (immediately, 6 months, or 1 year), additional mammographic images, breast imaging using another modality, biopsy, or surgical consultation. The number of mammograms obtained annually at each facility can be calculated from data in the Carolina Mammography Registry database.

Outcome data from the pathology database include date and type of pathology, method of biopsy, date of biopsy, breast site, number of nodes tested and number positive, estrogen and progesterone receptor status, and tumor grade and stage. All data are reviewed for quality. Detected errors are corrected before the data are entered into the registry. This project has the approval of the internal review board of the Medical School of the University of North Carolina at Chapel Hill and holds a certificate of confidentiality from the United States Public Health Service.

"Recall rate" is defined as the proportion of screening mammography examinations resulting in a recommendation for further workup, including recall for imaging studies and invasive procedures if they were recommended on the basis of the screening mammography findings. Women who were recommended for recall were considered to have a positive screening mammogram. A true-positive study was a positive mammographic examination that showed invasive breast cancer or ductal carcinoma in situ that was diagnosed within 12 months of the screening examination. A true-negative study was a negative mammographic examination that did not show invasive breast cancer or ductal carcinoma in situ diagnosed within 12 months of the examination. A false-negative study was a negative mammographic examination that resulted in a breast cancer diagnosis within 12 months of the study. A false-positive study was a positive mammographic examination that resulted in no diagnosis of cancer within 12 months.

Sensitivity was defined as the proportion of cancers that had positive mammographic findings within 12 months before the cancer diagnosis date, calculated as true-positive / (true-positive + false-negative). The PPV for recall was defined as the proportion of positive mammograms for which cancer was diagnosed within 12 months of the screening, calculated as true-positive / (true-positive + false-positive). Practice volume was calculated as the mean number of screening mammographic examinations performed at the facility per year. For most analyses, a missing response for family history of early breast cancer or personal history of breast cancer was classified as a negative response. The "cancer detection rate" was defined as the number of cancers discovered through mammography per 1000 women screened. Sensitivity, PPV, cancer detection rates, and recall rates were calculated for each practice.

Reduced monotonic regression analysis [18] was used to model PPV and sensitivity rates as functions of the recall rate for each of 31 radiology practices included in the study. Reduced monotonic regression is a nonparametric approach based on the isotonic regression theory. The reduced monotonic regression method simplifies the isotonic fit, identifying cut points from an isotonic regression fit, reflecting locations in the recall rate at which the trend in the dependent variable (sensitivity or PPV) is most manifest. To avoid identifying a cut point between two practices with nearly identical recall rates, practices whose recall rates differed by less than 1% of the range (i.e., by 0.12% in recall rate) were automatically grouped together. For all analyses, the data for each practice are weighted by the number of mammograms interpreted.

Linear regression analysis was performed to examine the association of recall rates with sensitivity and with PPV and to adjust for relevant covariates. In a second linear regression analysis, the recall rates were put into the models according to the groupings that resulted from the reduced monotonic regression.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Recall Rates and Screening Mammography Results
A total of 273,105 mammographic studies were recorded in the Carolina Mammography Registry for the period from January 1994 through June 1998. After the diagnostic mammograms were excluded, 215,665 screening mammograms obtained in 155,289 women were included for study. The mean age of this population was 56 years; two thirds of the screening mammograms were obtained in women younger than 60 years. These women were 82.5% white, 16.2% black, and 1.3% "other." Of all screening mammograms, 13,552 led to a recommendation for further workup—an overall recall rate of 6.3%. Recall rates and associated sensitivity, PPV, and cancer detection rate are shown by demographics and breast history in Table 1. The highest recall rate (13.6%) among all the subgroups was seen in women who reported a breast problem at screening; the lowest (2.4%) was in women with breasts categorized as almost entirely fat. The distribution of recommended follow-up visits was 68%, further imaging follow-up; 16%, biopsy or surgical consultation; and 0.5%, clinical follow-up. Fifteen percent of the recall follow-ups were missing the specific recommendation for follow-up (not shown in table). The 1-year cancer detection rate was 3.5 per 1000 mammograms obtained.


View this table:
[in this window]
[in a new window]

 
TABLE 1 Mammography Performance by Demographic Characteristic

 

In this population, recall rates decreased with increasing age, from 7.3% in women younger than 50 years old to 4.9% in women 70 years old and older. Women with a history of breast cancer were recalled at a greater rate than women whose mammograms were negative for breast cancer: 7.4% and 6.3%, respectively. For women who had a history of breast surgery or breast procedures, the recall rate was 7.2%, compared with 6.3% for women who did not have this history. The recall rate decreased with decreasing breast density, from nearly 7.0% in the extremely dense and heterogeneously dense groups to 2.4% in the almost entirely fat group. Recall rates increased as elapsed time since previous mammogram increased: 5.2% in women having recent previous mammography versus 8.7% in women whose previous mammography was more than 36 months previous or who had no previous mammography.

The largest difference was found between women who reported symptoms at the time of their screening mammogram and those who did not report symptoms: 13.6% for women reporting symptoms, which was twice the 6.1% for women not reporting symptoms. Recall rates were greater in black women than in white and other women. No difference was seen for family history of breast cancer. The characteristics of women giving rise to greater recall rates in this population included black race, age less than 50 years, extremely dense or heterogeneously dense breasts, a history of breast biopsy or surgery, report of a current breast problem, and no previous mammogram or an elapsed time of more than 36 months from the previous mammogram.

The relationship of recall rates to practice volume is seen in Table 2. Recall rates decreased with increasing practice volume: 8.3% in the practices with mean volumes of fewer than 200 mammographic examinations per month compared with 5.6% in practices with mean monthly volumes equal to or greater than 500.


View this table:
[in this window]
[in a new window]

 
TABLE 2 Mammography Performance by Monthly Volume of Practice

 

Recall Rate and Sensitivity
Sensitivity was inversely related to recall rates for age; that is, as age increased, the recall rate decreased and sensitivity increased. This same inverse relationship (decrease in recall rate and increase in sensitivity) was seen for a decrease in breast density, for a personal history of breast cancer, for a history of breast surgery, and for the presence of breast symptoms. Mammograms of women with almost entirely fat breasts showed a high sensitivity (91.9%) and the lowest recall rate (2.4%). Sensitivity was directly related to time since the last mammogram, increasing with increasing recall rates as the time increased. Screening mammograms with the shortest time since the previous mammogram had a recall rate of 5.2% and a sensitivity of 73%, and screening mammograms with the longest time or with no previous mammogram had a recall rate of 8.7% and a sensitivity of 80.7%.

With respect to the volume of mammography by practice, we found that sensitivity did not show an association with recall rates. Sensitivity seemed to remain in the mid 70% range, although the recall rate decreased with increasing mean practice volume (Table 2).

Recall Rate and PPV
PPV was inversely related to recall rate for age; that is, as age increased, the recall rate for age decreased and the PPV increased. This same pattern was seen for an increase in breast density and an increase in the time elapsed since previous mammography. For age, the recall rate decreased from 7.3% for the youngest women to 4.9% for the oldest women, and PPV rose from 1.9% to 12.7%. For breast density, as the recall rate rose from 2.4% in the almost-entirely-fat category to 6.8% in the extremely dense category, the PPV decreased from 10.8% to 4.1%. PPV was directly related to the recall rate for history of breast cancer, history of breast procedure, and presence of a current breast problem. No association of the recall rate with the PPV was seen for racial group or family history of breast cancer, although the PPV was greater in women with a family history of breast cancer (Table 1).

Looking at practice volume, we found an inverse relationship of PPV to recall rate for mean practice volume, with PPV increasing from 4.4% in practices with the lowest volume to 6.4% in practices with the largest volume, and recall rates decreased from 8.3% to 5.6% (Table 2).

Recall Rate and Cancer Detection Rate
The overall cancer detection rate (cancers seen on screening mammograms as a percentage of the total screened population) was 3.5 per 1000. The cancer detection rates are displayed in the last column of Table 1. The largest difference in recall rate and associated cancer detection was seen for the presence of symptoms at screening. Recall rates rose from 6.1% in women who did not have symptoms to 13.6% in symptomatic women, with the associated cancer detection rate rising from 3.4 to 10.3 per 1000. No association between recall rate and cancer detection was seen with respect to race, family history of breast cancer, or breast density.

Recall Rate, Sensitivity, and PPV
The individual data for each practice in the study are displayed in Table 3. The recall rates for the 31 practices ranged from 1.9% to 13.4%. These data were fit using an isotonic regression technique for evaluating the relationship between practice-specific recall rate and sensitivity. A graphic representation of the results is presented in Figure 1. The line running through the data points shows the isotonic regression fit to the data and provides an estimate of how sensitivity increases with increasing recall rate. Figure 2 shows the analogous results for the relationship of PPV as a function of recall rate, where PPV declines with increasing recall rate. The reduced monotonic regression shows that the trends for both sensitivity and PPV are statistically significant. (Reduced monotonic regression models the outcome variable as a constant within groups defined by cut points.) For sensitivity, a single cut point was identified at a recall rate of 4.6% (p < 0.0001). A cut point for the relationship between recall rate and PPV was identified at a recall rate of 8.8% (p < 0.001). A second suggestive, although statistically not significant, cut point for PPV (p = 0.13) was obtained at a recall rate of 5.7%. For practices with recall rates between 1.9 and 4.4%, the average sensitivity was 65%; for the remaining practices with recall rates greater than 4.4%, the average sensitivity was 80% (Table 4). The average PPV was 7.2% for practices with recall rates of 1.9-5.5%, 5.9% for practices with recall rates of 5.8-8.7%, and 3.3% for practices with recall rates of 8.9% or greater.


View this table:
[in this window]
[in a new window]

 
TABLE 3 Mammography Performance by Practice

 


View larger version (14K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1. Line graph shows isotonic regression of recall association with sensitivity according to mammography practice.

 


View larger version (14K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2. Graph shows isotonic regression of recall association with positive predictive value according to mammography practice.

 

View this table:
[in this window]
[in a new window]

 
TABLE 4 Sensitivity and Positive Predictive Value of Mammography by Recall Rate

 

Linear regression analysis was first performed for recall as a continuous variable controlling for the covariates of age, race, family and personal history of breast cancer, history of breast surgery or biopsy, presence of symptoms, and breast density. The analysis showed that practices with greater recall rates have greater sensitivity (p = 0.003, r2 = 0.64). When the reduced monotonic regression cut point of 4.6% was used for the recall rate, the fit improved to r2 = 0.68. Linear regression analysis likewise showed that PPV decreased as recall rate increased (p = 0.0002), with an overall r2 of 0.56. When the practices are split into groups based on the reduced monotonic regression cut points, the model fit improved to 0.66.


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The main purpose of this study was to examine the association of recall rates with sensitivity and PPV. We found no published study that focuses on recall rates alone. A search using the terms "recall rates" and "performance" turned up studies that mentioned recall rates in the pursuit of measuring performance [8, 19,20,21,22,23,24,25], recall rates related to the question of double interpretation [10, 26], and recall rates obtained from single-view versus two-view screening [27,28,29,30]. In addition, a few specific reports related recall rates to history of a previous benign biopsy [8] and the presence of implants or a history of breast cancer [31]. Our findings of recall rates are in the range of what has been reported previously in this literature.

Comparing our results directly with those in the literature is difficult because of the variation in the definition of recall (often, a definition is lacking). In previous studies, "recall" has been defined on the basis of clinical judgment [29]; need for further workup (including clinical breast examination, sonography, or cytology) [26]; recommendation for further imaging, including repeated mammography, for technical reasons [11]; recommendation for workup for clinical or radiographic suspicion of malignancy [32]; and other factors. Some studies restrict recall to further imaging only; other studies may include recommendations for biopsy. Obviously, the definition affects the recall rate and thereby its relationship with PPV and sensitivity. Our estimates are internally consistent and were based on recall defined as the proportion of screening mammography examinations resulting in a recommendation for further workup, including recall for imaging studies and invasive procedures if they were recommended on the basis of the screening mammography findings. We did not include cases recalled for repeated mammography requested for technical reasons.

Recall rates in the non—United States literature tend to be reported separately for prevalent and incident screening programs [13]. That method of reporting occurs less often in the United States, where both are usually combined. We were able to analyze our data by time elapsed since the previous screening examination, which approximates the prevalence and incidence screening data. In the Canadian screening programs, the recall rates were 9.5% for initial screening and 4.6% for subsequent screening [24]. Our recall rates were 8.7% for an interval longer than 36 months (including no previous screening) and 5.2% for an interval of 24 months or less. More than 60% of the women had previous screening within 3 years of the present screening. Our evaluation of the effect of elapsed time between mammograms shows that decreasing the time between subsequent mammograms reduces recall and improves other performance measures. Hunt et al. [33] found similar results in their study, indicating a significant 30% reduction in recall for annual mammography versus biennial, a finding that was consistent across age groups.

Our study was performed on data prospectively collected from 31 community practices for mammography in North Carolina. The women in this screened population represent approximately 25% of the women more than 40 years old in North Carolina. The women in our population are similar to the population distribution for North Carolina in their age and racial distribution except for underrepresentation of older black women, in keeping with the lower screening rates for these women in general, not just in North Carolina [34, 35]. As others have reported, we found that recall rates were higher for women who were younger; were black; had a history of breast biopsy, breast surgery, or breast cancer; or had higher breast density [7, 9, 36]. We also found that recall rates were greater for the presence of reported symptoms at screening and longer time elapsed since the previous screening. We found recall rates for women with and those without a family history of breast cancer to be virtually the same.

In our data, for the most part, recall rates stratified within the covariates of interest showed an association with sensitivity. As age increased, recall rates decreased and sensitivity increased. Recall rates increased and sensitivity decreased with increasing breast density when there was a history of breast (or other) cancer, previous breast surgery, or biopsy; or when symptoms were reported at screening. Only with an increase in time elapsed since the last screening did recall rates and sensitivity both increase.

For the association of recall rates with PPV, we found that women in the oldest age group (>=70 years) had a recall rate of 4.9% with a PPV of 12.7%, and women 60-69 years old had a recall rate of 5.8% with a PPV of 8.2%. Welch and Fisher [22] studied recall from Medicare claims data in women 65 and older and reported a recall rate of 8.5% and a PPV of 8% for women having further testing within 8 months of screening. We would have expected this PPV to be higher because it was based on women who were actually followed up for further workup, whereas ours is based on those for whom further workup was only recommended. Our findings for the relationship between recall and history of biopsy or surgery are the same as those reported by Slanetz et al. [8], although those authors reported recall only for women with a history of excisional biopsy. The recall rates reported by Slanetz et al. were 6% in women who did not have a history of biopsy and 7% for women who did have.

The association of recall rates with PPV in our study showed that as history of breast biopsy, surgery, or cancer, and the presence of symptoms at screening increased, an increase in recall rates was associated with an increase in PPV. As age decreased, breast density increased, time elapsed since previous mammography increased, recall rates increased, and PPV decreased. Black women had greater recall rates and lower PPVs than white women. The percentage of women with longer than 36 months from the previous screening or with no previous screening was also greater for black women than for white women. This trend of recall and PPV with increasing elapsed time since screening may explain the different findings in black and white women.

No reports exist of the association of recall with both PPV and sensitivity to compare with our results. When grouping practices by volume, we found that an increase in mean volume of mammograms was associated with a decrease in recall rate for screening volumes of more than 200 per month with no difference in sensitivity and an increase in PPV.

The key question we posed in this study was whether a point existed at which sensitivity reached a plateau as the recall rate increased, while PPV continued to decline. We did not find previous reports addressing this question. Our regression analyses showed that practices with recall rates of 4.4% or less had lower sensitivity than the remaining practices, which had recall rates of 4.8% or greater. However, no statistically significant increase in sensitivity was noted among the practices once a recall rate of 4.8% was reached. Although we must be cautious not to overinterpret the location of the cut point, both Figure 1 and Table 4 clearly show that, for these data, the sensitivity increased very little, if at all, beyond a recall rate of 4.8%. Conversely, a decline in PPV was observed with increasing recall rates for practices with recall rates of 8.9% or greater, and to a lesser extent for practices with recall rates of 5.9-8.7% (Fig. 2). Combining these findings, we conclude that practices with recall rates between 4.9% and 5.5% achieve the best trade-off of sensitivity and PPV.


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Greenlee RT, Murray T, Bolden S, Wingo PA. Cancer Statistics, 2000. CA Cancer J Clin 2000;50:7 -33[Abstract]
  2. Tabar L, Vitak B, Chen HH, et al. The Swedish two-county trial twenty years later. Radiol Clin North Am 2000;38:625 -651[Medline]
  3. Kerlikowske K, Grady D, Rubin SM, Sandrock C, Ernster VL. Efficacy of screening mammography: a meta-analysis. JAMA 1995;273:149 -154[Abstract/Free Full Text]
  4. Kerlikowske K, Grady D, Barclay J, Sickles EA, Eaton A, Ernster V. Positive predictive value of screening mammography by age and family history of breast cancer. JAMA 1993;270:2444 -2450[Abstract/Free Full Text]
  5. Fracheboud J, De Koning HJ, Beemsterboer PMM, et al. Nation-wide breast cancer screening in the Netherlands: results of initial and subsequent screening 1990-1995. Int J Cancer 1998;75:694 -698[Medline]
  6. Kollias J, Sibbering DM, Blamey RW, et al. Screening women aged less than 50 years with a family history of breast cancer. Eur J Cancer 1998;34:878 -883
  7. Kerlikowske K, Grady D, Barclay J, Sickles EA, Ernster V. Effect of age, breast density, and family history on the sensitivity of first screening mammography. JAMA 1996;276:33 -38[Abstract/Free Full Text]
  8. Slanetz PJ, Giardino AA, McCarthy KA, et al. Previous breast biopsy for benign disease rarely complicates or alters interpretation on screening mammography. AJR 1998;170:1539 -1541[Abstract/Free Full Text]
  9. Stomper PC, D'Souza DJ, DiNitto PA, Arredondo MA. Analysis of parenchymal density on mammograms in 1353 women 25-79 years old. AJR 1996;167:1261 -1265[Abstract/Free Full Text]
  10. Warren RML, Duffy SW. Comparison of single reading with double reading of mammograms, and change in effectiveness with experience. Br J Radiol 1995;68:958 -962[Abstract/Free Full Text]
  11. Seguret F, Daures JP, Guizard AV, et al. Herault breast screening programme: results after 30 months of a mobile French schedule. Eur J Cancer Prev 1995;4:299-305[Medline]
  12. Blanks RG, Wallis RM, Given-Wilson RM. Observer variability in cancer detection during routine repeat (incident) mammographic screening in a study of two versus one view mammography. J Med Screen 1999;6:152 -158[Abstract/Free Full Text]
  13. Perry NM, Kirkpatrick A. European guidelines for quality assurance in mammography screening. In: de Wolf CJM, Perry NM, eds. European guidelines for quality assurance in mammography screening, 2nd ed. Luxembourg: Office for Official Publications of the European Communities, 1996: I-1-I-15
  14. Quality Determinants of Mammography Guideline Panel. Quality determinants of mammography. Rockville, MD: United States Department of Health and Human Services, Public Health Service, Agency for Health Care Policy and Research, 1994:78 -86
  15. Yankaskas BC, Jones MB, Aldrich TE. The Carolina Mammography Registry: a population-based mammography and cancer surveillance project. J Registry Manage 1996;23:175 -178
  16. Ballard-Barbash R, Taplin SH, Yankaskas BC, et al. Breast Cancer Surveillance Consortium: a national mammography screening and outcomes database. AJR 1997;169:1001 -1008[Free Full Text]
  17. American College of Radiology. Breast imaging reporting and data system (BI-RADS), 3rd ed. Reston, VA: American College of Radiology, 1998
  18. Schell MJ, Singh B. The reduced monotonic regression method. J Am Statist Assoc 1997;92:128 -135
  19. Ng EH, Ng FC, Tan PH, et al. Results of intermediate measures from a population-based, randomized trial of mammographic screening prevalence and detection of breast carcinoma among Asian women. Cancer 1998;82:1521 -1528[Medline]
  20. Giordano L, Giorgi D, Fasolo G, Segnan N, Del Turco MR. Breast cancer screening: characteristics and results of the Italian programmes in the Italian Group for Planning and Evaluating Breast Cancer Screening Programmes (GISMa). Tumori 1996;82:31 -37[Medline]
  21. Robinson JI, Crane CEB, King JM, Scarce DI, Hoffmann CEJ. The South Australian Breast X-ray Service: results from a statewide mammographic screening programme. Br J Cancer 1996;73:837 -842[Medline]
  22. Welch HG, Fisher ES. Diagnostic testing following screening mammography in the elderly. J Natl Cancer Inst 1998;90:1389 -1392[Abstract/Free Full Text]
  23. Kerlikowske K, Carney PA, Geller B, et al. Performance of screening mammography among women with and without a first-degree relative with breast cancer. Ann Intern Med 2000;133:855 -863[Abstract/Free Full Text]
  24. Paquette D, Snider J, Bouchard F, et al. Performance of screening mammography in organized programs in Canada in 1996. CMAJ 2000;163:1133 -1138[Abstract/Free Full Text]
  25. Libstug AR, Moravan V, Aitken SE. Results from the Ontario breast screening program, 1990-1995. J Med Screen 1998;5:73 -80[Abstract/Free Full Text]
  26. Brown J, Bryan S, Warren R. Mammography screening: an incremental cost effectiveness analysis of double versus single reading of mammograms. BMJ 1996;312:809 -812[Abstract/Free Full Text]
  27. Wald NJ, Murphy P, Major P, Parkes C, Townsend J, Frost C. UKCCCR multicentre randomised controlled trial of one and two view mammography in breast cancer screening. BMJ 1995;311:1189 -1193[Abstract/Free Full Text]
  28. Warren RML, Duggy SW, Bashir S. The value of the second view in screening mammography. Br J Radiol 1996;69:105 -108[Abstract/Free Full Text]
  29. Bryan S, Brown J, Warren R. Mammography screening: an incremental cost-effectiveness analysis of two view versus one view procedures in London. J Epidemiol Community Health 1995;49:70 -78[Abstract/Free Full Text]
  30. Blanks RG, Wallis MG, Moss SM. A comparison of cancer detection rates achieved by breast cancer screening programmes by number of readers, for one and two view mammography: results from the UK NHS breast screening programme. J Med Screen 1998;5:195 -201[Abstract/Free Full Text]
  31. Kopans DB, Moore RH, McCarthy KA, et al. Should women with implants or a history of treatment for breast cancer be excluded from mammography screening programs? AJR 1997;168:29 -31[Abstract/Free Full Text]
  32. De Placido S, Nuzzo F, Perrone F, et al. The first breast cancer screening program in southern Italy: preliminary results from three municipalities of the Naples province. Tumori 1995;81:7 -12
  33. Hunt KA, Rosen EL, Sickles EA. Outcome analysis for women undergoing annual versus biennial screening mammography: a review of 24,211 examinations. AJR 1999;173:285 -289[Abstract/Free Full Text]
  34. Burns RB, McCarthy EP, Freund KM, et al. Black women receive less mammography even with similar use of primary care. Ann Intern Med 1996;125:173 -182[Abstract/Free Full Text]
  35. Caplan LS, Wells BL, Haynes S. Breast cancer screening among older racial/ethnic minorities and whites: barriers to early detection. J Gerontol 1992;47:101 -110
  36. Mandelson MT, Oestreicher N, Porter PL, et al. Breast density as a predictor of mammographic detection: comparison of interval- and screen-detected cancers. J Natl Cancer Inst 2000;92:1081 -1087[Abstract/Free Full Text]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
E. J. A. Bowles and B. M. Geller
Best Ways to Provide Feedback to Radiologists on Mammography Performance
Am. J. Roentgenol., July 1, 2009; 193(1): 157 - 164.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
C. H. Ahern and Y. Shen
Cost-Effectiveness Analysis of Mammography and Clinical Breast Examination Strategies: A Comparison with Current Guidelines
Cancer Epidemiol. Biomarkers Prev., March 1, 2009; 18(3): 718 - 725.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
P. Skaane, S. Hofvind, and A. Skjennald
Randomized Trial of Screen-Film versus Full-Field Digital Mammography with Soft-Copy Reading in Population-based Screening Program: Follow-up and Final Results of Oslo II Study
Radiology, September 1, 2007; 244(3): 708 - 717.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
J. G. Elmore and R. J. Brenner
The More Eyes, the Better to See? From Double to Quadruple Reading of Screening Mammograms
J Natl Cancer Inst, August 1, 2007; 99(15): 1141 - 1143.
[Full Text] [PDF]


Home page
RadiologyHome page
M. J. Schell, B. C. Yankaskas, R. Ballard-Barbash, B. F. Qaqish, W. E. Barlow, R. D. Rosenberg, and R. Smith-Bindman
Evidence-based Target Recall Rates for Screening Mammography
Radiology, June 1, 2007; 243(3): 681 - 689.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
P. A. Carney, L. A. Abraham, D. L. Miglioretti, K. R. Yabroff, E. A. Sickles, D. S. M. Buist, C. J. Kasales, B. M. Geller, R. D. Rosenberg, M. B. Dignan, et al.
Factors Associated with Imaging and Procedural Events Used to Detect Breast Cancer After Screening Mammography
Am. J. Roentgenol., February 1, 2007; 188(2): 385 - 392.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
J. M. Ko, M. J. Nicholas, J. B. Mendel, and P. J. Slanetz
Prospective assessment of computer-aided detection in interpretation of screening mammography.
Am. J. Roentgenol., December 1, 2006; 187(6): 1483 - 1491.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
R. D. Rosenberg, B. C. Yankaskas, L. A. Abraham, E. A. Sickles, C. D. Lehman, B. M. Geller, P. A. Carney, K. Kerlikowske, D. S. M. Buist, D. L. Weaver, et al.
Performance Benchmarks for Screening Mammography
Radiology, October 1, 2006; 241(1): 55 - 66.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
K. K. Lindfors, M. C. McGahan, C. J. Rosenquist, and G. S. Hurlock
Computer-aided Detection of Breast Cancer: A Cost-effectiveness Study
Radiology, June 1, 2006; 239(3): 710 - 717.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
S. Hofvind, P. Skaane, B. Vitak, H. Wang, S. Thoresen, L. Eriksen, H. Bjorndal, A. Braaten, and N. Bjurstam
Influence of Review Design on Percentages of Missed Interval Breast Cancers: Retrospective Study of Interval Cancers in a Population-based Screening Program
Radiology, November 1, 2005; 237(2): 437 - 443.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
E. S. Burnside, J. M. Park, J. P. Fine, and G. A. Sisney
The Use of Batch Reading to Improve the Performance of Screening Mammography
Am. J. Roentgenol., September 1, 2005; 185(3): 790 - 796.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
J. D. M. Otten, N. Karssemeijer, J. H. C. L. Hendriks, J. H. Groenewoud, J. Fracheboud, A. L. M. Verbeek, H. J. de Koning, and R. Holland
Effect of Recall Rate on Earlier Screen Detection of Breast Cancers Based on the Dutch Performance Indicators
J Natl Cancer Inst, May 18, 2005; 97(10): 748 - 754.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
L. A. Hardesty, A. H. Klym, B. E. Shindel, D. M. Chough, J. H. Sumkin, and D. Gur
Is Maximum Positive Predictive Value a Good Indicator of an Optimal Screening Mammography Practice?
Am. J. Roentgenol., May 1, 2005; 184(5): 1505 - 1507.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
K. Kerlikowske, R. Smith-Bindman, L. A. Abraham, C. D. Lehman, B. C. Yankaskas, R. Ballard-Barbash, W. E. Barlow, J. H. Voeks, B. M. Geller, P. A. Carney, et al.
Breast Cancer Yield for Screening Mammographic Examinations with Recommendation for Short-Interval Follow-up
Radiology, March 1, 2005; 234(3): 684 - 692.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
B. C. Yankaskas, S. H. Taplin, L. Ichikawa, B. M. Geller, R. D. Rosenberg, P. A. Carney, K. Kerlikowske, R. Ballard-Barbash, G. R. Cutter, and W. E. Barlow
Association between Mammography Timing and Measures of Screening Performance in the United States
Radiology, February 1, 2005; 234(2): 363 - 373.
[Abstract] [Full Text] [PDF]


Home page
CMAJHome page
I. Theberge, N. Hebert-Croteau, A. Langlois, D. Major, and J. Brisson
Volume of screening mammography and performance in the Quebec population-based Breast Cancer Screening Program
Can. Med. Assoc. J., January 18, 2005; 172(2): 195 - 199.
[Abstract] [Full Text] [PDF]


Home page
NEJMHome page
K. Altundag, P. Morandi, O. Altundag, D. Gur, M. Kriege, C. T.M. Brekelmans, and J. G.M. Klijn
MRI in Breast Cancer
N. Engl. J. Med., November 18, 2004; 351(21): 2235 - 2236.
[Full Text] [PDF]


Home page
RadiologyHome page
P. Skaane and A. Skjennald
Screen-Film Mammography versus Full-Field Digital Mammography with Soft-Copy Reading: Randomized Trial in a Population-based Screening Program--The Oslo II Study
Radiology, July 1, 2004; 232(1): 197 - 204.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
L. E. M. Duijm, J. H. Groenewoud, J. H. C. L. Hendriks, and H. J. de Koning
Independent Double Reading of Screening Mammograms in the Netherlands: Effect of Arbitration Following Reader Disagreements
Radiology, May 1, 2004; 231(2): 564 - 570.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
M. A. Helvie, L. Hadjiiski, E. Makariou, H.-P. Chan, N. Petrick, B. Sahiner, S.-C. B. Lo, M. Freedman, D. Adler, J. Bailey, et al.
Sensitivity of Noncommercial Computer-aided Detection System for Mammographic Breast Cancer Detection: Pilot Clinical Trial
Radiology, April 1, 2004; 231(1): 208 - 214.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
D. M. Ikeda, R. L. Birdwell, K. F. O'Shaughnessy, E. A. Sickles, and R. J. Brenner
Computer-aided Detection Output on 172 Subtle Findings on Normal Mammograms Previously Obtained in Women with Breast Cancer Detected at Follow-Up Screening Mammography
Radiology, March 1, 2004; 230(3): 811 - 819.
[Abstract] [Full Text] [PDF]


Home page
JNCI J Natl Cancer InstHome page
D. Gur, J. H. Sumkin, H. E. Rockette, M. Ganott, C. Hakim, L. Hardesty, W. R. Poller, R. Shah, and L. Wallace
Changes in Breast Cancer Detection and Mammography Recall Rates After the Introduction of a Computer-Aided Detection System
J Natl Cancer Inst, February 4, 2004; 96(3): 185 - 190.
[Abstract] [Full Text] [PDF]


Home page
JAMAHome page
R. Smith-Bindman, P. W. Chu, D. L. Miglioretti, E. A. Sickles, R. Blanks, R. Ballard-Barbash, J. K. Bobo, N. C. Lee, M. G. Wallis, J. Patnick, et al.
Comparison of Screening Mammography in the United States and the United Kingdom
JAMA, October 22, 2003; 290(16): 2129 - 2137.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
R. F. Brem, J. Baum, M. Lechner, S. Kaplan, S. Souders, L. G. Naul, and J. Hoffmeister
Improvement in Sensitivity of Screening Mammography with Computer-Aided Detection: A Multiinstitutional Trial
Am. J. Roentgenol., September 1, 2003; 181(3): 687 - 693.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
P. Crystal, S. D. Strano, S. Shcharynski, and M. J. Koretz
Using Sonography to Screen Women with Mammographically Dense Breasts
Am. J. Roentgenol., July 1, 2003; 181(1): 177 - 182.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
F. M. Hall, T. M. Kolb, J. Lichy, and J. H. Newhouse
Screening Breast US [letter] * Dr Kolb and colleagues respond:
Radiology, May 1, 2003; 227(2): 607 - 609.
[Full Text] [PDF]


Home page
ANN INTERN MEDHome page
P. A. Carney, D. L. Miglioretti, B. C. Yankaskas, K. Kerlikowske, R. Rosenberg, C. M. Rutter, B. M. Geller, L. A. Abraham, S. H. Taplin, M. Dignan, et al.
Individual and Combined Effects of Age, Breast Density, and Hormone Replacement Therapy Use on the Accuracy of Screening Mammography
Ann Intern Med, February 4, 2003; 138(3): 168 - 175.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
F. M. Hall and E. L. Rosen
Malignancy in BI-RADS Category 3 Mammographic Lesions * Dr Rosen responds:
Radiology, December 1, 2002; 225(3): 918 - 920.
[Full Text] [PDF]


Home page
Med Decis MakingHome page
J. M. Boone, K. K. Lindfors, and J. A. Seibert
Determining Sensitivity of Mammography from Screening Data, Cancer Incidence, and Receiver-Operating Characteristic Curve Parameters
Med Decis Making, June 1, 2002; 22(3): 228 - 237.
[Abstract] [PDF]


Home page
Am. J. Roentgenol.Home page
F. M. Hall
Immediate Reporting of Screening Mammography
Am. J. Roentgenol., April 1, 2002; 178(4): 1031 - 1032.
[Full Text] [PDF]


Home page
JNMHome page
P. Shaffer, I. Khalkhali, and S. B. Haber
Sestamibi Scanning of Breast Cancer
J. Nucl. Med., January 1, 2002; 43(1): 125 - 126.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Yankaskas, B. C.
Right arrow Articles by Kozar, R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Yankaskas, B. C.
Right arrow Articles by Kozar, R.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS