AJR Your Link to CME
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Tigges, S.
Right arrow Articles by Manaster, B. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Tigges, S.
Right arrow Articles by Manaster, B. J.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
AJR 2000; 175:545-547
© American Roentgen Ray Society


Do Radiologists Use the American College of Radiology Musculoskeletal Appropriateness Criteria?

Stefan Tigges1, Douglas Sutherland1 and B. J. Manaster2

1 Department of Radiology, The Emory Clinic, Emory University School of Medicine, Bldg. A, 1365 Clifton Rd. N.E., Atlanta, GA 30322.
2 Department of Radiology, University of Colorado Health Sciences Center, 4200 E. 9th Ave., Box A030, Denver, CO 80262.

Received December 2, 1999; accepted after revision January 24, 2000.

 
Address correspondence to S. Tigges.


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. The objective of this study was to determine the proportion of radiologists in three different radiology organizations who report using the American College of Radiology (ACR) musculoskeletal appropriateness criteria.

MATERIALS AND METHODS. Radiologists from the Society of Skeletal Radiology, Georgia Radiological Society, and Utah Radiological Society were surveyed regarding their use of the ACR musculoskeletal appropriateness criteria. The surveys were carried out during 1998 and data were collected using written survey forms, telephone, and fax.

RESULTS. The overall survey response rate was 298 (64%) of 465. Overall, 30% of respondents reported using the musculoskeletal appropriateness criteria. The proportion of respondents who used the musculoskeletal criteria was not different across the three organizations or for private practice compared with academic radiologists.

CONCLUSION. The proportion of radiologists who report using the ACR musculoskeletal radiology appropriateness criteria is low. This result is consistent with other reports in the literature that show little impact on the practice of physicians after the distribution of written practice guidelines.


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Two of the most significant factors shaping medical practice today are the demands for scientifically proven methods of diagnosis and treatment and the need to provide these services in the most cost-effective manner possible. The American College of Radiology (ACR) recognized these trends in 1993 and devised a set of appropriateness criteria to guide clinical decision making [1]. Criteria for the appropriate diagnostic approach to nine different disease categories or target patient populations have been developed. In each category, multiple clinical conditions are presented along with several different options for radiologic evaluation. Diagnostic imaging options are then rated for appropriateness on a nine-point scale with a score of one being least appropriate and a score of nine being most appropriate. The criteria have been mailed to radiologists in written form and as a CD-ROM [2]. In addition, the criteria are available online at the ACR Web site (www.acr.org).

The ACR has invested significant effort in developing and distributing the appropriateness criteria [1] but, to our knowledge, has no way of determining what the impact of these guidelines has been on the practice of radiology. In addition, no reports concerning what proportion of radiologists have incorporated the criteria into their daily practice have been published. The purpose of this study is to determine the number of radiologists in three different radiology organizations who report using the musculoskeletal appropriateness criteria.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
A one-page survey form was used to determine in which state the respondent practiced, whether the respondent was in a private practice or was an academic radiologist, and whether the practice was predominantly musculoskeletal. Respondents were then asked to respond with a yes or no to the following questions: Are you familiar with the ACR appropriateness criteria? Have you received a copy of the ACR appropriateness criteria? Have you read any of the ACR appropriateness criteria? Have you read any of the ACR appropriateness criteria pertaining to musculoskeletal radiology? Do you use any of the musculoskeletal radiology appropriateness criteria?

The respondents who did use the criteria were then asked how often they used the criteria, whether clinicians responded favorably, and the most common type of use of the criteria. Options for this last question were restricted to the following: choosing an imaging methodology for a particular clinical situation; validating the choice of imaging methodology with a clinician; utilization review; and billing or insurance questions.

Members of three different radiology organizations, the Society of Skeletal Radiology, the Georgia Radiological Society, and the Utah Radiological Society, were surveyed during the 1998 calendar year. The same survey form was used for all three groups, but the methods used to carry out the survey were different. In the case of the Society of Skeletal Radiology, active members of the society as of 1997 practicing in the United States were surveyed. The survey was distributed to the attendees of the 1998 annual meeting and completed forms were collected at the end of the meeting. Surveys were then mailed to all eligible members of the society who had not yet completed the form. A second group of surveys was then mailed to nonresponders. Finally, those members who did not respond to either of the written surveys were called and queried over the telephone.

All active members of the Utah Radiological Society as of 1997 who had not already been surveyed as members of the Society of Skeletal Radiology were surveyed with two rounds of survey mailings. Nonresponders to the first mailing were sent a second form.

The Georgia Radiological Society was the largest organization that we surveyed: its membership list included 498 radiologists. To keep the number of responses manageable, we chose to survey every fourth member of this society. In addition, after we had reduced this list by 75%, we further limited the number to be surveyed by excluding all members who practiced radiology at the first author's institution or had already been surveyed as a member of the Society of Skeletal Radiology. This method of selection left 114 radiologists. We then randomly selected another 43 members to be surveyed for a total of 157 radiologists. We carried out these surveys by telephone or fax, depending on the preference of the respondent. After the surveys had been completed, we discovered that one radiologist had been surveyed both as a member of the Society of Skeletal Radiology and the Georgia Radiological Society. We kept his survey for the Skeletal Society but eliminated his Georgia response, leaving the Georgia survey group with a total of 156 radiologists.

For analysis, the data were entered into a SAS (SAS Institue, Cary, NC) data set. Tests of significance for comparing proportions in the various groups were carried out using the chi-square test.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The overall response rate for the survey was 298 (64%) of 465. Response rates for the three organizations were the following: 151 (87%) of 174 for the Society of Skeletal Radiology, 67 (43%) of 156 for the Georgia Radiological Society, and 80 (59%) of 135 for the Utah Radiological Society.

Overall, 30% of respondents reported using the musculoskeletal radiology appropriateness criteria [1], and 19% of the members of the Georgia Radiological Society reported using the criteria, whereas 33% and 34% of the members of the Society of Skeletal Radiology and the Utah Radiological Society, respectively, used the criteria. The proportions of respondents who reported using the musculoskeletal criteria in each of the three groups was not significantly different at an alpha of 0.05 (chi-square test, p = 0.091). Virtually identical proportions of academic (31%) and private practice (30%) radiologists reported using the musculoskeletal criteria (p > 0.50). Ninety percent of respondents were familiar with the ACR criteria, 83% reported receiving a copy of the criteria (Georgia Radiological Society, 88%; Society of Skeletal Radiology, 81%; Utah Radiological Society, 81%; chi-square test, p = 0.442), 78% had read some of the criteria, and 51% had read some of the musculoskeletal criteria. Thirty-four (37%) of the 91 radiologists who reported using the musculoskeletal criteria used them many times a day. Forty-nine (54%) of the 91 respondents who used the criteria reported a favorable reaction from referring physicians. The most common reason for using the criteria was for utilization review, followed by validation of the choice of imaging method with the clinician. No respondent reported using the criteria to handle billing or insurance questions.


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The ACR has invested a large amount of time and money in an effort to provide the most up-to-date and scientifically based practice guidelines possible. Numerous radiologists voluntarily contributed countless hours developing the criteria. In addition, considerable effort has been expended to distribute the criteria to practicing radiologists. However, only slightly more than half the radiologists surveyed reported reading the musculoskeletal criteria and less than one third reported using the criteria. The low reported-use rate applied to all three societies and was true both for private practice and academic radiologists. However, almost half those who did use the criteria reported using them several times a day, most commonly for utilization reviews or to validate a particular choice of imaging with a clinician.

A previous article has shown that the ACR criteria can be applied to about three fourths of general internal medicine practice patients for whom radiologic evaluation is requested [3]. Despite this potentially high rate of use, most radiologists in our survey did not refer to the criteria for guidance. This disappointing finding may in part be a result of the format in which the criteria are presented. A recent review article found little impact on clinical practice after the distribution of printed educational material [4]. The authors of this review report that the most effective ways of changing practice patterns include outreach visits (defined as "use of a trained person who meet[s] with providers in their practice settings to provide information") and the influence of local opinion leaders (defined as "use of providers (for education) nominated by their colleagues as `educationally influential"') [4]. For example, in a study in Canada, the rates of cesarian section were not significantly changed after publication and distribution of guidelines designed to reduce the number of this procedure [5]. However, a second trial using an opinion leader to educate obstetricians in ways to decrease the number of cesarian sections did result in lower rates of this procedure [6]. Perhaps a completely novel approach such as using the Internet may prove effective [7].

Radiologists may actually use the ACR criteria more often than indicated by our results. Although we included both academic and private practice radiologists in our survey and sampled radiologists in two separate states, few radiologists from the northeast, Midwest, or the Pacific Coast were surveyed unless they happened to be members of the Society of Skeletal Radiology. Conceivably, practitioners in these areas may use the ACR appropriateness criteria more frequently than the radiologists whom we surveyed. In addition, the survey response rate for the Georgia Radiological Society was poor and for the Utah Radiological Society was only fair. Unsurveyed members of these organizations could use the criteria more often than those whom we were able to reach. Given that the rate of use of the criteria in the group with an excellent response rate (Society of Skeletal Radiology) was virtually identical to that of the other groups, we consider this explanation unlikely. Finally, it is possible that radiologists are already practicing in ways consistent with the criteria because all states require that physicians obtain a certain number of continuing medical education credits.

A significant limitation of this study is our inability to determine why radiologists do not use the ACR criteria and what factors (sex, level of training, age, years in practice) are associated with higher rates of use. Possible reasons for not using the criteria include inconvenience, lack of familiarity with the guidelines, and even disagreement with the recommendations. We chose not to include questions related to these issues in our survey because we believed that a shorter survey was more likely to get responses.

In summary, we found that less than one third of those surveyed reported using the ACR musculoskeletal appropriateness criteria. Perhaps the college, with its superior resources, could answer some of the questions left unanswered by this study such as why radiologists do not use the criteria. Such information is crucial to determining the most effective way of popularizing the criteria. More effective ways of influencing the day-to-day practice of radiologists might include using outreach visits or local opinion leaders to educate radiologists.


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. American College of Radiology. Appropriateness criteria. Reston, VA: American College of Radiology, 1996
  2. Bode FR, Cascade PN. The American College of Radiology appropriateness criteria: will they be useful for us? Chest 1996;110:869 -871[Free Full Text]
  3. Martin TA, Quiroz FA, Rand SD, Kahn CE Jr. Applicability of American College of Radiology appropriateness criteria in a general internal medicine clinic. AJR 1999;173:9 -12[Abstract/Free Full Text]
  4. Freemantle N, Harvey EL, Wolf F, Grimshaw JM, Grilli R, Bero LA. Printed educational materials: effects on professional practice and health care outcomes [abstr]. The Cochrane Library [serial online]. Issue 2, 2000. Oxford: Update Software. Available at: http://www.update-software.com
  5. Lomas J, Anderson GM, Domnick-Pierre K, Vayda E, Enkin VE, Hannah WJ. Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. New Engl J Med 1989;321:1306 -1311[Abstract]
  6. Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs audit and feedback to implement practice guidelines: delivery after previous cesarean section. JAMA 1991;265:2202 -2207[Abstract]
  7. Tjahjono D, Kahn CE Jr. Promoting the online use of radiology appropriateness criteria. Radio-Graphics 1999;19:1673 -1681[Abstract/Free Full Text]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
G. Levy, A. Blachar, L. Goldstein, I. Paz, S. Olsha, E. Atar, A. Goldberg, and Y. B. Dayan
Nonradiologist Utilization of American College of Radiology Appropriateness Criteria in a Preauthorization Center for MRI Requests: Applicability and Effects
Am. J. Roentgenol., October 1, 2006; 187(4): 855 - 858.
[Abstract] [Full Text] [PDF]


Home page
RadiologyHome page
H. O. Stolberg and S. Tigges
Comments on Routine Chest Radiography * Dr Tigges responds:
Radiology, July 1, 2005; 236(1): 368 - 368.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
N. M. Major and A. J. Grainger
Imaging of the Subcoracoid Bursa
Am. J. Roentgenol., March 1, 2001; 176(3): 812 - 813.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
L. Berlin, S. Tigges, D. Sutherland, and B. J. Manaster
American College of Radiology Appropriateness Criteria and Standards: Separate Programs
Am. J. Roentgenol., March 1, 2001; 176 (3): 811 - 812.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Tigges, S.
Right arrow Articles by Manaster, B. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Tigges, S.
Right arrow Articles by Manaster, B. J.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS