AJR ARRS: Your Link to CME
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Goodman, C. S.
Right arrow Articles by Coulam, C. H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Goodman, C. S.
Right arrow Articles by Coulam, C. H.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?
DOI:10.2214/AJR.08.1927
AJR 2009; 193:432-437
© American Roentgen Ray Society


Review

How Well Does CT Predict the Need for Laparotomy in Hemodynamically Stable Patients With Penetrating Abdominal Injury? A Review and Meta-Analysis

Cyle S. Goodman1, Jee Y. Hur1, Marc A. Adajar2 and Curtis H. Coulam3

1 Chicago Medical School, 3333 Green Bay Rd., North Chicago, IL, 60064.
2 Department of Surgery, Advocate Illinois Medical Center, Chicago, IL.
3 Department of Radiology, St. Alphonsus Regional Medical Center, Boise ID.

Received October 8, 2008; accepted after revision January 22, 2009.

 
Address correspondence to C. S. Goodman (cyle.goodman{at}my.rfums.org).


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. The objective of our study was to determine how well CT predicts the need for laparotomy in hemodynamically stable patients with penetrating abdominal injury.

MATERIALS AND METHODS. We reviewed MEDLINE articles published from January 1994 through June 2008. The sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and accuracy were calculated for each source and collectively using a meta-analysis.

RESULTS. Of 180 relevant studies, five were included in the meta-analysis. Pooled weighted estimates of sensitivity, specificity, NPV, PPV, and accuracy were 94.90%, 95.38%, 98.62%, 84.51%, and 94.70%, respectively.

CONCLUSION. CT in patients with penetrating abdominal trauma has high sensitivity, specificity, NPV, and accuracy, but has lower PPV in determining the need for laparotomy. It follows that CT is an indispensable tool in predicting the need for laparotomy in these patients but still has room for improvement.

Keywords: abdominal injury • CT • emergency radiology • laparotomy • penetrating trauma • trauma


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The management of penetrating abdominal injuries has been and continues to be controversial among medical professionals. Until late in the 19th century, almost all penetrating abdominal wounds were dealt with expectantly. Marion Sims, a surgical pioneer, was a strong supporter of the use of laparotomy in abdominal injuries and gave a speech at the New York Academy of Medicine in 1881 describing the necessity of such a surgery. At that time, the mortality rate in patients with abdominal wounds was approximately 72% [1]. Accepted management changed from expectant to surgical toward the end of World War I, and the mortality rate decreased to 53%. By 1950, the mortality rate plunged to 12% with the advent of new antibiotics and blood transfusions.

With the increased use of laparotomies in patients with penetrating abdominal injuries, it is not surprising that an increase in the rate of negative laparotomies followed. To combat this trend, the concept of selective management was introduced, in which medical professionals determined whether patients with penetrating abdominal trauma were candidates for nonoperative versus operative management. In the late 1960s and early 1970s, Sir Godfrey Hounsfield and Allan McLeod Cormack independently invented the CT scanner, leading to their shared 1979 Nobel Prize in Medicine.

Since that time, continual advances have been made in CT, and the CT scanner has become an indispensable tool in the process of selective management. Today, the standard of care for patients with penetrating abdominal trauma depends on hemodynamic stability and peritoneal signs [2]. Most patients who are hemodynamically unstable or have signs of peritonitis are taken directly to the operating room. Various algorithms for managing hemodynamically stable patients are available depending on the hospital, but most involve performing CT of the abdomen. However, the incidence of unnecessary laparotomies still ranges from 1.7% to 38%, leading to increased complications, longer hospital stays, and increased costs [3].

Despite technologic and procedural advancements, the question in the medical arena remains: How well do findings on CT images predict which patients with abdominal injuries should undergo laparotomy and which should not? This study set out to answer this question by determining the sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and accuracy of CT in predicting the need for laparotomy in hemodynamically stable patients with penetrating abdominal injuries. In doing so, the appropriate use of CT can be identified, potentially minimizing the rate of unnecessary laparotomies.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Data Sources
A computerized literature search was performed from January 1994 through June 2008 using the MEDLINE database. The following search line was used: "(penetrating or penetrate+) and (abdominal or abdomen) and (injury or injuries or trauma+) and (CT or computed tomography or computed tomographies)." Only articles written in English were included in this study because of the difficulty in accessing the complete original articles and the potential for unreliable translations of articles in foreign languages. No other restrictions were applied to the search.

Study Selection Criteria
The following inclusion criteria were developed in the meta-analysis protocol before beginning the search to minimize selection bias. All types of studies—that is, retrospective, observational, case reports, and so on—were eligible as long as they contained at least 10 study subjects. The data in the study had to be collected during or after 1994. The study had to provide quantitative data on the number of positive and negative CT examinations and whether laparotomy was performed in each of these groups. A positive CT study was defined as CT that indicated the need for laparotomy, such as injury to the retroperitoneal bowel, renal collecting system, or major vessels. Likewise, a negative CT study was one that did not indicate the need for laparotomy, such as no clear penetration of the peritoneal cavity, no visceral injury, no free air or fluid, or no contrast leak. Male and female patients of all ages and ethnicities were accepted; they must have had a penetrating abdominal injury and subsequently undergone abdominal CT. Penetrating abdominal injuries consist of stab wounds, gunshot wounds, or trauma caused by any object that could have entered the peritoneal cavity or retroperitoneum and damaged the abdominal contents. Additionally, patients had to be hemodynamically stable, which was defined as presenting with a systolic blood pressure ≥ 90 mm Hg after receiving a maximum of 2 L of IV fluids.

The following exclusion criteria were also incorporated into the meta-analysis protocol. Patients were excluded if they were hemodynamically unstable, exhibited signs of peritonitis, or had any other indication for emergent laparotomy according to the hospital's treatment guidelines. Patients with injuries due to blunt trauma, such as motor vehicle accidents or falls, were also excluded. If a single study was published in multiple publications, the latest published article containing the study data was used.

Study Selection and Quality Control
Two individuals separately performed the article search, study selection, and study quality evaluation. All of the search and selection protocols were created beforehand. Any discrepancies were settled at a conference where the two would state their cases and come to one final decision. After searching MEDLINE as described, articles were screened for relevance and inclusion criteria. The sources remaining after the initial screen were then evaluated with a quality evaluation score sheet modified from Berman and Parker [4] (Appendix 1). The studies were required to contain the inclusion criteria discussed. Additionally, a score of 15 or greater was needed on the quality evaluation form for the study to be accepted.

End Points and Data Extraction
The principal objective was to calculate sensitivity, specificity, NPV, PPV, and accuracy of CT. To accomplish this, the following specific data from each study were extracted and recorded: the total number of hemodynamically stable patients with penetrating abdominal injury, total number of CT examinations performed, number of positive and negative CT examinations, number of therapeutic laparotomies after positive and negative CT examinations, number of nontherapeutic laparotomies after positive and negative CT examinations, number of negative laparotomies after positive and negative CT examinations, nontherapeutic laparotomy rate, and the percentage of avoided laparotomies in stable patients. Laparotomy was considered negative when no injury was found, nontherapeutic when injuries requiring no intervention were discovered, and therapeutic when injuries were identified and repaired on exploration.

Next, 2 x 2 tables were set up comparing the CT results with the laparotomy results. True-positives were patients with a positive CT examination and a therapeutic laparotomy. False-positives were patients with a positive CT examination and a nontherapeutic, negative, or no laparotomy. True-negatives were patients with a negative CT examination and a nontherapeutic, negative, or no laparotomy. False-negatives were patients with a negative CT examination and a therapeutic laparotomy. These 2 x 2 tables were used to calculate the sensitivity, specificity, NPV, PPV, and accuracy of CT. Additionally, researchers collected data regarding the mean age of the patients, the percentage of male and female patients, and year that the data were obtained.

Statistical Analysis
The study's primary goal with respect to statistical analysis was to summarize the available data and to explain any variability that may exist among studies. The protocol for data analysis was set up before data collection to limit false-positive conclusions. We analyzed the following effect sizes independently: sensitivity, specificity, NPV, PPV, and accuracy. The Mantel-Haenszel method (fixed-effects model) and DerSimonian and Laird method (random-effects model) were used to calculate the weighted mean effect sizes from the pooled data. The 95% CI and inverse variance weight were calculated using the modified Wald method [5]. Wilson's practical meta-analysis was used as a guide to calculate the mean effect size, standard error of the mean effect size, 95% CI, Cochran's Q, and the random-effects variance component [6]. The individual effect sizes, mean effect sizes, and 95% CIs were used to create a forest plot to visually summarize the data using software (Prism 5, GraphPad Software).

Heterogeneity across studies was assessed by interpreting Cochran's Q with an alpha value of 0.10 as the cutoff point, which correlated to a critical chi-square value of 7.78. To find out if study characteristics contributed to any heterogeneity, we calculated Pearson's correlation coefficient (r) by comparing the weighted effect sizes with patient age, percentage of males and females, and year that data were collected. Pearson's r was converted to t to test for significance of the Pearson's product-moment correlation coefficient. The critical t value was determined to be 2.353 for p < 0.05 according to the appropriate degrees of freedom.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
A search of the terms in MEDLINE recovered 180 records. Researchers read through all 180 records and eliminated 150 on the basis of relevance and obvious lack of inclusion criteria. The remaining 30 articles were read by two individuals and assessed for inclusion criteria and quality using a quality evaluation score sheet (Appendix 1) modified from Berman and Parker [4]. Through this process, five studies were eventually incorporated into the meta-analysis [711]. The study group characteristics for each source are shown in Table 1.


View this table:
[in this window]
[in a new window]

 
TABLE 1: Study Group Characteristics for Each Source

 

The sensitivity of CT in detecting the need for laparotomy is summarized in Figure 1, which contains source data as well as weighted mean sensitivity of the pooled data with 95% CIs. The weighted mean sensitivity was 95.38% (95% CI, 90.41–100%) with Cochran's Q equal to 3.47 (p = 0.48) according to the fixed-effects model and 94.90% (89.15–100%) with Cochran's Q equal to 3.13 (p = 0.54) according to the random-effects model.


Figure 1
View larger version (8K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1 Forest plot displays sensitivity for each source and weighted mean sensitivities calculated from pooled data with 95% CIs. Weighted mean sensitivity is summary sensitivity calculated using fixed-effects model. Random mean sensitivity is summary sensitivity calculated using random-effects model.

 
The fixed-effects model produced a specificity of 95.92% (95% CI, 93.69–98.16%) with a Cochran's Q of 11.38 (p = 0.02), whereas the random-effects model generated a specificity of 95.38% (90.95–99.81%) with a Cochran's Q of 5.24 (p = 0.26) (Fig. 2).


Figure 2
View larger version (8K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2 Forest plot displays specificity for each source and weighted mean specificities calculated from pooled data with 95% CIs. Weighted mean specificity is summary specificity calculated using fixed-effects model. Random mean specificity is summary specificity calculated using random-effects model.

 

The weighted mean NPV ranged from 98.70% (95% CI, 97.02–100%) with Cochran's Q equal to 2.39 (p = 0.66) to 98.62% (96.37–100%) with Cochran's Q equal to 2.28 (p = 0.68) using the fixed-effects model and random-effects model, respectively (Table 2 and Fig. 3).


View this table:
[in this window]
[in a new window]

 
TABLE 2: Negative Predictive Value (NPV) With 95% CI for Each Source and the Weighted Mean NPV With 95% CI

 

Figure 3
View larger version (8K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 3 Forest plot displays negative predictive value (NPV) for each source and weighted mean NPVs calculated from pooled data with 95% CIs. Weighted mean NPV is summary NPV calculated using fixed-effects model. Random mean NPV is summary NPV calculated using random-effects model.

 

The PPV was calculated as 83.29% (95% CI, 76.67–89.91%) with a Cochran's Q of 6.75 (p = 0.15) using the fixed-effects model and 84.51% (75.08–93.94%) with a Cochran's Q of 3.89 (p = 0.42) by means of the random-effects model (Fig. 4). The fixed-effects model produced an accuracy of 95.18% (95% CI, 93.13–97.22%), whereas the random-effects value was 94.70% (95% CI, 91.29–98.10%) with Cochran's Q equal to 8.31 (p = 0.08) and 4.22 (p = 0.38), respectively (Table 3 and Fig. 5).


Figure 4
View larger version (8K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 4 Forest plot displays positive predictive value (PPV) for each source and weighted mean PPVs calculated from pooled data with 95% CIs. Weighted mean PPV is summary PPV calculated using fixed-effects model. Random mean PPV is summary PPV calculated using random-effects model.

 

View this table:
[in this window]
[in a new window]

 
TABLE 3: Accuracy With 95% CI for Each Source and the Weighted Mean Accuracy With 95% CI

 

Figure 5
View larger version (8K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 5 Forest plot displays accuracy for each source and weighted mean accuracies calculated from pooled data with 95% CIs. Weighted mean accuracy is summary accuracy calculated using fixed-effects model. Random mean accuracy is summary accuracy calculated using random-effects model.

 

Table 4 summarizes the correlation between study characteristics and weighted effect sizes by listing the Pearson's r values and t values that were calculated. The critical t value for p < 0.05 was 2.353. The only study characteristic that produced t values greater than 2.353 was the year that data were collected. When comparing the median year that data were collected before 2008 with weighted sensitivity, the Pearson's r value was –0.85 with a t value of 2.76 (p = 0.035). All other correlations between study characteristics and weighted effect sizes yielded t values less than 2.353.


View this table:
[in this window]
[in a new window]

 
TABLE 4: Pearson's r Values and p Values Used to Test for Correlations Between Various Study Characteristics and Weighted Effect Sizes

 


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
This study's main goal was to determine how well CT findings predicted which hemodynamically stable patients with penetrating abdominal trauma needed laparotomies and which did not. To accomplish this, one extremely important step was to check for homogeneity across the five studies. This was done using Cochran's Q to test whether it is reasonable to assume that all of the effect sizes were estimating the same population mean. If homogeneity was rejected, the distribution of effect sizes would be thought to be heterogeneous. Because of the small number of studies, Cochran's Q test had the potential to have poor power to detect differences. Thus, an alpha value equal to 0.10 was used as the cutoff, which correlated to a critical chi-square value for Cochran's Q of 7.78. All but two of the calculated Q values were less than 7.78. In each of these, researchers failed to reject the null hypothesis of homogeneity. Therefore, the variability across these effect sizes did not exceed what would be expected based on sampling error.

The calculation of specificity and accuracy with the fixed-effects model produced Cochran's Q values greater than the critical value. In this instance, it was concluded that heterogeneity did indeed exist between the studies. Addressing this heterogeneity, study characteristics were compared with weighted effect sizes to analyze between study variability. Additionally, researchers fit the data to the random-effects model. The only study characteristic to show a significant correlation with weighted effect sizes was the year that data were collected. The more recent the CT examinations were conducted, the higher the sensitivity. This seems reasonable given that CT has been continually improving in quality over the years. None of the study characteristics that were examined could account for the heterogeneity found between studies when specificity was computed. Thus, it was assumed that the excess variability across effect sizes was derived from random differences across studies. Researchers, therefore, concluded that it is more appropriate to use the values calculated using the random-effects model rather than the fixed-effects model.

The sensitivity, specificity, NPV, and accuracy were all found to be ≥ about 95%, whereas the PPV was approximately 85%. The lower PPV could possibly be explained by how a positive CT was defined in this study. Findings of free intraperitoneal fluid, air, or both were considered as positive CT findings in the articles analyzed for this meta-analysis; therefore, it was necessary in this study to include these as positive CT images. In the trauma setting, however, free intraperitoneal fluid or air alone does not necessarily indicate a need for laparotomy. Including these findings as positive CT images had the potential to increase the number of false-positives and subsequently negatively affect the specificity and PPV of CT.

The results of this study show that CT is an indispensable tool in predicting the need for laparotomy but still has room for improvement. As mentioned, unnecessary laparotomy rates for trauma range from 1.7% to 38% [3]. According to Demetriades and Velmahos [12], the overall incidence of early complications in patients who underwent unnecessary laparotomy for penetrating injuries was 10.6%. The overall late complication rate in this setting has been reported at 2.4% [13].

Increased cost and length of hospital stay have been reported for patients who underwent unnecessary laparotomy. According to one study, the average hospital charge for nonoperatively managed patients with abdominal gunshot wounds was $8,595, whereas patients who underwent unnecessary surgery paid an average of $18,123 [14]. The proper use of CT has the possibility to decrease the number of unnecessary laparotomies and thereby reduce complication rates, hospital stays, and hospital costs. Some critics of selective nonoperative management might argue that these patients are at increased risk of having missed injuries and that the missed findings have the potential for increased complications. In a review of 728 patients with penetrating injuries, Demetriades et al. [2] found a 3.4% incidence of delayed diagnosis with delayed treatment leading to no deaths and a morbidity that was comparable to patients receiving an early operation.

In this meta-analysis, researchers did not have access to the type of CT scanner used in each study (e.g., single-detector, multidetector, helical). Furthermore, the scanning protocols used, such as the use of contrast material and thickness of slices, were not made available. These data were requested from the authors of the sources; however, some authors did not respond and some of the responding authors could not accurately produce these data. Therefore, assessing whether differences in outcomes could be explained by use of specific types of CT scanners or scanning protocols was not possible.

Another potential limitation of our study is that the studies selected for this meta-analysis represent a combination of stab and gunshot wound patients. The trajectory of a sharp object in a stab wound tends to be linear, whereas the trajectory of a bullet in a gunshot wound is usually nonlinear. This difference leads to gunshot wounds behaving more aggressively and likely causing injuries to multiple organs. More aggressive and obvious wounds are more likely to be described as positive and are less likely to be missed. Thus, in theory, gunshot wounds should produce a higher true-positive rate, and stab wounds should produce a higher false-negative rate. Additionally, stab wounds tend to be treated more conservatively, whereas gunshot wounds are treated more aggressively. Many surgeons will perform laparotomies on patients with gunshot wounds despite the negative CT findings. This leads to an increased number of laparotomies performed on patients with gunshot wounds compared with patients with stab wounds.

The follow-up period varied from article to article. Some subjects were observed for less than 24 hours and were subsequently lost to follow-up. Others were followed for 44 months. The reported mean follow-up ranged from 7 days to 10 months between articles. If these patients were not adequately followed, then the number of true-negatives, false-positives, or both could be inflated. However, the articles did state that most patients were followed up for at least a couple of days, which is enough time to detect most injuries requiring laparotomy.

As with any meta-analysis, this research has the potential to contain biases despite researchers' efforts to optimize protocols before accumulating data and conducting analyses. Publication bias is always a possibility because studies that show a significant effect are more likely to be published than studies with nonsignificant findings. In this study, language bias is likely because only sources written in English were used in an attempt to protect against unreliable translations of articles published in other languages. Additionally, this analysis involved some small studies, which tend to have more dramatic results than large studies.

In light of the possibility for bias, this meta-analysis is just one step in the process of determining CT's potential in triaging patients with penetrating abdominal injury. As CT scanners are advancing and the quality of CT images is improving, CT's full capabilities must be explored. A next step could entail setting up a multicenter prospective research project with a standardized protocol. Such a study would minimize potential biases and produce more reliable results. Furthermore, the accuracy of today's CT could be identified and compared with imaging of the past. Technology is continually improving, and medical professionals must continue to adapt their practices to maximize patient benefits.

Go


View this table:
[in this window]
[in a new window]

 
APPENDIX I: Quality Evaluation Score Sheeta

 


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Cayten CG, Nassoura ZE. Abdomen. In: Ivatury RR, Cayten CG, eds. The textbook of penetrating trauma. Baltimore, MD: Williams & Wilkins, 1996:281 –295
  2. Demetriades D, Velmahos GC. Indications for and techniques of laparotomy. In: Feliciano DV, Mattox KL, Moore EE, eds. Trauma, 6th ed. New York, NY: McGraw-Hill,2008 : 607–622
  3. Demetriades D, Velmahos G. Technology-driven triage of abdominal trauma: the emerging era of nonoperative management. Annu Rev Med 2003; 54:1 –15[CrossRef][Medline]
  4. Berman NG, Parker RA. Meta-analysis: neither quick nor easy. BMC Med Res Methodol 2002;2 :10
  5. Agresti A, Coull BA. Approximate is better than "exact" for interval estimation of binomial proportions. Am Stat 1998; 52:119 –126[CrossRef]
  6. Lipsey MW, Wilson DB. Practical meta-analysis (applied social research methods). Thousand Oaks, CA: SAGE Publications,2001 : 1–231
  7. Beekley AC, Blackbourne LH, Sebesta JA, et al.; 31st Combat Support Hospital Research Group. Selective nonoperative management of penetrating torso injury from combat fragmentation wounds. J Trauma 2008; 64[suppl 2]: S108–S116; discussion S116–S117[CrossRef][Medline]
  8. Conrad MF, Patton JH Jr, Parikshak M, Kralovich KA. Selective management of penetrating truncal injuries: is emergency department discharge a reasonable goal? Am Surg 2003;69 : 266–272; discussion 273[Medline]
  9. Mitra B, Gocentas R, O'Reilly G, Cameron PA, Atkin C. Management of haemodynamically stable patients with abdominal stab wounds. Emerg Med Australas 2007; 19:269 –275[CrossRef][Medline]
  10. Shanmuganathan K, Mirvis SE, Chiu WC, Killeen KL, Hogan GJ, Scalea TM. Penetrating torso trauma: triple-contrast helical CT in peritoneal violation and organ injury—a prospective study in 200 patients. Radiology 2004;231 : 775–784[Abstract/Free Full Text]
  11. Soto JA, Morales C, Múnera F, Sanabria A, Guevara JM, Suárez T. Penetrating stab wounds to the abdomen: use of serial US and contrast-enhanced CT in stable patients. Radiology2001; 220:365 –371[Abstract/Free Full Text]
  12. Demetriades D, Velmahos GC. Laparotomy. In: Mattox KL, Feliciano DV, Moore EE, eds. Trauma, 4th ed. New York, NY: McGraw-Hill, 2000
  13. Weigelt JA, Kingman RG. Complications of negative laparotomy for trauma. Am J Surg 1988;156 : 544–548[Medline]
  14. Demetriades D, Velmahos G, Cornell E 3rd, et al. Selective nonoperative management of gunshot wounds of the anterior abdomen. Arch Surg 1997;132 : 178–183[Abstract/Free Full Text]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Goodman, C. S.
Right arrow Articles by Coulam, C. H.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Goodman, C. S.
Right arrow Articles by Coulam, C. H.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS