AJR F and L Medical Products: Radiation Protection & More
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Costantino, M. M.
Right arrow Articles by Vegas, C. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Costantino, M. M.
Right arrow Articles by Vegas, C. D.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?
DOI:10.2214/AJR.07.2552
AJR 2008; 191:471-474
© American Roentgen Ray Society


Original Research

CT Angiography in the Evaluation of Acute Pulmonary Embolus

Mary M. Costantino1, Geneva Randall1, Marc Gosselin1, Marissa Brandt2,3, Kristopher Spinning2,4 and C. David Vegas1

1 Department of Radiology, Oregon Health Science University, 3183 SW Sam Jackson Park Rd., Portland, OR 97239-3098.
2 Oregon Health Science University School of Medicine, Portland, OR.
3 Present address: Stanford University Medical Center, Stanford, CA.
4 Present address: Department of Diagnostic Radiology, Bridgeport Hospital and Yale New Haven Health, Bridgeport, CT.

Received May 12, 2007; accepted after revision February 26, 2008.

 
Address correspondence to M. M. Costantino (costanti{at}ohsu.edu).


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. The purpose of this study was to assess the appropriate use of CT angiography (CTA) in the diagnostic evaluation of acute pulmonary embolism (PE).

MATERIALS AND METHODS. We reviewed a total of 575 CT angiograms obtained to evaluate for PE at a large level 1 trauma teaching hospital from January 2004 through March 2005. Various clinical settings were used for 267 inpatient (46%), 258 emergency department (45%), and 50 outpatient (9%) studies. We excluded CTA performed for other reasons, repeated CTA, and patient records with incomplete clinical data. On the basis of chart review in which the investigators were blinded to final diagnoses, pretest probability of PE according to the Wells criteria was retrospectively assigned to each patient. D-dimer values, when obtained, also were reviewed. The diagnosis of PE was based on final CTA reports.

RESULTS. PE was diagnosed in 9.57% of 575 patients. Positivity rates by location were 32 (12%) of the 267 inpatients, 22 (8.5%) of the 258 emergency department patients, and one (2.0%) of the 50 outpatients. Three (< 1%) of the 575 patients had high probability of PE, even though 351 patients had gone directly to CTA. Of the other 572 patients, 158 (28%) had intermediate and 414 (72%) low probability of PE. In the high, intermediate, and low probability groups, two (67%), 24 (15%), and 29 (7%), respectively, of the patients had PE. A D-dimer assay was performed for 224 (39%) of the 575 patients. Thirty-nine (17%) of the 224 patients had normal results (< 0.5 µg/mL); 107 (48%), intermediate results (0.6–2.0 µg/mL); and 78 (35%), abnormal results (> 2.0 µg/mL). In the emergency department cohort, 151 (59%) of 258 patients underwent a D-dimer assay. Thirty-two (21%) of the 151 patients had normal results; 81 (54%), intermediate results; and 38 (25%), abnormal results. Only one patient with a normal D-dimer level and three patients with intermediate D-dimer levels had PE, the equivalent of 3% of each group. The number of CTA examinations ordered for patients with normal and intermediate D-dimer results was 146 (25% of the 575 total studies). Twenty-two (8%) of the 258 emergency department patients had PE, and clinical suspicion of PE was high for 11 (50%), intermediate for 10 (45%), and low for one (5%) of those patients.

CONCLUSION. Our data showed suboptimal use of the Wells criteria and subjective overestimation of the probability of PE before ordering of CTA. Although a definitive acceptable PE positivity rate for CTA has not been established, the 10% yield represents overuse of CTA as a screening rather than a diagnostic examination.

Keywords: CT angiography • D-dimer assay • emergency department • pulmonary embolism • radiation


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
There are an estimated 600,000 episodes of pulmonary embolism (PE) per year in the United States. Conventional wisdom from data collected long before the development of pulmonary CT angiography (CTA) in an era of extensive algorithmic evaluation with angiography, ventilation–perfusion scans, lower-extremity Doppler studies, autopsy, follow-up studies, rudimentary single-detector CT, and high clinical probability in the diagnosis of PE was that the overall mortality rate among untreated patients approaches 20–35%, more than 80% of deaths from PE occurring in the first 30 minutes and 90% within the first 2.5 hours of the event [13]. The patients who survive to be referred for diagnostic evaluation are a very different subset of this population. It has been suggested [1] that the mortality and recurrence rates in this population are likely as low as 5%, even if the patient is not treated.

The perceived risks associated with a missed PE diagnosis with regard to morbidity and mortality leave treating physicians with the challenge of how best to approach patients with symptoms and signs that may be associated with PE. Clinical concern may be lagging behind the evolving ideas of PE. Newer articles [4] and pathology teaching show PE is not as severe a diagnosis as once thought. Although this concept is controversial, it is possible that the lungs are meant to act as a filtering device, preventing small emboli from traveling to end organs such as brain, kidneys, and bowel.

Because subsegmental emboli are being detected with high sensitivity, in some cases images show a physiologic process [5]. Instead of reporting CTA findings as either positive or negative for PE, perhaps radiologists should describe the degree of pulmonary arterial obstruction, which can be correlated with blood gas values to determine the clinical significance of small subsegmental emboli [6]. The widespread use of sensitive and specific 16- and 64-MDCT and increased detection of subsegmental emboli present an interesting challenge for treating physicians in deciding whether to manage incidental subsegmental PE in patients without symptoms or small subsegmental PE in patients with symptoms out of proportion to a small clot burden.

With the advent of helical CT, CTA has evolved into the new reference standard for diagnosis of PE. Two of the most widely used scoring systems are the Wells score [7] and the Geneva clinical probability [8]. Numerous studies [914] have yielded data ascribing a high sensitivity and specificity to CTA and showing acceptable clinical outcome among patients with normal findings on CTA. CTA is fast, easy, reliable, diagnostic, and widely available. These attributes have led to a significant increase in the number of patients undergoing imaging for PE since the late 1990s. At our institution, this marked increase in use of CTA seemed to be paired with a concomitant decrease in the overall positivity rate for PE in the scans obtained. The reason for this decrease in positivity may be that some physicians have begun using an overly ag gressive diagnostic strategy for patients at low risk. These physicians may be motivated by the ease and availability of CTA and by perceived fears surrounding a missed diagnosis and its medicolegal ramifications.

Several scoring systems and algorithms have been developed to better assign pretest PE risk categories and facilitate management decisions. Implementation of these algo rithms in clinical practice, however, is seemingly inconsistent, and CTA may be increasingly used more as a screening study in the care of patients with suspected cardio thoracic disease than as a more appropriate later step of diagnostic evaluation in the presence of truly intermediate to high pretest probability of PE. Problems with this approach arise with respect to the increasing costs of unnecessary imaging studies and the potential carcinogenic and atherosclerotic effects of ionizing radiation on radiosensitive tissues, such as thyroid, breast, and coronary arteries, that often are not considered or deemed relevant to acute care.

The purpose of this study was to evaluate the use of CTA in the evaluation of PE at our institution, to determine the positivity rate, and to correlate this rate with the use of D-dimer assay and pretest probability based on established diagnostic algorithms. We performed a retrospective review of a total of 575 pulmonary CTA examinations performed to rule out PE within a 14-month period with correlation of retrospective application of the Wells criteria, clinical presentation, and D-dimer results.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
A retrospective review included all patients who underwent pulmonary CTA from January 2004 through March 2005, a total of 619 studies. This study was approved by our institutional review board. CTA was ordered by attending physicians, residents, interns, nurse practitioners, and physician assistants and was deemed necessary by the attending staff caring for the patient. Forty-four studies were excluded: 20 because of lack of clinical notes (19 negative for PE, one positive for PE), 14 because they were coronary angiograms, eight because they were performed to evaluate pulmonary venous anatomy, one because of contrast extravasation, and one because it was nondiagnostic owing to poor contrast bolus timing. All other patients who underwent CTA in the study time frame were included, a total of 575 studies. We reviewed CTA and D-dimer results, patient demographic features, and presenting clinical data by systematic chart review. Comorbid conditions and clinical signs and symptoms at presentation for CTA were recorded with particular attention to signs, symptoms, and factors in the patient history that are positive predictors of PE according to the Wells [7] criteria (Table 1).


View this table:
[in this window]
[in a new window]

 
TABLE 1: Wells Criteria

 

CTA results were categorized as positive or negative for PE. Patient demographics, including age, sex, and location (inpatient, outpatient, emergency department), were recorded. Monoclonal antibody D-dimer results were categorized as normal (0–0.5 µg/mL), intermediate (0.6–2.0 µg/mL), or abnormal (> 2.1 µg/mL) according to our standard laboratory assay (Liatest, Stago). At our institution, clinicians interpret an intermediate result as indeterminate; therefore, these patients undergo CTA. Equipment for the D-dimer assay was readily available in the emergency department, and results were reported from the laboratory within approximately 20 minutes.

A single observer blinded to final diagnosis used the clinical information from the electronic medical record to retrospectively assign the Wells criteria. The following data points were obtained: clinical signs and symptoms of deep venous thrombosis, heart rate greater than 100 beats/min, surgery or immobilization for longer than 3 days in the previous 4 weeks, previous PE or deep venous thrombosis, hemoptysis, therapy for malignant dis ease in the previous 6 months, or pal liative care. Seven patients had D-dimer values documented in the medical record, but the D-dimer results were excluded from the study for the following reasons, all in one case each: hemolyzed sample, sample in which a lipemic plasma substance rendered the sample nondiagnostic, D-dimer ordered 3, 5, or 6 days before CTA, D-dimer ordered at an outside hospital that used an assay different from ours, and fibrinogen measurement ordered. All seven of these patients underwent CTA. Two of the seven had CTA findings of PE: the patient who underwent fibrinogen measurement and the patient for whom D-dimer assay was ordered 6 days before CTA.

CTA was preformed on 16- and 64-MDCT scanners (Brilliance, Philips Healthcare). After a 20-mL timing bolus over the main pulmonary artery, 100 mL of contrast medium, either isoosmolar (iodixanol, Visipaque, GE Healthcare) or nonionic low osmolar (iohexol, Omnipaque 300, GE Healthcare) was administered IV. Caudocranial 1-mm helical images were acquired from the thoracic inlet to the adrenal glands at 140 kV, 120 mAs, and 2-mm axial reconstructions. Coronal reconstructions were available for review at the discretion of the interpreting radiologist. Fellowship-trained board-certified thoracic radiologists interpreted the CTA images. All studies were interpreted on a PACS workstation. The diagnosis of PE was based on final CTA reports. There was no additional review of images during our study.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Fifty-five (10%) of the 575 patients had PE (Table 2). The population included all patients who underwent CT within the selected time frame, including 258 (45%) emergency department patients, 267 (46%) inpatients, and 50 (9%) outpatients. Positivity rates by location were 22 (8%) of 258 in the emergency department, 32 (12%) of 267 inpatients, and one (2%) of 50 outpatients. By retrospective assignment of clinical probability, only three (< 1%) of the 575 patients had high probability of PE; 158 (28%), intermediate probability; and 414 (72%), low probability. Despite this finding, 351 (61%) of the 575 patients went directly to CTA without D-dimer assay. Of the high, intermediate, and low probability groups, two (67%) of three, 24 (15%) of 158, and 29 (7%) of 414 patients, respectively, had findings positive for PE. A D-dimer assay was ordered for only 224 (39%) of all the patients. Thirty-nine (17%) of these patients had a normal D-dimer value (< 0.5 µg/mL); 107 (48%), an intermediate value (0.5–2.0 µg/mL); and 78 (35%), an abnormal value (> 2.0 µg/mL). In the emergency department cohort, 151 (59%) of the 258 patients underwent a D-dimer assay. The findings were normal in 32 (21%) of the cases, intermediate in 81 (54%), and positive in 38 (25%). Among the emergency department patients, 107 (41%) went directly to CTA.


View this table:
[in this window]
[in a new window]

 
TABLE 2: Summary of D-Dimer, Clinical Probability, and CT Angiography Results

 

Among the 575 patients, only one patient with a normal D-dimer value and three patients with an intermediate D-dimer value had PE, the equivalent of 2% (3/146) of all of the patients with normal and intermediate D-dimer values. The number of CTA examinations ordered for patients with low and intermediate D-dimer values accounted for 146 (25%) of the total 575 studies ordered. In the emergency department, 22 (8%) of the 258 patients had PE. Clinical suspicion of PE was high for 11 (50%), intermediate for 10 (45%), and low for one (5%) of those 22 patients.

Among the 351 (61%) of the 575 patients for whom D-dimer was not measured, 36 (10%) had PE. Among the 351 patients who did not undergo D-dimer assay, 240 (68%), 109 (31%), and two (< 1%) had low, intermediate and high, respectively, clinical probability of PE. Our emergency department purports to routinely use the Wells criteria in the evaluation of patients with suspected PE. Therefore, we assume that all patients who did not undergo D-dimer assay but had PE were designated as having high clinical probability of PE by the ordering clinician, because this is the cohort who goes straight to CTA in evaluation for PE.


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
The Wells criteria and several other well-validated guidelines underscore the importance of estimating clinical pretest probability before initiating diagnostic testing. Adherence to these evidence-based algorithms is necessary to optimize both cost-effective management and patient outcome. With use of these guidelines, before the decision is made to order a D-dimer assay or proceed with CTA, a patient's condition should be stratified into one of three categories: low, intermediate, or high clinical probability corresponding to increasing likelihood of PE. Otherwise, the results of these tests become less diagnostically helpful, and extensive unnecessary evaluations are undertaken in patients without significant risk factors or presenting symptoms. A D-dimer assay should be ordered only for patients with low to intermediate clinical probability. Owing to the high sensitivity and low specificity of the test, the sole purpose should be to exclude the diagnosis of PE. CTA should be performed only after pretest probability has been assigned and after the result of a D-dimer assay is abnormal. CTA should not be indiscriminately ordered for every patient presenting with cardiothoracic signs and symptoms.

Our data show wavering adherence to the clinical guidelines. Thirty-one patients who on retrospective application of Wells criteria were assigned low clinical probability and on presentation had a normal D-dimer result underwent CT. Thirty of these patients had CTA findings negative for PE. Eight intermediate-probability patients also had normal D-dimer results and underwent CTA, all with negative results for PE. A total of 351 (61%) of the CTA studies were performed on patients who had low or intermediate clinical probability of PE and went directly to CTA with no D-dimer assay ordered. If the algorithm had been followed by clinicians, these patients would have to be assumed to have high clinical probability; however, only 36 (10%) of the 351 had CTA findings positive for PE. In comparison, Wells et al. [7] found that approximately 66.7% of high-probability patients had positive CTA findings for PE. Interestingly, in our study the rates of positive PE findings among patients retrospectively designated as having low, intermediate, and high prob ability of PE were 7%, 15%, and 67%. This finding mir rors the incidence of PE in each of these groups according to the study by Wells et al. [7] (positive rate, 3.6%, 20.5%, and 66.7%). We believe this finding lends validation to our retrospective assignment of clinical probability.

Our data indicate the incidence of PE among patients with intermediate D-dimer levels is extremely low. The incidence of PE among patients with low or intermediate clinical probability and normal or intermediate D-dimer values was 2.7%, or four cases among 146 patients. This finding supports the hypothesis that an intermediate D-dimer concentration is a negative predictor of the presence of PE.

The positivity rate for PE from our data was 10%. Although a definitive acceptable positivity range for CTA in the evaluation of acute PE has yet to be established, we believe a positivity rate of 10% is on the low side, especially in consideration of the large number of studies preformed on patients with low or intermediate probability of PE, both with normal D-dimer levels and for whom a D-dimer assay was not ordered. The not negligible risk associated with CTA, predominately radiogenic cancer, must be considered.

CT pulmonary angiography has been reported [15] to result in a minimum radiation dose of 2.0 rad (20 mGy) to the breasts of an average-size woman. This dose approximates 10–25 two-view mammograms and as many as 100–400 chest radiographs [1619]. Data from the fifth Biological Effects of Ionizing Radiation report [20] show an increase of four new cases of cancer per 10,000 persons exposed to 1 rad (10 mGy) of radiation, or eight cases of radiogenic cancer per 10,000 CT examinations. These numbers are of particular importance to women younger than 35 years, who are at the most risk from radiation and who, along with pediatric patients, should avoid unnecessary exposure.

With rigorous implementation of the Wells criteria and appropriate use of the D-dimer assay, the total number of CTA examinations performed for PE could be significantly reduced. In our study, the number of CTA examinations could have been decreased at least 25% if CTA had not been performed on patients with low or intermediate probability of PE who had normal D-dimer results. The reduction likely would have been greater if D-dimer had been measured for the 351 (61%) patients who actually had low or intermediate probability but went directly to CTA.

The strengths of this study include the large sample size, consistent application of the Wells criteria by a single reviewer, and consistency in performance of the D-dimer assay for all patients. In addition, that all CTA images were read by one of two board-certified fellowship-trained thoracic radiologists decreased interobserver variability. The major weakness of this study was retrospective assignment of clinical probability by persons other than the physician evaluating the patient. However, the positivity rate for PE among the three groups is close to the positivity rate reported for each of the three groups in the study by Wells et al. [7], lending validity.

In conclusion, CTA is fast, diagnostic, and widely available for evaluation of acute PE. The Wells criteria are used for clinical stratification of patients and guidance of evaluation for PE. Our data show suboptimal use of the Wells criteria and subjective overestimation of PE probability before CTA is ordered. The finding of normal D-dimer values is not deterring unnecessary CTA. A paradigm shift has occurred whereby clinical tools are supplanted by laboratory values and imaging that, although noninvasive, are not without cost or risk. Modern algorithms are changing; less emphasis is being placed on clinical presentation and signs and symptoms and more on imaging and laboratory results, decreasing risk to the physician. Although a definitive acceptable PE positivity rate for CTA has not been established, we believe that the rate of 10% represents overuse of CTA as a screening rather than diagnostic test. This practice equates with ineffective resource utilization, increased health care costs, and unnecessary radiation and contrast exposure. On the basis of our data, a prospective study is being implemented at our institution whereby our physician order entry system will require any physician who orders CTA to complete an electronic calculation of the Wells score and Geneva clinical probability. Results of further large-scale investigations of PE positivity rates may help define an acceptable positivity rate.


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Calder KK, Herbert M, Henderson SO. The mortality of untreated pulmonary embolus in emergency department patients. Ann Emerg Med 2005; 45:302 -310[CrossRef][Medline]
  2. Wood KE. Major pulmonary embolism: review of a pathophysiologic approach to the golden hour of hemodynamically significant pulmonary embolism. Chest 2002; 121:877 -905[CrossRef][Medline]
  3. Stein PD, Henry JW, Relyea B. Untreated patients with pulmonary embolism: outcome, clinical and laboratory assessment. Chest 1995; 107:931 -935[CrossRef][Medline]
  4. Goodman LR. Small pulmonary emboli: what do we know? Radiology 2005;234 : 654-658[Free Full Text]
  5. Engelke C, Rummeny E, Marten K. Pulmonary embolism at multi-detector row CT of chest: one year survival of treated and untreated patients. Radiology 2006;239 : 563-575[Abstract/Free Full Text]
  6. Metafratze Z, Vassiliou M, Maglaras G, et al. Acute pulmonary embolism: correlation of CT pulmonary artery obstruction index with blood gas values. AJR 2006;186 : 213-219[Abstract/Free Full Text]
  7. Wells PS, Ginsberg JS, Anderson DR, et al. Use of a clinical model for safe management of patients with suspected pulmonary embolism. Ann Intern Med 1998;129 : 997-1005[Abstract/Free Full Text]
  8. Le Gal G, Righini M, Roy PM, et al. Prediction of pulmonary embolism in the emergency department: the revised Geneva score. Ann Intern Med 2006; 144:165 -171[Abstract/Free Full Text]
  9. Blachere H, Latrabe V, Montaudon M, et al. Pulmonary embolism revealed on helical CT angiography: comparison of ventilation–perfusion radionuclide lung scanning. AJR 2000;174 : 1041-1047[Abstract/Free Full Text]
  10. Remy-Jardin M, Remy J, Deschildre F, et al. Diagnosis of pulmonary embolism with spiral CT: comparison with pulmonary angiogram and scintigraphy. Radiology 1996;200 : 699-706[Abstract/Free Full Text]
  11. Patel S, Kazerooni EA Cascade PN. Pulmonary embolism: optimization of small artery visualization at multi-detector row CT. Radiology 2003;227 : 455-460[Abstract/Free Full Text]
  12. Montgomery AB, Gilkeson RC, Glauser J, Applegate KE. The role of spiral CT using pulmonary embolus protocol: a comparison of emergency department and hospitalized patients. Emerg Radiol2000; 7:25 -30[CrossRef]
  13. Garg K. CT of pulmonary thromboembolic disease. Radiol Clin North Am 2002; 40:111 -122[CrossRef][Medline]
  14. Richman PB, Courtney DM, Friese J, et al. Chest CT angiography (CTA) to rule out pulmonary embolism frequently reveals clinically significant ancillary findings: a multi-center study of 1025 emergency department patients. Acad Emerg Med 2003;10 : 564-566[CrossRef]
  15. Parker MS, Hui FK, Camacho MA, Chung JK, Broga DW, Sethi NN. Female breast radiation exposure during CT pulmonary angiography. AJR 2005; 185:1228 -1233[Abstract/Free Full Text]
  16. Nickoloff EL, Alderson PO. Radiation exposures to patients from CT: reality, public perception and policy. AJR2001; 177:285 -287[Free Full Text]
  17. McCollough CH, Liu HH. Breast dose during electron-beam CT: measurement with film dosimetry. Radiology1995; 196:153 -157[Abstract/Free Full Text]
  18. Trigaux JP, Lacrosse M. Radiation exposure and computed tomography. Rev Mal Respir 1999;16 : 127-136[Medline]
  19. McCollough CH, Zink FE. Performance evaluation of a multi-slice CT system. Med Phys 1999;26 : 2223-2230[CrossRef][Medline]
  20. Committee on the Biological Effects of Ionizing Radiation (BEIR V), National Research Council. Health effects of exposure to low levels of ionizing radiation: BEIR V. Washington, DC: National Academies Press, 1990

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
J. Debnath
Acute Pulmonary Embolism: When to Perform Pulmonary CT Angiography?
Am. J. Roentgenol., September 1, 2009; 193(3): W252 - W252.
[Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
D. Tack and P. A. Gevenois
Body MDCT at 140 kV
Am. J. Roentgenol., March 1, 2009; 192(3): W139 - W140.
[Full Text] [PDF]


Home page
RadioGraphicsHome page
J. S. Klein, E. Castaner, X. Gallardo, E. Ballesteros, M. Andreu, Y. Pallardo, J. M. Mata, and L. Riera
Invited Commentary * Authors' Response * Authors' Response
RadioGraphics, January 1, 2009; 29(1): 50 - 53.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Costantino, M. M.
Right arrow Articles by Vegas, C. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Costantino, M. M.
Right arrow Articles by Vegas, C. D.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS