AJR Women's Imaging Online
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bruegel, M.
Right arrow Articles by Rummeny, E. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Bruegel, M.
Right arrow Articles by Rummeny, E. J.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?
DOI:10.2214/AJR.07.3279
AJR 2008; 191:1421-1429
© American Roentgen Ray Society


Original Research

Diagnosis of Hepatic Metastasis: Comparison of Respiration-Triggered Diffusion-Weighted Echo-Planar MRI and Five T2-Weighted Turbo Spin-Echo Sequences

Melanie Bruegel1, Jochen Gaa1, Simone Waldt1, Klaus Woertler1, Konstantin Holzapfel1, Berthold Kiefer2 and Ernst J. Rummeny1

1 Department of Radiology, Klinikum rechts der Isar, Technische Universität München, Ismaninger Str. 22, D-81675 Munich, Germany.
2 Siemens Medical Solutions, Erlangen, Germany.

Received October 9, 2007; accepted after revision May 21, 2008.

 
Address correspondence to M. Bruegel (mbruegel{at}roe.med.tum.de).

The employment status of B. Kiefer at Siemens Medical Solutions did not influence the data in this study.


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. The purpose of this study was to compare the value of respiration-triggered diffusion-weighted (DW) single-shot echo-planar MRI (EPI) and five variants of T2-weighted turbo spin-echo (TSE) sequences in the diagnosis of hepatic metastasis.

MATERIALS AND METHODS. Fifty-two patients with extrahepatic primary malignant tumors underwent 1.5-T MRI that included DW EPI and the following variants of T2-weighted TSE techniques: breath-hold fat-suppressed HASTE, breath-hold fat-supressed TSE, respiration-triggered fat-suppressed TSE, breath-hold STIR, and respiration-triggered STIR. Images were reviewed independently by two blinded observers who used a 5-point confidence scale to identify lesions. Results were correlated with surgical and histopathologic findings and follow-up imaging findings. The accuracy of each technique was measured with free-response receiver operating characteristic analysis.

RESULTS. A total of 118 hepatic metastatic lesions (mean diameter, 12.8 mm; range, 3–84 mm) were evaluated. Accuracy values were higher (p < 0.001) with DW EPI (0.91–0.92) than with the T2-weighted TSE techniques (0.47–0.67). Imaging with the HASTE sequence (0.47–0.52) was less accurate (p < 0.05) than imaging with the breath-hold TSE, breath-hold STIR, respiration-triggered TSE, and respiration-triggered STIR sequences (0.59–0.67). Sensitivity was higher (p < 0.001) with DW EPI (0.88–0.91) than with T2-weighted TSE techniques (0.45–0.62). For small (≤ 10 mm) metastatic lesions only, the differences in sensitivity between DW EPI (0.85) and T2-weighted TSE techniques (0.26–0.44) were even more pronounced.

CONCLUSION. DW EPI was more sensitive and more accurate than imaging with T2-weighted TSE techniques. Because of the black-blood effect on vessels and low susceptibility to motion artifacts, DW EPI was particularly useful for the detection of small (≤ 10 mm) metastatic lesions.

Keywords: detection • diffusion MRI • echo-planar imaging • hepatic metastasis


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
MRI is one of the most sensitive methods for the detection of hepatic metastasis. At many institutions, it is considered the standard for preoperative assessment of patients eligible for surgical treatment of hepatic metastasis [1]. Use of extracellular gadolinium chelates and liver-specific contrast media has been found to increase the accuracy of MRI in lesion detection compared with unenhanced MRI [26]. However, unenhanced T2-weighted sequences are a basic component of any MRI examination. They are used to detect and characterize hepatic lesions and to facilitate the selection of contrast media for accurate diagnosis. Several techniques have been investigated for optimizing unenhanced T2-weighted MRI. Most radiologists are using turbo spin-echo (TSE) techniques (also called fast spin-echo sequences) [1, 7]. Breath-hold TSE and breath-hold HASTE imaging are options for reducing respiratory motion artifacts and achieving short acquisition times. Another approach is respiration-triggered TSE techniques, which have high spatial resolution and may improve the detection of focal hepatic lesions compared with breath-hold TSE techniques [8, 9].

Studies [1013] have shown that diffusion-weighted imaging (DWI) of the liver can be used for characterization of focal hepatic lesions through quantification of diffusion effects with apparent diffusion coefficient (ADC) measurements. Some reports [10, 14, 15] have suggested that owing to high lesion-to-liver contrast, DWI may be highly sensitive for the detection of focal hepatic lesions. One of the most commonly used techniques for DWI of the abdomen is breath-hold single-shot echo-planar imaging (EPI) in combination with parallel acquisition techniques [1618]. Implementation of parallel acquisition techniques reduces acquisition time, motion artifacts, blurring due to significant T2 decay during the acquisition of relatively long echo trains, and typical EPI artifacts such as chemical shift and susceptibility artifacts [19]. Application of respiratory triggering may further improve the quality of DW EP images because high spatial resolution can be achieved with an adequate signal-to-noise ratio, enhancing ability to detect focal hepatic lesions. The purpose of our study was to assess the value of respiration-triggered DW EPI in the diagnosis of hepatic metastasis and to compare the results with those obtained with five variants of T2-weighted TSE sequences: three breath-hold and two respiration-triggered techniques.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Patients
All patients gave their informed consent for MRI, which was performed during routine evaluation for suspected hepatic metastasis. The local institutional review board approved retrospective analysis of the data and waived informed consent for that analysis. Seventy-four patients with extrahepatic primary malignant tumors were examined between September 2005 and February 2006 according to the MRI protocol described later. Twelve patients were later excluded from the study cohort because the presence of hepatic lesions was not sufficiently confirmed with histopathologic or follow-up imaging findings. To minimize bias, 10 additional patients found to have more than 15 focal hepatic lesions also were excluded from analysis.

The study group comprised 52 patients (30 men, 22 women; mean age, 56.4 years; age range, 18–75 years). A total of 118 hepatic metastatic lesions were diagnosed in 28 patients (16 patients with synchronous and 12 with metachronous hepatic metastatic lesions). The underlying primary tumors were as follows: four cases of carcinoma of the breast, two cases of bronchial carcinoma, nine cases of colorectal carcinoma, one case of duodenal carcinoma, two cases of gastric carcinoma, one case of hypernephroma, two cases of melanoma, and seven cases of neuroendocrine carcinoma. Nine of the 28 patients with hepatic metastasis had coexistent benign hepatic lesions: 11 hemangiomas and 13 cysts. Twenty patients had solely benign hepatic lesions: 46 hemangiomas and 36 cysts. The other four patients had no evidence of focal hepatic lesions.

Verification of Pathologic Findings
Histopathologic results after biopsy or surgical resection were available for a total of 34 metastatic lesions and three hemangiomas. In 18 patients, the diagnosis of metastatic hepatic disease was established with biopsy of at least one lesion; in six patients, at surgical resection; and in four patients (all with synchronous hepatic metastatic lesions), with pathologic tracer uptake of the lesions at PET/CT. Among the 28 patients with metastatic hepatic disease, 17 patients started systemic chemotherapy, two patients underwent transarterial chemoembolization, two patients were treated with stereotactic irradiation, six patients underwent surgical resection with curative attempt, and one patient declined therapy.

To determine the exact number and location of metastatic and benign lesions in patients who did not undergo surgery, a consensus review was performed by two experienced abdominal radiologists (16 and 21 years of experience in abdominal MRI). The consensus board reviewers were presented with histopathologic and surgical reports, if available. They also were given images obtained with all sequences included in the MRI protocol and serial cross-sectional images of all patients (25 who underwent follow-up MRI, 27 who underwent follow-up CT). Whenever new lesions were found on follow-up images, all initial MR images were carefully reevaluated. If any of the new lesions was retrospectively visible on at least one of the initial images, the lesions were included in the final study group.

For the 84 metastatic lesions without explicit histopathologic verification, diagnoses were confirmed with imaging criteria consisting of characteristic features on unenhanced and dynamic gadolinium-enhanced MR images [20, 21]. In addition, all lesions exhibited interval growth or regression (after the start of chemotherapy) in lesion diameter on serial cross-sectional images (mean follow-up interval, 5.4 months; range, 2–10 months). Diagnosis of the 54 hemangiomas without explicit histopathologic confirmation and of the 49 cysts was based on typical imaging findings on unenhanced and dynamic gadolinium-enhanced MR images [2123] in addition to stability of all lesions on serial cross-sectional images (mean follow-up interval, 9.1 months; range, 5–16 months). To facilitate accurate lesion identification in the subsequent evaluation process, all lesions were electronically labeled, and the diagnosis, size (determined by largest diameter), and location according to Couinaud segmental anatomy of each lesion were recorded.

MRI
MRI was performed with a 1.5-T system (Magnetom Avanto, Siemens Medical Solutions) with two anterior six-channel body phased-array coils and two posterior spinal clusters (three channels each). The MRI protocol included respiration-triggered DW EPI and five variants of T2-weighted TSE sequences: breath-hold fat-suppressed HASTE, breath-hold fat-suppressed TSE, breath-hold STIR, respiration-triggered fat-suppressed TSE, and respiration-triggered STIR. In addition, dynamic contrast-enhanced 3D gradient-echo sequences (volumetric interpolated breath-hold examination) were performed for all patients. Contrast administration was a bolus injection of 0.2 mL/kg of gadopentetate dimeglumine (Magnevist, Bayer Schering Pharma).

Image parameters for DW EPI and all T2-weighted TSE sequences are presented in Table 1. All images were obtained in the transverse plane with a section thickness of 5 mm. For shortening of the echo-train length, integrated parallel imaging techniques with generalized autocalibrating partially parallel acquisition [24] with a twofold acceleration factor were used. For respiratory triggering, prospective acquisition correction was implemented. The prospective acquisition correction technique interleaved the imaging sequence with a navigator sequence to synchronize the measurement with the patient's breathing cycle and to place the data acquisition period into the end-expiration phase.


View this table:
[in this window]
[in a new window]

 
TABLE 1: Technical Parameters of MRI Sequences

 

The DW EPI sequence used in this study was a vendor supplied work-in-progress package. A single-shot EPI readout was preceded by a diffusion-sensitizing block consisting of two 180° radiofrequency pulses and four motion-probing gradient pulses. The gradient factors (b values) and spatial direction of the motion-probing gradients were identical for all sections acquired during one respiratory cycle and were altered only between respiratory cycles. Three mutually perpendicular spatial directions were encoded with three b values: 50, 300, and 600 s/mm2. To increase the signal-to-noise ratio, three averages were performed. Trace images were synthesized for each b value, and an ADC map was calculated from all diffusion weightings and directions.

Image Analysis
Analysis of all MR images was performed with a PACS workstation (Easy Vision, Philips Healthcare). Patient details were removed, and the sets of images were analyzed randomly. All MR images were evaluated independently by two experienced radiologists (9 and 15 years of experience in abdominal MRI) unaware of other imaging findings, the results of the consensus board review, and the findings at surgery and histopathologic examination. To minimize bias, the observers reviewed the images in six sessions with an interval of at least 1 week between sessions.

Each observer recorded the presence of all suspected focal hepatic lesions by placing an electronic label and assigning one of five confidence levels using the following scale: 1, definitely not metastatic (i.e., definitely benign); 2, probably not metastatic (i.e., probably benign); 3, possibly metastatic; 4, probably metastatic; and 5, definitely metastatic. On T2-weighted TSE images, lesion scoring was based on criteria well documented in the literature [2023]. Lesions were assigned a score of 1 if they were sharply defined with a round or lobulated contour and had homogeneously high signal intensity similar to that of cerebrospinal fluid (simple cyst or hemangioma). Irregular or ill-defined lesions with low to moderately high signal intensity or a heterogeneous signal intensity pattern were regarded as definitely metastatic and were assigned a score of 5. Lesions that did not exactly meet these criteria were given intermediate scores based on the observer's subjective rating.

For lesion evaluation with DW EPI, images with a b value of 50 s/mm2 were used to detect focal abnormalities. Subsequent readings of images with b values of 300 and 600 s/mm2 and region-of-interest measurements within lesions on ADC maps were performed to further classify lesions. Lesions were assigned a score of 1 if they were sharply defined and had an ADC greater than 2.1 x 10–3 mm2/s (hemangioma or cyst). Ill-defined lesions with an ADC less than 1.3 x 10–3 mm2/s were considered definitely metastatic and were assigned a score of 5. For lesions with an ADC in the range of 1.3–2.1 x 10–3 mm2/s, intermediate scores were allocated on the basis of the observer's subjective rating. Because pre viously published data [1013, 18] showed large discrepancies in ADCs of focal hepatic lesions, the cutoff values were based on our experience with the DW EPI sequence implemented in our imaging protocol [25]. At the time of review, the observers were aware that sensitivity calculations would be based only on lesions assigned scores of 3–5.

Qualitative ratings of the overall image quality with each MRI sequence were recorded by the two observers, and final decisions were made in consensus. Image quality was considered excellent when the border of the liver and intrahepatic vessels were sharply defined, focal hepatic lesions were well visualized, and motion artifacts were absent or negligible; good when the margins of the liver and intrahepatic vessels were moderately well defined, lesion conspicuity was fair, or moderate motion artifacts were present; and poor when substantial motion artifacts were present.

Finally, the study coordinator performed one-to-one comparisons between lesions defined by the consensus board and those assigned scores during each of the two blinded readings. The results for each observer and each MRI sequence were documented, and all additional pseudolesions (e.g., vessels, partial volume effects) that had been allocated scores by the two blinded observers were recorded.

Statistical Analysis
The accuracy of each observer in the diagnosis of hepatic metastasis with each MRI sequence was measured with free-response receiver operating characteristic analysis. Calculations were per formed with jackknife free-response receiver operating characteristic analysis software (JAFROC version 2.2, D. P. Chakraborty). The sen sitivity of each observer with each MRI sequence was assessed by regarding all metastatic lesions assigned confidence levels of 3–5 as true-positive findings. The McNemar test was used to analyze the statistical significance of any difference in per formance between MRI sequences for an individual observer. Kappa analysis was used to determine interobserver variability for the diagnosis of metastasis with each MRI sequence ({kappa} ≤ 0.40, poor agreement; {kappa} = 0.41–0.75, good agreement; {kappa} ≥ 0.76, excellent agreement). Calculations were perform ed with SPSS software (version 11.5, SPSS). Two-sided p < 0.05 indicated statistical significance.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Lesions
A total of 118 metastatic lesions (mean size, 12.8 mm; range, 3–84 mm) and 106 benign lesions (49 cysts, 57 hemangiomas; mean size, 9.7 mm; range, 3–48 mm) were found in our study group of 52 patients. Twenty-eight patients had at least one metastatic lesion (one to four metastatic lesions in each of 19 patients, five to eight metastatic lesions in each of five patients, and nine to 11 metastatic lesions in each of four patients). Seventy-seven percent (91 of 118) of the meta static lesions were found in the right lobe (segments V–VIII) and the others (27 of 118) in the left lobe (segments I–IV).

Accuracy
The results of the free-response receiver operating characteristic analysis including the figure-of-merit values (accuracy values) for the diagnosis of hepatic metastatic lesions for each observer and each MRI sequence are summarized in Table 2. For both individual observers, the DW EPI sequence was significantly more accurate than the T2-weighted TSE sequences (p < 0.001 for all) (Fig. 1A, 1B, 1C, 1D, 1E, 1F). In the comparison of T2-weighted TSE sequences, none of the minor differences in figure-of-merit values between breath-hold TSE, breath-hold STIR, respiration-triggered TSE, and respiration-triggered STIR reached statistical significance (p > 0.05 for all). However, the HASTE sequence was less accurate, and the differences in figure-of-merit values compared with all other T2-weighted TSE techniques were statistically significant for both observers (p < 0.05 for all).


View this table:
[in this window]
[in a new window]

 
TABLE 2: Results of Free-Response Receiver Operating Characteristic Analysis

 

Figure 1
View larger version (98K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1A 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. T2-weighted fat-suppressed HASTE MR image.

 

Figure 2
View larger version (91K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1B 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. T2-weighted fat-suppressed breath-hold turbo spin-echo MR image.

 

Figure 3
View larger version (101K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1C 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. T2-weighted fat-suppressed respiration-triggered turbo spin-echo MR image.

 

Figure 4
View larger version (93K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1D 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. Diffusion-weighted respiration-triggered single-shot echo-planar MR image, b = 50 s/mm2.

 

Figure 5
View larger version (85K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1E 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. Diffusion-weighted respiration-triggered single-shot echo-planar MR image, b = 600 s/mm2.

 

Figure 6
View larger version (110K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1F 54-year-old woman with neuroendocrine carcinoma of small bowel. Both observers correctly identified 12-mm metastatic lesion (short arrow) on all images and detected 4- and 5-mm metastatic lesions (long arrows, D and E) only with diffusion-weighted single-shot echo-planar sequence. Small cyst (arrowhead) has markedly high signal intensity in D that fades out in E, whereas metastatic lesions retain their high signal intensity. Cyst has high apparent diffusion coefficient (ADC) and is clearly visible in F, whereas metastatic lesions have low ADC similar to that of hepatic parenchyma. Diffusion-weighted respiration-triggered single-shot echo-planar MR image ADC map.

 

Sensitivity
The sensitivity values for the diagnosis of all 118 hepatic metastatic lesions with each MRI sequence and for each observer are given in Table 3. Corresponding results for the 66 metastatic lesions 10 mm or smaller are given in Table 4. For both observers, the sensitivity of DW EPI in the diagnosis of metastatic lesions of all sizes was significantly higher than that of any of the T2-weighted TSE sequences (p < 0.001 for all). In the comparison of T2-weighted TSE techniques, none of the differences in sensitivity between breath-hold TSE, breath-hold STIR, respiration-triggered TSE, and respiration-triggered STIR imaging reached statistical significance (p > 0.05 for all). For both observers, the HASTE sequence was significantly less sensitive than the breath-hold TSE, respiration-triggered TSE, and respiration-triggered STIR sequences (p < 0.05 for all). For one observer, HASTE images were significantly less sensitive than breath-hold STIR images (p < 0.005).


View this table:
[in this window]
[in a new window]

 
TABLE 3: Sensitivity for the Diagnosis of Hepatic Metastasis (n = 118)

 

View this table:
[in this window]
[in a new window]

 
TABLE 4: Sensitivity for the Diagnosis of Small (≤10 mm) Hepatic Metastatic Lesions (n = 66)

 

When only small (≤ 10 mm) metastatic lesions were considered, the differences in sensitivity between DW EPI and the T2-weighted TSE sequences were even more pronounced than in the evaluation of larger lesions. Again, there were no statistically significant differences between breath-hold TSE, breath-hold STIR, respiration-triggered TSE, and respiration-triggered STIR sequences (p > 0.05 for all). For both observers, the HASTE sequence was significantly less sensitive than respiration-triggered TSE and respiration-triggered STIR sequences (p < 0.05 for all). For one observer, HASTE images were also significantly less sensitive than breath-hold STIR images (p < 0.05).

Interobserver agreement for the diagnosis of metastatic lesions of all sizes was good to excellent for all MRI sequences, the kappa values ranging from 0.42 for DW EPI to 0.90 for breath-hold STIR imaging. When only small (≤ 10 mm) metastatic lesions were analyzed, kappa values were generally lower, but agreement was good to excellent for all sequences.

False-Negative Findings
For the DW EPI sequence, a total of 25 false-negative interpretations (14 and 11 false-negative interpretations by observers 1 and 2, respectively) were recorded for all patients. In 14 of the 25 cases, metastatic lesions had been assigned low confidence levels of 1 or 2. In the other 11 cases, the lesions had not been scored at any confidence level. The size of the unscored metastatic lesions ranged from 4 to 8 mm.

For the T2-weighted TSE sequences, the total numbers of false-negative interpretations (combined from both observers) were as follows: 92 with respiration-triggered STIR, 97 with respiration-triggered TSE, 98 with breath-hold STIR, 105 with breath-hold TSE, and 126 with HASTE. Most of the false-negative diagnoses of metastasis had not been scored at any confidence level (77 with breath-hold STIR, 82 with breath-hold TSE, 85 with respiration-triggered STIR, 87 with respiration-triggered TSE, and 112 with HASTE). Most of the unscored metastatic lesions were small (≤ 10 mm), but several unscored lesions were larger than 10 mm (eight on breath-hold STIR, 13 on breath-hold TSE, 13 on respiration-triggered TSE, 15 on respiration-triggered STIR, and 21 on HASTE images) (Fig. 2A, 2B, 2C, 2D, 2E, 2F, 2G).


Figure 7
View larger version (114K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2A 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. T2-weighted fat-suppressed HASTE MR image.

 

Figure 8
View larger version (121K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2B 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. T2-weighted fat-suppressed breath-hold MR image.

 

Figure 9
View larger version (129K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2C 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. T2-weighted breath-hold STIR MR image.

 

Figure 10
View larger version (127K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2D 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. T2-weighted respiration-triggered turbo spin-echo MR image.

 

Figure 11
View larger version (129K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2E 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. T2-weighted respiration-triggered STIR MR image.

 

Figure 12
View larger version (105K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2F 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. Diffusion-weighted respiration-triggered single-shot echo-planar MR image, b = 50 s/mm2.

 

Figure 13
View larger version (94K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2G 61-year-old woman with breast cancer. Because of low lesion-to-liver contrast and interfering high signal intensity of intrahepatic vessels, 7- and 11-mm metastatic lesions (arrows) were frequently missed by observers on T2-weighted turbo spin-echo images (A–E). F and G clearly show both lesions. Diffusion gradient with b value of 600 s/mm2 (G) induces increased background noise but suppresses signal intensity of bile ducts. Thus metastatic lesions remain only hyperintense structures within hepatic parenchyma. Diffusion-weighted respiration-triggered single-shot echo-planar MR image, b = 600 s/mm2.

 
False-Positive Findings
For the DW EPI sequence, a total of 16 false-positive interpretations (nine and seven by observers 1 and 2, respectively) were recorded for all patients. In 14 of the 16 cases, hemangiomas had been assigned a confidence level of 3, 4, or 5. The other two false-positive observations were based on misinterpretation of artifacts. For the T2-weighted TSE sequences, the total numbers of false-positive interpretations (combined from both observers) were as follows: 17 with HASTE, 17 with respiration-triggered STIR, 18 with respiration-triggered TSE, 19 with breath-hold TSE, and 21 with breath-hold STIR. Several false-positive diagnoses were found to be due to misclassification of hemangiomas or cysts (three on HASTE, seven on breath-hold STIR, 11 on breath-hold TSE, 13 on respiration-triggered STIR, and 16 on respiration-triggered TSE images). The other false-positive observations did not correspond to true lesions. At retrospective review, these pseudolesions were attributed to vessels (33 of 42 cases), artifacts (six of 42), or partial volume effects from bowel or gallbladder (three of 42).

Histopathologically Confirmed Metastasis
Thirty-four histopathologically confirmed metastatic lesions (mean size, 17 mm; range, 4–53 mm) were present in 24 patients. With the DW EPI sequence, the numbers of correctly diagnosed metastatic lesions were 31 by observer 1 and 32 by observer 2. Two metastatic lesions in one patient had been mistaken for benign lesions (assigned a score of 2) by either observer; in another patient, one metastatic lesion had not been scored by one observer. For the T2-weighted TSE sequences, the total numbers of metastatic lesions correctly diagnosed by observers 1 and 2 were as follows: 22 and 21 with HASTE, 24 and 25 with breath-hold TSE, 25 and 25 with respiration-triggered TSE, 25 and 26 with breath-hold STIR, and 26 and 26 with respiration-triggered STIR. At least six metastatic lesions in three patients had not been scored by either observer with any of the T2-weighted TSE sequences. In addition, at least two metastatic lesions had been mistaken for benign lesions (assigned a score of 1 or 2) by either observer with each T2-weighted technique.

Although the sensitivity of DW EPI (0.91 and 0.94 for observers 1 and 2) was higher than that of any of the T2-weighted TSE sequences (maximum 0.76 for observer 2 with breath-hold STIR and for either observer with respiration-triggered STIR), the differences did not reach statistical significance except for the HASTE sequence (0.65 and 0.62 for observers 1 and 2, p < 0.05).

Image Quality
In our study group of 52 patients, the overall quality of DW EPI images with a b value of 50 s/mm2 was rated excellent in 45 cases and good in seven cases. For breath-hold TSE and breath-hold STIR images, the ratings were as follows: excellent in 19 and 22 cases, good in 30 and 27 cases, and poor in three cases each. With respiration-triggered TSE and respiration-triggered STIR sequences, image quality was judged excellent in 23 cases each, good in 26 and 25 cases, and poor in three and four cases. The quality of HASTE images was rated good in all cases.


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
With advances in MRI technology, including increased field homogeneity, high-performance gradient systems, and parallel imaging techniques such as sensitivity encoding (SENSE), the quality of DW images of the abdomen has markedly improved [26, 27]. Studies of the value of respiration-triggered DW EPI with sensitivity encoding in the detection of focal hepatic lesions have had promising results. Coenegrachts et al. [28] reported that lesion conspicuity of hemangiomas and metastatic lesions was significantly higher with DWI performed with a b value of 20 s/mm2 than with respiration-triggered single-shot T2-weighted TSE images. Nasu et al. [14] compared the accuracy of DWI with that of superparamagnetic iron oxide–enhanced MRI in the detection of hepatic metastatic lesions. Combined reading of DW images and unenhanced T1- and T2-weighted images showed higher accuracy than did combined reading of unenhanced and superparamagnetic iron oxide–enhanced T1- and T2-weighted images.

Use of navigator-controlled respiratory triggering and generalized autocalibrating partially parallel acquisition enabled us to acquire high-quality DW images with b values of 50, 300, and 600s/mm2 during an acquisition time of approximately 5 minutes. The overall quality of DW EP images obtained with a b value of 50 s/mm2 was rated good or excellent in all cases. Occasional limitations in image quality resulted from susceptibility artifacts at the periphery of the liver adjacent to air in the lungs or gastrointestinal tract and from signal intensity alterations in the left lobe of the liver due to cardiac pulsation. Although identical navigator-controlled triggering techniques (prospective acquisition correction) were applied to DW EPI, respiration-triggered TSE, and respiration-triggered STIR sequences, respiratory motion artifacts were less frequently encountered on DW EP images. The latter may be explained by the single-shot EPI readout, which diminishes motion artifacts when respiratory triggering is suboptimal in patients with a fast or irregular breathing cycle.

For the diagnosis of 118 hepatic metastatic lesions, including 66 lesions 1 cm or smaller, the sensitivity of DW EPI was 0.88–0.91. In the study by Nasu et al. [14], who evaluated 40 pathologically proved hepatic metastatic lesions, including 18 lesions 1 cm or smaller, combined reading of unenhanced T1- and T2-weighted images and DW EP images acquired with a b value of 500 s/mm2 resulted in a sensitivity of 0.78–0.88. Although high-b-value images facilitate differentiation of metastatic lesions (which retain high signal intensity because of restricted diffusion of extracellular water molecules in a cell-rich environment) from hemangiomas and cysts (which fade out at increasing b values owing to their high fluid content), we prefer low-b-value images for initial lesion detection. According to our experience and that of other investigators [28], visualization of hepatic lesions on high b-value-images often is hampered by suboptimal signal-to-noise ratios and more pronounced artifacts.

With T2-weighted TSE techniques, sensitivity in the diagnosis of hepatic metastatic lesions has ranged from 0.45 to 0.62. Like Huang et al. [29], who reported that T2-weighted breath-hold fat-suppressed fast-recovery fast spin-echo images and respiration-triggered fat-suppressed fast spin-echo images were comparable for detection and characterization of focal hepatic lesions, we did not observe a significant difference in accuracy between respiration-triggered TSE and breath-hold TSE images. Contrarily, other investigators [8, 30] found respiration-triggered T2-weighted TSE and fast spin-echo techniques more accurate than corresponding breath-hold techniques in the detection of solid hepatic lesions. However, as with all studies comparing MRI pulse sequences, the results strongly depend on the choice of individual MRI parameters.

The use of parallel imaging techniques may have been especially advantageous for our breath-hold TSE sequences, because it limited breath-hold times to 15 seconds, keeping respiratory motion artifacts low. Consequently, the overall quality of breath-hold TSE and breath-hold STIR images was good or excellent in most cases and was comparable with that of the corresponding respiration-triggered TSE images. According to a previous report [31], T2-weighted breath-hold fat-suppressed fast-recovery fast spin-echo images had better lesion clarity and higher overall image quality than did corresponding HASTE images. Similarly, we found breath-hold TSE images (and all other T2-weighted TSE images) more accurate than HASTE images in the diagnosis of hepatic metastasis. The latter were almost free of motion artifacts, but overall image quality suffered from blurring. Comparing the TSE sequences with chemical shift-selective fat suppression (breath-hold TSE and respiration-triggered TSE) and the corresponding inversion recovery techniques (breath-hold STIR and respiration-triggered STIR), we did not observe significant differences in accuracy in the diagnosis of hepatic metastasis. Contrarily, Gaa et al. [32] reported that the conspicuity of hepatic lesions was higher with inversion recovery fast spin-echo images than with fat-suppressed fast spin-echo images. Nearly one half of the lesions evaluated by Gaa et al., however, were nonsolid lesions, which specifically may have benefited from the additive effects of T1 and T2 weighting at inversion recovery imaging.

Most (14 of 25) of the false-negative observations with the DW EPI sequence in our study arose from misclassification of lesions (i.e., metastatic lesions were assigned scores of 1 or 2), whereas only 11 metastatic lesions were completely missed. Fourteen of the 16 false-positive observations, however, were made because hemangiomas had been mistaken for metastatic lesions. At retrospective review, these misclassified hemangiomas were found to have relatively low (< 1.6 x 10–3 mm2/s) ADCs. The difficulties in differentiating hemangiomas from metastatic lesions on the basis of ADC are well-known from previous studies [1013, 25]. Although the mean ADCs of metastatic lesions and hemangiomas have been found to differ significantly, a certain degree of overlap of ADCs of individual lesions also has been observed. All in all, our results indicate that limitations of the DW EPI sequence used are related predominantly to lesion characterization rather than to lesion detectability.

With T2-weighted TSE sequences, most false-negative diagnoses of metastasis had not been scored with any confidence level. Although several missed lesions were identified at retrospective review, initial lesion detectability was hampered by low lesion-to-liver contrast and the interfering high signal intensity from intrahepatic vessels. On the other hand, pseudolesions originating from the signal intensity of intrahepatic vessels were responsible for several false-positive observations on T2-weighted TSE images. Similar misinterpretations did not occur with the DW EPI sequence because of the coincident black-blood effect on vessels from diffusion-sensitizing gradients. The positive influence of the black-blood effect, particularly on the detection of small (≤ 10 mm) hepatic metastatic lesions, has also been discussed by Coenegrachts et al. [28].

A potential limitation of our study was the relatively small number of lesions with histopathologic confirmation. However, a thorough review of all MRI sequences with follow-up cross-sectional imaging was performed by two experienced readers, so the probability of misclassification of lesions is low. Although some small lesions might have been missed with all imaging techniques used during the consensus review, the validity of our comparison of MRI sequences should not be essentially affected. According to our results, it is unlikely that such small lesions would have been particularly detected on T2-weighted TSE images while being missed on DW EP images.

In conclusion, respiration-triggered DW EPI was more accurate and more sensitive in the diagnosis of hepatic metastasis than were T2-weighted TSE techniques. Combining DW EPI with respiratory triggering and generalized autocalibrating partially parallel acquisition resulted in high overall image quality and low susceptibility to respiratory motion artifacts. The black-blood effect on vessels also contributed to the high conspicuity of even very small lesions. Our preliminary results indicate that the respiration-triggered DW EPI technique may provide useful information in the preoperative evaluation of patients with suspected hepatic metastasis.


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Ward J. New MR techniques for the detection of liver metastases. Cancer Imaging 2006;6 : 33–42[CrossRef][Medline]
  2. Bartolozzi C, Donati F, Cioni D, et al. Detection of colorectal liver metastases: a prospective multicenter trial comparing unenhanced MRI, MnDPDP-enhanced MRI, and spiral CT. Eur Radiol2004; 14:14 –20[CrossRef][Medline]
  3. Blakeborough A, Ward J, Wilson D, et al. Hepatic lesion detection at MR imaging: a comparative study with four sequences. Radiology 1997;203 : 759–765[Abstract/Free Full Text]
  4. Petersein J, Spinazzi A, Giovagnoni A, et al. Focal liver lesions: evaluation of the efficacy of gadobenate dimeglumine in MR imaging—a multicenter phase III clinical study. Radiology2000; 215:727 –736[Abstract/Free Full Text]
  5. Reimer P, Jahnke N, Fiebich M, et al. Hepatic lesion detection and characterization: value of non-enhanced MR imaging, superparamagnetic iron oxide-enhanced MR imaging, and spiral CT-ROC analysis. Radiology 2000;217 : 152–158[Abstract/Free Full Text]
  6. Seneterre E, Taourel P, Bouvier Y, et al. Detection of hepatic metastases: ferumoxides-enhanced MR imaging versus unenhanced MR imaging and CT during arterial portography. Radiology1996; 200:785 –792[Abstract/Free Full Text]
  7. Keogan MT, Edelman RR. Technologic advances in abdominal MR imaging. Radiology 2001;220 : 310–320[Abstract/Free Full Text]
  8. Kanematsu M, Hoshi H, Itoh K, et al. Focal hepatic lesion detection: comparison of four fat-suppressed T2-weighted MR imaging pulse sequences. Radiology 1999;211 : 363–371[Abstract/Free Full Text]
  9. Pauleit D, Textor J, Bachmann R, et al. Improving the detectability of focal liver lesions on T2-weighted MR images: ultrafast breath-hold or respiratory-triggered thin-section MRI? J Magn Reson Imaging 2001; 14:128 –133[CrossRef][Medline]
  10. Ichikawa T, Haradome H, Hachiya J, Nitatori T, Araki T. Diffusion-weighted MR imaging with a single-shot echoplanar sequence: detection and characterization of focal hepatic lesions. AJR 1998; 170:397 –402[Abstract/Free Full Text]
  11. Namimoto T, Yamashita Y, Sumi S, Tang Y, Takahashi M. Focal liver masses: characterization with diffusion-weighted echo-planar MR imaging. Radiology 1997;204 : 739–744[Abstract/Free Full Text]
  12. Taouli B, Vilgrain V, Dumont E, Daire JL, Fan B, Menu Y. Evaluation of liver diffusion isotropy and characterization of focal hepatic lesions with two single-shot echo-planar MR imaging sequences: prospective study in 66 patients. Radiology 2003;226 : 71–78[Abstract/Free Full Text]
  13. Yamada I, Aung W, Himeno Y, Nakagawa T, Shibuya H. Diffusion coefficients in abdominal organs and hepatic lesions: evaluation with intravoxel incoherent motion echo-planar MR imaging. Radiology 1999;210 : 617–623[Abstract/Free Full Text]
  14. Nasu K, Kuroki Y, Nawano S, et al. Hepatic metastases: diffusion-weighted sensitivity-encoding versus SPIO-enhanced MR imaging. Radiology 2006;239 : 122–130[Abstract/Free Full Text]
  15. Okada Y, Ohtomo K, Kiryu S, Sasaki Y. Breath-hold T2-weighted MRI of hepatic tumors: value of echo planar imaging with diffusion-sensitizing gradient. J Comput Assist Tomogr 1998;22 : 364–371[CrossRef][Medline]
  16. Koh DM, Scurr E, Collins DJ, et al. Colorectal hepatic metastases: quantitative measurements using single-shot echo-planar diffusion-weighted MR imaging. Eur Radiol 2006;16 :1898 –1905[CrossRef][Medline]
  17. Taouli B, Martin AJ, Qayyum A, et al. Parallel imaging and diffusion tensor imaging for diffusion-weighted MRI of the liver: preliminary experience in healthy volunteers. AJR2004; 183:677 –680[Abstract/Free Full Text]
  18. Yoshikawa T, Kawamitsu H, Mitchell DG, et al. ADC measurement of abdominal organs and lesions using parallel imaging technique. AJR 2006; 187:1521 –1530[Abstract/Free Full Text]
  19. Kurihara Y, Yakushiji YK, Tani I, Nakajima Y, Van CM. Coil sensitivity encoding in MR imaging: advantages and disadvantages in clinical practice. AJR 2002;178 :1087 –1091[Free Full Text]
  20. Danet IM, Semelka RC, Leonardou P, et al. Spectrum of MRI appearances of untreated metastases of the liver. AJR2003; 181:809 –817[Abstract/Free Full Text]
  21. Lombardo DM, Baker ME, Spritzer CE, Blinder R, Meyers W, Herfkens RJ. Hepatic hemangiomas vs metastases: MR differentiation at 1.5 T. AJR 1990; 155:55 –59[Abstract/Free Full Text]
  22. Horton KM, Bluemke DA, Hruban RH, Soyer P, Fishman EK. CT and MR imaging of benign hepatic and biliary tumors. RadioGraphics 1999;19 : 431–451[Abstract/Free Full Text]
  23. Semelka RC, Brown ED, Ascher SM, et al. Hepatic hemangiomas: a multi-institutional study of appearance on T2-weighted and serial gadolinium-enhanced gradient-echo MR images. Radiology1994; 192:401 –406[Abstract/Free Full Text]
  24. Griswold MA, Jakob PM, Heidemann RM, et al. Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn Reson Med 2002; 47:1202 –1210[CrossRef][Medline]
  25. Bruegel M, Holzapfel K, Gaa J, et al. Characterization of focal liver lesions by ADC measurements using a respiratory triggered diffusion-weighted single-shot echo-planar MR imaging technique. Eur Radiol 2008;18 : 477–485[CrossRef][Medline]
  26. Chow LC, Bammer R, Moseley ME, Sommer FG. Single breath-hold diffusion-weighted imaging of the abdomen. J Magn Reson Imaging 2003; 18:377 –382[CrossRef][Medline]
  27. Hussain SM, De Becker J, Hop WC, Dwarkasing S, Wielopolski PA. Can a single-shot black-blood T2-weighted spin-echo echo-planar imaging sequence with sensitivity encoding replace the respiratory-triggered turbo spin-echo sequence for the liver? An optimization and feasibility study. J Magn Reson Imaging 2005; 21:219 –229[CrossRef][Medline]
  28. Coenegrachts K, Delanote J, Ter Beek L, et al. Improved focal liver lesion detection: comparison of single-shot diffusion-weighted echoplanar and single-shot T2-weighted turbo spin echo techniques. Br J Radiol 2007; 80:524 –531[Abstract/Free Full Text]
  29. Huang J, Raman SS, Vuong N, Sayre JW, Lu DS. Utility of breath-hold fast-recovery fast spin-echo T2 versus respiratory-triggered fast spin-echo T2 in clinical hepatic imaging. AJR 2005;184 : 842–846[Abstract/Free Full Text]
  30. Lee SS, Byun JH, Hong HS, et al. Image quality and focal lesion detection on T2-weighted MR imaging of the liver: comparison of two high-resolution free-breathing imaging techniques with two breath-hold imaging techniques. J Magn Reson Imaging 2007;26 : 323–330[CrossRef][Medline]
  31. Augui J, Vignaux O, Argaud C, Coste J, Gouya H, Legmann P. Liver: T2-weighted MR imaging with breath-hold fast-recovery optimized fast spin-echo compared with breath-hold half-Fourier and non-breath-hold respiratory-triggered fast spin-echo pulse sequences. Radiology 2002;223 : 853–859[Abstract/Free Full Text]
  32. Gaa J, Hatabu H, Jenkins RL, Finn JP, Edelman RR. Liver masses: replacement of conventional T2-weighted spin-echo MR imaging with breath-hold MR imaging. Radiology 1996;200 : 459–464[Abstract/Free Full Text]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
Am. J. Roentgenol.Home page
L. Mannelli, S. Kim, C. H. Hajdu, J. S. Babb, T. W. I. Clark, and B. Taouli
Assessment of Tumor Necrosis of Hepatocellular Carcinoma After Chemoembolization: Diffusion-Weighted and Contrast-Enhanced MRI With Histopathologic Correlation of the Explanted Liver
Am. J. Roentgenol., October 1, 2009; 193(4): 1044 - 1052.
[Abstract] [Full Text] [PDF]


Home page
RadioGraphicsHome page
A. Qayyum
Diffusion-weighted Imaging in the Abdomen and Pelvis: Concepts and Applications
RadioGraphics, October 1, 2009; 29(6): 1797 - 1810.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bruegel, M.
Right arrow Articles by Rummeny, E. J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Bruegel, M.
Right arrow Articles by Rummeny, E. J.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
Hotlight (NEW!)
Right arrow
What's Hotlight?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS