AJR Women's Imaging Online
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Wever, J. J.
Right arrow Articles by Mali, W. P. Th. M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Wever, J. J.
Right arrow Articles by Mali, W. P. Th. M.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
AJR 2000; 175:1279-1282
© American Roentgen Ray Society


Inter- and Intraobserver Variability of CT Measurements Obtained After Endovascular Repair of Abdominal Aortic Aneurysms

J. J. Wever1, J. D. Blankensteijn1, J. C. van Rijn1, I. A. M. J. Broeders1, B. C. Eikelboom1 and W. P. Th. M. Mali2

1 Department of Vascular Surgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
2 Department of Radiology, University Medical Center Utrecht, 3584 CX Utrecht, The Netherlands.

Received October 1, 1999; accepted after revision April 3, 2000.

 
Address correspondence to J. D. Blankensteijn.


Abstract
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
OBJECTIVE. Important decisions are made on the basis of CT angiographic measurements of aneurysm size obtained after endovascular abdominal aortic aneurysm repair; however, little is known about the variability of these measurements. We evaluated the variability of CT angiographic measurements of aneurysm size obtained after endovascular abdominal aortic aneurysm repair.

MATERIALS AND METHODS. Thirty CT angiographic data sets were randomly chosen from 91 sets, including preoperative, postoperative, and follow-up CT images. All images were obtained according to a standardized acquisition protocol. On a workstation, three parameters were measured: maximum aneurysm diameter, maximum aneurysm cross-sectional area, and aneurysm volume. All data sets were measured twice by two investigators in a random order. The difference of each pair of measurements was plotted against the mean value. The mean difference and its standard deviation were calculated with a repeatability coefficient.

RESULTS. The intraobserver repeatability coefficient for observer 1 was 3.8 mm for diameter, 201.7 mm2 for cross-sectional area, and 5.6 mL for volume. For observer 2, these figures were 3.0 mm, 219.0 mm2, and 8.1 mL, respectively. The interobserver repeatability coefficients were 3.9 mm, 236.2 mm2, and 10.3 mL.

CONCLUSION. Determination of the repeatability coefficient of aneurysm size measurements obtained after endovascular abdominal aortic aneurysm repair provides a good description of precision.


Introduction
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
After endovascular abdominal aortic aneurysm repair, continuing growth or shrinkage of the aneurysm does not always coincide with incomplete or complete exclusion, respectively [1]. Generally, reduction of aneurysm size indicates complete exclusion, and increasing size can be a sign of incomplete exclusion, and thus of a persisting risk of rupture [2]. Because follow-up imaging techniques may not always reveal endoleaks, size changes of the aneurysm must also be measured.

Helical CT angiography plays an important role in revealing aneurysm size; however, little is known about the variability of size measurements obtained after endovascular abdominal aortic aneurysm repair.

We evaluated the variability of CT angiographic measurements obtained after the endovascular treatment of an abdominal aortic aneurysm.


Materials and Methods
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
Thirty consecutive patients were scheduled for endovascular treatment of an abdominal aortic aneurysm between January 1994 and June 1997, and the EndoVascular Technologies endoprosthesis (Guidant, Menlo Park, CA) was used. The median age at the time of the procedure was 69 years (interquartile range, 65.3-75.5 years). Seventeen patients were selected for a tube graft and 13 for a bifurcated graft. The median preoperative maximum aneurysm diameter was 55.0 mm (interquartile range, 49.6-64.0 mm).

The study population contained 30 preoperative and 61 postoperative CT angiographic data sets. From these 91 data sets, 30 were randomly allocated to be included in the analysis, resulting in an aselect sample not only among patients but also among individual studies. We analyzed nine preoperative and 21 postoperative scans. All scans were obtained according to a standardized acquisition protocol using a EV-AP CT scanner (Philips Medical Systems, Best, The Netherlands). IV contrast material (140 mL) was administered at a rate of 3 mL/sec. Scanning started 30 sec after the beginning of contrast material injection at the level of the 12th thoracic vertebra, which is the presumed level of the celiac trunk. Fifty to 70 rotations of 1 sec each were obtained. The table speed was set at 5 mm/sec, and the collimation was set at 5 mm (pitch of 1), resulting in a length of the scanned volume of 25-35 cm.

The acquired set of raw CT angiographic data was reconstructed into 123-173 images with a slice thickness of 5 mm and a slice overlap of 3 mm. These images were transferred to an Easy Vision workstation (Philips Medical Systems).

The parameters assessed were maximum aneurysm diameter, maximum aneurysm cross-sectional area, and aneurysm volume. Two investigators independently measured the 30 data sets twice, resulting in two series of paired measurements. Repeated measurements were obtained in a random order without knowledge of the previous values.

Maximum Diameter and Cross-Sectional Area
A central lumen line was drawn manually through the lumen of the aorta. This was done by positioning points in the center of the lumen in the axial, sagittal, and coronal planes [3] (Fig. 1A,1B,1C,1D,1E).



View larger version (179K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1A. Method for drawing central lumen line. Sagittal CT scan shows how points are positioned in middle of lumen.

 


View larger version (179K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1B. Method for drawing central lumen line. Coronal CT scan shows same points as in A.

 


View larger version (158K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1C. Method for drawing central lumen line. Axial CT scan shows automatic segmentation of lumen using threshold technique.

 


View larger version (160K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1D. Method for drawing central lumen line. CT scan shows manual segmentation of thrombus and subtraction of lumen volume.

 


View larger version (26K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1E. Method for drawing central lumen line. Shaded surface display of CT scan shows total aneurysm volume.

 

A complete set of multiplanar reformats was reconstructed by the computer perpendicular to this central lumen line. The maximum aneurysm diameter was measured on this reformatted set of images. At the same level, a contour was drawn manually along the border of the thrombus. This contour was used to calculate the cross-sectional area of the aneurysm at the level of maximum diameter. Repeated measurements were obtained using a new central lumen line.

Volume
The aortic lumen was segmented using the threshold technique. The threshold was set to highlight only the contrast-enhanced lumen, stent (if present), and vertebrae [4]. The mean threshold was 100 H. By positioning a seeding point into the lumen, it was possible to separate the lumen and stent from the rest of the threshold voxels (Fig. 1D). In areas of close contact, the aortic lumen and vertebrae were separated by hand-drawn cutoff lines. The volume of the contrast-enhanced lumen, including the stent, was reconstructed from the individually segmented axial slices, starting at the level immediately below the renal arteries and ending at the level of the native aortic bifurcation.

The segmentation of the thrombus was fully manual. A contour was drawn along the border of the thrombus on each slice (Fig. 1E). Segmentation of the thrombus started just below the level of the renal arteries and ended at the level of the native bifurcation. No thrombus was found below this point. The procedure resulted in obtaining the volume of the thrombus plus the contrast-filled lumen in the thrombus. The actual thrombus volume was obtained by subtracting the volume of the contrast-filled lumen in the thrombus from the volume of the segmented thrombus (Fig. 1F). This algorithm was necessary because the lumen and thrombus do not end at the same level and are segmented using different techniques.

Total aneurysm volume was defined as the complete volume of the lumen and thrombus between the renal arteries and the native aortic bifurcation. This was the volume used when performing statistical comparison.

Analysis
The difference of means analysis described by Bland and Altman [5] was applied to our results. This method was used because it is simple to perform and to interpret and can replace methods like correlation coefficient calculation or regression analysis, which are misleading methods to use when calculating variability. The difference of each pair of measurements was plotted against the means. By analyzing the differences between the paired measurements, the only source of variability was the measurement error, which was likely to follow a normal distribution. Also, we calculated the standard deviation of the mean difference. The repeatability coefficient was defined as 1.96 times the standard deviation.

The repeatability coefficient was calculated for absolute figures and percentages in which the percentage is the difference between the paired measurements.

Additionally, the Student's t test was used to compare the means of the different series. Correlation between the magnitude of the mean and that of the difference was analyzed using Spearman's rank correlation.


Results
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
For the maximum aneurysm diameter, the intraobserver repeatability coefficients were 3.8 mm and 3.0 mm for observers 1 and 2, respectively; the interobserver repeatability coefficient was 3.9 mm. For the cross-sectional area, the intraobserver coefficients were 201.7 mm2 and 219.0 mm2 for observers 1 and 2, respectively; the interobserver coefficient was 236.2 mm2. The intraobserver repeatability coefficients for volume were 5.6 mL and 8.1 mL for observers 1 and 2, respectively; the interobserver coefficient was 10.3 mL. The data are summarized in Table 1.


View this table:
[in this window]
[in a new window]

 
TABLE 1 Repeatability Coefficients for Different Parameters

 

The differences were plotted against their mean for the interobserver variability of the three parameters (Figs. 2,3,4). Figures 2,3,4 show the mean difference and the range in which 95% of the differences lie.



View larger version (9K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2. Scatterplot shows mean of paired measurements plotted against difference of maximum diameter measurements. SD = standard deviation.

 


View larger version (10K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 3. Scatterplot shows mean of paired measurements plotted against difference of cross-sectional area measurements. SD = standard deviation.

 


View larger version (9K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 4. Scatterplot shows mean of paired measurements plotted against difference of volume measurements. SD = standard deviation.

 

Student's t test comparison of the means of the different series for maximum diameter, cross-sectional area, and volume is shown in Tables 2,3,4. The tables show that the paired measurements for one observer do not significantly differ among the three parameters, whereas the paired measurements between the observers reveal that observer 2 tends to measure significantly larger values than observer 1.


View this table:
[in this window]
[in a new window]

 
TABLE 2 Student's t Test Values for Maximum Diameter

 

View this table:
[in this window]
[in a new window]

 
TABLE 3 Student's t Test Values for Cross-Sectional Area of the Aneurysm

 

View this table:
[in this window]
[in a new window]

 
TABLE 4 Student's t Test Values for Aneurysm Volume

 

No correlation was found between the magnitude of the measurement and the measurement error, except in the intraobserver bias for volume measurements for observer 2. Here, a correlation coefficient of -0.38 (p <0.05) was noted.


Discussion
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 
After abdominal aortic aneurysm repair, if the excluded aneurysm sac is shrinking, then the risk of rupture is eliminated. In case of an expanding aneurysm, the patient must be considered at continued risk for rupture [6]. The exact consequences of such a rupture are currently unknown. Even though the endograft is still in place, aneurysm rupture may be dangerous [7]. Consequently, additional intervention is required if the expansion persists [8, 9], and careful measurements of aneurysm size are of fundamental importance.

When calculating the interobserver variability, we noted that observer 2 measured larger values than observer 1. As these CT angiographic measurements are based upon manipulations of a cursor on a computer screen, they are subject to observer interpretation. Although our measurement protocol is highly standardized, apparently some bias cannot be avoided. For instance, defining the border of thrombus on a calcified wall is in our experience an important source of differences in interpretation.

Sources of variability other than the observer may influence measurements during follow-up examinations; however, these sources are beyond the scope of this article. These sources include patient factors, including blood pressure, obesity, and the abilities to lie still and follow breath-holding instructions. CT angiographic factors, such as the type of CT and acquisition, may also influence measurements. Finally, the way the technician performs CT angiography and directs the patients through the procedure may affect measurements.

To assign statistical significance to the changes measured, it is necessary to define the measurement error in size changes. Calculation of the repeatability coefficient according to Bland and Altman [5] defines a range within which 95% of all size changes lie that are caused by measurement error. If the size change exceeds the repeatability coefficient, the size change can be considered a significant change with a confidence interval of 95%.

The fact that the intraobserver variability is smaller than interobserver variability implies that measurements, and especially trends in measurements during follow-up, will be more reliable when performed by one observer. Therefore, the more observers involved, the more difficult it will be to interpret the impact of measurements on clinical decision-making.

Because we use total volume for follow-up examinations performed after endovascular aneurysm repair, we have defined a 10-mL volume difference between two CT scans as being clinically significant on the basis of inter- and intraobserver variability. This definition has led to clinical decision-making in terms of endovascular reintervention or conversion to open surgery. For maximum diameter measurement, 4 mm would be clinically significant, and a cross-sectional area change of 250 mm2 is the proper cutoff point.

In conclusion, by determining the repeatability coefficient of three different parameters of aneurysm size after endovascular abdominal aortic aneurysm repair, it is possible to define a cutoff value, above which size changes become statistically significant and clinically relevant.

Measurements of total volume show the smallest intraobserver variability compared with maximum diameter and cross-sectional area; therefore, these measurements are the most precise parameters to use during follow-up examinations performed after endovascular abdominal aortic aneurysm repair.


References
Top
Abstract
Introduction
Materials and Methods
Results
Discussion
References
 

  1. Resch T, Ivancev K, Lindh M, et al. Persistent collateral perfusion of abdominal aortic aneurysm after endovascular repair does not lead to progressive change in aneurysm diameter. J Vasc Surg 1998;28:242 -249[Medline]
  2. Malina M, Ivancev K, Chuter TA, et al. Changing aneurysmal morphology after endovascular grafting: relation to leakage or persistent perfusion. J Endovasc Surg 1997;4:23 -30[Medline]
  3. Balm R, Kaatee R, Blankensteijn JD, Mali WP, Eikelboom BC. CT angiography of abdominal aortic aneurysms after transfemoral endovascular aneurysm management. Eur J Vasc Endovasc Surg 1996;12:182 -188[Medline]
  4. Balm R, van Leeuwen MS, Noordzij J, Eikelboom BC. Spiral CT for aortic aneurysms. In: Balm R, ed. Transfemoral endovascular aneurysm management. Utrecht, The Netherlands: University of Utrecht, 1996: 43-57
  5. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307 -310[Medline]
  6. Broeders IA, Blankensteijn JD, Gvakharia A, et al. The efficacy of transfemoral endovascular aneurysm management: a study on size changes of the abdominal aorta during mid-term follow-up. Eur J Vasc Endovasc Surg 1997;84 -90
  7. Matsumura JS, Moore WS. Clinical consequences of periprosthetic leak after endovascular repair of abdominal aortic aneurysm. J Vasc Surg 1998;27:606 -613[Medline]
  8. Ivancev K, Chuter T, Lindh M, Lindbladt B, Brunkwall J, Risberg B. Options for treatment of persistent aneurysm perfusion after endovascular repair. World J Surg 1996;20:673 -678[Medline]
  9. May J, White GH, Yu W, et al. Conversion from endoluminal to open repair of abdominal aortic aneurysms: a hazardous procedure. Eur J Vasc Endovasc Surg 1997;14:4 -11[Medline]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
RadiologyHome page
S. W. Stavropoulos and S. R. Charagundla
Imaging Techniques for Detection and Management of Endoleaks after Endovascular Aortic Aneurysm Repair
Radiology, June 1, 2007; 243(3): 641 - 655.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
M. Schoder, F. Cartes-Zumelzu, M. Grabenwoger, M. Cejna, M. Funovics, C. G. Krenn, D. Hutschala, F. Wolf, S. Thurnher, G. Kretschmer, et al.
Elective Endovascular Stent-Graft Repair of Atherosclerotic Thoracic Aortic Aneurysms:Clinical Results and Midterm Follow-Up
Am. J. Roentgenol., March 1, 2003; 180(3): 709 - 715.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Wever, J. J.
Right arrow Articles by Mali, W. P. Th. M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Wever, J. J.
Right arrow Articles by Mali, W. P. Th. M.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS