|
|
||||||||
1
Department of Clinical Radiology, Staedtische Kliniken Dortmund, Beurhausstra. 40, 44137 Dortmund, Germany.
2
Computing Center and Department of Statistics, University of Dortmund, August-Schmidt-Stra. 12, 44221 Dortmund, Germany.
Received May 17, 1999;
accepted after revision June 29, 1999.
Presented at the annual meeting of the American Roentgen Ray Society, New Orleans, May 1999.
Abstract
|
|
|---|
SUBJECTS AND METHODS. Eighty patients (46 men and 34 women; age range, 18-91 years; mean age, 63 years) who underwent CT of the chest were examined with the new digital radiography system, which is based on a 43 x 43 cm silicon flat-panel detector, and with a conventional screen-film system, which is used routinely in clinical practice. Posteroanterior and lateral radiographs were obtained. Four radiologists analyzed the digital and conventional images separately for chest abnormalities and rated the images using a five-level scale of confidence; CT was used as the reference standard. Diagnostic value was assessed using receiver operating characteristic curves for each abnormality.
RESULTS. No significant differences were found between the area under the receiver operating characteristic curve of the digital and that of the conventional radiography method for almost all investigated criteria. The only exception was mediastinal abnormalities, for which the digital method provided better results than the conventional method (p <<0.05).
CONCLUSION. The diagnostic performance of the new large-area silicon flat-panel detector is equivalent or superior to that of the conventional screen-film system for clinical chest imaging and can replace conventional radiography systems. This new technology offers transmission and storage possibilities inherent to digital radiology that would facilitate daily practice and reduce the initial high costs in the long-term.
|
|
|---|
Image quality and diagnostic performance of these new techniques should be at least as good as those of conventional systems. On the other hand, disadvantages for patients, such as an increase of radiation dose, must be avoided. Furthermore, a new technique should be easy to perform in daily practice.
Chest radiographs are the most frequently obtained images in diagnostic radiology. Chest radiology is highly demanding because there are special technical requirements that result from the wide range of tissue densities [2, 5]. The main advantages of conventional screen-film systems are high spatial resolution, good uniformity over a large area, high sensitivity, easy handling, and low cost, but these systems are limited by the small exposure range of the film [4]. Using wide-latitude film and performing the technique at a high kilovoltage are suitable to overcome this problem to a certain extent.
Digital systems provide a wide dynamic range, which is preferable in chest imaging. The first step in digital chest radiology was the use of storage phosphor plates, which provide images of equivalent quality compared with those of conventional screen-film systems [4, 5, 6]. However, a higher radiation dose is needed to achieve a similar contrast resolution [7]. The second step was to use the selenium-drum detector, which was shown to produce images superior to those obtained using conventional screen-film systems [8, 9, 10, 11, 12, 13] and the storage phosphor technique [14, 15], in the depiction of anatomic regions.
Recently, direct-readout radiography systems were developed. These systems are flat-panel X-ray detectors with either an integrated charge-coupled device or an integrated thin-film transistor (TFT) readout mechanism. Various types of TFT detectors have been studied [16, 17, 18]. All detectors are based on amorphous silicon TFT technologies, but each is combined with different types of converter arrays, which convert X-ray beams to electric charges directly or indirectly. Findings from a phantom study in chest imaging [19] and clinical studies in skeletal radiology 20, 21] have shown that this new electronically readable detector is promising.
In this study, the diagnostic performance of a digital large-area silicon flat-panel detector was compared with that of a conventional screen-film system in clinical chest imaging using abnormal findings documented by CT as the reference standard.
|
|
|---|
Digital Radiography
A new flat-panel detector system (CXDI-11; Canon, Tokyo, Japan) was used to perform the digital chest radiography with the patient in an erect position. The detector uses a TFT and a metal insulator semiconductor-type photoelectric converter fabricated together on a glass substrate. Both components are made from hydrogenated amorphous silicon. The sensor has 2688 x 2688 pixels, with each pixel being 160 µm. The active area is 43 x 43 cm (17 x 17 inches). The system uses a rare-earth scintillator (terbium-doped gadolinium dioxide sulfide) coupled to the array. X-ray beams are converted to visible light at the scintillator, and the visible light is detected by the metal insulator semiconductor-type photoelectric converter. The resultant signals are scanned by the TFTs. This type of detector is characterized by a high signal-to-noise ratio and provides a spatial resolution of 3.1 line pairs per millimeter; dynamic range is approximately four digits. Signals are digitized in a 12-bit format producing a 4096 gray-scale image. Within 3 sec a preview image is displayed on an operation panel to allow the technician to check that body-positioning is correct and exposure is adequate. Image data can be postprocessed, printed, or archived as digital information.
We used a standard X-ray tube (SRO 33/100; Philips, Hamburg, Germany) and a standard high-voltage generator (HFG 650 R; Communications and Power Industries, Ontario, Canada); the automatic exposure control was adjusted to a 400-speed class system requested by the German guidelines for diagnostic radiology. The system included a moving grid (40 lines per centimeter; ratio = 12). Exposure specifications were 125 kVp and a 200-cm film-focus distance. These specifications are concordant with the German guidelines for diagnostic radiology.
No individual postprocessing of the images was performed. To produce an overall appearance that was comparable with that of conventional radiographs, all data were processed with one defined parameter set that was adjusted during the installation phase of the system. This processing included a gray-scale look-up table, dynamic range compression, and adaptive unsharp masking for edge enhancement. Images were transferred to a laser imager (Ektascan 190 laser printer; Kodak, Stuttgart, Germany) to be printed on laser films (35 x 43 cm) (Ektascan EHN7; Kodak).
Conventional Radiography
Conventional examinations were performed using an automatic chest film changer (Thoramat; Siemens, Erlangen, Germany) combined with a latitude ultraviolet screen-film system (Ultravision L; Sterling, Bad Homburg, Germany); posteroanterior and lateral radiographs were obtained with the patient in an erect position. The spatial resolution that can be achieved with this technique is 5.6 line pairs per millimeter. Exposure specifications were set to be similar to those used to obtain the digital radiographs (e.g., 400-speed class, 125 kVp, and 200-cm film-focus distance), leading to comparable radiation doses for both methods. However, the exact entrance exposure for patients was not measured. A moving grid (40 lines per centimeter; ratio = 12) was used.
CT
Helical CT of the chest was performed (Somatom Plus; Siemens) with an 8-mm collimation, a table speed of 10 mm/sec, and 8-mm reconstruction intervals. Exposure parameters were 137 kVp and 145 mA with a 1-sec scan time. Sixty milliliters of IV nonionic contrast material (iopromide [Ultravist 300]; Schering, Berlin, Germany) was administered by power injection at a rate of 2 ml/sec. Images were reconstructed using a soft-tissue algorithm and were displayed at mediastinal window settings (width, 240 H; level, 60 H) and at lung window settings (width, 2000 H; level, -500 H).
Image Evaluation
The diagnoses that served as the reference standard were established by consensus of three radiologists who did not participate in the receiver operating characteristic (ROC) curve analysis. The consensus diagnoses were based on a review of CT scans and knowledge of each patient's history. The presence of abnormal findings was rated according to seven collective criteria (i.e., categories of abnormalities) and four single criteria (i.e., abnormalities rated additionally because of their special importance with regard to diagnostic or therapeutic consequences). The panel then checked image quality and confirmed consistent findings on digital and conventional radiographs to exclude possible changes between the two exposures.
The images were assessed for abnormalities (collective criteria), which were divided into categories. The category of pleural abnormalities (n = 38 [47.5%]) consisted of pleural effusion, pneumothorax, and pleural thickening. Pulmonary abnormalities (n = 51 [63.8%]) were defined as alveolar infiltration, atelectasis, interstitial disease, pulmonary masses and nodules, cavitation, bullae, and focal fibrosis. Mediastinal abnormalities (n = 33 [41.3%]) were defined as mediastinal masses, cardiomegaly, aortic aneurysm, and diaphragmatic hernia. Chest wall abnormalities (n = 16 [20.0%]) included rib fractures and evidence of mastectomy. Scoliosis, disk degeneration, osteophytes, and vertebral deformity were classified as spinal abnormalities (n = 53 [66.3%]). Catheter material and clips were classified as foreign bodies (n = 25 [31.3%]). Calcifications (n = 38 [47.5%]) could be noted as pleural calcification, vascular calcification, or other calcification.
From these categories, single criteria were extracted and rated additionally because of their special importance with regard to diagnostic or therapeutic consequences. These single criteria were pulmonary nodules (n = 21 [26.3%]), mediastinal masses (n = 19 [23.8%]), interstitial disease (n = 11 [13.8%]), and pleural effusion (n = 14 [17.5%]). Pulmonary nodules were measured and divided into the following subgroups according to their size: smaller than 1 cm (n = 12 [57.1%]), 1-2 cm (n = 6 [28.6%]), and greater than 2 cm (n = 3 [14.3%]). In three patients with multiple nodules of different sizes the smallest nodule was considered, so the numbers represent number of cases and not the number of nodules.
For the ROC analysis, further image evaluation using the same list of criteria was performed independently by four different board-certified radiologists. The radiologists were asked to determine whether each collective and single criterion was visible using the following five-level rating scale of confidence: definitely not present, 1; probably not present, 2; equivocal, 3; probably present, 4; or definitely present, 5. In addition, the observers noted the location of the lesion on a diagram of the lung. There were 80 digital and 80 conventional imagepairs, each consisting of posteroanterior and lateral radiographs. Digital and conventional image-pairs were given to the observers in randomized order to avoid bias in interpretation. The observers had to evaluate the digital and conventional examinations separately. Examinations of the same patient were viewed with a time interval of at least 6 weeks to minimize learning effects. Observers were not aware of the patient's history. Image evaluation was always performed under equal conditions such as room light or viewing boxes; interpretation time was unlimited. Digital and conventional images were not identified as such but could easily be recognized because of the specific properties of conventional and laser radiographs.
Data Analysis
ROC analysis was used to compare the performance of digital versus conventional radiography using the nonparametric method developed by deLong et al. [22]. This method takes into account that the empiric results for both radiographic techniques performed on the same individuals are correlated. All two-sided confidence intervals for the area under the ROC curves and for the difference between both areas are given at the 95% level. For the calculation, 1760 values per observer were needed (11 criteria x 80 patients x two methods). The computations and the plot were generated with a statistical analysis software (SAS; SAS Institute, Cary, NC).
|
|
|---|
|
ROC Analysis of Digital versus Conventional Radiography
The area under the ROC curve depends on the different criteria and ranges from 0.687 (mediastinal abnormalities, conventional method) to 0.953 (foreign bodies, digital method) (Table 2). No significant differences were found between the area under the ROC curve of the digital and conventional methods for almost all criteria considered. The single exception was the collective criterion mediastinal abnormalities, for which the digital method gave better results than the conventional method (p <<0.05) (Table 2 and Fig. 1). However, in all criteria except two (chest wall abnormalities and calcifications), the digital system performed equally to or slightly better than the conventional system without being statistically significant (Table 2).
|
|
Interobserver Variability for the ROC Analysis
Table 2 shows the differences of the areas under the ROC curves for all the observers. These differences of the area under the ROC curve of the digital radiography minus the corresponding area of the conventional radiography range from 0.064 (mediastinal abnormalities) to -0.023 (calcifications). Regarding these differences for each observer these quantities differ by less than 0.1 from the quantity which is calculated for all observers. Overall, no large differences among the ratings of the four observers were found. However, the observed area under the ROC curve for mediastinal abnormalities for the digital method was greater than the corresponding area for the conventional method for observer 1 (difference = 0.079), observer 2 (difference = 0.103), and observer 3 (difference = 0.091), whereas the opposite was true for observer 4 (difference = -0.025).
Detection of Pulmonary Nodules Categorized by Size
In 21 patients, pulmonary nodules were definitely detected on CT. Categorized by size, the nodules there were smaller than 1 cm in 12 of the 21 patients. On digital images, these nodules were detected by the four observers in 39 observations (probably present, n = 3; definitely present, n = 36). In nine observations, the nodules were missed and rated as definitely not present. On conventional images, the nodules were detected in 34 observations (probably present, n = 3; definitely present, n = 31). The nodules were missed in 12 observations (definitely not present, n = 9; probably not present, n = 3). Two observations were equivocal. The second subgroup consisted of six patients with nodules of between 1 and 2 cm. On digital images, the nodules were detected by the four observers in 22 observations (probably present, n = 1; definitely present, n = 21). In two observations, the nodules were missed and rated as definitely not present. On conventional images, the nodules were detected in 20 observations (probably present, n = 3; definitely present, n = 17). The nodules were missed in four observations (definitely not present, n = 3; probably not present, n = 1). The third subgroup consisted of three patients with nodules of greater than 2 cm. The nodules were detected by the four observers on all 12 digital observations (probably present, n = 1; definitely present, n = 11) and in all 12 conventional observations (definitely present, n = 12). No ROC analysis for these subgroups was performed because the subsamples were small, only 12, six, and three, respectively. However, the data indicate that both radiographic methods performed similarly for these 21 patients.
|
|
|---|
Which of these systems will become the preferred solution for the future remains unclear. However, image quality is substantially influenced by the type used. Physical indicators, such as the detective quantum efficiency, can describe the overall system performance, but there is no physical measurement that correlates perfectly with perceived diagnostic quality. MacMahon et al. [23] have already shown that a pixel size of 200 µm, leading to a lower spatial resolution than that of conventional screen-film systems, is sufficient for digital chest imaging. Finally, the ability of radiologists to detect lesions determines whether a new imaging technique is superior to existing systems. Therefore, observer studies with separate presentation of digital and conventional radiographs are the most conclusive methods [18]. ROC analysis clearly provides the best approach by which to measure image-based diagnostic performance studies [8, 13, 24].
To our knowledge, no other clinical study has dealt with the diagnostic performance of a flat-panel detector in chest radiography. A previous study performed in our department investigated the observer preference for the depiction of normal anatomic structures in a side-by-side view of conventional radiographs and digital flat-panel radiographs. The results showed an equal or higher score for most of the considered regions, but performance was worse for the hilum and aortopulmonary window in the lateral view (Hennings SP et al., presented at the European Congress of Radiology, March 1999).
Strotzer et al. [19] investigated the observer preference of another indirect-conversion flat-panel detector with a scintillator based on cesium iodide. In this phantom study of cases of simulated chest lesions, comparison of digital images with images from a screen-film system showed a statistically significant better result of the digital system for linear structures and micronodular lesions. Performance of pulmonary nodules and reticular patterns was the same. In skeletal radiology, the indirect-conversion detector [20] and the selenium-based direct-conversion detector [21] revealed an image quality equivalent or superior to that of screen-film radiographs at comparable doses.
In our study, more definite ratings for the conventional images occurred; this finding is probably associated with the fact that the observers were more accustomed to conventional images. Thus, the better performance of the digital images is more striking. The overestimation of calcifications in both digital and conventional images can be explained by projection effects of overlying structures.
One of the major advantages of the digital system is the wide dynamic range of the detector and the histogram equalization. These characteristics explain the improved contrast throughout the image and allow better visualization of low-contrast regions, such as the mediastinum. Clinical studies of diagnostic performance in digital radiology with CT serving as the gold standard for lesion detection only exist for the selenium-drum technique and the storage phosphor technique. No statistically significant difference was found for the diagnostic performance of the selenium-drum technique compared with that of a conventional chest system [8, 25]. Digital storage phosphor imaging was shown to be superior to conventional film radiography for CT-documented mediastinal lesions and pulmonary opacities of greater than 2 cm in diameter. For all other types of pulmonary lesions and pleural abnormalities, both systems were equivalent [26, 27].
In our study, no significant differences were found for the detection of CT-documented abnormalities in digital flat-panel radiography compared with that of conventional screen-film radiography for almost all criteria considered. We only found a significantly better result for the imaging of mediastinal abnormalities in digital radiography. However, the collective criterion mediastinal abnormalities contained mediastinal masses, cardiomegaly, aortic aneurysm, and diaphragmatic hernia. Referring to the more important single criterion, mediastinal masses, the difference in diagnostic performance was not statistically significant. Furthermore, observer 4 showed a smaller area under the ROC curve for the digital method than for the conventional method; however, overall we found no severe differences in diagnostic ability among the observers. Empirically for all criteria except two (chest wall abnormalities and calcifications), the digital system performed equally to or better than the conventional system.
Noting the distribution of the sizes of pulmonary nodules, in an attempt to describe different case difficulties, showed that digital and conventional imaging allowed similar diagnostic performance even for small pulmonary nodules. Thus, the lower spatial resolution had no impact on the diagnostic performance in our patients. This finding is consistent with the findings in the studies investigating the selenium-drum technique and the storage phosphor technique [8, 19, 25, 26].
In addition to various observer-preference studies with side-by-side comparison of radiographs in digital radiography, this CT-controlled study of diagnostic performance serves as a complement in imaging technique evaluation. Our results show an equal or better rate of detection of CT-documented abnormalities on digital radiographs relative to conventional radiographs. This study was designed as a comparison between a silicon flat-panel system and a conventional screen-film system; digital radiographs were intentionally obtained with an image appearance comparable with that of screen-film radiographs without a systematic study of the postprocessing. Other investigators have suggested that appropriate postprocessing could improve diagnostic performance because moderate edge enhancement at high spatial frequency would compensate for reduced spatial resolution that is limited by the pixel size of the detector [28, 29]. Nevertheless, individual postprocessing is time-consuming and not acceptable in daily practice. On the other hand, direct readout is timesaving; this advantage should be taken into account in systematic cost analysis, which is important when considering the introduction of new techniques. Immediately checking the patient's body position and the overall image quality reduces wait time and increases the patient's comfort. Integration of a new technique in picture archiving and communication systems will be an inevitable precondition [1]. Dose reduction is another promising advantage of this new flat-panel technology, which has also been shown for skeletal radiology and simulated chest lesions [19, 20]. Further investigations should prove this for clinical chest radiography.
We conclude that the diagnostic performance of the new large-area silicon flat-panel detector is equivalent or superior to that of the conventional screen-film system in clinical chest imaging and can replace conventional radiographic systems. This new technology offers the transmission and storage possibilities inherent to digital radiology, which could facilitate daily practice and reduce the initial high costs in the long-term.
Acknowledgments
We thank Mark Pattison for reviewing this manuscript and E. A. Hühn and the technicians in our department for their help.
|
|
|---|
This article has been cited by other articles:
![]() |
Y. Hatakeyama, S. Kakeda, N. Ohnari, J. Moriya, N. Oda, K. Nishino, W. Miyamoto, and Y. Korogi Reduction of Radiation Dose for Cerebral Angiography Using Flat Panel Detector of Direct Conversion Type: A Vascular Phantom Study AJNR Am. J. Neuroradiol., April 1, 2007; 28(4): 645 - 650. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. J. M. Kroft, W. J. H. Veldkamp, B. J. A. Mertens, J. P. A. van Delft, and J. Geleijns Detection of simulated nodules on clinical radiographs: dose reduction at digital posteroanterior chest radiography. Radiology, November 1, 2006; 241(2): 392 - 398. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Bacher, P. Smeets, L. Vereecken, A. De Hauwere, P. Duyck, R. De Man, K. Verstraete, and H. Thierens Image quality and radiation dose on digital chest imaging: comparison of amorphous silicon and amorphous selenium flat-panel systems. Am. J. Roentgenol., September 1, 2006; 187(3): 630 - 637. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. Neofotistou, V. Tsapaki, S. Kottou, A. Schreiner-Karoussou, and E. Vano Does digital imaging decrease patient dose? A pilot study and review of the literature Radiat Prot Dosimetry, December 1, 2005; 117(1-3): 204 - 210. [Abstract] [Full Text] [PDF] |
||||
![]() |
S Chapman Non-accidental injury Imaging, December 1, 2004; 16(2): 161 - 173. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. J. M. Kroft, J. Geleijns, B. J. A. Mertens, W. J. H. Veldkamp, H. M. Zonderland, and A. de Roos Digital Slot-Scan Charge-coupled Device Radiography versus AMBER and Bucky Screen-Film Radiography for Detection of Simulated Nodules and Interstitial Disease in a Chest Phantom Radiology, April 1, 2004; 231(1): 156 - 163. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Bacher, P. Smeets, K. Bonnarens, An De Hauwere, K. Verstraete, and H. Thierens Dose Reduction in Patients Undergoing Chest Imaging: Digital Amorphous Silicon Flat-Panel Detector Radiography Versus Conventional Film-Screen Radiography and Phosphor-Based Computed Radiography Am. J. Roentgenol., October 1, 2003; 181(4): 923 - 929. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Ludwig, K. Ahlers, D. Wormanns, M. Freund, T. M. Bernhardt, S. Diederich, and W. Heindel Lumbar Spine Radiography: Digital Flat-Panel Detector versus Screen-Film and Storage-Phosphor Systems in Monkeys as a Pediatric Model Radiology, October 1, 2003; 229(1): 140 - 144. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Ganten, B. Radeleff, A. Kampschulte, M. D. Daniels, G. W. Kauffmann, and J. Hansmann Comparing Image Quality of Flat-Panel Chest Radiography with Storage Phosphor Radiography and Film-Screen Radiography Am. J. Roentgenol., July 1, 2003; 181(1): 171 - 176. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Ludwig, C. Schulke, S. Diederich, D. Wormanns, H. Lenzen, T. M. Bernhardt, P. Brinckmann, and W. Heindel Detection of Subtle Undisplaced Rib Fractures in a Porcine Model: Radiation Dose Requirement--Digital Flat-Panel versus Screen-Film and Storage-Phosphor Systems Radiology, April 1, 2003; 227(1): 163 - 168. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Fink, P. J. Hallscheidt, G. Noeldge, A. Kampschulte, B. Radeleff, W. P. Hosch, G. W. Kauffmann, and J. Hansmann Clinical Comparative Study with a Large-Area Amorphous Silicon Flat-Panel Detector: Image Quality and Visibility of Anatomic Structures on Chest Radiography Am. J. Roentgenol., February 1, 2002; 178(2): 481 - 486. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Ludwig, H. Lenzen, K.-F. Kamm, T. M. Link, S. Diederich, D. Wormanns, and W. Heindel Performance of a Flat-Panel Detector in Detecting Artificial Bone Lesions: Comparison with Conventional Screen-Film and Storage-Phosphor Radiography Radiology, February 1, 2002; 222(2): 453 - 459. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |