AJR Women's Imaging Online
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kim, S. H.
Right arrow Articles by Choi, B. I.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kim, S. H.
Right arrow Articles by Choi, B. I.
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
DOI:10.2214/AJR.07.2072
AJR 2007; 189:41-51
© American Roentgen Ray Society


Original Research

Computer-Aided Detection of Colonic Polyps at CT Colonography Using a Hessian Matrix–Based Algorithm: Preliminary Study

Se Hyung Kim1, Jeong Min Lee1,2, Joon-Goo Lee3, Jong Hyo Kim1,2,3, Philippe A. Lefere4, Joon Koo Han1,2 and Byung Ihn Choi1,2

1 Department of Radiology, Seoul National University College of Medicine, 28, Yongon-dong, Chongno-gu, Seoul 110-744, Korea.
2 Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea.
3 Department of Medical Engineering, Seoul National University College of Medicine, Seoul, Korea.
4 Department of Radiology, Stedelijk Ziekenhuis, Roeselare, Belgium.

Received October 10, 2006; accepted after revision February 22, 2007.

 
Supported by grant 0412-MI00-0401-0007 from the Korea Health 21 R&D Project, Ministry of Health & Welfare, Republic of Korea. 110-744, Korea.

Address correspondence to J. M. Lee (leejm{at}radcom.snu.ac.kr).


Abstract
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
OBJECTIVE. The purpose of our study was to develop a Hessian matrix–based computer-aided detection (CAD) algorithm for polyp detection on CT colonography (CTC) and to analyze its performance in a high-risk population.

SUBJECTS AND METHODS. The CTC data sets of 35 patients with at least one colonoscopically proven polyp were interpreted with a Hessian matrix–based CAD algorithm, which was designed to depict bloblike structures protruding into the lumen. Our gold standard was a combination of segmental unblinded optical colonoscopy and retrospective unblinded consensus review by two radiologists. Sensitivity of CAD for polyp detection was evaluated on both per-polyp and per-patient bases. The average number of false-positive detections was calculated, and the causes of false-positives and false-negatives were analyzed.

RESULTS. Ninety-four polyps were identified on colonoscopy. Forty-six polyps were smaller than 6 mm and 48 were 6 mm or larger. Seventy-five (79.8%) of these 94 polyps were identified by radiologists in a retrospective review. When colonoscopy was used as a standard of reference, the sensitivity of CAD was 77.1% for polyps 6 mm or larger. For large polyps (≥ 6 mm) that could be identified on retrospective review, the CAD algorithm achieved sensitivities of 92.5% (37/40) and 91.7% (22/24), respectively, on per-polyp and per-patient bases. There were an average of 5.5 false-positive detections per patient and 3.1 false-positive detections per data set for CAD. The two most frequent causes of false-positives on CAD were prominent or converging fold (78/191) and feces (50/191). Of the three polyps 6 mm or larger that were missed by CAD, two had a flat appearance on colonoscopy and the remaining one was located in the narrow area between the rectal tube and the rectal wall.

CONCLUSION. A Hessian matrix–based CAD algorithm for CTC has the potential to depict polyps larger than or equal to 6 mm with high sensitivity and an acceptable false-positive rate.

Keywords: colon • computer-aided detection • CT • CT colonography • neoplasm • polyps


Introduction
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
Colorectal cancer accounts for approximately 945,000 new cases and 500,000 deaths worldwide each year [1]. However, good or fair evidence has accumulated that several screening methods, including fecal occult blood testing, are effective in reducing mortality from colorectal cancer; and the incidence of colorectal cancer can be reduced by colonoscopic polypectomy [24]. Considering that compliance and diagnostic performance are major factors in the evaluation of a screening strategy [5], CT colonography (CTC), a rapidly evolving, noninvasive technology for the detection of colonic polyps, has shown promising results for colorectal cancer screening [6, 7]. However, radiologists have encountered several obstacles in the clinical practicality of CTC. Among them are a long interpretation time for inexperienced reviewers and the high variability of diagnostic accuracy among reviewers due to the steep learning curve.

Computer-aided diagnosis (CAD) for CTC is attractive because it has the potential to circumvent these obstacles. Among the five typical tasks of the CAD system, the detection of polyp candidates requires an appropriate method to characterize these shape differences into polyps, folds, and the colonic wall. Several approaches have been proposed, including the use of the surface curvature with a rule-based filter, a volumetric shape index, and the extent of curvature [812]. And although each approach has been shown to be effective in detecting polyp candidates, one common problem with these approaches is that curvature-based polyp detection algorithms use only one or two parameters, thereby generating a myriad of false-positives. To overcome such shortcomings, new polyp detection algorithms using various parameters are being sought.


Figure 1
View larger version (17K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 1 Schematic diagram of our methods of detecting polyps in CT colonography.

 
Since Sato et al. [13] proposed the Hessian matrix method for the enhancement of curvilinear structures such as vessels in 3D imaging, the Hessian matrix–based algorithm has been considered to be a more sensitive method for classifying local shape features as a result of the use of three independent parameters. The Hessian matrix is the square matrix of second partial derivatives of a scalar-valued function. Calculation of the Hessian matrix on 3D CT data and Eigen decomposition of the matrix result in three Eigen values and vectors at each voxel. Using these Eigen values, it is possible to determine which type of intensity structure (blob, line, or sheetlike) a given voxel is. Blobs, lines, and sheetlike objects represent polyps, folds, and colonic wall, respectively, in the inner colonic structures. Indeed, the clinical feasibility of this method for the detection of lung nodules, especially for nonperfect spherical shapes—for example, cut spheres—was proven on CT lung CAD [14]. However, this algorithm has not yet been applied to the detection of colonic polyps in CTC.

Therefore, the purpose of this preliminary study was to apply a new Hessian matrix–based CAD algorithm to CTC images and to analyze its performance on the basis of the reference standard of combined colonoscopy and retrospective unblinded review of CTC by experienced radiologists.


Subjects and Methods
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
Patient Population
Patients were recruited in two ways. The first group (n = 24) was composed of patients who were known to have polyps as a result of recent flexible sigmoidoscopy (n = 16) or colonoscopy (n = 8). The purposes for initial sigmoidoscopy or colonoscopy were screening in 22 patients, abdominal discomfort in one, and a change of bowel habits in another. These patients were 19 men and five women with an age range of 41–78 years (mean age, 58.4 years). For the second group, we retrospectively collected the first 11 consecutive CT colonographic cases among 53 patients with at least one colonic polyp from a larger group of 200 asymptomatic patients who underwent CT colonographic examinations between August 2004 and February 2005. Seven men and four women with an age range of 47–72 years (mean age, 59 years) composed the second group. In total, 26 men and nine women with an age range of 41–78 years (mean age, 58.6 years) were enrolled in this study. In all 35 patients, same-day colonoscopy and subsequent polypectomy for all detected polyps were performed. This study was approved by the institutional review board of our hospital, and written informed consent was obtained from all patients.

CT Colonography and Colonoscopy
CTC was performed using either of two MDCT scanners (LightSpeed Ultra, GE Healthcare [n = 24]; or Sensation 16, Siemens Medical Solutions [n = 11]). In all patients, colonic cleansing was performed with the oral administration of 4 L of polyethylene glycol solution. All subjects underwent CTC and successive same-day conventional colonoscopy within a 4-hour interval. No spasmolytic agent was administered. For air insufflations, the colon was gently insufflated with room air to maximum patient tolerance using a mechanical inflator (Enema Teleflator CK-85, Kaigen), which is usually used for double-contrast barium enemas, not for CTC examinations.

The scanning parameters used for the 8- and 16-MDCT scanners were 8 x 1.25 and 16 x 0.75 mm detector configuration, 1.5- and 1-mm slice thickness, 13.5 and 12 mm/s table feed, 0.8- and 0.5-second rotation time, respectively. Other parameters were 1-mm reconstruction interval, 512 x 512 matrix, 120 kVp, and 150 mAs for the prone and supine positions. The average scanning time to cover the entire colon was 15–18 seconds for each position. For the second group (n = 11), supine images were acquired after the IV administration of 150 mL of iopromide at a rate of 3 mL/s after a 70-second delay. Contrast enhancement was performed to evaluate the extracolonic findings.

In all patients of the second group, conscious sedation was induced by IV sedatives (midazolam) during colonoscopy. Although all our practitioners would have liked to give midazolam liberally to all patients for colonoscopy, because of a lack of personnel and necessary resources only the second group received the sedative. All colonoscopic examinations were performed by one of five board-certified gastroenterologists using the segmental unblinding technique [6]. Polyp size was estimated by direct in vivo comparison with a 10-mm-long biopsy forceps along the axis of the base or head of the polyp, excluding the stalk if present. Flat lesions were defined as mucosal elevations with a height less than half the lesion diameter [15]. Except for some larger lesions, these flat polyps generally measure 3 mm or less in height. A histologic examination was performed on all lesions by one pathologist.

Overall Computer-Aided Polyp Detection Scheme
We transferred the CTC images to a PC and analyzed the images using the prototype CAD scheme developed in our laboratory (Fig. 1). The CT images were interpolated along the transverse direction with a linear interpolation to yield an isotropic volume data set (0.6 x 0.6 x 0.6 cm). Before the detection of polyp candidates, colonic segmentation was done using the seeded region-growing and isosurface-generation methods. A region-growing threshold (–475 H) for seeding the colonic lumen and a threshold (–800 H) for generating the isosurface were chosen. In region growing, a seed point in the colonic lumen is manually selected, then all voxels connected to the seed that have intensities less than a specified threshold are identified by the computer. The surface of the lumen was then generated. The surface of the colon was dilated and eroded by five voxels, and two images were subtracted to extract a colonic wall of 10-voxel thickness. Then we used a 3D shape-based filtering method based on the gradient vector and Hessian matrix of volume intensity function to classify each structure into a polyp, fold, or colonic wall, as suggested by Sato et al. [13, 16].


Figure 2
View larger version (11K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 2 Schematic diagrams of measures of similarity to local structures and basic conditions of these local structures. For line structure, Eigen values {lambda}2 and {lambda}3 along directions of greater gray-level changes are larger than Eigen value {lambda}1, which corresponds to direction e1 of smaller gray-level change ({approx} 0). For blob that represents polyp in colon, change of gray level is large in all three directions of blob. For sheetlike structure, Eigen value {lambda}3 along direction of greater gray-level change is larger than Eigen values {lambda}1 and {lambda}2, which correspond to directions e1 and e2 of smaller gray-level change ({approx} 0).

 
Before applying the Hessian matrix decomposition to the CTC data set, gaussian blurring had to be done to enhance specific 3D local intensity structures. However, if a large gaussian smoothing factor is applied, the distinction between polyps, folds, and the colonic wall becomes weakened. In addition, to further enhance detectability of polyp candidates, the shape threshold also had to be determined. The diagnostic performance of a CAD scheme is represented by both sensitivity and the number of false-positives. There is an inherent trade-off between the two. Therefore, if a low gaussian smoothing factor and shape threshold are applied to yield a high true-positive rate (i.e., high sensitivity), a high false-positive rate (i.e., low specificity) often results.

Because we did not know the optimal setting in terms of gaussian smoothing factor and shape threshold, we investigated a variety of combinations using the two parameters. We designed three combinations that used the values of gaussian smoothing factor and shape threshold from low to high: gaussian smoothing factor and shape threshold of 1.5 (low) and 2.5 (low), of 1.5 (low) and 4.0 (intermediate), and of 2.0 (high) and 5.0 (high), respectively. We referred to these combinations as settings 1, 2, and 3, respectively. The three combinations were then analyzed using CTC data sets of 15 patients randomly selected from the 35 patients. A polyp was considered to be detected by the computer algorithm when one or more voxels considered to be a polyp candidate by CAD were in a polyp on CTC that matched the colonoscopy report.

To make this assessment, two radiologists evaluated the transverse and endoluminal 3D images. The sensitivity and total number of false-positive detections for each setting were determined for all 15 studies and compared using Fisher's exact test and the Friedman test. On the basis of these results, the optimum setting was identified. The optimal setting, as compared with the other settings, had both a high sensitivity and a low mean number of false-positives per patients.

Hessian matrix is the square matrix of second partial derivatives of a scalar-valued function and is well known for object recognition in computer vision and medical shape analysis. The details of the Hessian matrix–based method are presented in Appendix 1 and illustrated in Figure 2. All processes were performed automatically without human intervention.

Evaluation of CAD Results
The colon was divided into six segments: the cecum, ascending colon, transverse colon, descending colon, sigmoid colon, and the rectum. For evaluating CAD performance, we used two standards of reference: colonoscopic results and results of retrospective and unblinded review. To establish the ground truth, two radiologists (each with previous experience of 300 CTC examinations) who were not blinded to the colonoscopic results, retrospectively reviewed CTC images in a consensus manner. Lesions identified by the radiologists were matched with the findings at colonoscopy on the basis of the colonoscopic findings and the video registration. A polyp identified on CTC was considered a true-positive if it matched the findings on colonoscopy on the basis of colonic segment, size, shape, and anatomic interrelation to haustral folds. For a given lesion to be considered a true-positive between CTC and colonoscopy, it had to be in the same or an adjacent colonic segment, the two recorded sizes had to be the same within a 30% margin of error, and the lesion had to have similar morphologic features on both examinations. In addition, the relationship of a lesion to thick colonic folds—that is, polyp on a fold versus polyp between folds—was also considered to determine a true-positive match.

Sensitivity for polyp detection was computed as a function of polyp size and on per-polyp and per-patient bases. We computed sensitivity for polyp detection in two ways: first, by using the number of true-positive polyp detections that were made by the final results of colonoscopy after segmental unblinding to the CTC reports; and second, by using the number of true-positive detections made by the results of a retrospective and consensus review by two radiologists. The latter is especially useful for distinguishing the performance of CAD from the shortcomings of the CTC technique itself. For the latter, to avoid bias we did not use CAD to help locate the polyps not identified by radiologists. Instead, the radiologists reviewed the CTC images to define the causes of these 19 polyps that were not identified with even a retrospective analysis. Lesions were categorized by size on the basis of the colonoscopic results. Because we included only patients with at least one colonoscopically proven polyp, per-patient specificity was not calculated.

We reported the average number of false-positive detections for CAD rather than specificity. As is typical for other types of CAD used in radiology, CAD for colonic polyps usually resulted in one or more false-positive detections for each CTC examination (i.e., specificity approached 0).

In this study, two methods were used to calculate sensitivity and the average number of false-positive findings: first, evaluation based on volumetric data sets (by data set evaluation), and second, evaluation based on patients or cases (by patient evaluation). With both methods, the CAD scheme processed the supine and prone volumetric data sets independently to yield possible polyps. With the first method, supine and prone views of a patient were considered as different data sets, and the sensitivity per data set and the average number of false-positive findings per data set were calculated. With the second method, a polyp was recognized if it was detected on either the supine or the prone view of a patient, and the average number of false-positive findings per patient was calculated.

All the lesions depicted with CTC by CAD that were not seen at colonoscopy or did not match a colonoscopic finding were considered false-positive findings. All individual false-positives were carefully matched between data sets. The radiologists also inspected the cause of these false-positive findings in consensus using multiplanar reformatted views with reference to colonoscopic findings. Lesions that were missed on the CTC images by CAD were also reassessed retrospectively by the same two radiologists who had knowledge of the colonoscopic findings. A consensus judgment was made as to the cause of the false-negative results. Both the supine and prone views were used as needed during the retrospective interpretation.


Results
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
Colonoscopic and Histopathologic Findings
A total of 94 polyps (17 flat, 65 sessile, and 12 pedunculated) ranging from 2 to 70 mm were identified on colonoscopy. The distribution of the lesions in the various anatomic segments of the colon according to polyp histology, size, and morphology is summarized in Table 1. There were 46 polyps 5 mm or smaller, 28 of 6–9 mm, and 20 of 10 mm or larger. Approximately half the lesions (44/94, 46.8%) were located in the sigmoid colon. There were three advanced adenomas, of which two were tubulovillous adenomas of 7 and 13 mm and one was a villous adenoma of 15 mm. All six cancers were detected.


View this table:
[in this window]
[in a new window]

 
TABLE 1: Distribution of Polyps According to Size and Histology

 

In 15 patients who were used to find the optimal combination of the gaussian smoothing factor and shape threshold settings, a total of 26 polyps in 11 patients were identified at colonoscopy. Seventeen polyps were 5 mm or smaller in size, seven were 6–9 mm, and two were 10 mm or larger. Among them, five polyps of 5 mm or smaller were not identified in a retrospective review.

In 30 patients, thirty-five (76.1%) of 46 small polyps (≤ 5 mm), 21 (75%) of 28 intermediate polyps (6–9 mm), and 19 (95%) of 20 large polyps (≥ 10 mm) were identified on the CTC images by two radiologists who were not blinded to the results of colonoscopy. Thus, these sensitivities were defined as the maximum possible sensitivities for the CAD algorithm. For the 19 polyps that were not identified even with a retrospective analysis, their sizes ranged from 2 to 10 mm. Six were flat, 12 sessile, and one pedunculated. Ten were adenomatous and nine were non-adenomatous polyps. Potential causes for the false-negative diagnoses include that two polyps (10 and 8 mm) were located in collapsed segments, one (7 mm, pedunculated) was buried in fluid or stool, and one (7 mm) was obscured by the rectal balloon. No cause could be identified for the remaining 15 false-negative diagnoses (three 7-mm, one 6-mm, and 12 < 5-mm polyps).

Diagnostic Performance of CAD on CTC
For 15 patients, the sensitivity and mean number of false-positives in the three combinations of gaussian smoothing factor and shape threshold are described in Table 2. Setting 1 had the highest sensitivity (42.9%) for all polyps and setting 3 had the lowest sensitivity (23.8%). However, the differences of sensitivity among the three settings were not statistically significant for all sizes. The average number of false-positives was 14 in setting 1, 6.4 in setting 2, and 5.8 in setting 3. Even though per-polyp sensitivity was highest in setting 1, the average number of false-positives was unacceptably large (14 per patient). On the contrary, because the per-polyp sensitivity of setting 2 for large polyps (≥ 6 mm) was the same as for setting 1 and the number of false-positives (6.4 per patient) was significantly smaller than that of setting 1, we determined that the optimal setting was setting 2, which was used for further analysis of CAD performance for the testing set.


View this table:
[in this window]
[in a new window]

 
TABLE 2: Per-Polyp Sensitivities and Number of False-Positives of Three Settings for Polyp Detection

 

Table 3 shows the numbers of true-positives and the sensitivities of CAD according to the size category for the analysis on per-polyp basis. On the basis of the colonoscopic results, the CAD algorithm using both supine and prone CTC data sets detected six small polyps (≤ 5 mm), 19 intermediate polyps (6–9 mm), and 18 large polyps (≥ 10 mm), for sensitivities of 13%, 67.9%, and 90%, respectively, and an overall sensitivity of 45.7%. The sensitivity of CAD for 48 polyps 6 mm or larger was 77.1% (37/48). When we used a combination of colonoscopy and retrospective review as the reference standard, per-polyp sensitivities increased to 17.1% for small polyps, 90.5% for intermediate polyps, and 94.7% for large polyps. For the 40 polyps 6 mm or larger detected on retrospective unblinded review by two radiologists, the CAD algorithm achieved a sensitivity of 92.5% (37/40). Therefore, the overall potential sensitivity of CAD and secondary interpretation by radiologists for polyps 6 mm or larger would be 83.3% (40/48). Of 43 polyps detected with CAD, eight were detected solely on supine CTC images; 12, solely on prone CTC images; and 23, on both supine and prone CTC images. All six cancers were detected by CAD, of which five were detected on both supine and prone CTC images and one was detected on only the prone images. Example CTC images of 20-, 9-, and 6-mm polyps detected by CAD are shown in Figures 3A, 3B, 3C, 4A, 4B, 4C, 5A, and 5B.


View this table:
[in this window]
[in a new window]

 
TABLE 3: Sensitivities for Polyp Detection by Computer-Aided Detection (CAD) Algorithm on a Per-Polyp Basis

 

Figure 3
View larger version (63K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 3A 45-year-old woman with 6-mm hyperplastic polyp in rectum. On CT colonographic images in supine (A) and prone (B) views, part of polyp (arrow) is colored red and detected with computer-aided detection scheme on both supine and prone data sets. Note endoluminal appearance of polyp on each data set (right lower corner).

 

Figure 4
View larger version (67K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 3B 45-year-old woman with 6-mm hyperplastic polyp in rectum. On CT colonographic images in supine (A) and prone (B) views, part of polyp (arrow) is colored red and detected with computer-aided detection scheme on both supine and prone data sets. Note endoluminal appearance of polyp on each data set (right lower corner).

 

Figure 5
View larger version (125K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 3C 45-year-old woman with 6-mm hyperplastic polyp in rectum. Colonoscopic image shows a sessile polyp.

 

Figure 6
View larger version (72K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 4A 41-year-old man with 20-mm pedunculated polyp in sigmoid colon. On axial and corresponding 3D endoluminal (right lower corner) CT colonographic images in supine view, color coding is based on shape likelihood, in which polyps, folds, and colonic wall are shown in red, blue, and green, respectively. As a result, polyp is clearly differentiated from folds and colonic wall. Pedunculated polyp is represented by red and is detected as a polyp candidate (arrow) by computer-aided detection (CAD).

 

Figure 7
View larger version (66K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 4B 41-year-old man with 20-mm pedunculated polyp in sigmoid colon. On axial and corresponding 3D endoluminal (right lower corner) CT colonographic images in prone view, head of pedunculated polyp is submerged in residual fluid and only part of stalk (arrow) of polyp is visualized. Therefore, polyp cannot be identified by CAD algorithm.

 

Figure 8
View larger version (105K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 4C 41-year-old man with 20-mm pedunculated polyp in sigmoid colon. Colonoscopic image shows adenomatous polyp (arrow) having a long stalk (asterisk).

 

Figure 9
View larger version (65K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 5A 71-year-old man with 9-mm sessile polyp in ascending colon. On axial and corresponding 3D endoluminal (right lower corner) CT colonographic images in supine view, polyp (arrow) looks smaller than expected and appears to be flat. On this view, polyp does not contain adequate voxels with high likelihood of being a blob, making it not detectable by computer-aided detection (CAD) algorithm.

 

Figure 10
View larger version (71K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 5B 71-year-old man with 9-mm sessile polyp in ascending colon. On axial and corresponding 3D endoluminal (right lower corner) CT colonographic images in prone view, polyp (arrow) appears rounder and larger than its supine counterpart, so it was identified by CAD algorithm. Colonoscopic biopsy confirmed an adenomatous polyp (not shown).

 

Table 4 shows the results on a per-patient basis. Based on colonoscopic findings, per-patient sensitivity of CTC for polyps measuring 6 mm or more in diameter was 88% (22/25). For 24 patients having polyps 6 mm or larger detected on retrospective unblinded review, the sensitivity exceeded 91% (22/24).


View this table:
[in this window]
[in a new window]

 
TABLE 4: Sensitivities for Polyp Detection by Computer-Aided Detection Algorithm on a Per-Patient Basis

 

Analysis of False-Negative and False-Positive Findings
Although both supine and prone CTC images were analyzed, a total of 51 polyps were missed by CAD: 25 adenomatous, 13 hyperplastic, and 13 inflammatory polyps. At a retrospective review of the CAD results, 19 missed lesions were not identified by two radiologists: seven adenomatous, 10 hyperplastic, and two inflammatory polyps. Only three of the remaining 32 missed lesions were larger than 5 mm. The three retrospectively identifiable polyps that were missed by CAD were all adenomatous polyps. Two of the three polyps, 8 and 10 mm, were located in the sigmoid colon and had a flat appearance on colonoscopy (Figs. 6A, 6B, 6C, and 6D). The remaining polyp was located in the far distal rectum and was collapsed between the rectal wall and rectal tube, resulting in its manifestation as a flat lesion even though the original shape of the lesion was pedunculated (Figs. 6A, 6B, 6C, and 6D).


Figure 11
View larger version (74K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 6A Examples of false-negative lesions by computer-aided detection (CAD). A 10-mm flat adenomatous polyp in sigmoid colon was missed by CAD. Axial 3D endoluminal (right lower corner) CT colonography images (supine, A; prone, B) show polyp (arrow) that is not tagged with red.

 

Figure 12
View larger version (69K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 6B Examples of false-negative lesions by computer-aided detection (CAD). A 10-mm flat adenomatous polyp in sigmoid colon was missed by CAD. Axial 3D endoluminal (right lower corner) CT colonography images (supine, A; prone, B) show polyp (arrow) that is not tagged with red.

 

Figure 13
View larger version (104K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 6C Examples of false-negative lesions by computer-aided detection (CAD). Colonoscopic image of polyp reveals flat nature of lesion.

 

Figure 14
View larger version (78K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 6D Examples of false-negative lesions by computer-aided detection (CAD). Note 7-mm pedunculated polyp in distal rectum. On axial 3D endoluminal (right lower corner) CT colonography image of prone view, polyp (arrow) was not identified by CAD algorithm. Polyp is located in narrow space where rectal wall and rectal tube are attached, so shape of polyp is seen as flat even though original shape of lesion is pedunculated. Colonoscopic biopsy confirmed adenomatous polyp (not shown).

 
A total of 191 false-positive findings on two CTC data sets were detected; the average number of false-positive findings per patient was 5.5. The false-positive findings according to the types and patients' positions are listed in Table 5. The types of false-positive findings detected on CAD were similar to common perception errors made by radiologists (Figs. 7A, 7B, 7C, 7D, and 7E). However, most of these false-positive findings could be easily distinguished from true polyps by experienced radiologists. False-positive findings caused by folds composed 43.4% of all false-positive findings in our algorithm. Of the 191 false-positive findings detected with CAD, 90 were detected on supine CTC images only; 72, on prone CTC images only; and 29, on both supine and prone CTC images. The distribution of the causes of false-positives was significantly different between the supine and prone CTC images (p = 0.007, Fisher's exact test).


View this table:
[in this window]
[in a new window]

 
TABLE 5: Types of False-Positive Findings Generated with Computer-Aided Detection Algorithm

 

Figure 15
View larger version (69K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 7A Examples of false-positive lesions by computer-aided detection (CAD). Axial and corresponding 3D endoluminal (lower corner) CT colonographic images of false-positive findings by computer-aided detection (CAD). Feces (arrow, A) and prominent or converging folds (arrow, B) tend to be major causes of false-positive findings, followed by residual fluid (arrow, C), ileocecal valve (arrow, D), and rectal tube (arrow, E). These lesions appear as blobs and were thus incorrectly identified by CAD as polyp. Various false-positive lesions are colored red, which indicates false-positive findings by CAD.

 

Figure 16
View larger version (71K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 7B Examples of false-positive lesions by computer-aided detection (CAD). Axial and corresponding 3D endoluminal (lower corner) CT colonographic images of false-positive findings by computer-aided detection (CAD). Feces (arrow, A) and prominent or converging folds (arrow, B) tend to be major causes of false-positive findings, followed by residual fluid (arrow, C), ileocecal valve (arrow, D), and rectal tube (arrow, E). These lesions appear as blobs and were thus incorrectly identified by CAD as polyp. Various false-positive lesions are colored red, which indicates false-positive findings by CAD.

 

Figure 17
View larger version (71K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 7C Examples of false-positive lesions by computer-aided detection (CAD). Axial and corresponding 3D endoluminal (lower corner) CT colonographic images of false-positive findings by computer-aided detection (CAD). Feces (arrow, A) and prominent or converging folds (arrow, B) tend to be major causes of false-positive findings, followed by residual fluid (arrow, C), ileocecal valve (arrow, D), and rectal tube (arrow, E). These lesions appear as blobs and were thus incorrectly identified by CAD as polyp. Various false-positive lesions are colored red, which indicates false-positive findings by CAD.

 

Figure 18
View larger version (71K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 7D Examples of false-positive lesions by computer-aided detection (CAD). Axial and corresponding 3D endoluminal (lower corner) CT colonographic images of false-positive findings by computer-aided detection (CAD). Feces (arrow, A) and prominent or converging folds (arrow, B) tend to be major causes of false-positive findings, followed by residual fluid (arrow, C), ileocecal valve (arrow, D), and rectal tube (arrow, E). These lesions appear as blobs and were thus incorrectly identified by CAD as polyp. Various false-positive lesions are colored red, which indicates false-positive findings by CAD.

 

Figure 19
View larger version (67K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Fig. 7E Examples of false-positive lesions by computer-aided detection (CAD). Axial and corresponding 3D endoluminal (lower corner) CT colonographic images of false-positive findings by computer-aided detection (CAD). Feces (arrow, A) and prominent or converging folds (arrow, B) tend to be major causes of false-positive findings, followed by residual fluid (arrow, C), ileocecal valve (arrow, D), and rectal tube (arrow, E). These lesions appear as blobs and were thus incorrectly identified by CAD as polyp. Various false-positive lesions are colored red, which indicates false-positive findings by CAD.

 


Discussion
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
In the past several years, technical developments have advanced CAD substantially, and a fundamental scheme of CAD for CTC in the detection of polyps has been established. Along the way, various CAD schemes that have been potentially useful in the automated detection of colonic polyps have been proposed [8, 9, 1719]. However, the most recent CAD systems based on these schemes produced a wide range of results regarding per-patient sensitivity (70–100% for polyps ≥ 6 mm) and false-positive rate (2–8 lesions per patient) in the detection of polyps at CTC in patients with known polyps [812, 1822]. These data are clearly an indication that CAD for CTC needs further improvement.

In our study, the Hessian matrix–based CAD algorithm provided diagnostic performance comparable to previously developed CAD schemes. More specifically, its per-polyp (92.5%) and per-patient (91.7%) sensitivities for large polyps (≥ 6 mm) were in the high range compared with values in the published literature [812, 1822]. However, although there is always a trade-off between sensitivity and the false-positive rate in assessing the diagnostic performance of any CAD scheme, our prototype CAD algorithm, for which we did not apply any method to reduce the number of false-positives, showed a high rate of sensitivity for large polyps (≥ 6 mm) while maintaining a low false-positive rate (3.1 per data set). The results of our study can be attributed mainly to the following reason: Compared with other detection algorithms in which only one or two shape parameters are used, the Hessian matrix–based algorithm uses three morphologic structures (line, sheet, and blob) calculated from each voxel on 3D CTC images providing a detailed morphologic description of the candidate surface.

The low gaussian smoothing factor and intermediate shape threshold we applied can also explain such positive results. Before applying the Hessian matrix decomposition to the CTC data set, gaussian blurring should be performed to enhance specific 3D local-intensity structures followed by the application of a shape threshold to further enhance detection capability for blobs (polypoid lesions) versus lines (folds in the colon) or sheetlike structures (colonic wall). The larger the applied gaussian smoothing factor is, the blurrier the colonic wall becomes. This means that the distinction between polyps, folds, and the colonic wall becomes weaker as a larger gaussian smoothing factor is applied to the images. This assumption was also proven in our study. Therefore, when we applied a low gaussian smoothing factor to yield a high true-positive rate (i.e., high sensitivity), the result was a higher false-positive rate (i.e., lower specificity) than we would have ideally wanted. However, we believed that an intermediate shape threshold somewhat compensated for the shortcomings of the low gaussian smoothing factor setting. Similar to the curvature used by Yoshida et al. [9] and Yoshida and Dachman [17], choosing a very high or very low shape threshold can lead to an increase in the number of false-positives, such as folds with high curvature and a colonic wall with low curvature. Even though the false-positive rate (3.1 per data set) of our study is in an acceptable range, there is room for further improvement, especially considering that we omitted false-positive reduction, which is usually performed as the last step of CTC CAD.

When applied to both supine and prone data sets, 11 of 48 large polyps (≥ 6 mm) were missed by CAD. However, only three of the 11 polyps could be identified in a retrospective review by two radiologists. Two had a flat appearance on colonoscopy, and the remaining polyp appeared as a flat lesion on CTC although the original shape of the lesion was pedunculated. Our result of poor CAD performance for flat polyps corresponds to that of previous studies [22]. A lower sensitivity of the colonic CAD system for flat polyps is well recognized. Indeed, in a recent study regarding CTC CAD in a screening population, zero of five flat adenomatous polyps 6 mm or larger were detected by CAD, whereas 48.5% of sessile polyps and 70.6% of pedunculated polyps of the same size were detected by CAD [22]. The difference in sensitivity as a function of shape was significant in that study. Such limitations of CTC for the detection of flat polyps are also the case with human reviewers as with CAD [23].

The false-positive findings of our CAD system are mostly similar to those of other previously developed CAD algorithms [9, 24]. Most (139/191, 72.8%) false-positive detections in our study were caused by folds or retained feces. However, interestingly, 11% of the false-positive findings of our CAD scheme were caused by residual fluid in the colon. This rather high rate of false-positives caused by residual fluid can be explained by our use of wet preparation. Although wet preparation has the advantage of less feces in comparison with dry preparation, it retains a larger amount of fluid that shifts from side to side during the movement of the CT table, especially when the pitch parameter is high. Consequently, these gentle but perceptible waves simulate a blob, which is then identified by the CAD algorithm as a polyp. As a whole, we found that most false-positives can easily be identified as normal structures such as a colonic fold, fluid, or ileocecal valve. According to a recent article by Summers et al. [22], only a few (0.9%) of the false-positive CAD findings coincided with radiologists' false-positive findings. This suggests that most of the false-positive CAD findings would be determined by the radiologist to be unlikely to represent true polyps. Furthermore, preliminary evidence indicates that CAD's false-positives do not significantly impair radiologists' specificity even when almost 30 false-positives per patient are shown [25].

Our study has several limitations. First, we collected only a small number of polyps for this preliminary study; therefore, we are limited in making generalizations about the detection performance of our prototype CAD scheme. Evaluation of a larger number of polyps is desirable so that we may obtain a statistically solid performance measurement.

Second, we focused our CAD scheme only on the detection of polyp candidates, not on their characterization. The acronym "CAD" has been used to represent both computer-aided detection and computer-aided diagnosis. Initially, these might be considered identical, but an important difference exists when considering the number of blobs mimicking true polyps in the colon. Although our data show that it is possible to develop a CAD prototype that has a sensitivity comparable to those of radiologists and previously developed CAD algorithms with an acceptable number of false-positive detections, applying the final step of the CAD scheme—that is, false-positive reduction—to our prototype will be necessary to further decrease the number of false-positive detections.

Third, we used the same data set for both training and testing our CAD algorithm. This limitation is also related to the small number of cases. Although the validity of training and testing using the same data set, also known as cross-validation, is widely accepted in the medical and medical engineering fields, it could inflate the performance of CAD on the test set [26]. Accordingly, further prospective studies with a larger number of cases allowing adequate training and independent testing (external validation) are needed to better assess the performance of our CAD algorithm for detecting colonic polyps. If such a study produces encouraging results, the possibility of applying this method to clinical practice should be explored.

Finally, we performed this study to evaluate the feasibility of our CAD algorithm in detecting polyp candidates and to understand the types of false-positive findings generated using the Hessian matrix–based algorithm, and not to evaluate the benefit of our CAD scheme as a second opinion provider. To estimate the improvement of radiologists' detection based on our prototype CAD, an observer study using ROC analysis for radiologists of variable expertise with CTC should be conducted [27].

In conclusion, a Hessian matrix–based CAD algorithm for CTC has the potential to depict polyps larger than or equal to 6 mm with high sensitivity and an acceptable false-positive rate. Additional studies using a full CAD scheme that includes the final step of CAD—false-positive reduction—are needed to further minimize the number of false-positive detections.


APPENDIX 1: The Hessian Matrix–Based Method
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 
The CT value in a 3D CT colonoscopy (CTC) image is considered to be a 3D function I(x, y, z). The Eigen value and the Eigen vector of the Hessian matrix at each point of the image are used. The Hessian matrix denoted as H is a matrix with the second-order derivatives in the respective directions as its elements:

Formula(1)
where partial second derivatives of image I(x, y, z) are represented as Ixx, Iyz, and so on. After building the Hessian matrix H, the filters decompose it into three Eigen values (i.e., {lambda}1, {lambda}2, and {lambda}3) and three Eigen vectors of each pixel. When an object in the 3D image is approximated by a quadratic function, its shape is characterized in terms of the Eigen values of the Hessian matrix.

Eigen values and vectors were applied to basic conditions for each local structure (i.e., sheet, line, blob) and representative anatomic structures (i.e., colonic wall, fold, and polyp, respectively) to determine the likelihood of each shape. Figure 2 shows the Eigen values and Eigen vectors of each structure in 3D space. The lengths of the arrows in the figure indicate the magnitudes of the Eigen values. Figure 2 also shows schematic diagrams measuring similarity to local structures and the basic conditions of these local structures. Thus, in the line structure in general, the change of the gray level is large in the cross section and small along the direction of the line.

Sato et al. [13] proposed a line emphasis filter, based on the above shape characterization, using the Eigen values of the Hessian matrix. The Eigen values of the Hessian matrix are the second-order derivatives of the change of the gray level along the direction of the Eigen vectors. Letting the calculated Eigen values be |{lambda}1| ≤ |{lambda}2| ≤ |{lambda}3|, the Eigen values {lambda}2 and {lambda}3, which correspond to e2 and e3 along the directions of the greater gray-level changes, are larger than Eigen value {lambda}1, which corresponds to the direction e1 of smaller gray-level change. Consequently, the following relationship applies to the interior of the line structure:

Formula(2)
For the blob structure, which represents a polyp in the colon, the change of the gray level is large in all three directions of the blob. Therefore, the Eigen value condition will show this relation:

Formula(3)
Finally, different colors were assigned to each structure to facilitate the classification of the three structures (colon wall, green; fold, blue; and polyp, red).


References
Top
Abstract
Introduction
Subjects and Methods
Results
Discussion
APPENDIX 1: The Hessian...
References
 

  1. Sidney J, Winawer MD. Screening of colorectal cancer. Surg Oncol Clin N Am 2005;14 : 699-722[CrossRef][Medline]
  2. [no authors indicated] Screening for colorectal cancer: recommendation and rationale. Ann Intern Med2002; 137:129 -131[Abstract/Free Full Text]
  3. Winawer S, Fletcher R, Rex D, et al. Colorectal cancer screening and surveillance: clinical guidelines and rationale—update based on new evidence. Gastroenterology 2003;124 : 544-560[CrossRef][Medline]
  4. Winawer SJ, Zauber AG, Ho MN, et al. Prevention of colorectal cancer by colonoscopic polypectomy. The National Polyp Study Workgroup. N Engl J Med 1993;329 : 1977-1981[Abstract/Free Full Text]
  5. Frazier AL, Colditz GA, Fuchs CS, Kuntz KM. Cost-effectiveness of screening for colorectal cancer in the general population. JAMA 2000; 284:1954 -1961[Abstract/Free Full Text]
  6. Pickhardt PJ, Choi JR, Hwang I, et al. Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 2003;349 : 2191-2200[Abstract/Free Full Text]
  7. Svensson MH, Svensson E, Lasson A, Hellstrom M. Patient acceptance of CT colonography and conventional colonoscopy: prospective comparative study in patients with or suspected of having colorectal disease. Radiology 2002;222 : 337-345[Abstract/Free Full Text]
  8. Summers RM, Beaulieu CF, Pusanik LM, et al. Automated polyp detector for CT colonography: feasibility study. Radiology 2000;216 : 284-290[Abstract/Free Full Text]
  9. Yoshida H, Masutani Y, MacEneaney P, Rubin DT, Dachman AH. Computerized detection of colonic polyps at CT colonography on the basis of volumetric features: pilot study. Radiology2002; 222:327 -336[Abstract/Free Full Text]
  10. Paik DS, Beaulieu CF, Rubin GD, et al. Surface normal overlap: a computer-aided detection algorithm with application to colonic polyps and lung nodules in helical CT. IEEE Trans Med Imaging2004; 23:661 -675[CrossRef][Medline]
  11. Kiss G, Van CJ, Thomeer M, Suetens P, Marchal G. Computer-aided diagnosis in virtual colonography via combination of surface normal and sphere fitting methods. Eur Radiol 2002;12 : 77-81[CrossRef][Medline]
  12. Acar B, Napel S, Paik DS, Gokturk SB, Tomasi C, Beaulieu CF. Using optical flow fields for polyp detection in virtual colonoscopy. In: Beaulieu CF, ed. Proceedings of Medical Image Computing and Computer-Assisted Intervention. Utrecht, Holland: Springer-Verlag, 2001:637 -644
  13. Sato H, Westin C, Bhalerao A, et al. Tissue classification based on 3D local intensity structures for volume rendering. IEEE Trans Visualization and Computer Graphics 2000;6 : 160-180[CrossRef]
  14. Sahiner B, Chan H, Hadjiiski LM, et al. Computerized lung nodule detection on screening CT scans: performance improvement using Hessian features and an artificial neural network classifier. (abstr) Radiology 2005;392 (P): 392
  15. Pickhardt PJ, Nugent PA, Choi JR, Schindler WR. Flat colorectal lesions in asymptomatic adults: implications for screening with CT virtual colonoscopy. AJR 2004;183 : 1343-1347[Abstract/Free Full Text]
  16. Sato Y, Nakajima S, Shiraga N, et al. Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. Med Image Anal 1998;2 : 143-168[CrossRef][Medline]
  17. Yoshida H, Dachman AH. Computer-aided diagnosis for CT colonography. Semin Ultrasound CT MR2004; 25:419 -431[CrossRef][Medline]
  18. Summers RM, Jerebko AK, Franaszek M, Malley JD, Johnson CD. Colonic polyps: complementary role of computer-aided detection in CT colonography. Radiology 2002;225 : 391-399[Abstract/Free Full Text]
  19. Gokturk SB, Tomasi C, Acar B, et al. A statistical 3-D pattern processing method for computer-aided detection of polyps in CT colonography. IEEE Trans Med Imaging 2001;20 : 1251-1260[CrossRef][Medline]
  20. Jerebko AK, Summers RM, Malley JD, Franaszek M, Johnson CD. Computer-assisted detection of colonic polyps with CT colonography using neural networks and binary classification trees. Med Phys 2003; 30:52 -60[CrossRef][Medline]
  21. Acar B, Beaulieu CF, Gokturk SB, et al. Edge displacement field-based classification for improved detection of polyps in CT colonography. IEEE Trans Med Imaging2002; 21:1461 -1467[CrossRef][Medline]
  22. Summers RM, Yao J, Pickhardt PJ, et al. Computed tomographic virtual colonoscopy computer-aided polyp detection in a screening population. Gastroenterology 2005;129 : 1832-1844[CrossRef][Medline]
  23. Park SH, Ha HK, Kim MJ, et al. False-negative results at multi-detector row CT colonography: multivariate analysis of causes for missed lesions. Radiology 2005;235 : 495-502[Abstract/Free Full Text]
  24. Yoshida H, Nappi J, MacEneaney P, Rubin DT, Dachman AH. Computer-aided diagnosis scheme for detection of polyps at CT colonography. RadioGraphics 2002;22 : 963-979[Abstract/Free Full Text]
  25. Mani A, Napel S, Paik DS, et al. Computed tomography colonography: feasibility of computer-aided polyp detection in a "first reader" paradigm. J Comput Assist Tomogr 2004;28 : 318-326[CrossRef][Medline]
  26. Halligan S, Taylor SA, Dehmeshki J, et al. Computer-assisted detection for CT colonography: external validation. Clin Radiol 2006; 61:758 -763; discussion 764-765[CrossRef][Medline]
  27. Halligan S, Altman DG, Mallett S, et al. Computed tomographic colonography: assessment of radiologist performance with and without computer-aided detection. Gastroenterology2006; 131:1690 -1699, [Epub ahead of print][CrossRef][Medline]

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services