Recently introduced coronary CT angiography (CCTA)-based methods allow noninvasive estimation of fractional flow reserve (cFFR) through the application of computational fluid dynamics or, for onsite evaluation, machine learning (ML), hence improving the diagnostic yield of CCTA [
1,
2] and potentially reducing the number of unnecessary invasive procedures [
3]. However, attenuation values vary in association with the tube voltage used [
4], and it has not previously been shown whether this significantly affects the diagnostic performance of cFFR estimated with an ML algorithm (cFFR
ML).
In this multicenter study, we retrospectively evaluated the correlation, agreement, and diagnostic performance of prototype cFFRML software for tube voltages of 80, 100, and 120 kVp in relation to invasively measured FFR. However, because of the small number of examinations performed using a tube voltage of 80 kVp, our main focus was on the difference in the diagnostic performance of cFFRML derived from examinations performed using 100 kVp and 120 kVp, although the results for examinations performed using 80 kVp will be presented where appropriate.
Results
Demographic Characteristics
On a per-patient basis, the median age for the 351 patients included in the study was 63 years. For 342 of the 351 patients (data were missing for nine patients), the median body weight and BMI were 79 kg and 26.8, respectively. The median heart rate at CCTA was 63 beats/min for 233 patients (data were missing for 118 patients), and the median DLP was 506 for 342 patients (data were missing for nine patients).
On a per-vessel basis, the median (range) invasive FFR and cFFR
ML for the all groups was 0.84 (0.24–1.00) and 0.82 (0.31–1.00), respectively. Of 525 invasively measured FFR values, 212 (40.4%) indicated significant stenosis. Corresponding values for the tube voltage subgroups were 14 (40.0%), 98 (37.0%), and 100 (44.4%) for the 80-, 100-, and 120-kVp groups, respectively. Additional demographic data for each separate tube voltage setting are presented in
Tables 1 and
2.
Using the nonparametric Mann-Whitney U test, statistically significant differences between the 100- and 120-kVp groups (on a per-patient basis) were noted in terms of body weight (p = 0.002), BMI (p = 0.007), DLP (p < 0.001), and Agatston (calcium) score (p = 0.021). On a per-vessel basis, significant differences were noted in terms of cFFRML (p = 0.025) but not in terms of invasively measured FFR (p = 0.081).
When the 80-kVp subgroup was compared to the other two subgroups, the only significant differences were observed for age (p = 0.033) and DLP (p < 0.001).
Correlation and Agreement
On a per-vessel basis for all groups, the Spearman rank correlation coefficient for cFFRML in relation to invasive FFR was ρ = 0.645 (p < 0.001). For the 80-, 100-, and 120-kVp tube voltage subgroups, the Spear-man rank correlation coefficient for cFFRML in relation to invasively measured FFR was ρ = 0.684 (p < 0.001), ρ = 0.622 (p < 0.001), and ρ = 0.669 (p < 0.001), respectively.
Agreement between cFFRML and invasively measured FFR in terms of the intra-class correlation coefficient was 0.76 (p < 0.001) for all groups. For the 80-, 100-, and 120-kVp tube voltage subgroups, the intra-class correlation coefficient was 0.78, 0.76, and 0.77, respectively (p < 0.001 for all).
The Cohen kappa coefficient for all groups was 0.56, and it was 0.72, 0.52, and 0.57 for the 80-, 100-, and 120-kVp tube voltage subgroups, respectively (p < 0.001 for all).
Bland-Altman plots for tube voltages of 100 and 120 kVp are presented in
Figure 2.
Detection of Significant Stenosis
The sensitivity, specificity, PPV, NPV, and accuracy of cFFR
ML in terms of detection of significant stenosis are shown in
Table 3. The ROC AUC value for all groups was 0.84 (
p < 0.001), and it was 0.90, 0.82, and 0.84 for the 80-, 100-, and 120-kVp tube voltage subgroups, respectively (
p < 0.001 for all) (
Fig. 3).
Discussion
During the past decade, CCTA has been proved to be a reliable method for detection of coronary artery stenosis, and it is the recommended primary diagnostic tool for patients with a low or intermediate risk of coronary artery disease before testing [
14–
16]. The method has a high NPV, thus allowing the exclusion of coronary artery disease with a high degree of certainty. However, the PPV and specificity are somewhat less impressive, and further evaluation with ICA is often required when CCTA findings are positive. When ICA is performed, visual evaluation of a perceived stenosis can be further enhanced by functional assessment in the form of measurement of the FFR, the value of which was shown by Tonino et al. [
12] in the FAME (FFR versus Angiography Multivessel Evaluation) study. Today, FFR is considered to be the reference standard in stenosis evaluation, and it expresses the relative decrease in coronary artery flow caused by a stenosis during maximal coronary microvascular dilation. Clinically, FFR is determined by measuring the upstream and downstream pressure of a stenosis [
17,
18] with use of a dedicated pressure gauge catheter.
However, previous studies have shown that even when preceded by CCTA, approximately 30% of all ICA examinations have negative findings in terms of significant stenosis [
19]. ICA and, hence, FFR are invasive and therefore are expensive methods that require the use of additional radiation and contrast agent and also add a small but significant procedural risk for the patient [
20,
21]. Thus, the development of robust noninvasive alternatives is indeed needed to improve the selection process and decrease both the monetary cost and the risk of unnecessary invasive procedures. During the past half decade, a number of CCTA-based methods have become available—most notably, cFFR [
1,
2] but also measurement of the transluminal contrast attenuation gradient [
22] and semiautomated quantification of coronary artery plaque composition [
23]. The common characteristic of these methods is that they can be applied to an ordinary CCTA dataset without the requirement for any additional radiation or contrast medium administration (as opposed to, for example, CT perfusion). Because these methods are CT based, they are also all dependent on attenuation values as a basis for segmentation and quantification.
The iodine k-edge is located at approximately 33 keV, which means that a lower peak tube voltage of 70–80 kVp improves iodine-related image contrast compared with protocols using higher tube voltages [
24]. This effect is often desirable in CT angiography and has been used to decrease the amount of contrast agent given to elderly patients and patients with impaired renal function [
25,
26]. As a drawback, blooming artifacts resulting from calcifications will be more prominent when a lower tube voltage is used [
27]. However, standard attenuation values are based on a tube voltage of 120 kVp, and the use of other tube voltages is accompanied by a corresponding deviation in attenuation values [
4]. Apart from the variation in plaque composition itself, this could possibly account for some of the large variation in coronary plaque attenuation and characterization that was reported in a previous study [
28]. Although this may not necessarily affect the accuracy of manual stenosis evaluation [
29], the effect could be more conspicuous when attenuation-based segmentation algorithms are used. Hitherto unpublished data from our center does indeed indicate that the accuracy of some semiautomated plaque quantification software may be severely impaired unless there is compensation for this effect. This also raises a question regarding the extent to which the performance of other quantitative attenuation-dependent, software-based methods, such as cFFR
ML, are affected by the tube voltage.
In the present study, a total of 334 CCTA examinations were performed with a tube voltage of either 100 or 120 kVp, and a total of 490 invasively measured FFR values with corresponding cFFRML estimates were obtained for the same patients, making the study material uniquely suited for the evaluation of the effect of tube voltage on the accuracy of cFFRML.
The differences in demographic and clinical characteristics between patients in the different tube voltage subgroups were generally small. The 120-kVp subgroup did have a significantly higher Agatston score than the 100-kVp group, but there was no significant difference in the total stenosis burden between the groups, as expressed by the invasive FFR values. Apart from that, significant differences between the 100- and 120-kVp groups were found only in terms of body weight or BMI and dose expressed as DLP; however, this was to be expected because body weight in itself is generally used for triage to protocols with different tube voltages. The 17 patients in the 80-kVp subgroup were slightly (but significantly) younger, but they were otherwise demographically similar to patients in the 100- and 120-kVp subgroups.
All groups combined and the 100- and 120-kVp subgroups yielded very similar results in terms of agreement, correlation, and the ROC AUC value, and no significant differences were observed in terms of sensitivity, specificity, PPV, NPV, or accuracy. Hence, cFFR
ML seems to be a robust technique with comparable performance, regardless of whether 100 or 120 kVp is used. Of interest, the much smaller 80-kVp subgroup seemed to show even better results in terms of correlation and agreement between cFFR
ML and invasively measured FFR and also in terms of the ROC AUC value. With such a small group, the reason for this is difficult to identify, but the result could possibly stem from the better iodine-related contrast that can be expected when this tube voltage is used. Also, patients in the 80-kVp subgroup were slightly younger than those in the 100- and 120-kVp subgroups, and one can only speculate whether this might have resulted in better breath-holding and compliance during the CCTA examination. Fourteen of the 17 examinations performed with a tube voltage of 80 kVp were conducted at one center [
7], and small local variations in patient selection, examination technique, or reading or postprocessing technique may have also played a role.
Limitations
The present study has a number of limitations. Although it is a multicenter study, the relevant examinations were all performed before the multicenter MACHINE consortium was formed. Even though examination protocols were similar, no agreed-upon protocol was used by all centers. Consequently, small differences in protocol may exist, as well as slight differences in patient selection criteria and postprocessing procedures, depending on local variations. Also, most of the material was retrospectively collected and processed, with only one of five participating centers having performed a prospective study [
5].
All examinations in the study were performed using first- and second-generation dual-source CT scanners. Although these scanners still meet the current recommendations for CCTA [
30], current state-of-the-art scanners can perform scanning of the coronary arteries with even lower tube voltage, a lower dose, and a lesser amount of contrast medium [
31]. Thus, further research in this area is warranted, especially as the possibilities of using advanced postprocessing as a complement to visual evaluation are ever increasing.
Conclusion
CCTA-derived cFFRML is a robust method, and its performance does not vary significantly between 100- and 120-kVp examinations. However, because of rapid advancements in CT and postprocessing technology, further research is needed.