Corresponding author.
Findings from a previous study (ClinicalTrials.gov:
Received 2025 Feb 20; Accepted 2025 May 20; Collection date 2025.
Clinical decision support systems (CDSS) embedded in electronic health records (EHRs) enhance patient safety and guide clinicians toward evidence-based care
The electrocardiogram (ECG) is a widely used diagnostic tool, performed over 3 million times daily worldwide
The rapid response system (RRS) has been shown to enhance the recognition and management of high-risk patients, reducing mortality
Despite these promising results, the cost-effectiveness of AI-ECG systems remains unclear, particularly in the context of their integration into routine clinical practice. Given that healthcare resources are limited, investments in new technologies often come at the expense of potential investments in other areas, highlighting the importance of considering opportunity costs. Therefore, it is crucial to evaluate not only clinical efficacy but also the economic impact of new technologies to support informed healthcare decision-making. This study is novel in providing the first comprehensive economic evaluation of an AI-ECG system, assessing both its clinical outcomes and incremental cost-effectiveness from a health payer’s perspective. By addressing these critical gaps, this research aims to inform the sustainable adoption of AI-driven CDSS in real-world healthcare settings.
A complete description of patients characteristics for the AI-ECG alert clinical trial is available is the main trial article
Summary of clinical outcomes, medical costs, and cost-effectiveness of AI-ECG alerts versus usual care (
| Category | Outcome | AI-ECG | Usual care | Incremental cost (95% CI) |
|---|---|---|---|---|
| Clinical and resource utilization | Number of ECGs, mean (SD) | 2.41 (3.53) | 2.27 (2.71) | – |
| Length of hospital stay, median (IQR), days | 2 (7) | 2 (7) | – | |
| ICU admission within 3 days, % | 3.6% | 3.4% | – | |
| Length of ICU stay, median (IQR), days | 8 (13.2) | 7 (11) | – | |
| 90-Day medical costs, mean ($) | Total cost | 6204 | 5803 | 402 (61–735) |
| Drug | 1331 | 1177 | 153 (−6–330) | |
| Examinations | 1181 | 1145 | 36 (−24–96) | |
| Medical supplies | 1157 | 1100 | 56 (−40–150) | |
| Procedures | 1055 | 1013 | 42 (−36–119) | |
| Ward | 626 | 616 | 9 (−28–48) | |
| ICU | 474 | 395 | 79 (19–142) | |
| Diagnosis | 246 | 240 | 5 (−3–14) | |
| Others | 135 | 116 | 19 (−1–41) | |
| Clinical effectiveness | Mortality rate, % (95% CI) | 3.6 (3.2–4.1) | 4.3 (3.8–4.8) | – |
| Cost-effectiveness | Incremental cost per death averted ($, 95% CI) | 59,500 (−4657 to 385,950) | Reference | – |
Figure
The cost-effectiveness of the AI-ECG alert in reducing all-cause mortality is presented in Table
The cost-effectiveness plane presents the uncertainty around the bootstrapping estimates of ICER, as shown in Fig.
Among the 5000 bootstrap samples, 96.8% fell in quadrant I, indicating higher costs and more deaths averted with the AI-ECG alert system. AI-ECG alert dominated usual care in 2.3% of samples and was dominated in less than 0.1%.
The cost-effectiveness acceptability curve illustrates the probability that the AI-ECG intervention is cost-effective across a range of willingness-to-pay (WTP) thresholds. The dashed lines indicate the WTP values at which the AI-ECG alert system reaches a 50% probability ($60,628) and a 95% probability ($409,321) of being cost-effective.
To assess the robustness of the base-case results, we conducted sensitivity analyses by varying both the unit price of the AI-ECG alert system ($4, $8, and $32) and the override rate (0%, 40%, and 60%). We selected these three override levels to represent ideal, moderate, and high alert fatigue scenarios while maintaining interpretability. The analysis showed that although higher override rates and increased AI-ECG costs led to slightly increased ICERs, the intervention remained within a potentially acceptable cost-effectiveness range under all scenarios (Table
Sensitivity analysis of the prices of AI-ECG alert and override rates on the cost-effectiveness
| Cost of AI-ECG | Override rate (%) | Incremental cost ($) | Reduction in mortality rate (%) | ICER ($) |
|---|---|---|---|---|
| 40 | 249 (−81, 572) | 0.4 (−0.2, 1.1) | 61,787 | |
| 60 | 168 (−146, 468) | 0.3 (−0.4, 1.0) | 63,006 | |
| $8 | 0 | 413 (72, 747) | 0.7 (0.0, 1.4) | 60,082 |
| 40 | 253 (−77, 576) | 0.4 (−0.2, 1.1) | 62,778 | |
| 60 | 172 (−142, 472) | 0.3 (−0.4, 1.0) | 64,509 | |
| $32 | 0 | 437 (96, 771) | 0.7 (0.0, 1.4) | 63,575 |
| 40 | 277 (−53, 600) | 0.4 (−0.2, 1.1) | 68,726 | |
| 60 | 196 (−118, 496) | 0.3 (−0.4, 1.0) | 73,527 |
Each block represents a different assumed cost of the AI-ECG alert system. Override rates simulate varying levels of alert adoption by clinicians. The bold values indicate the base-case scenario.
Subgroup analyses revealed notable variation in the cost-effectiveness of AI-ECG alerts across different patient groups (Supplementary Table
The present study reports the direct medical costs associated with implementing AI-ECG alert system in predicting mortality risk compared to usual care in hospitalized patients from a RCT. Results of this economic evaluation revealed the implementation of AI-ECG resulted in a modest increase in short-term healthcare costs while reducing 90-day all-cause mortality. From a healthcare payer’s perspective, the intervention appears to represent a cost-effective strategy, particularly when used in a population with elevated baseline risk.
Using AI to analyze existing ECGs can provide clinicians with a wealth of additional information. Beyond indicating high mortality risk
In the base-case analysis, the ICER was $59,500 per death averted. The cost-effectiveness acceptability curve indicated a 95% probability that the intervention would be considered cost-effective at a WTP threshold of $409,321. This wide range of uncertainty is likely due to the relatively small differences in both costs and mortality between the intervention and control groups. When such differences are modest, even small variations in either can cause large fluctuations in the ICER estimates, especially when using resampling methods. The base-case ICER corresponds to approximately 1.8 times Taiwan’s WTP threshold for a QALY gained, while the upper bound aligns with 12.3 times that threshold. Given the average age of patients in the trial (61 years) and a life expectancy of around 80 years in Taiwan, each death averted could conservatively translate into 7 to 12 additional QALYs. Using a WTP threshold equivalent to one time Taiwan’s GDP per capita, the implied acceptable range for a death averted would be between $232,638 and $398,808. In this context, the findings suggest that the intervention is likely to be cost-effective in Taiwan’s healthcare system and potentially applicable to other middle- or high-income countries with similar or higher WTP thresholds.
In this cost-effective analysis, the cost of the AI-ECG alert system itself is the first factor to consider. However, the results of this study suggest that the costs of the AI-ECG alert system have no significant impact on healthcare team expenditures. Since ECGs are inherently very inexpensive tests, past research has emphasized that the cost-effectiveness analysis of ECGs should focus more on the care cascades triggered by ECGs. In asymptomatic adults, low-value ECGs can initiate care cascades that lead to substantial economic burdens
Many clinical support systems have been designed to assist physicians and improve patient safety, yet these alerts are often overridden due to alert fatigue. Previous studies have shown that override rates can reach up to three-quarters in inpatient settings and nearly two-thirds in emergency departments
Critical care, particularly admission to ICU, is widely recognized for significantly reducing patient mortality
A key limitation of the study is that it was conducted in Taiwan, with cost analysis tailored to the Taiwanese healthcare system, which may restrict the generalizability of the findings to other countries. Differences in healthcare systems, along with demographic and socioeconomic disparities, could influence the cost-effectiveness. Previous studies comparing AI-ECG for asymptomatic left ventricular dysfunction screening to usual care have shown significant variations in ICERs, primarily due to differences in healthcare costs across regions
Additionally, the evaluation was conducted from a health payer’s perspective, excluding costs borne by patients and their families after hospitalization, which may result in an underestimation of the total economic impact. We also did not include future healthcare costs associated with extended survival (i.e., life extension costs), which are sometimes considered in lifetime models. This exclusion may further contribute to a conservative estimate of the ICER. Lastly, this study did not extrapolate deaths averted into QALYs gained or adopted a lifetime horizon, as the trial population was heterogeneous, and the follow-up period was limited to 90 days. Future research may consider these approaches to capture longer-term health outcomes.
The AI-ECG alert significantly reduced all-cause mortality among hospitalized patients. Although it incurred slightly higher costs than usual care, the incremental costs per death averted suggest favorable cost-effectiveness, even when accounting for the large uncertainty in the ICER. The AI-ECG alert system presents a promising and cost-effective approach to improving patient outcomes. However, further validation across diverse clinical settings is necessary to ensure the generalizability of these findings.
The economic evaluation was a cost-effectiveness analysis conducted alongside a pragmatic randomized clinical trial in Taiwan, assessing the impact of an AI-ECG alert system on clinical outcomes
Both the RCT and the cost-effectiveness analysis were approved by the Institutional Review Board of Tri-Service General Hospital, Taipei, Taiwan (approval numbers A202105120 and A202405157). The trial included 39 eligible attending physicians from the internal medicine and emergency medicine departments, all of whom provided informed consent. As the research team did not have direct contact with patients and de-identified patient-level data were collected through EHRs, patient consent was waived by the ethics committee. The inclusion criteria encompassed any patient in the emergency department or inpatient wards who underwent at least one ECG for any clinical indication during the study period. Patients under 18 years of age and those with a time delay of more than 2 h between ECG recording and AI-ECG analysis were excluded. All eligible patients were included in the analysis.
Randomization was conducted based on the hospital’s seven-digit serial medical record numbers. This patient-level randomization ensured longer patient follow-up and minimized potential loss of follow-up that could occur with physician-level randomization. The randomization process was completed before the trial began, using simple random sampling. Half of the possible medical record numbers were allocated to the intervention group, meaning the randomization may have occurred prior to the actual creation of the medical record numbers. The trial commenced on 15 December 2021, when the AI-ECG support system was activated for patients in the intervention group, and concluded on 30 April 2022, with approximately 8000 patients assigned to each arm.
The AI-ECG system used in this study is a convolutional neural network, with its technical details previously described in an earlier publication
The system aimed to prompt timely medical evaluations and interventions without altering standard procedures or treatment criteria, which remained unaffected by AI-ECG findings before the trial. While the intervention emphasized high-risk alerts, the AI-ECG system also provided risk levels for all patients in the intervention group, enabling physicians to review these assessments at their discretion through the EHR system. In contrast, patients in the control group received usual care and were not covered by the active warning message service provided by the AI-ECG system.
The endpoint of the study was all-cause mortality within 90 days post-intervention, chosen for its robustness against clinician biases. Mortality status was tracked using EHRs, with additional verification to confirm the survival status of any censored patients up to their last recorded hospital visit. While it is possible that some patients may have died outside the hospital and were not captured in the EHR, we ensured that all censored patients were confirmed alive up to the time of their most recent recorded hospital encounter.
This economic evaluation was conducted from the perspective of Taiwan’s National Health Insurance (NHI). The total cost for each participant was determined by aggregating all medical resource utilization incurred during the hospital stay. Cost data were extracted directly from the EHR systems of the participating hospitals, where they were originally recorded in New Taiwan Dollars (NTD$). These data included both costs reimbursed by the NHI and out-of-pocket expenses paid by patients. The extracted data were categorized into eight groups: drugs, examinations, medical supplies, procedures, diagnoses, wards, intensive care units (ICU), and others. Procedure costs included fees for various medical treatments and interventions, while medical supplies encompassed both consumables and more advanced medical devices. Diagnosis costs covered fees for consultations and assessments by physicians and specialists. Costs were converted to USD according to the currency rate obtained from the Bank of Taiwan on November 18, 2024.
Cost-effectiveness was evaluated by calculating the incremental cost-effectiveness ratio (ICER), which represents the additional costs of one intervention compared to another, divided by the additional effects gained from one intervention compared to another. Since there is no established consensus on the willingness-to-pay (WTP) threshold for a death averted, we used the WTP for a quality-adjusted life year (QALY) gained as a proxy. Following WHO guidelines and broader health economic literature, one Gross Domestic Product (GDP) per capita was considered an appropriate threshold for assessing cost-effectiveness in Taiwan
To address uncertainty in cost and outcome data, we employed non-parametric bootstrapping with 5000 replications to generate distributions of mean costs and effects for both the AI-ECG and control groups. These bootstrap replications were used to calculate the incremental cost per death averted and to construct 95% confidence intervals (CIs) around the ICERs. To further assess uncertainty in decision-making, we constructed a cost-effectiveness acceptability curve (CEAC) by plotting the proportion of bootstrap replications that fall below varying WTP thresholds for a death averted. Notably, there were no missing data in this trial, as all relevant medical records were assumed complete and available for analysis.
We conducted sensitivity analyses by varying two key variables to estimate their impact on the ICER: (1) the cost of the AI-ECG service and (2) the override rate of the AI-ECG alerts. In the absence of clear pricing guidelines for AI-ECG, we initially set the cost at $4, equivalent to a standard ECG, and progressively increased it up to eightfold. To account for potential non-adherence to AI alerts in real-world practice, we modeled override rates of 40 and 60%. In these analyses, we assumed that patients whose AI-ECG alerts were overridden would have outcomes similar to those receiving usual care. Accordingly, we sampled cost and outcome data with replacement from the control group at proportions corresponding to the override rates.
We also performed subgroup analyses to explore potential heterogeneity in cost-effectiveness across patient characteristics (e.g., age, sex, comorbidities) and hospital settings (e.g., academic medical center vs. community hospital, emergency vs. inpatient department). For each subgroup, we calculated incremental costs, absolute reduction in mortality, and the ICER per death averted.
Supplementary information
This study was supported by funding from the National Science and Technology Council, Taiwan (NSTC 113-2320-B-016-011 to P.H.H.). The funder of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report.
P.H.H., C.L., and C.S.T. conceptualized the study. P.H.H., C.L., T.K.L., and C.S.T. designed the methodology. C.S.L. and W.T.L. did the data collection. P.H.H., C.L., and D.J.T. did the data analysis. P.H.H. wrote the original draft of the manuscript. All authors reviewed and edited the manuscript. C.S.T. supervised the data collection and analyses. P.H.H., C.L., W.T.L., and C.S.T. did project administration. Y.J.H., Y.H.C., C.Y.L., S.H.L., and C.S.T. acquired funding. P.H.H. and C.L. verified the data. All authors have read and agreed to the final version of the manuscript and to the submission for publication.
Patient data cannot be made publicly available due to privacy concerns. De-identified tabular data can be obtained from the corresponding author on approval from the ethics committee of the Tri-Service General Hospital. Approval from this committee can be requested from the Tri-Service General Hospital’s Clinical Trial Management System (
The authors declare no competing interests.
The online version contains supplementary material available at 10.1038/s41746-025-01735-7.
Supplementary information
Patient data cannot be made publicly available due to privacy concerns. De-identified tabular data can be obtained from the corresponding author on approval from the ethics committee of the Tri-Service General Hospital. Approval from this committee can be requested from the Tri-Service General Hospital’s Clinical Trial Management System (