TY - JOUR
T1 - Diagnosis and prognosis of abnormal cardiac scintigraphy uptake suggestive of cardiac amyloidosis using artificial intelligence
T2 - a retrospective, international, multicentre, cross-tracer development and validation study
AU - Spielvogel, Clemens P
AU - Haberl, David
AU - Mascherbauer, Katharina
AU - Ning, Jing
AU - Kluge, Kilian
AU - Traub-Weidinger, Tatjana
AU - Davies, Rhodri H
AU - Pierce, Iain
AU - Patel, Kush
AU - Nakuz, Thomas
AU - Göllner, Adelina
AU - Amereller, Dominik
AU - Starace, Maria
AU - Monaci, Alice
AU - Weber, Michael
AU - Li, Xiang
AU - Haug, Alexander R
AU - Calabretta, Raffaella
AU - Ma, Xiaowei
AU - Zhao, Min
AU - Mascherbauer, Julia
AU - Kammerlander, Andreas
AU - Hengstenberg, Christian
AU - Menezes, Leon J
AU - Sciagra, Roberto
AU - Treibel, Thomas A
AU - Hacker, Marcus
AU - Nitsche, Christian
N1 - Publisher Copyright:
© 2024 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license
PY - 2024/4
Y1 - 2024/4
N2 - Background: The diagnosis of cardiac amyloidosis can be established non-invasively by scintigraphy using bone-avid tracers, but visual assessment is subjective and can lead to misdiagnosis. We aimed to develop and validate an artificial intelligence (AI) system for standardised and reliable screening of cardiac amyloidosis-suggestive uptake and assess its prognostic value, using a multinational database of
99mTc-scintigraphy data across multiple tracers and scanners. Methods: In this retrospective, international, multicentre, cross-tracer development and validation study, 16 241 patients with 19 401 scans were included from nine centres: one hospital in Austria (consecutive recruitment Jan 4, 2010, to Aug 19, 2020), five hospital sites in London, UK (consecutive recruitment Oct 1, 2014, to Sept 29, 2022), two centres in China (selected scans from Jan 1, 2021, to Oct 31, 2022), and one centre in Italy (selected scans from Jan 1, 2011, to May 23, 2023). The dataset included all patients referred to whole-body
99mTc-scintigraphy with an anterior view and all
99mTc-labelled tracers currently used to identify cardiac amyloidosis-suggestive uptake. Exclusion criteria were image acquisition at less than 2 h (
99mTc-3,3-diphosphono-1,2-propanodicarboxylic acid,
99mTc-hydroxymethylene diphosphonate, and
99mTc-methylene diphosphonate) or less than 1 h (
99mTc-pyrophosphate) after tracer injection and if patients’ imaging and clinical data could not be linked. Ground truth annotation was derived from centralised core-lab consensus reading of at least three independent experts (CN, TT-W, and JN). An AI system for detection of cardiac amyloidosis-associated high-grade cardiac tracer uptake was developed using data from one centre (Austria) and independently validated in the remaining centres. A multicase, multireader study and a medical algorithmic audit were conducted to assess clinician performance compared with AI and to evaluate and correct failure modes. The system's prognostic value in predicting mortality was tested in the consecutively recruited cohorts using cox proportional hazards models for each cohort individually and for the combined cohorts. Findings: The prevalence of cases positive for cardiac amyloidosis-suggestive uptake was 142 (2%) of 9176 patients in the Austrian, 125 (2%) of 6763 patients in the UK, 63 (62%) of 102 patients in the Chinese, and 103 (52%) of 200 patients in the Italian cohorts. In the Austrian cohort, cross-validation performance showed an area under the curve (AUC) of 1·000 (95% CI 1·000–1·000). Independent validation yielded AUCs of 0·997 (0·993–0·999) for the UK, 0·925 (0·871–0·971) for the Chinese, and 1·000 (0·999–1·000) for the Italian cohorts. In the multicase multireader study, five physicians disagreed in 22 (11%) of 200 cases (Fleiss’ kappa 0·89), with a mean AUC of 0·946 (95% CI 0·924–0·967), which was inferior to AI (AUC 0·997 [0·991–1·000], p=0·0040). The medical algorithmic audit demonstrated the system's robustness across demographic factors, tracers, scanners, and centres. The AI's predictions were independently prognostic for overall mortality (adjusted hazard ratio 1·44 [95% CI 1·19–1·74], p<0·0001). Interpretation: AI-based screening of cardiac amyloidosis-suggestive uptake in patients undergoing scintigraphy was reliable, eliminated inter-rater variability, and portended prognostic value, with potential implications for identification, referral, and management pathways. Funding: Pfizer.
AB - Background: The diagnosis of cardiac amyloidosis can be established non-invasively by scintigraphy using bone-avid tracers, but visual assessment is subjective and can lead to misdiagnosis. We aimed to develop and validate an artificial intelligence (AI) system for standardised and reliable screening of cardiac amyloidosis-suggestive uptake and assess its prognostic value, using a multinational database of
99mTc-scintigraphy data across multiple tracers and scanners. Methods: In this retrospective, international, multicentre, cross-tracer development and validation study, 16 241 patients with 19 401 scans were included from nine centres: one hospital in Austria (consecutive recruitment Jan 4, 2010, to Aug 19, 2020), five hospital sites in London, UK (consecutive recruitment Oct 1, 2014, to Sept 29, 2022), two centres in China (selected scans from Jan 1, 2021, to Oct 31, 2022), and one centre in Italy (selected scans from Jan 1, 2011, to May 23, 2023). The dataset included all patients referred to whole-body
99mTc-scintigraphy with an anterior view and all
99mTc-labelled tracers currently used to identify cardiac amyloidosis-suggestive uptake. Exclusion criteria were image acquisition at less than 2 h (
99mTc-3,3-diphosphono-1,2-propanodicarboxylic acid,
99mTc-hydroxymethylene diphosphonate, and
99mTc-methylene diphosphonate) or less than 1 h (
99mTc-pyrophosphate) after tracer injection and if patients’ imaging and clinical data could not be linked. Ground truth annotation was derived from centralised core-lab consensus reading of at least three independent experts (CN, TT-W, and JN). An AI system for detection of cardiac amyloidosis-associated high-grade cardiac tracer uptake was developed using data from one centre (Austria) and independently validated in the remaining centres. A multicase, multireader study and a medical algorithmic audit were conducted to assess clinician performance compared with AI and to evaluate and correct failure modes. The system's prognostic value in predicting mortality was tested in the consecutively recruited cohorts using cox proportional hazards models for each cohort individually and for the combined cohorts. Findings: The prevalence of cases positive for cardiac amyloidosis-suggestive uptake was 142 (2%) of 9176 patients in the Austrian, 125 (2%) of 6763 patients in the UK, 63 (62%) of 102 patients in the Chinese, and 103 (52%) of 200 patients in the Italian cohorts. In the Austrian cohort, cross-validation performance showed an area under the curve (AUC) of 1·000 (95% CI 1·000–1·000). Independent validation yielded AUCs of 0·997 (0·993–0·999) for the UK, 0·925 (0·871–0·971) for the Chinese, and 1·000 (0·999–1·000) for the Italian cohorts. In the multicase multireader study, five physicians disagreed in 22 (11%) of 200 cases (Fleiss’ kappa 0·89), with a mean AUC of 0·946 (95% CI 0·924–0·967), which was inferior to AI (AUC 0·997 [0·991–1·000], p=0·0040). The medical algorithmic audit demonstrated the system's robustness across demographic factors, tracers, scanners, and centres. The AI's predictions were independently prognostic for overall mortality (adjusted hazard ratio 1·44 [95% CI 1·19–1·74], p<0·0001). Interpretation: AI-based screening of cardiac amyloidosis-suggestive uptake in patients undergoing scintigraphy was reliable, eliminated inter-rater variability, and portended prognostic value, with potential implications for identification, referral, and management pathways. Funding: Pfizer.
UR - http://www.scopus.com/inward/record.url?scp=85188249914&partnerID=8YFLogxK
U2 - 10.1016/S2589-7500(23)00265-0
DO - 10.1016/S2589-7500(23)00265-0
M3 - Journal article
C2 - 38519153
SN - 2589-7500
VL - 6
SP - e251-e260
JO - The Lancet Digital Health
JF - The Lancet Digital Health
IS - 4
ER -