m37 · AI on the surface ECG
Education only. Not for diagnosis, treatment or any clinical decision.
In 60 seconds
A deep network for the ECG is a stack of learned filters followed by a rule that turns scores into probabilities. Trained on enough labeled recordings, such networks have matched or beaten physicians on curated test sets: cardiologists for 12 rhythm classes on single-lead ambulatory ECGs (Hannun et al. 2019), and cardiology residents for six abnormalities on 12-lead ECGs (Ribeiro et al. 2020). They can also find signals no reader uses, such as signs of atrial fibrillation (AF, a fast, irregular rhythm of the upper chambers) in an ECG recorded during normal rhythm (Attia et al. 2019). Whether a model helps patients is a different question. Only prospective and randomized studies answer it (Noseworthy et al. 2022; Yao et al. 2021; Adedinsewo et al. 2024). This module builds a classifier from its parts, shows what one output of a network can and cannot see, and shows why a model that is excellent on its own test set can disappoint somewhere else.
From the field
- Labels set the ceiling. In the 2017 PhysioNet/Computing in Cardiology Challenge, experts relabeled the 1,129 recordings on which the best algorithms disagreed most. Their agreement was only fair, Fleiss’ κ = 0.245 (Clifford et al. 2018). A model cannot be more right than its labels; m35 shows how to measure this (m35).
- Bigger is not always better. In the same Challenge, with 8,528 training recordings, a random forest on well-chosen features did as well as deep networks, and even the winning entries showed clear overtraining (Clifford et al. 2018).
- The device is part of the data. The Challenge recordings came from a handheld single-lead device at 300 Hz with a 0.5–40 Hz band, and many were inverted because users could hold the device either way round (Clifford et al. 2018). PTB-XL holds 12-lead ECGs at 500 Hz, with a 100 Hz copy (Wagner et al. 2020). A model moved between them meets a new sampling rate, band and polarity.
- Split by patient. PTB-XL’s ten recommended folds keep every patient in one fold, with fold 10 for testing and fold 9 for validation (Wagner et al. 2020). A record-wise split leaks patients across sets (m35).
- Check subgroups. A Stanford study trained a network on 12-lead ECGs from 326,518 patient encounters to predict heart failure within 5 years. Its performance fell with age, and it did significantly worse in Black patients aged 0 to 40 (Kaur et al. 2023).
- Tools in practice. A team from Stanford, UCSF and the device maker iRhythm Technologies trained an end-to-end network on 91,232 single-lead ECGs from 53,549 patients (Hannun et al. 2019). Teams that cannot pool data use federated learning: each site trains locally and only model updates are shared. In one multinational study, whose authors included NVIDIA researchers, 20 institutes trained a model this way (Dayan et al. 2021). NVIDIA FLARE is an open-source framework for such projects (Roth et al. 2022). The course labs stay small and offline: NumPy and scikit-learn, with an optional PyTorch version.
Derivations
Symbols: \(x[n]\) an ECG sample, \(f_s\) the sampling rate (Hz), \(z_c\) the score for class \(c\), \(p_c\) its probability, \(y_c\) the label (1 for the true class, else 0), \(w[k]\) a kernel weight, \(k_l\) and \(s_l\) the kernel width and stride of layer \(l\), \(\pi\) prevalence, Se and Sp sensitivity and specificity.
From samples to class probabilities
A classifier maps a recording to one score per class. The softmax turns scores into probabilities that are positive and sum to one:
\[ p_c = \frac{e^{z_c}}{\sum_{j=1}^{C} e^{z_j}} \tag{1}\]
Training lowers the cross-entropy \(L = -\sum_c y_c \log p_c\), the average surprise at the true label. Its gradient with respect to the scores is short:
\[ \frac{\partial L}{\partial z_c} = p_c - y_c \tag{2}\]
To derive it, write \(\log p_c = z_c - \log \sum_j e^{z_j}\); then \(\partial L / \partial z_c = -y_c + \left(\sum_j y_j\right) p_c\), and the labels sum to one. Each score moves in proportion to how wrong its probability was. Backpropagation carries this error back through every layer.
With two classes, set the scores to \((0, u)\) and the softmax becomes the logistic function. This is logistic regression when \(u\) is a weighted sum of features \(\mathbf x\):
\[ p = \sigma(\beta_0 + \boldsymbol\beta^{\mathsf T}\mathbf x), \qquad \sigma(u) = \frac{1}{1 + e^{-u}} \tag{3}\]
Key takeaways
- Softmax makes probabilities; cross-entropy rewards putting probability on the true label.
- The error signal is \(p - y\): a confident wrong answer gets the largest correction.
- Logistic regression is a one-layer network with two classes.
Convolution is a learned filter
A convolutional layer slides a short kernel \(w\) of width \(K\) along the signal. Deep-learning libraries compute a cross-correlation, with stride \(s\) (the step between outputs) and bias \(b\):
\[ y[n] = b + \sum_{k=0}^{K-1} w[k]\, x[s n + k] \tag{4}\]
This is a finite impulse response (FIR) filter, the same object as the digital filters of m04, except that the weights are learned. Its gain at frequency \(f\) follows from feeding it a sinusoid:
\[ H(f) = \sum_{k=0}^{K-1} w[k]\, e^{-i 2\pi f k / f_s} \tag{5}\]
A sinusoid comes out scaled by \(\lvert H(f) \rvert\). A kernel \([1, 0, -1]/2\), for example, has \(\lvert H \rvert = \lvert \sin(2\pi f / f_s) \rvert\): a high-pass, derivative-like filter that favors the steep QRS complex over the slow T wave.
Stacking layers widens what one output sees. With kernel widths \(k_l\) and strides \(s_l\), an output of layer \(L\) depends on
\[ r = 1 + \sum_{l=1}^{L} (k_l - 1) \prod_{j<l} s_j \tag{6}\]
input samples, its receptive field. Layer \(l\) adds \(k_l - 1\) samples, measured in steps of the layers below it. In seconds, the receptive field is \(r / f_s\).
Exact
Assumptions
- The receptive field is Equation 6, exact for any stack of convolutions. The first layer has stride 1 and the others the chosen stride; all layers share one kernel width. Pooling, dilation and attention layers, which change the count, are not included.
- The trace is the course’s synthetic ECG (approximate model,
labs/python/epml/aiecg.py): a sum of Gaussian waves per beat, after the morphology part of McSharry et al. (2003). Its wave sizes, times and widths are illustrative, not reference values. It is noise-free and perfectly regular here. - Heart rate, sampling rate and layer settings are illustrative inputs.
- What would change the result: a global pooling layer at the end lets the whole network see the whole record even when each output’s receptive field is short.
Key takeaways
- A convolution kernel is a learned FIR filter; its frequency response is Equation 5.
- One output sees only its receptive field. Strides grow it quickly, kernel width slowly.
- To judge whether beats come at irregular times, something in the network must see more than one interval between beats.
What a rhythm model can measure
AF detectors look at one of two things: the atrial activity, or the ventricular response, that is, the timing of the beats (Clifford et al. 2018). Surface-ECG methods exist for both (Bollmann et al. 2006). A model can use either. The interval between two R peaks is the RR interval. With \(RR_i\) the \(i\)-th interval, \(\overline{RR}\) its mean and \(s_{RR}\) its sample standard deviation, three simple features are
\[ \overline{RR}, \qquad \mathrm{CV} = \frac{s_{RR}}{\overline{RR}}, \qquad \mathrm{nRMSSD} = \frac{1}{\overline{RR}} \sqrt{\frac{1}{n-1}\sum_{i=1}^{n-1} \left(RR_{i+1} - RR_i\right)^2 } \tag{7}\]
where \(n\) is the number of intervals. CV measures spread; nRMSSD (normalized root mean square of successive differences) measures beat-to-beat change. Regular beats give zero for both. Intervals alternating between \(a\) and \(b\) give \(\mathrm{nRMSSD} \cdot \overline{RR} = \lvert a - b \rvert\). Finding the R peaks needs a QRS detector; the classic design band-passes, differentiates, squares and integrates the signal before thresholding (Pan and Tompkins 1985). The lab uses a simplified version.
A model built on Equation 7 and Equation 3 is small and easy to inspect. A convolutional network learns its own features, which may include P-wave shape. The two can fail differently: an irregular rhythm that is not AF (for example, frequent early beats) fools interval features, while a different device or lead can fool a network trained on waveform shape. Many rhythms that are not AF also have irregular intervals (Clifford et al. 2018).
Key takeaways
- Interval features are cheap, explainable and portable across devices.
- A network may rely on waveform shape you did not intend; test it where shape changes.
- In the Challenge data, simple features held their own against deep networks (Clifford et al. 2018).
Moving a model to a new place
Data at a new site differ from training data in three main ways. The mix of classes changes (prior shift). The recordings change: device, leads, sampling rate, filters, polarity, population (covariate shift). Or the labels mean something different, for example a new definition or a different reader (concept shift). Each needs its own check.
Prior shift has an exact fix when the recordings of each class look the same in both places. If a calibrated model gives probability \(p\) where the positive class had prevalence \(\pi\), then where it has prevalence \(\pi'\) (Saerens et al. 2002):
\[ p' = \frac{\dfrac{\pi'}{\pi}\, p}{\dfrac{\pi'}{\pi}\, p + \dfrac{1-\pi'}{1-\pi}\,(1-p)} \tag{9}\]
A model trained on balanced data (\(\pi = 0.5\)) and used where \(\pi' = 0.02\) turns a raw 0.5 into about 0.02. Ranking, and so AUC, does not change; thresholds and PPV do.
Covariate shift has no formula. It is found by testing on an external data set: one collected elsewhere, never used for training or tuning (TRIPOD+AI, (Collins et al. 2024)). Practical checks for ECG models: resample to a common rate, match the band, test with inverted polarity, and report results by subgroup (Kaur et al. 2023). Standards for digital ECG acquisition are set out by Kligfield and colleagues (Kligfield et al. 2007).
Key takeaways
- Name the shift: prevalence, recordings or labels.
- Correct prevalence with Equation 9; test everything else on external data.
- Report performance by subgroup, not only overall.
Clinical correlate
This section describes published findings only. It is not guidance for patient care, and it has not yet been reviewed by an EP physician.
AI-ECG to decide whom to monitor for AF. In a prospective, non-randomized study, 1,003 patients with stroke risk factors and no known AF wore a continuous monitor for up to 30 days after a routine ECG (Noseworthy et al. 2022). A network read the ECG and sorted patients into high and low risk. AF was found in 48 of 633 high-risk patients (7.6%) and 6 of 370 low-risk patients (1.6%), an odds ratio of 4.98 (95% CI 2.11–11.75). Compared with matched patients in usual care, AI-guided screening was associated with more AF detected.
What this design shows, and what it does not, in the terms of this module:
- It tests use, not only accuracy. The model’s output decided who was studied, a rung above the retrospective result it built on (Attia et al. 2019).
- Its outcome is detection. The primary outcome was newly diagnosed AF, not strokes prevented. A rise in detection is a reason to ask about outcomes, not an answer.
- It was not randomized. The comparison with usual care used propensity-score matching, which balances measured differences only. Randomized designs, such as the trial of Yao et al. (2021) for low ejection fraction, remove that concern.
Module m45 covers how such studies are designed and reported.
Visual summary
Schematic
Assumptions
- Schematic: no quantitative claim. The stages follow this module’s derivations (Equation 4, Equation 6, Equation 1, Equation 9, Equation 8).
How experts think
Before trusting an ECG model’s number, ask:
- Who made the labels, and how much did they agree? Fair agreement, as in the Challenge relabeling (\(\kappa\) = 0.245, (Clifford et al. 2018)), caps any score.
- Was the split by patient? If one patient’s ECGs sit in both training and test sets, the score is optimistic (m35).
- What can one output see? Compute the receptive field (Equation 6) and compare it with the feature you hope the model uses, such as successive RR intervals.
- Which numbers depend on prevalence? AUC does not; PPV, F1 and the flags per case found (Equation 8) do.
- Was it tested somewhere else? A different site, device, rate or population. Was the prevalence corrected (Equation 9) and the subgroup performance reported (Kaur et al. 2023)?
- Which rung of evidence is this? Retrospective accuracy, prospective use or a randomized trial (Attia et al. 2019; Noseworthy et al. 2022; Yao et al. 2021).
One sentence to keep: a model’s accuracy belongs to its test set; its usefulness belongs to the place it is used.
Cheat sheet
| Quantity | Result |
|---|---|
| Softmax (Equation 1) | \(p_c = e^{z_c} / \sum_j e^{z_j}\) |
| Cross-entropy gradient (Equation 2) | \(\partial L / \partial z_c = p_c - y_c\) |
| Logistic regression (Equation 3) | \(p = \sigma(\beta_0 + \boldsymbol\beta^{\mathsf T}\mathbf x)\) |
| Convolution layer (Equation 4) | \(y[n] = b + \sum_k w[k]\, x[sn + k]\) |
| Kernel gain (Equation 5) | \(H(f) = \sum_k w[k]\, e^{-i2\pi fk/f_s}\) |
| Receptive field (Equation 6) | \(r = 1 + \sum_l (k_l - 1)\prod_{j<l} s_j\) samples, \(r/f_s\) seconds |
| RR features (Equation 7) | \(\overline{RR}\), \(\mathrm{CV} = s_{RR}/\overline{RR}\), nRMSSD |
| Screening yield (Equation 8) | \(N_+ = N[\pi\mathrm{Se} + (1-\pi)(1-\mathrm{Sp})]\); \(1/\mathrm{PPV}\) flags per case |
| Prior shift (Equation 9) | \(p' \propto (\pi'/\pi)\,p\) against \(((1-\pi')/(1-\pi))(1-p)\) |
Two data sets used in the lab
| PhysioNet/CinC Challenge 2017 (Clifford et al. 2018) | PTB-XL (Wagner et al. 2020) | |
|---|---|---|
| Leads | One (lead I equivalent, often inverted) | 12 |
| Sampling | 300 Hz, 0.5–40 Hz band | 500 Hz, plus a 100 Hz copy |
| Length | 9–61 s | 10 s |
| Size | 8,528 public training recordings | 21,837 records from 18,885 patients (paper) |
| Labels | Normal, AF, other rhythm, noisy | 71 statements, multi-label |
| Splits | Hidden test set | Ten folds by patient; fold 10 for testing |
Rules of thumb
- Report AUC with PPV at the prevalence of use, and calibration.
- Count receptive fields in seconds and in beats.
- Split by patient; test on an external site; report subgroups.
- Retrospective accuracy is not clinical benefit.
Interview questions
Try each question before you open its model answer. In a real interview, say which assumptions you are making.
Q1. Derive the gradient of the softmax cross-entropy with respect to the scores.
Model answer
With \(\log p_c = z_c - \log\sum_j e^{z_j}\), the loss is \(L = -\sum_c y_c z_c + \left(\sum_c y_c\right)\log \sum_j e^{z_j}\). Differentiating, \(\partial L/\partial z_c = -y_c + \left(\sum_c y_c\right) e^{z_c}/\sum_j e^{z_j} = p_c - y_c\), because one-hot labels sum to one (Equation 2). The error is the gap between predicted and true probability, so a confident wrong prediction gets the largest update.
Q2. Why is a convolutional layer “just a filter”, and what does that buy an engineer?
Model answer
Each output is a weighted sum of a short window of inputs (Equation 4): an FIR filter with learned weights. Its frequency response (Equation 5) can be computed and plotted like any filter. That lets you check what a trained first layer passes (QRS energy, baseline wander, mains interference) and reason about sampling-rate changes: a kernel learned at 300 Hz has a different response in hertz when applied at 500 Hz.
Q3. A network has four layers of width 9; the last three have stride 2. At 100 Hz and 70 bpm, how many RR intervals does one output see?
Model answer
\(r = 1 + 8(1 + 1 + 2 + 4) = 65\) samples (Equation 6), or 0.65 s. One RR interval at 70 bpm lasts about 0.86 s, so an output sees less than one interval. On its own it cannot compare successive beats; the network can judge irregularity only after a pooling or later stage combines outputs (demo m37-d1).
Q4. Your model’s AUC is 0.87, but its F1 is 39%. Is something wrong?
Model answer
Not necessarily. AUC measures ranking and does not depend on prevalence; F1 combines sensitivity with PPV, and PPV falls when positives are rare. Attia et al. (2019) reported exactly this pair, with 8.4% of test patients positive. Report both, and give PPV at the prevalence where the model will be used (Equation 8).
Q5. A model trained on balanced data outputs 0.5 for a new patient. In the clinic, prevalence is 2%. What probability should be shown?
Model answer
If the model is calibrated on its training data and each class’s recordings look the same in the clinic, Equation 9 with \(\pi = 0.5\) and \(\pi' = 0.02\) gives \(p' = 0.02 \cdot 0.5 / (0.02 \cdot 0.5 + 0.98 \cdot 0.5) = 0.02\). The ranking is unchanged, so AUC stays the same, but a threshold of 0.5 now flags far too many people. Check calibration on local data before trusting either number.
Q6. Name three ways a single-lead handheld ECG differs from a 12-lead resting ECG, and how each could break a model.
Model answer
Sampling and band: the Challenge data are 300 Hz with a 0.5–40 Hz band (Clifford et al. 2018), while PTB-XL is 500 Hz with a 100 Hz copy (Wagner et al. 2020), so learned filters see different frequencies. Polarity: many handheld recordings are inverted, so a model keyed to an upright R wave fails. Population and length: self-recorded 9–61 s strips versus 10-s clinical ECGs change the mix of rhythms, noise and duration. Fixes: resample, match the band, augment with inverted signals, and test externally.
Q7. Why might a random forest on RR features match a deep network on AF detection?
Model answer
AF’s main surface signs, irregular intervals and missing organized P waves, can be summarized by a few features (Equation 7). With limited training data, a model with few, well-chosen inputs has less room to overfit. In the 2017 Challenge, with 8,528 training recordings, that is what happened (Clifford et al. 2018). Deep networks gain when data are larger or the signal is subtler, as with AF signatures in sinus-rhythm ECGs (Attia et al. 2019).
Q8. What is wrong with splitting ECG records at random into training and test sets?
Model answer
Patients with several records end up on both sides. The model can recognize the person, not the rhythm, and the test score is optimistic. Split by patient, as PTB-XL’s folds do (Wagner et al. 2020), and use the design effect from m35 to judge how many independent cases you really have.
Q9. A study shows that an AI-ECG increases AF detection. A manager concludes it prevents strokes. Respond.
Model answer
Detection is an intermediate outcome. The study cited for this, Noseworthy et al. (2022), measured newly diagnosed AF, not strokes, and was not randomized: its comparison with usual care used propensity matching. Stroke prevention needs a trial with that outcome. The evidence ladder in this module separates “the model ranks well”, “using it changes what clinicians find” and “patients do better”.
Q10. Your model works overall but worse in one age group. What do you check and what can you change?
Model answer
Check the number of cases in the subgroup (small groups give wide intervals), label quality, and whether the subgroup’s recordings differ (device, setting). In Kaur et al. (2023), performance fell with age and was significantly worse in young Black patients. Adding demographics to the model or rebalancing data did not fix it, while thresholds chosen per subgroup improved F1. Report subgroups, with confidence intervals, and decide thresholds openly.
Q11. What is federated learning, and what problem does it not solve?
Model answer
Each site trains on its own data and shares only model updates, so raw recordings stay local (Dayan et al. 2021; Roth et al. 2022). It eases data sharing and can improve how well a model generalizes across sites. It does not fix label disagreement, differences in label definitions between sites, or the need to test on a site that took no part in training.
Q12. How would you design a first external validation for an AF detector trained on handheld single-lead data?
Model answer
Pick a data set from another source with patient-level splits, for example lead I of PTB-XL’s fold 10 (Wagner et al. 2020). Freeze the model and its threshold before looking. Harmonize sampling rate and band; report AUC, sensitivity and specificity at the frozen threshold, calibration, and PPV after correcting for prevalence (Equation 9). State the differences that remain (lead, setting, population). The lab does this in part E.
Code lab
The lab builds an ECG classifier from its parts and then moves it to a new data set. It runs in about two minutes, including downloads.
| Part | What you do | Data |
|---|---|---|
| A | Check the softmax gradient (Equation 2) numerically; plot a kernel’s frequency response (Equation 5) | synthetic |
| B | Check Equation 6 by perturbing inputs; count beats per output | synthetic |
| C | Build a synthetic cohort with several records per patient; compare record-wise and patient-wise splits with RR features (Equation 7) and logistic regression | synthetic |
| D | Train a small convolutional network written in NumPy; test both models on inverted signals and on irregular rhythms that are not AF | synthetic |
| E | Train on the Challenge 2017 data, test unchanged on PTB-XL lead I; correct for prevalence (Equation 9) | PhysioNet |
| F | Optional: the same network in PyTorch | synthetic |
- Python notebook: labs/python/m37_lab.ipynb. Run it from the course repository after
pip install -r requirements.txt, or open it in Google Colab. - Data for part E: small subsets of the PhysioNet/CinC Challenge 2017 training set (Clifford et al. 2017; Clifford et al. 2018) (Open Data Commons Attribution v1.0) and of PTB-XL 1.0.3 (Wagner et al. 2022, 2020) (Creative Commons Attribution 4.0), downloaded from PhysioNet and checked against each database’s published SHA-256 checksums (Goldberger et al. 2000). Without internet access, part E is skipped.
- Part F runs only if PyTorch is installed (
pip install torch); otherwise it is skipped.
Each part ends with checks: lines that pass with the code as given. If you change something and a check fails, that is information, not an error to hide.
Self-check
Short checks you can do in your head. Open each answer after you have tried it.
S1. A single layer has kernel width 31 at 300 Hz. How long a stretch of ECG does one output see?
Answer
31 samples (Equation 6 with one layer), or about 0.10 s.
S2. True or false: correcting for a new prevalence with Equation 9 changes a model’s AUC.
Answer
False. The correction is a monotone function of \(p\), so the ranking of patients, and therefore AUC, is unchanged. Thresholds, PPV and calibration change.
S3. Sensitivity 0.8, specificity 0.9, prevalence 2%. About how many people are flagged per 1,000 screened, and how many flags per true case?
Answer
\(N_+ = 1000(0.02 \cdot 0.8 + 0.98 \cdot 0.1) = 16 + 98 = 114\) flagged, 16 true cases, so about 7 flags per case found (Equation 8; demo m37-d2 defaults).
S4. RR intervals alternate 0.6 s, 1.0 s, 0.6 s, 1.0 s, … What is nRMSSD?
Answer
Successive differences are all 0.4 s, so RMSSD = 0.4 s; the mean is 0.8 s; so nRMSSD = 0.5 (Equation 7).
S5. Which rung of the evidence ladder is a cluster-randomized trial in which clinicians do or do not see the model’s output?
Answer
A pragmatic randomized trial: it tests whether using the model changes what happens, as in the trial of Yao et al. (2021).
S6. Why does doubling the stride of every layer after the first grow the receptive field faster than doubling the kernel width of one layer?
Answer
In Equation 6 each layer’s \(k_l - 1\) is multiplied by the product of all earlier strides, so strides compound across layers, while one wider kernel adds only once.
Literature figures
These figures are worth looking at alongside this module. We link to them instead of copying them: some licenses do not allow reuse here, and others we could not confirm. Each entry says what to look for and where this module explains it.
- Network against cardiologists. Hannun and colleagues, Figure 1 and Table 1 [Hannun et al. (2019); free full text]. ROC curves for the network and F1 scores for the network and for six cardiologists, against a committee consensus. A publisher correction notes that the x axis of Figure 1a is 1 − specificity. Compare where the network and the average cardiologist fall for AF. This module: Equation 1, interview Q4.
- Confusion matrices. Hannun and colleagues, Figure 2 (Hannun et al. 2019). Which rhythm classes the network and the averaged cardiologists confuse; the correction notes that panel b is for the cardiologists. Both tend to struggle with the same classes, a sign that the labels themselves are hard (From the field).
- A data set built for testing. Wagner and colleagues, the overview figure and the description of the cross-validation folds [Wagner et al. (2020); free full text]. Look at how folds are assigned by patient and why fold 10 holds only human-validated records. This module: interview Q8 and Q12.
- Overtraining in a public challenge. Clifford and colleagues, the table of top-scoring entries with their training, validation and test scores [Clifford et al. (2018); free full text]. Compare each entry’s training score with its test score. This module: From the field, interview Q7.
Further reading
- Overviews. Svennberg et al. (2025): the 2025 EHRA, HRS and ESC statement on the state of AI in clinical EP. Feeny et al. (2020): a review of AI and machine learning in arrhythmias and cardiac EP, written for readers new to the methods.
- Data sets. Wagner et al. (2020) and Clifford et al. (2018), with their PhysioNet pages (Wagner et al. 2022; Clifford et al. 2017).
- Evidence. Attia et al. (2019), Noseworthy et al. (2022), Yao et al. (2021) and Adedinsewo et al. (2024) form a ladder from retrospective accuracy to randomized trials.
- ECG technology. Kligfield et al. (2007): how the digital ECG is acquired and processed.
- Methods. Saerens et al. (2002) on prior shift; Collins et al. (2024) (TRIPOD+AI) on reporting prediction models; m35 for validation basics.
- Training across sites. Dayan et al. (2021) and Roth et al. (2022) on federated learning.
- AI competency areas. Machine learning; AI and society (external validation). See the AI competency map.