Evaluation lab
How the pilot inside IFHAS Memory Testing, part of Abu Dhabi's adult screening programme, measures Thabat against the MoCA (Montreal Cognitive Assessment) the programme already uses. Written for a DoH Research Ethics Committee and reported to STARD 2015 and DECIDE-AI.
People to enrol
1,000
Below the MoCA cut-off needed
100
Checked by a specialist
All flags + 10%
Follow-up
12 months
Worked from Buderer (1996): size the people below and above the cut-off for the precision wanted, then divide by the share expected in each group. A low share below the cut-off drives enrolment.
The 12% share is an assumption. The first three months of IFHAS Memory Testing data replace it before the final sizing goes to the committee.
| Endpoint | What is measured | Target | Analysis |
|---|---|---|---|
| Completion | People who start a check and finish all four activities, alone or with help | 90% or more | Proportion with Wilson 95% CI |
| Test-retest reliability | Composite at enrolment and at a second check 14 days later | ICC 0.75 or more | ICC(2,1) with 95% CI; Bland–Altman limits |
| Sensitivity | A flag when the same-visit MoCA is below the education-adjusted cut-off | 80% or more, lower 95% bound 70% or more | Wilson 95% CI; Begg–Greenes against specialist assessment |
| Specificity | No flag when the same-visit MoCA is at or above the cut-off | 85% or more, lower 95% bound 80% or more | Wilson 95% CI; Begg–Greenes against specialist assessment |
| Meaningful change | Reliable-change flag against a MoCA drop of 2 points or more at 12 months | Cohen's κ 0.40 or more | κ with 95% CI. Sensitivity to change |
| False referrals per 1,000 | Specialist referrals where the specialist finds no cognitive disorder, per 1,000 people checked | 20 or fewer | Rate with Poisson 95% CI |
| Days to clinical assessment | Days from a flag to the family-physician review | Median 14 days or fewer | Median and IQR; Kaplan–Meier for those not yet seen |
| Distress after disclosure | GAD-2 anxiety questions and the Distress Thermometer 2 weeks after a flagged result is shared, against enrolment | Mean rise under 1 point. Anyone with GAD-2 of 3 or more called within 2 working days | Paired difference with 95% CI, as in the REVEAL trial |
Distress after disclosure is measured as well as acknowledged. The FCGA guideline asks that the psychological impact of early risk disclosure be acknowledged, and this endpoint puts a number on it.
| Subgroup | Levels |
|---|---|
| Language | Arabic (Gulf and other dialects) · English · other, through assisted mode |
| Age band | 50–64 · 65–75 |
| Education band | 0–6 years · 7–12 years · 13 years or more |
| Sex | Female · male |
Every endpoint is reported for every level, with its denominator. Current subgroup results