Skip to main content
. 2021 Feb 10;2021(2):CD010945. doi: 10.1002/14651858.CD010945.pub2
Question Response and weighting Explanation
Patient Selection
Was the sampling method appropriate? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Where sampling is used, the designs least likely to cause bias are consecutive sampling or random sampling. Sampling that is based on volunteers or selecting subjects from a clinic or research resource is prone to bias.
Was a case‐control or similar design avoided? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Designs similar to case control that may introduce bias are those designs where the study team deliberately increase or decrease the proportion of subjects with the target condition, which may not be representative. Some case control methods may already be excluded if they mix subjects from various settings.
Are exclusion criteria described and appropriate? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Study will be automatically graded unclear if exclusions are not detailed (pending contact with study authors). Where exclusions are detailed, the study will be graded as "low risk" if exclusions are felt to be appropriate by the review authors. Certain exclusions common to many studies of dementia are: medical instability; terminal disease; alcohol/substance misuse; concomitant psychiatric diagnosis; other neurodegenerative condition. Exclusions are not felt to be appropriate if 'difficult to diagnose' patients are excluded. Post hoc and inappropriate exclusions will be labelled "high risk" of bias.
Index Test
Was plasma and CSF ABeta42 biomarkers' assessment/interpretation performed without knowledge of clinical dementia diagnosis? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Terms such as "blinded" or "independently and without knowledge of" are sufficient and full details of the blinding procedure are not required. Interpretation of the results of the index test may be influenced by knowledge of the results of reference standard. If the index test is always interpreted prior to the reference standard then the person interpreting the index test cannot be aware of the results of the reference standard and so this item could be rated as 'yes'.
For certain index tests the result is objective and knowledge of reference standard should not influence result, for example level of protein in cerebrospinal fluid, in this instance the quality assessment may be "low risk" even if blinding was not achieved.
Were plasma and CSF ABeta42 biomarkers' thresholds pre‐specified? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
For scales and biomarkers there is often a reference point (in units or categories) above which subjects are classified as "test positive"; this may be referred to as threshold; clinical cut‐off or dichotomisation point. A study is classified high risk of bias if the authors define the optimal cut‐off post‐hoc based on their own study data because selecting the threshold to maximise sensitivity and specificity may lead to overoptimistic measures of test performance.
Certain papers may use an alternative methodology for analysis that does not use thresholds and these papers should be classified as not applicable.
Reference Standard
Is the assessment used for clinical diagnosis of dementia acceptable? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Commonly used international criteria to assist with clinical diagnosis of dementia include those detailed in DSM‐IV and ICD‐10. Criteria specific to dementia subtypes include but are not limited to NINCDS‐ADRDA criteria for Alzheimer's dementia; McKeith criteria for Lewy Body dementia; Lund criteria for frontotemporal dementia; and the NINDS‐AIREN criteria for vascular dementia. Where the criteria used for assessment is not familiar to the review authors or the Cochrane Dementia and Cognitive Improvement group ('unclear') this item should be classified as "high risk of bias".
Was clinical assessment for dementia performed without knowledge of the plasma and CSF ABeta42 biomarkers? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Terms such as "blinded" or "independently and without knowledge of" are sufficient and full details of the blinding procedure are not required. Interpretation of the results of the reference standard may be influenced by knowledge of the results of index test.
Patient flow
Was there an appropriate interval between plasma and CSF ABeta42 biomarkers and clinical dementia assessment?
Were all patients who received plasma and/or biomarkers assessment included in the final analysis?
No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
For a cross‐sectional study design, there is potential for the patient to change between assessments. The ideal would be same day assessment. We have set an arbitrary maximum interval of one month between tests, although this may be revised depending on the test and the stability of the condition of interest.
If drop outs these should be accounted for; a maximum proportion of drop outs to remain low risk of bias has been specified as 20%.
Weighting: Low risk
Did all subjects get the same assessment for dementia regardless of plasma and CSF ABeta42 biomarkers? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
There may be scenarios where subjects who score "test positive" on index test have a more detailed assessment. Where dementia assessment differs between subjects this should be classified as high risk of bias.
Were all patients who received plasma and CSF ABeta42 biomarker's assessment included in the final analysis? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
If the number of patients enrolled differs from the number of patients included in the 2 x 2 table then there is the potential for bias. If patients lost to drop‐outs differ systematically from those who remain, then estimates of test performance may differ.
If drop outs these should be accounted for; a maximum proportion of drop outs to remain low risk of bias has been specified as 20%
Were missing plasma and CSF ABeta42 biomarkers' results or uninterpretable plasma and CSF ABeta42 biomarkers' biomarker results reported? No = high risk of bias
Yes = low risk of bias
Unclear = unclear risk of bias
Where missing or uninterpretable results are reported, and if there is substantial attrition (we have set an arbitrary value of 50% missing data), this should be scored as 'no'. If those results are not reported, this should be scored as 'unclear' and authors will be contacted.
Anchoring statements to assist with assessment for applicability
Question Explanation
Were included patients representative of the general population of interest? The included patients should match the intended population as described in the review question. The review authors should consider population in terms of symptoms; pre‐testing; potential disease prevalence; setting.
If there is a clear ground for suspecting an unrepresentative spectrum the item should be rated poor applicability.
Index test
Were sufficient data on plasma and CSF ABeta42 biomarkers' application given for the test to be repeated in an independent study? Variation in technology, test execution, and test interpretation may affect estimate of accuracy. In addition, the background, and training/expertise of the assessor should be reported and taken in consideration. If plasma and CSF ABeta42 biomarkers were not performed consistently this item should be rated poor applicability.
Reference standard
Was clinical diagnosis of dementia made in a manner similar to current clinical practice? For many reviews, inclusion criteria and assessment for risk of bias will already have assessed the dementia diagnosis. For certain reviews an applicability statement relating to reference standard may not be applicable. There is the possibility that a form of dementia assessment, although valid, may diagnose a far larger proportion of subjects with disease than usual clinical practice. In this instance the item should be rated poor applicability.