Abstract
Introduction
Cancer-related cognitive impairment (CRCI) can have detrimental effects on quality of life, even among patients with non-central nervous system (CNS) cancers. Several studies have been conducted to explore different markers associated with CRCI to understand its pathobiology. It is proposed that the underlying mechanisms of CRCI are related to a cascade of physiological adaptive events in response to cancer and/or treatment. Hence, peripheral blood would be a logical source to observe and identify these physiological events. This paper outlines the protocol for a scoping review being conducted to summarise the extant literature regarding blood-based biomarkers of CRCI among patients with non-CNS cancer.
Methods/analysis
Methods will be informed by the updated guidelines of Arksey and O’Malley. The systematic search for literature will include electronic databases, handsearching of key journals and reference lists, forward citation tracking and consultation with content experts. Study selection will be confirmed by duplicate review and calculation of inter-rater reliability. Data to be charted will include study design, sample size, cancer and treatment characteristics, demographic characteristics, cognitive variable/s and biomarkers assessed, associations between cognitive functioning and biomarkers (including statistics used), and rigour in biomarker sample collection and processing. Results will be presented through: (1) a descriptive numerical summary of studies, including a flow diagram based on the Preferred Reporting Items for Systematic Reviews and Meta-analyses statement, (2) a list of blood-based biomarkers associated with CRCI and (3) a narrative overview developed through collaboration among the research team and consultation with content experts.
Dissemination
The findings of this review will highlight current directions and gaps in the current body of evidence that may lead to improved rigour in future CRCI investigations. The dissemination of this work will be facilitated through the involvement of clinicians and researchers on the research team, an external consultation process and the presentation of the results through scholarly publication and presentation.
Keywords: Biomarkers, Cancer-related Cognitive Impairment (crci), Scoping Review, Blood, Neurocognition
Strengths and limitations of this study.
This review will apply scoping review methodology to map the literature regarding blood-based biomarkers of cancer-related cognitive impairment.
Interpretation of the data will involve the collaboration of clinicians, researchers and content experts.
The review will be limited to research conducted in adults with non-central nervous system cancers and published in English.
Introduction
Improved survival after cancer treatment has led to greater impetus to minimise the long-term adverse effects of the disease and its treatment. Cancer-related cognitive impairment (CRCI) is now widely regarded as a prevalent and clinically significant issue among adult patients with non-central nervous system (CNS) tumours, particularly after systemic treatment with chemotherapy.1 2 CRCI is typically characterised by problems in memory, attention, processing speed and executive functioning.3 4 The potential consequences of CRCI on survivors’ quality of life are significant, including challenges with emotional well-being, return to work and ability to engage effectively in self-care5 6 in the months to years after treatment.
Numerous reviews of clinical studies of patients with non-CNS cancer indicate wide variation in the severity, trajectory and duration of CRCI that can be expected after cancer treatment.7–13 Estimates of prevalence have also varied widely, ranging from 17% to 75% of patients depending on how CRCI is measured.12 14–16 CRCI has demonstrated associations with a range of factors, such as treatment severity, overall functional status and affective symptoms, but study findings are largely mixed.12 16 17 Ultimately, the identification of patients most likely to experience persistent negative cognitive outcomes remains unclear and effective interventions for routine use have yet to be established.18–20 To address these gaps, a greater understanding of the biological mechanisms underlying CRCI is needed.
Several candidate mechanisms of CRCI have been proposed, including inflammation and cytokine dysregulation, chemotherapy-induced epigenetic changes, blood–brain barrier disruption, hormone deficiencies, oxidative DNA damage and shortened telomere length, and genetic susceptibility.21–26 However, the heterogeneity and design limitations within the emerging body of evidence have led to recommendations for harmonising study methodologies and moving towards multisite, longitudinal research.3 27 Such approaches would support the demonstration of robust relationships between measurable biological processes and cognitive outcomes.
In this context, peripheral blood is appealing as a biomarker data source in CRCI research. Biomarkers or biological markers have been broadly defined as ‘a characteristic that is objectively measured and evaluated as an indicator of normal biological processes, pathogenic processes or pharmacological responses to therapeutic intervention’ (Biomarkers Definition Working Group, p89).28 Peripheral blood offers a rich source of circulating proteins, metabolites, cells and genomic markers that may reflect processes underlying CRCI. For example, cytokines produced in the periphery reach the brain through several pathways, including directly through the blood–brain barrier, to stimulate microglia and other immune cells to secrete proinflammatory cytokines in the brain, which at elevated levels can produce negative effects to learning, memory and neuronal plasticity.29 Bringing together the current evidence related to CRCI biomarkers in peripheral blood will suggest priority biomarkers for future investigation in this area, thereby facilitating consistency in research approaches and advancement towards large prospective studies. In addition, aligned with the movement towards personalised medicine, the determination of sensitive and specific blood-based biomarkers could potentially prove useful in stratifying risk for poor cognitive outcomes and guiding treatment decision-making in clinical practice.
The purpose of this paper is to report our protocol for a scoping review that will summarise the extant literature regarding blood-based biomarkers of cognitive impairment among patients with non-CNS cancer. A scoping review methodology was chosen as it facilitates a characterisation of the range and extent of existing evidence available on a given topic, particularly when a body of literature is emerging and expected to be heterogeneous in nature.30 31 Such evidence is often not amendable to systematic review methods that employ stringent selection criteria and quality appraisal processes aimed to answer narrowly focused questions, primarily of intervention effectiveness.30 While detailed evidence reviews related to select hypothesised biological mechanisms of CRCI have been previously published,21–23 32 we describe in this paper our approach to map the evidence on the potential array of blood-based biomarkers for CRCI more broadly. Such work will inform priority research areas and opportunities for moving towards the identification of blood-based biomarkers that are clinically significant and feasible to collect. The study will follow the methodology of Arksey and O’Malley31 and refined by Levac et al,33 which outlines a six-stage process for conducting scoping reviews.
Methods
Stage 1: identifying the research question
The scoping review is guided by the following research question:
What blood-based biomarkers have been associated with CRCI in patients with non-CNS cancer?
For the purposes of this review, blood-based biomarkers are operationalised as molecular indicators detected in blood, blood products, plasma or serum. We define CRCI as difficulties in thinking processes, including but not limited to memory, attention, concentration, processing speed and executive functioning among patients with a cancer diagnosis.3 34 35
Stage 2: identifying relevant studies
The search for relevant studies will incorporate electronic databases, handsearching of key journals, review of reference lists, forward citation tracking and consultation with experts in CRCI and symptom science. Search strategies were developed by an academic health science librarian (APA) with input from project leads. A comprehensive search of electronic databases involved MEDLINE (Ovid MEDLINE 1946 to January Week 4 2017, Ovid MEDLINE In-Process and Other Non-Indexed Citations 6 February 2017), EMBASE (Embase Classic+Embase 1947 to 26 February 2017), PsycINFO (PsycINFO 1974 to January Week 5 2017), Cumulative Index to Nursing and Allied Health Literature (CINAHL) (1 January 2006 to 7 February 2017), Cochrane Central Register of Controlled Trials (CENTRAL) and grey literature. The search strategies were translated using each database platform’s command language, controlled vocabulary and appropriate search fields. Medical subject headings (MeSH), EMTREE terms, American Psychological Association thesaurus terms, CINAHL headings and textwords were used to search the concepts of synonyms of ‘blood’, ‘biological markers’, ‘neurocognitive impairment’ and ‘cancer’. Language limits were applied to capture articles in English in all databases, where applicable. Publication date limits were also applied to capture articles published from 2006 to present. Final searches were completed in February 2017. The full MEDLINE search strategy is provided in online supplementary appendix A.
bmjopen-2017-017578supp001.pdf (94KB, pdf)
The database search will be supplemented by: (1) hand searches of the table of contents for the past 10 years of key journals known to publish studies related to CRCI (see box); (2) review of reference lists of included studies (‘snowballing’) and (3) forward citation tracking of included studies in Scopus and Web of Science. Consultation with content experts, including authors of included studies and individuals identified through our collective research networks, will also be conducted to determine if known relevant articles have been missed.
Box. List of journals for hand search.
Annals of Oncology
Blood
Brain, Behaviour, and Immunity
Journal of Clinical Oncology
Journal of Pain and Symptom Management
Journal of Psychosomatic Research
Psycho-Oncology
Psychosomatic Medicine
Supportive Care in Cancer.
All records retrieved will be downloaded into a bibliographic software (EndNote) where duplicates will be removed and recorded. Finally, citations will be uploaded to Covidence, an internet-based software programme designed to facilitate review data management and collaboration between reviewers during the study selection process.
Stage 3: study selection
Studies selected for the scoping review will be included if they: (1) are clinical studies of patients with a cancer diagnosis; (2) enrolled adults (≥18 years of age); (3) include a measurement of blood-based biomarkers; (4) include a subjective or objective assessment of cognitive functioning; (5) report on the association between the biomarker and cognitive functioning and (6) are written in English. Studies will be excluded that focus on cancers of the CNS or paediatric cancer, due to likely differences in pathology of cognitive impairment in these populations. Case reports, editorials, letters, literature reviews, meeting abstracts and dissertations will be excluded.
Study selection will occur through two phases using the Covidence platform. In phase I, titles and abstracts of citations will be screened for relevance in duplicate, by two independent reviewers, based on the research question and inclusion/exclusion criteria. Citations determined as relevant will be retrieved in full-text and proceed to phase II screening. In phase II, the inclusion and exclusion criteria will be applied to each of the full-text articles by two independent reviewers. Included studies will form the basis of the scoping review; otherwise, reasons for study exclusion after full-text review will be documented. In both phases of study selection, inter-rater reliability between reviewers on determinations of study inclusion will be assessed by calculating a Cohen’s κ statistic,36 and strong agreement (κ≤0.80)37 will be ensured prior to proceeding. Any disagreements between the two reviewers will be resolved by a third reviewer.
Given the exploratory and iterative nature of scoping studies, reviewer meetings throughout the course of the study selection process will allow for the discussion, clarification and refinement of inclusion/criteria as needed.31 33
Stage 4: charting the data
‘Charting’ the data involves the standardised collection of key items of information from the included studies, which will form the basis of the analysis.31 A data charting form developed by the research team will be used to ensure that the most appropriate data is collected from each study to answer the research question. The data to be extracted from each study will include: publication year, study location, study aim, study design, sample size, cancer diagnoses, severity of disease (eg, metastatic, non-metastatic), cancer treatment received, demographic characteristics (eg, age, sex), cognitive measure(s) (eg, name of questionnaires or neuropsychological tests), cognitive variable measured (eg, attention, verbal memory, executive function), biomarker assessed, biomarker sample source (eg, serum, plasma), association between cognitive functioning and biomarkers, and statistical approach used in determining association. Scoping reviews typically do not involve a formalised quality assessment of included studies,31 33 however, including a consideration of methodological characteristics of existing studies can facilitate the identification of gaps in the evidence base.38 As such, data will also be collected from each study regarding documented rigour in biomarker sample collection (eg, timing), processing and testing (eg, preparation, storage, assay protocol), and analysis (eg, replication), as available. Data charting fields may be further updated on closer consideration of the included studies.33
Independent data extraction by two reviewers (MA, WB) on a shared 10 studies will be used to assess clarity of the data charting form and consistency across reviewers. Discrepancies will be discussed in collaboration with the principal investigator (SJM) and revisions made to the data charting form as required. After consistency between reviewers is established, each additional included study will have data extracted by a single reviewer (MA or WB). Data extraction for each study will be further reviewed by one of the study investigators to ensure accuracy.
Stage 5: collating, summarising and reporting the results
This stage will be composed of three steps, as recommended by Levac et al33: (1) analysing the data; (2) reporting results and (3) applying meaning to the results. In the first step, data analysis will involve a descriptive numerical summary analysis and a qualitative analysis. The descriptive numerical summary will include a description of included studies, such as number of studies included types of study designs, sample characteristics, cognitive assessment tools and biomarkers assessed. In addition, a flowchart based on the Preferred Reporting Items for Systematic Reviews and Meta-analyses statement39 will be added to present the flow of studies through the scoping review screening process. A qualitative summary of the results will be developed with involvement from all members of the research team, who will work collaboratively to review the data for overarching patterns and themes. In the second step, a list of the blood-based biomarkers that have shown associations with cognitive functioning will be reported, with details of the relevant evidence about these relationships. In the third step, the broader meaning of the results will be considered through a narrative overview that will characterise dominant lines of research regarding potential blood-based biomarkers of cognitive functioning, identify opportunities and gaps in the current body of evidence, and the potential implications on clinical practice, policy and future research.
Stage 6: consultation
Consultation allows for broader stakeholder involvement in the interpretation of the available literature. While stakeholders representing extensive clinical and research expertise in oncology are engaged as part of the research team, a consultation process will be undertaken to engage feedback from external stakeholders that will inform the final presentation of results. Specifically, diverse perspectives from relevant practice, policy and research arenas will be sought through presentation of preliminary findings at various academic conferences and meetings, in order to enhance the validity and impact of this review.
Ethics and dissemination plan
Overall, the current review will characterise dominant lines of research regarding potential blood-based biomarkers of cognitive functioning, emerging topics and gaps in the current body of evidence, and implications of the design of future work in this area. The results of this review will contribute to the refinement of research efforts to identify blood-based biomarkers that are clinically significant and feasible to collect. The dissemination of this work is facilitated through an integrated knowledge translation approach, which includes the involvement of clinicians and researchers on the research team and an external consultation process. Moreover, the presentation of the results through scholarly publication and presentation will contribute to its uptake. The expected study end date for this work is February 2018. Ethical approval for this review is not required.
Supplementary Material
Footnotes
Contributors: SJM, JK, RL, APA and DLK were involved in the conception and design of the protocol. SJM, MA, WB and LS were involved in the drafting of the article. All authors contributed to final approval of the article.
Funding: This study is funded by the Pilot Research Grant Funding Program of the Lawrence S. Bloomberg Faculty of Nursing, University of Toronto.
Competing interests: None declared.
Patient consent: Not required.
Ethics approval: Ethical approval for this review is not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
References
- 1.Joly F, Giffard B, Rigal O, et al. Impact of Cancer and Its Treatments on Cognitive Function: Advances in Research From the Paris International Cognition and Cancer Task Force Symposium and Update Since 2012. J Pain Symptom Manage 2015;50:830–41. 10.1016/j.jpainsymman.2015.06.019 [DOI] [PubMed] [Google Scholar]
- 2.Vardy J, Wefel JS, Ahles T, et al. Cancer and cancer-therapy related cognitive dysfunction: an international perspective from the Venice cognitive workshop. Ann Oncol 2008;19:623–9. 10.1093/annonc/mdm500 [DOI] [PubMed] [Google Scholar]
- 3.Wefel JS, Vardy J, Ahles T, et al. International Cognition and Cancer Task Force recommendations to harmonise studies of cognitive function in patients with cancer. Lancet Oncol 2011;12:703–8. 10.1016/S1470-2045(10)70294-1 [DOI] [PubMed] [Google Scholar]
- 4.Jansen CE, Miaskowski C, Dodd M, et al. A metaanalysis of studies of the effects of cancer chemotherapy on various domains of cognitive function. Cancer 2005;104:2222–33. 10.1002/cncr.21469 [DOI] [PubMed] [Google Scholar]
- 5.Mayo S, Messner HA, Rourke SB, et al. Relationship between neurocognitive functioning and medication management ability over the first 6 months following allogeneic stem cell transplantation. Bone Marrow Transplant 2016;51:841–7. 10.1038/bmt.2016.2 [DOI] [PubMed] [Google Scholar]
- 6.Harder H, Cornelissen JJ, Van Gool AR, et al. Cognitive functioning and quality of life in long-term adult survivors of bone marrow transplantation. Cancer 2002;95:183–92. 10.1002/cncr.10627 [DOI] [PubMed] [Google Scholar]
- 7.Falleti MG, Sanfilippo A, Maruff P, et al. The nature and severity of cognitive impairment associated with adjuvant chemotherapy in women with breast cancer: a meta-analysis of the current literature. Brain Cogn 2005;59:60–70. 10.1016/j.bandc.2005.05.001 [DOI] [PubMed] [Google Scholar]
- 8.Phillips KM, McGinty HL, Cessna J, et al. A systematic review and meta-analysis of changes in cognitive functioning in adults undergoing hematopoietic cell transplantation. Bone Marrow Transplant 2013;48:1350–7. 10.1038/bmt.2013.61 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Anderson-Hanley C, Sherman ML, Riggs R, et al. Neuropsychological effects of treatments for adults with cancer: a meta-analysis and review of the literature. J Int Neuropsychol Soc 2003;9:967–82. 10.1017/S1355617703970019 [DOI] [PubMed] [Google Scholar]
- 10.Stewart A, Bielajew C, Collins B, et al. A meta-analysis of the neuropsychological effects of adjuvant chemotherapy treatment in women treated for breast cancer. Clin Neuropsychol 2006;20:76–89. 10.1080/138540491005875 [DOI] [PubMed] [Google Scholar]
- 11.Hutchinson AD, Hosking JR, Kichenadasse G, et al. Objective and subjective cognitive impairment following chemotherapy for cancer: a systematic review. Cancer Treat Rev 2012;38:926–34. 10.1016/j.ctrv.2012.05.002 [DOI] [PubMed] [Google Scholar]
- 12.Pullens MJ, De Vries J, Roukema JA. Subjective cognitive dysfunction in breast cancer patients: a systematic review. Psychooncology 2010;19:1127–38. 10.1002/pon.1673 [DOI] [PubMed] [Google Scholar]
- 13.Hodgson KD, Hutchinson AD, Wilson CJ, et al. A meta-analysis of the effects of chemotherapy on cognition in patients with cancer. Cancer Treat Rev 2013;39:297–304. 10.1016/j.ctrv.2012.11.001 [DOI] [PubMed] [Google Scholar]
- 14.Vardy J, Tannock I. Cognitive function after chemotherapy in adults with solid tumours. Crit Rev Oncol Hematol 2007;63:183–202. 10.1016/j.critrevonc.2007.06.001 [DOI] [PubMed] [Google Scholar]
- 15.Janelsins MC, Kesler SR, Ahles TA, et al. Prevalence, mechanisms, and management of cancer-related cognitive impairment. Int Rev Psychiatry 2014;26:102–13. 10.3109/09540261.2013.864260 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Janelsins MC, Kohli S, Mohile SG, et al. An update on cancer- and chemotherapy-related cognitive dysfunction: current status. Semin Oncol 2011;38:431–8. 10.1053/j.seminoncol.2011.03.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hess LM, Insel KC. Chemotherapy-related change in cognitive function: a conceptual model. Oncol Nurs Forum 2007;34:981–94. 10.1188/07.ONF.981-994 [DOI] [PubMed] [Google Scholar]
- 18.Treanor CJ, McMenamin UC, O’Neill RF, et al. Non-pharmacological interventions for cognitive impairment due to systemic cancer treatment. Cochrane Database Syst Rev 2016:CD011325 10.1002/14651858.CD011325.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.National Comprehensive Cancer Network. Survivorship, Version 2.2014. National Comprehensive Cancer Network 2014. [Google Scholar]
- 20.Von Ah D, Jansen C, Allen DH, et al. Putting evidence into practice: evidence-based interventions for cancer and cancer treatment-related cognitive impairment. Clin J Oncol Nurs 2011;15:607–15. 10.1188/11.CJON.607-615 [DOI] [PubMed] [Google Scholar]
- 21.Cheung YT, Lim SR, Ho HK, Hk H, et al. Cytokines as mediators of chemotherapy-associated cognitive changes: current evidence, limitations and directions for future research. PLoS One 2013;8:e81234 10.1371/journal.pone.0081234 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Wang XM, Walitt B, Saligan L, et al. Chemobrain: a critical review and causal hypothesis of link between cytokines and epigenetic reprogramming associated with chemotherapy. Cytokine 2015;72:86–96. 10.1016/j.cyto.2014.12.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ren X, St Clair DK, Butterfield DA. Dysregulation of cytokine mediated chemotherapy induced cognitive impairment. Pharmacol Res 2017;117:267–73. 10.1016/j.phrs.2017.01.001 [DOI] [PubMed] [Google Scholar]
- 24.Ahles TA, Saykin AJ. Candidate mechanisms for chemotherapy-induced cognitive changes. Nat Rev Cancer 2007;7:192–201. 10.1038/nrc2073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Saykin AJ, Ahles TA, McDonald BC. Mechanisms of chemotherapy-induced cognitive disorders: neuropsychological, pathophysiological, and neuroimaging perspectives. Semin Clin Neuropsychiatry 2003;8:201–16. [PubMed] [Google Scholar]
- 26.Merriman JD, Von Ah D, Miaskowski C, et al. Proposed mechanisms for cancer- and treatment-related cognitive changes. Semin Oncol Nurs 2013;29:260–9. 10.1016/j.soncn.2013.08.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Vardy J, Rourke S, Tannock IF. Evaluation of cognitive function associated with chemotherapy: a review of published studies and recommendations for future research. J Clin Oncol 2007;25:2455–63. 10.1200/JCO.2006.08.1604 [DOI] [PubMed] [Google Scholar]
- 28.Biomarkers Definitions Working Group. Biomarkers and surrogate endpoints: preferred definitions and conceptual framework. Clin Pharmacol Ther 2001;69:89–95. 10.1067/mcp.2001.113989 [DOI] [PubMed] [Google Scholar]
- 29.Yirmiya R, Goshen I. Immune modulation of learning, memory, neural plasticity and neurogenesis. Brain Behav Immun 2011;25:181–213. 10.1016/j.bbi.2010.10.015 [DOI] [PubMed] [Google Scholar]
- 30.Peters MD, Godfrey CM, Khalil H, et al. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc 2015;13:141–6. 10.1097/XEB.0000000000000050 [DOI] [PubMed] [Google Scholar]
- 31.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8:19–32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
- 32.Wardill HR, Mander KA, Van Sebille YZ, et al. Cytokine-mediated blood brain barrier disruption as a conduit for cancer/chemotherapy-associated neurotoxicity and cognitive dysfunction. Int J Cancer 2016;139:2635–45. 10.1002/ijc.30252 [DOI] [PubMed] [Google Scholar]
- 33.Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010;5:1–9. 10.1186/1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Wefel JS, Witgert ME, Meyers CA. Neuropsychological sequelae of non-central nervous system cancer and cancer therapy. Neuropsychol Rev 2008;18:121–31. 10.1007/s11065-008-9058-x [DOI] [PubMed] [Google Scholar]
- 35.Williams AM, Zent CS, Janelsins MC. What is known and unknown about chemotherapy-related cognitive impairment in patients with haematological malignancies and areas of needed research. Br J Haematol 2016;174:835–46. 10.1111/bjh.14211 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Cohen J: A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 1960;20:37–46. [Google Scholar]
- 37.McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012;22:276–82. [PMC free article] [PubMed] [Google Scholar]
- 38.Pham MT, Rajić A, Greig JD, et al. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Res Synth Methods 2014;5:371–85. 10.1002/jrsm.1123 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009;339:b2535 10.1136/bmj.b2535 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2017-017578supp001.pdf (94KB, pdf)
