Skip to main content
Digital Health logoLink to Digital Health
. 2025 May 5;11:20552076251334449. doi: 10.1177/20552076251334449

Moving toward the digitalization of neuropsychological tests: An exploratory study on usability and operator perception

Maria Grazia Maggio 1,*, Fabio Mauro Giambò 1,*, Martina Barbera 2, Paolo De Pasquale 1,, Francesca Bruno 2, Andrea Calderone 2, Angelo Quartarone 1, Amelia Rizzo 2, Rocco Salvatore Calabrò 1
PMCID: PMC12059415  PMID: 40343060

Abstract

Introduction

The COVID-19 pandemic highlighted the potential of digital tools in clinical neuropsychology, prompting a shift from traditional paper-based assessments to digital alternatives. However, research on this topic remains limited. This study evaluates the usability of digital neuropsychological assessment tools and examines healthcare professionals’ perceptions of their reliability and efficiency in clinical settings.

Methods

A cross-sectional observational study was conducted at the Centro Neurolesi “Bonino-Pulejo.” Healthcare professionals, including neuropsychologists and clinicians, were asked to alternate between digital and traditional paper-based assessments. The usability of the digital tools was measured using the System Usability Scale (SUS), while qualitative feedback was gathered through open-ended questions.

Results

A panel of 29 healthcare professionals participated in the study. The quantitative analysis of the SUS scores revealed a mean score of 89.48 (SD = 10.12) for the digital format and 81.38 (SD = 11.49) for the traditional format. A Wilcoxon signed-rank test showed a statistically significant difference between the two conditions (p = 0.0003), indicating that participants found the digital tools to be more usable compared to the traditional assessment format. Key qualitative feedback indicated that participants appreciated the speed, efficiency, and reduced error rates of digital tools, with many noting improvements in data organization and reporting.

Conclusions

Although the study's single-center design, small sample size, and reliance on self-reported measures may limit the generalizability of the findings, the results underscore the high usability and effectiveness of digital neuropsychological assessments. Healthcare professionals reported improved efficiency, accuracy, and data organization, supporting the tool's potential integration into clinical practice. These findings underscore the promise of digital tools in modern neuropsychology, paving the way for future multicentric and longitudinal research to validate their broader applicability.

Keywords: Clinical neuropsychology, digital tools, health professionals, neuropsychological assessments, neurorehabilitation, usability

Introduction

In recent years, technology has significantly impacted the medical field, extending to clinical neuropsychology, especially as the COVID-19 pandemic highlighted the potential of digital tools in healthcare delivery. 1 This rapid shift pointed out the need to explore digital solutions in neuropsychological assessment, where traditional paper-based tools continue to dominate despite notable limitations. A key limitation of paper-based assessments is their infrequent data collection, providing only a snapshot of cognitive functioning instead of capturing fluctuations over time.2,3 Traditional assessments overlook real-time factors like fatigue and time of day, which impact cognitive performance.4,5 Studies indicated that cognitive performance fluctuates throughout the day, with older adults generally performing better in the morning than in the afternoon or evening.6,7

Additionally, these assessments are often time-consuming, limiting the capacity to assess more patients and contributing to longer wait times. 8 Human error during scoring and data transcription also poses a risk, potentially affecting result accuracy and diagnostic reliability. 9 Furthermore, paper-based tests lack adaptive testing capabilities, meaning that test difficulty remains fixed regardless of the participant's performance, unlike digital assessments that can dynamically adjust based on real-time responses. 10 Another significant challenge is data management and storage. Paper records require considerable physical space, are susceptible to loss or damage, and make longitudinal tracking of cognitive changes more difficult. The absence of automated data integration further complicates research applications and clinical follow-ups. 11 Given these challenges, the transition to digital assessments represents a promising solution to overcome many of these limitations, offering improved efficiency, accuracy, and accessibility in neuropsychological evaluation. Digital assessments may address some of these issues. Adaptive testing enables shorter, more personalized sessions by adjusting item difficulty based on previous responses, while automated scoring enhances measurement accuracy by minimizing manual errors.12,13 Digital formats also enable clinicians to conduct group assessments, allowing them to reach more patients within the same timeframe.14,15 Despite these advantages, digital assessments are not yet widely adopted. A key barrier to their adoption is the perceived usability among healthcare professionals (HCPs), as their acceptance is critical for routine implementation in clinical settings. Although digital cognitive assessments can enhance testing efficiency, accuracy, and accessibility, 16 many neuropsychologists’ express concerns about their reliability and validity compared to traditional methods. 17 To encourage wider adoption, it is essential to ensure that digital tools meet the psychometric standards of traditional assessments. The shift from paper-based to digital neuropsychological tests offers the opportunity to improve efficiency and data collection. 18 However, usability remains a critical factor for successful implementation, digital tools must be intuitive and accessible, ensuring that they measure cognitive abilities rather than users’ proficiency with the technology. 19 Furthermore, HCPs must trust these tools, emphasizing the need for adequate training and support.20,21 Most existing research has primarily focused on fully remote testing or the development of specific digital tools, often overlooking their practical implementation in clinical settings.18,22 While studies suggest that digital cognitive assessments can improve testing efficiency, accuracy, and accessibility, 16 concerns persist regarding their validity and reliability compared to traditional methods. 17 Addressing these challenges, this study contributes to an emerging field by evaluating the usability and feasibility of digital neuropsychological tools when administered in person. Given these gaps in the literature, it is essential to investigate how digital neuropsychological assessments perform in real-world clinical settings and how they are perceived by HCPs. Unlike previous research, which has primarily examined fully remote assessments or the implementation of specific digital tests,22,23 this study focuses on the usability of digitized neuropsychological assessment tools in face-to-face contexts. Additionally, it explores HCPs’ perceptions regarding their reliability, efficiency, and potential for integration into routine clinical workflows.

Methods

Study design and study population

This study is a cross-sectional observational study conducted at the IRCCS Centro Neurolesi “Bonino-Pulejo” from August 2023 to August 2024. The aim was to evaluate the usability and perception of digital neuropsychological assessment tools among HCPs. Written informed consent was obtained from all participating HCPs. The study was conducted in accordance with the Declaration of Helsinki and approved by Institutional Review Board (IRB) and Ethics Committee of IRCCS Centro Neurolesi “Bonino-Pulejo,” Messina, Italy (Ethics Approval ID: 19/2023).

The study included a diverse group of HCPs such as neuropsychologists, physiotherapists, speech therapists, and clinicians involved in cognitive and functional assessments. The inclusion criteria were: (i) a degree in a relevant healthcare field (e.g. psychology, neuropsychology, physiotherapy, speech therapy, or related disciplines); (ii) at least 1 year of experience in administering neuropsychological or functional assessments; (iii) at least basic experience with both digital and paper-based test formats, ensuring an adequate level of familiarity for a comparative evaluation; active engagement in cognitive assessment, rehabilitation, or neuropsychological testing in routine practice. Moreover, the following exclusion criteria were applied: (i) lack of prior exposure to digital neuropsychological assessments, as this could introduce variability in usability perception; (ii) limited clinical experience (i.e. professionals with less than 1 year of practice in neuropsychological or functional assessment); (iii) roles without direct involvement in patient assessment.

Procedure

Before entering the study, all HCPs attended an introductory session with an IT engineer to review the digital system's functionalities and operations. The session served as a brief refresher rather than a formal training, minimizing potential bias in usability perceptions. During the 1-year study, HCPs alternated between digital and paper-based formats for the neuropsychological assessments most used in their practice (see table 1). Both formats were integrated into routine clinical assessments, allowing HCPs to gain practical experience with digital tools while maintaining the traditional paper method as a reference.

Table 1.

Test/scale in digital format.

Test Acronym Description
12-item short form survey 20 SF-12 a self-reported outcome measure assessing the impact of health on an individual's everyday life
36-item short form survey 24 SF-36 an outcome measure instrument that is often used, well-researched, self-reported measure of health
Beck Depression Inventory – II 25 BDI-II is a widely used 21-item self-report inventory measuring the severity of depression in adolescents and adults
Brain Injurj Sexuality Questionnaire 26 BIQS a measurement tool for future traumatic brain injury sexuality research
Brief Repeatable Battery of Neuropsychological Tests in Multiple Sclerosis 27 BRB-NT a sensitive measure of cognitive impairment in multiple sclerosis patients
Body Uneasiness Test 28 BUT a valuable tool for the screening and the clinical assessment of abnormal body image attitudes and eating disorders
Box & Block Test 29 BBT measures unilateral gross manual dexterity
Caregiver Burden Inventory 30 CBI a questionnaire that aims to evaluate the specific aspects of the caregiver's burden
Child Behavior Checklist For Ages 1.5–5 31 CBCL 1.5–5 a questionnaire that assesses a broad range of emotional and behavioral problems in children, versions for preschool (for ages 1.5–5) children
Child Behavior Checklist For Ages 6–18 31 CBCL 6–18 a questionnaire that assesses a broad range of emotional and behavioral problems in children, versions for school-age (for ages 6–18) children
Composite Autonomic Symptom Score 32 COMPASS-31 is a validated self-assessment instrument designed for clinical autonomic research and practice
Conners 3 33 assesses cognitive, behavioral, and emotional problems, with a focus on ADHD and comorbid disorders
Coping Orientation To Problems Experienced 34 COPE is a self-report questionnaire designed to measure effective and ineffective ways to cope with a stressful life event
Disability Of The Arm, Shoulder And Hand 35 DASH asks about your symptoms as well asyour ability to perform certain activities
Douleur Neuropathique 36 DN4 a simple tool to screen for neuropathic pain
Dyadic Trust Scale 37 DTS an instrument that assesses dyadic trust in fraternal relationships
Dyadic Adjustment Scale 38 DAS is a measure designed to assess the relationship quality of intact (married or cohabiting) couples
Edinburgh Handedness Inventory 39 is a measurement scale used to assess the dominance of a person's right or left hand in everyday activities
Emotional Quotient Inventory 40 EQ a self-report tool that assesses emotional intelligence across domains such as self-perception, and interpersonal skills
Family Relationships Index 41 FRI a self-report measure that provides an overall index of the quality of the family environment
Female Sexual Function Index 42 FSFI a self-report questionnaire designed to measure sexual functioning in women
Franchay Activities Index 43 FAI a measure of instrumental activities of daily living for use with patients recovering from stroke
Fugl-Meyer 44 FMA a stroke-specific, performance-based impairment index
Goal Attainment Scale 45 GAS a method of scoring the extent to which a patient's individual goals are achieved in the course of intervention in a standardized way as to allow statistical analysis
Hamilton Anxiety Rating Scale 46 HAM-A a psychological questionnaire used by clinicians to rate the severity of a patient's anxiety
Hamilton Depression Rating Scale 47 HAM-D a multiple-item questionnaire used to indicate depression
Hospital Anxiety And Depression Scale 48 HADS a standardized questionnaire capable of identifying states of anxiety and depression in patients affected by organic diseases
Intrinsic Motivation Inventory 49 IMI a multidimensional measurement used in assessing the subjective experiences of participants when developing an activity
International Index Of Erectile Function Questionnaire (5 Items) 50 IIEF-5 a multidimensional scale that can be used to evaluate the most relevant aspects of male sexual function (5 items)
Modified Barthel Index 51 a well-established patient-centered to evaluate the functional status of patients at admission and discharge
Motricity Index 52 MI an ordinal method of measuring limb strength
Non-Motor Symptoms Scale For Parkinson's Disease 53 NMSS a scale to assess a wide range of non-motor symptoms in patients with Parkinson's disease
Parkinson's Disease Questionnaire 54 PDQ-39 a self-report questionnaire, which assesses Parkinson's disease-specific health related quality over the last month
Personality Inventory For DSM-5-SF 55 PID-5 a measure designed to assess dysfunctional personality
Perth Alexithymia Questionnaire 56 PAQ a self-report measure of alexithymia
Post-Stroke Depression Rating Scale 57 PSDRS a tool for the evaluation of early symptoms of depression in patients in the first week after cerebral stroke
Psychological Well-Being Scale 58 PWBS a self-assessment questionnaire divided into six scales representing the dimensions of psychological well-being
Quality Of Life In Autism 59 QoLA a validated measure of QoL for parents of autistic children
Personal Meaning Organization Assessment Questionnaire 60 QSP a questionnaire for the evaluation of the interaction between parents and children on the development of the child
Repetitive Behaviors Scale – Revised 61 RBS-R a self-report questionnaire that is used to measure the breadth of repetitive behavior in children and adolescents with Autism Spectrum disorders
Scoring Forms For Multiple Sclerosis Quality Of Life 62 MSQOL-54 a battery providing a quality of life measure that is both generic and MS-specific
Semmes-Weinstein Monofilament Test 63 SWMT is used to assess the threshold stimulus necessary for perception of light touch to deep pressure
Sexual Motivation Scale 64 SEXMS measures the different types of motivation proposed by self-determination theory (SDT) and their associations to positive and negative sexual outcomes
Short Sensory Profile 65 SSP a tool to identify the sensory profile of children and adolescents
Social Dominance Orientation-7 Scale 66 SDO-7 a measure of an individual's preference for hierarchy within any social system and the domination over lower-status groups
State-Trait Anxiety Inventory 67 STAI a psychological inventory, it measures two types of anxiety – state anxiety and trait anxiety
Strengths And Difficulties Questionnaire 68 SDQ a brief emotional and behavioral screening questionnaire for children and young people
System Usability Scale 68 SUS a questionnaire-based method to assess the usability of a system or product through a series of standardized questions
Toronto Alexithymia Scale 69 TAS-20 a self-administered questionnaire that measures difficulty in identifying and describing emotions
World Health Organization Quality Of Life Brief Version 70 WHOQOL-26 a brief assessment of quality of life in large epidemiological studies and clinical trials where quality of life is of interest. In addition, the WHOQOL-BREF may be of use to health professionals in the assessment and evaluation of treatment efficacy
Youth Self-Report For Ages 11–18 31 CBCL SELF REPORT a widely used child-report measure that assesses problem behaviors along two “broadband scales”: Internalizing and Externalizing

The digitalization process involved Microsoft Forms, part of the Microsoft Office Suite, which was used to convert the paper-based assessment tools into an interactive digital format. The scoring of responses was conducted using Microsoft Excel, ensuring automated calculation and data organization while maintaining consistency with standard clinical scoring procedures. The digital tools used in this study were adapted from existing standardized neuropsychological assessments to ensure consistency with traditional formats. While Microsoft Forms was utilized for digitization, the structure, scoring criteria, and administration procedures remained aligned with their validated paper-based counterparts. These tools were not independently pre-validated but were designed to adhere to established clinical protocols.

At the end of the study period, a comprehensive evaluation was conducted to assess HCPs’ experiences and perceptions of both formats, focusing on usability factors such as ease of use, time efficiency, and perceived reliability. HCPs completed a detailed feedback questionnaire, facilitating a direct comparison of usability and perception between the digital and traditional formats.

Outcome measures

Usability and perception were assessed via a customized questionnaire completed by HCPs at the end of the study. The questionnaire included items on ease of use, efficiency, and reliability, with responses rated on a Likert scale ranging from “Strongly Agree” to “Strongly Disagree.” Additionally, open-ended questions allowed participants to provide qualitative feedback, capturing in-depth perspectives on both digital and traditional formats. The System Usability Scale (SUS) developed by Brooke, is a quick and reliable method for assessing the usability of design solutions. 68 In the present paper was also administered to quantify the usability of the digital format.

Statistical analysis

The statistical analysis for this study was conducted using Jamovi (Jamovi Project). 71 The demographic variables were represented using descriptive statistics, with continuous variables, such as age, reported as means and standard deviations, while categorical variables, such as gender distribution, educational background, and profession, were presented as percentages. For quantitative analysis, SUS scores were assessed using non-parametric methods due to the small sample size and the non-normal distribution of data. Normality was tested using the Shapiro–Wilk test, which confirmed a non-normal distribution. Consequently, a Wilcoxon signed-rank test was used to compare the median usability scores with the reference value, with a significance level set at p < 0.05.

Additionally, a qualitative analysis was conducted on open-ended responses regarding participants’ experiences with the digital format. This involved a thematic analysis, a method used to systematically identify, analyze, and report patterns (themes) within qualitative data, as described by Braun and Clarke. 72 The analysis aimed to uncover key themes related to usability, such as speed and efficiency, error reduction, and data organization.

Results

In this study, a total of 29 participants were included. The majority of the sample consisted of women (93.1%), while men accounted for only 6.9%. The mean age of the participant was 34 years, with a standard deviation of 6.93 years. Regarding educational background, 48.3% of the sample held a postgraduate specialization, while 10.3% were in internship or postgraduate training. In terms of profession, the largest group was composed of health researcher psychologists, representing 41.67% of the sample, while there was only one physiotherapist health researcher, accounting for 4.17% of the total sample. The second largest group consisted of psychology research trainees, who represented 25% of the participants. Both speech therapists and neuropsychomotor therapists constituted 8.33% each. Finally, professional research collaborators made up 4.17% of the sample. These results indicate a diverse range of skills among the HCPs involved in the study.

The quantitative analysis of the SUS scores revealed a mean score of 89.48 (SD = 10.12) for the digital format and 81.38 (SD = 11.49) for the traditional format. A Wilcoxon signed-rank test showed a statistically significant difference between the two conditions (W = 22.5, p = 0.0003), indicating that participants found the digital tools to be more usable compared to the traditional assessment format. For more details see Figure 1.

Figure 1.

Figure 1.

Comparison of SUS scores between traditional and digital tools. The bar graph illustrates the mean SUS scores for traditional (orange) and digital (blue) assessment tools.

In addition to the quantitative findings, qualitative feedback from participants highlighted several key themes. The main themes that emerged, along with the corresponding percentages of participants mentioning each theme, are: speed and efficiency, with 65% of participants highlighting the time savings during administration and result processing; error reduction, with 52% of participants appreciating the increased reliability of the results due to automated scoring and reduced human errors; and data organization, which was seen as a key advantage by 48% of participants, as digital data are easier to manage, store, and retrieve for further analysis. Additionally, a theme related to the ease of use of digital tools emerged, with 38% of participants finding the devices easy to use after a brief familiarization period.

These themes indicate strong acceptance of the digital format, suggesting that participants perceived significant improvements over traditional methods in terms of efficiency, accuracy, and ease of use. The responses were coded and categorized in a way that provides a clear understanding of the perceived benefits, which supports the quantitative results and points toward a potential direction for the future adoption of these tools.

Discussion

The results of this study demonstrate a high level of usability for digital neuropsychological assessment tools, as indicated by SUS scores. The mean SUS score suggests that HCPs found the digital format effective and intuitive. Previous research has shown that usability is a critical factor in the adoption of digital tools in clinical settings, as it directly influences clinicians’ satisfaction and their willingness to integrate new technologies into their practice.73,74 Qualitative feedback from participants further highlighted the perceived benefits of digital tools, particularly in terms of speed and efficiency. Many respondents noted significant time savings during assessments, corroborating the findings of other studies highlighting the efficiency of digital formats in clinical workflows. 75 For example, the shift to digital assessments significantly reduced the time required for patient assessments, which in turn enabled HCPs to effectively manage larger workloads.

In addition to time savings, participants also reported that digital tools enhanced the consistency of assessments. 76 The reduction in errors reported by participants aligns with existing literature, which highlights the increased accuracy associated with digital assessments. 77 Standardized prompts and automated scoring reduce variability across assessments, minimize human error in data entry and interpretation, and improve patient data reliability.78,79 This consistency is particularly valuable in neuropsychology, where standardized assessment protocols contribute to more accurate diagnoses and treatment plans, ultimately enhancing continuity of care. 80 Furthermore, the data organization mentioned by participants is supported by research indicating that digital systems improve data management capabilities, allowing for easier retrieval and analysis of patient information. As healthcare becomes increasingly data-driven, integrating digital assessment tools can improve clinical decision-making and patient outcomes. 81

Recent studies have increasingly focused on the usability and feasibility of digital neuropsychological assessments. For instance, Um Din et al. 82 developed a supervised, tablet-based version of a cognitive and manual dexterity tests on a digital tablet to screen people with cognitive impairment. The authors demonstrated high system acceptance among older adults, despite low familiarity with technology. Similarly, Polk et al. 22 evaluated remote and unsupervised cognitive assessment tools in preclinical AD samples. They reported positive usability ratings and found that remote assessments showed good construct validity with traditional neuropsychological tests. 22 Moreover, baseline memory performance assessed digitally was associated with future cognitive decline, indicating the potential of such tools for monitoring Alzheimer's disease progression. 83 Our study systematically evaluated the usability of digitized versions of standardized neuropsychological tests administered in person, an approach that has received limited investigation. By assessing the perceptions of HCPs who routinely use these tools, our research provides insights into their practical applicability and integration into clinical workflows. 84 This combination of quantitative and qualitative approaches offers a comprehensive understanding of usability, efficiency, and potential barriers to adoption in real-world settings. 85 Collectively, these studies, including ours, highlighted the growing evidence supporting the usability and validity of digital neuropsychological assessments across various populations and settings. 18 Therefore, the clinical implications of this study are significant, as they highlight the potential benefits of integrating digital assessments into routine practice. By improving usability, these tools can improve workflow efficiency, reduce errors, and ultimately lead to better patient outcomes.18,22 Healthcare organizations should consider investing in training and support to facilitate the transition to digital formats. 86 Additionally, ongoing evaluations of usability and effectiveness are essential to ensure that these tools continue to meet the needs of both healthcare providers and patients. 87

Strengths, limitations, and future perspectives

Previous research on digital neuropsychological assessments has primarily focused on fully remote testing or developing specific digital tools, often neglecting their practical implementation in clinical settings.22,23 Our study addresses this gap by evaluating the usability of digitalized versions of in-person standardized neuropsychological tests, an approach that has received little attention. Additionally, we assessed the perceptions of HCPs who regularly use these tools, providing insights into their practical applicability and integration into clinical workflows. By combining quantitative and qualitative approaches, this study offers a comprehensive understanding of usability, efficiency, and potential barriers to adoption in real-world settings.

Despite these contributions, several limitations must be acknowledged. Although informative, the sample of 29 participants may not fully capture the diversity of HCPs using digital assessment tools. Additionally, the monocentric design limited the ability to conduct statistically robust subgroup analyses across different professional categories. However, the inclusion of a wide range of professionals ensured a broad assessment of usability perceptions. Future research should expand the sample size across more institutions to allow for a more detailed assessment of interprofessional differences. A larger, multicenter study could provide more generalizable results, accounting for institutional and geographical differences in digital tool adoption and usability perceptions. Such studies could also explore whether usability perceptions vary across healthcare settings with different levels of technological infrastructure.

Another limitation is the gender distribution, as 93.1% of participants were female, which may impact the generalizability of the findings. Additionally, the reliance on self-report measures introduces potential biases, such as social desirability bias or overestimation of usability. The study also did not include a patient-centered assessment, which is critical to understanding the broader impact of digital tools on clinical outcomes and patient experience. Moreover, the cross-sectional design captures only a snapshot of usability perceptions at one point in time, preventing an analysis of how these perceptions evolve with increased exposure. This study does not extensively address barriers to adoption, such as cost, training, and accessibility, key factors influencing digital assessment implementation. Cost remains a key barrier, as some digital neuropsychological tools require expensive licensing fees or specialized hardware, which may not be feasible for all institutions. Additionally, training requirements must be considered, while digital tools can streamline assessment workflows, their effectiveness depends on adequate clinician training to ensure accurate administration and interpretation. Finally, infrastructure disparities across institutions may affect accessibility, with some facilities lacking the necessary technological resources to implement digital assessments seamlessly. Future studies should focus on identifying and addressing these challenges to facilitate seamless integration into routine workflows.

Finally, a potential limitation of this study is that participants had prior exposure to digital tools, as required by the inclusion criteria. While this ensured that usability evaluations were not confounded by a complete lack of digital familiarity, it may limit the generalizability of the findings to professionals without previous experience with digital neuropsychological assessments. Future studies should include clinicians with varying levels of digital proficiency to assess whether usability perceptions differ based on prior exposure. This would provide insights into potential barriers to adoption for individuals less experienced with digital tools and inform tailored training strategies.

Despite these limitations, our findings provide an important foundation for further research and clinical advances in digital neuropsychological assessments. Increasing sample size and diversity across multiple institutions will improve the generalizability of the findings. At the same time, longitudinal studies could provide deeper insights into how perceptions of usability change over time with repeated use. Incorporating patient perspectives would also offer a more holistic assessment of the impact of digital tools on neuropsychological care. Finally, identifying cost-effective implementation strategies, improving training protocols, and enhancing accessibility could help in optimizing the adoption of digital tools in clinical practice. Finally, because all participants had prior experience with digital tools as part of the inclusion criteria, this study was unable to assess how different levels of digital proficiency influence perceptions of usability. Future research should include participants with different levels of digital familiarity to explore potential differences in user experience and adoption.

Conclusions

In conclusion, this study highlights the promising potential of digital neuropsychological assessment tools to enhance clinical practice. With a high SUS score, HCPs found these tools effective and intuitive, demonstrating their readiness to integrate digital technologies into their workflow. This aligns with previous research highlighting that usability is critical for the successful integration of digital tools in healthcare settings, influencing both clinician satisfaction and technology adoption.

The study also shows significant time savings, with digital tools enabling quicker assessments and allowing clinicians to manage larger caseloads, which supports findings from other studies on the efficiency of digital formats.

Moreover, the consistency and accuracy of assessments were enhanced, with fewer errors reported by participants, which is crucial for neuropsychological evaluations.

Digital tools help standardize processes, reduce human error, and improve data reliability, contributing to more accurate diagnoses and treatment plans.

Additionally, the improved organization of patient data facilitates better decision-making and patient outcomes.

Future research should focus on multicenter validation studies to ensure that these findings are generalizable across diverse clinical settings. Investigating longitudinal usability perceptions will also be crucial to assess whether clinicians’ acceptance of digital tools changes over time as they gain more experience. Furthermore, patient-centered evaluations should complement clinician perspectives to explore how digital assessments impact patient engagement, adherence, and clinical outcomes. Integrating digital assessments into routine practice can improve efficiency, reduce errors, and enhance patient care. To maximize their benefits, healthcare organizations should prioritize training and support programs, ensuring a smooth transition to digital workflows while continuously evaluating usability to meet evolving clinical needs.

Statements and declarations

Ethics considerations: The studies were conducted in compliance with local legislation and institutional requirements. Participants provided written informed consent to participate in the study. Written informed consent was also obtained from the individuals for the publication of any potentially identifiable images or data included in this article.

Author contributions/CRediT: Conceptualization, methodology, and writing—original draft preparation were done by FMG, MGM; software was done by FMG, PDP; validation was done by MGM, AR; formal analysis and data curation were done by FMG, MGM, PDP; investigation was done by FMG, MGM, AQ, RSC; resources was done by AR, MB, FB; writing—review and editing was done by MGM, AR, MB, FB, RSC; visualization and supervision were done by AQ, RSC; project administration was done by FMF, MGM, AR, PDP, AQ, RSC. All authors have read and agreed to the published version of the manuscript.

Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Current Research Funds, 2025, Ministry of Health, Italy.

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Data availability: The data supporting the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

References

  • 1.Libon DJ, Baliga G, Swenson Ret al. et al. Digital neuropsychological assessment: new technology for measuring subtle neuropsychological behavior. J Alzheimers Dis 2021; 82: 1–4. [DOI] [PubMed] [Google Scholar]
  • 2.Matar E, Shine JM, Halliday GMet al. et al. Cognitive fluctuations in Lewy body dementia: towards a pathophysiological framework. Brain 2020; 143: 31–46. [DOI] [PubMed] [Google Scholar]
  • 3.Naglieri JA, Drasgow F, Schmit M, et al. Psychological testing on the internet: new problems, old issues. Am Psychol 2004; 59: 150–162. [DOI] [PubMed] [Google Scholar]
  • 4.Donovan H, Ellis E, Cole L, et al. Reducing time to complete neuropsychological assessments within a memory assessment service and evaluating the wider impact. BMJ Open Qual 2020; 9: e000767. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Walters ER, Lesk VE. Time of day and caffeine influence some neuropsychological tests in the elderly. Psychol Assess 2015; 27: 161–168. [DOI] [PubMed] [Google Scholar]
  • 6.Wilks H, Aschenbrenner AJ, Gordon BA, et al. Sharper in the morning: cognitive time of day effects revealed with high-frequency smartphone testing. J Clin Exp Neuropsychol 2021; 43: 825–837. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bell L, Dodd GF, Jeavons M, et al. The impact of a walnut-rich breakfast on cognitive performance and brain activity throughout the day in healthy young adults: a crossover intervention trial. Food Funct 2025; 16: 1696–1707. [DOI] [PubMed] [Google Scholar]
  • 8.Gibbons RD, Weiss DJ, Kupfer DJ, et al. Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatr Serv 2008; 59: 361–368. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Garza MY, Williams T, Ounpraseuth S, et al. Error rates of data processing methods in clinical research: a systematic review and meta-analysis of manuscripts identified through PubMed. Int J Med Inform 2025; 195: 105749. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Burr SA, Gale T, Kisielewska J, et al. A narrative review of adaptive testing and its application to medical education. MedEdPublish (2016) 2023; 13: 21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Al Kez D, Foley AM, Laverty D, et al. Exploring the sustainability challenges facing digitalization and internet data centers. J Cleaner Prod 2022; 371: 133633. [Google Scholar]
  • 12.Sternin A, Burns A, Owen AM. Thirty-five years of computerized cognitive assessment of aging-where are we now? Diagnostics (Basel) 2019; 9: 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Nicosia J, Wang B, Aschenbrenner AJ, et al. To BYOD or not: are device latencies important for bring-your-own-device (BYOD) smartphone cognitive testing? Behav Res Methods 2023; 55: 2800–2812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Harris C, Tang Y, Birnbaum E, et al. Digital neuropsychology beyond computerized cognitive assessment: applications of novel digital technologies. Arch Clin Neuropsychol 2024; 39: 290–304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Caze T, Dorsman KA, Carlew AR, et al. Can you hear me now? Telephone-based teleneuropsychology improves utilization rates in underserved populations. Arch Clin Neuropsychol 2020/; 35: 1234–1239. [DOI] [PubMed] [Google Scholar]
  • 16.Schmand B. Why are neuropsychologists so reluctant to embrace modern assessment techniques? Clin Neuropsychol 2019; 33: 209–219. [DOI] [PubMed] [Google Scholar]
  • 17.Parsons MW, Gardner MM, Sherman JC, et al. Feasibility and acceptance of direct-to-home tele-neuropsychology services during the COVID-19 pandemic. J Int Neuropsychol Soc 2022; 28: 210–215. [DOI] [PubMed] [Google Scholar]
  • 18.Lunardini F, Luperto M, Romeo M, et al. Supervised digital neuropsychological tests for cognitive decline in older adults: usability and clinical validity study. JMIR Mhealth Uhealth 2020; 8: e17963. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Spreij LA, Gosselt IK, Visser-Meily JMA, et al. The journey is just as important as the destination-digital neuropsychological assessment provides performance stability measures in patients with acquired brain injury. PLoS One 2021; 16: e0249886. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ware J, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996; 34: 220–233. [DOI] [PubMed] [Google Scholar]
  • 21.Wang T, Thielen H, De Preter E, et al. Encouraging digital technology in neuropsychology: the theory of visual attention on tablet devices. Arch Clin Neuropsychol 2021; 36: 1450–1464. [DOI] [PubMed] [Google Scholar]
  • 22.Polk SE, Öhman F, Hassenstab J, et al. A scoping review of remote and unsupervised digital cognitive assessments in preclinical Alzheimer’s disease. medRxiv. 2024;2024.09.25.24314349.
  • 23.Baykara E, Kuhn C, Linz N, et al. Validation of a digital, tablet-based version of the trail making test in the Δelta platform. Eur J Neurosci 2022; 55: 461–467. [DOI] [PubMed] [Google Scholar]
  • 24.Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992; 30: 473–483. [PubMed] [Google Scholar]
  • 25.Beck AT, Steer RA, Ranieri WF. Scale for suicide ideation: psychometric properties of a self-report version. J Clin Psychol 1988; 44: 499–505. [DOI] [PubMed] [Google Scholar]
  • 26.Stolwyk RJ, Downing MG, Taffe J, et al. Assessment of sexuality following traumatic brain injury: validation of the brain injury questionnaire of sexuality. J Head Trauma Rehabil 2013; 28: 164–170. [DOI] [PubMed] [Google Scholar]
  • 27.Boringa JB, Lazeron RH, Reuling IE, et al. The brief repeatable battery of neuropsychological tests: normative values allow application in multiple sclerosis clinical practice. Mult Scler 2001; 7: 263–267. [DOI] [PubMed] [Google Scholar]
  • 28.Cuzzolaro M, Vetrone G, Marano Get al. et al. The body uneasiness test (BUT): development and validation of a new body image assessment scale. Eat Weight Disord 2006; 11: 1–13. [DOI] [PubMed] [Google Scholar]
  • 29.Mathiowetz V, Volland G, Kashman Net al. et al. Adult norms for the box and block test of manual dexterity. Am J Occup Ther 1985; 39: 386–391. [DOI] [PubMed] [Google Scholar]
  • 30.Novak M, Guest C. Application of a multidimensional caregiver burden inventory. Gerontologist 1989; 29: 798–803. [DOI] [PubMed] [Google Scholar]
  • 31.Achenbach TM. Child behavior checklist. In: Kreutzer JS, DeLuca J, Caplan B. (eds) Encyclopedia of clinical neuropsychology [internet]. New York, NY: Springer, 2011. [cited 2025 Feb 14], pp.546–552. Available from: 10.1007/978-0-387-79948-3_1529. [DOI] [Google Scholar]
  • 32.Greco C, Di Gennaro F, D’Amato C, et al. Validation of the composite autonomic symptom score 31 (COMPASS 31) for the assessment of symptoms of autonomic neuropathy in people with diabetes. Diabet Med 2017; 34: 834–838. [DOI] [PubMed] [Google Scholar]
  • 33.Izzo VA, Donati MA, Novello F, et al. The conners 3-short forms: evaluating the adequacy of brief versions to assess ADHD symptoms and related problems. Clin Child Psychol Psychiatry 2019; 24: 791–808. [DOI] [PubMed] [Google Scholar]
  • 34.Sica C, Magni C, Ghisi M, et al. Coping orientation to the problems experiences-new Italian version (COPE-NVI). Psicoterapia Cognitiva e Comportamentale 2008; 14: 27–53. [Google Scholar]
  • 35.Hudak PL, Amadio PC, Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. the upper extremity collaborative group (UECG). Am J Ind Med. 1996; 29: 602–608. [DOI] [PubMed] [Google Scholar]
  • 36.Bouhassira D, Attal N, Alchaar H, et al. Comparison of pain syndromes associated with nervous or somatic lesions and development of a new neuropathic pain diagnostic questionnaire (DN4). Pain 2005; 114: 29–36. [DOI] [PubMed] [Google Scholar]
  • 37.Larzelere RE, Huston TL. The dyadic trust scale: toward understanding interpersonal trust in close relationships. J Marriage Fam 1980; 42: 595–604. [Google Scholar]
  • 38.Spanier GB. Measuring dyadic adjustment: new scales for assessing the quality of marriage and similar dyads. J Marriage Fam 1976; 38: 15. [Google Scholar]
  • 39.Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971; 9: 97–113. [DOI] [PubMed] [Google Scholar]
  • 40.Lawrence EJ, Shaw P, Baker D, et al. Measuring empathy: reliability and validity of the empathy quotient. Psychol Med 2004; 34: 911–919. [DOI] [PubMed] [Google Scholar]
  • 41.Holahan CJ, Moos RH. The quality of social support: measures of family and work relationships. Br J Clin Psychol 1983; 22: 157–162. [Google Scholar]
  • 42.Rosen R, Brown C, Heiman J, et al. The female sexual function Index (FSFI): a multidimensional self-report instrument for the assessment of female sexual function. J Sex Marital Ther 2000; 26: 191–208. [DOI] [PubMed] [Google Scholar]
  • 43.Holbrook M, Skilbeck CE. An activities index for use with stroke patients. Age Ageing 1983; 12: 166–170. [DOI] [PubMed] [Google Scholar]
  • 44.Fugl-Meyer AR, Jääskö L, Leyman I, et al. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med 1975; 7: 13–31. [PubMed] [Google Scholar]
  • 45.Kiresuk TJ, Sherman RE. Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J 1968; 4: 443–453. [DOI] [PubMed] [Google Scholar]
  • 46.Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol 1959; 32: 50–55. [DOI] [PubMed] [Google Scholar]
  • 47.Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960; 23: 56–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983; 67: 361–370. [DOI] [PubMed] [Google Scholar]
  • 49.Markland D, Hardy L. On the factorial and construct validity of the intrinsic motivation inventory: conceptual and operational concerns. Res Q Exerc Sport 1997; 68: 20–32. [DOI] [PubMed] [Google Scholar]
  • 50.Rosen RC, Cappelleri JC, Smith MD, et al. Development and evaluation of an abridged, 5-item version of the international Index of erectile function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int J Impot Res 1999; 11: 319–326. [DOI] [PubMed] [Google Scholar]
  • 51.Shah S, Vanclay F, Cooper B. Improving the sensitivity of the Barthel Index for stroke rehabilitation. J Clin Epidemiol 1989; 42: 703–709. [DOI] [PubMed] [Google Scholar]
  • 52.Collin C, Wade D. Assessing motor impairment after stroke: a pilot reliability study. J Neurol Neurosurg Psychiatry 1990; 53: 576–579. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Chaudhuri KR, Martinez-Martin P, Schapira AHV, et al. International multicenter pilot study of the first comprehensive self-completed nonmotor symptoms questionnaire for Parkinson’s disease: the NMSQuest study. Mov Disord 2006; 21: 916–923. [DOI] [PubMed] [Google Scholar]
  • 54.Jenkinson C, Fitzpatrick R, Peto V, et al. The Parkinson’s disease questionnaire (PDQ-39): development and validation of a Parkinson’s disease summary index score. Age Ageing 1997; 26: 353–357. [DOI] [PubMed] [Google Scholar]
  • 55.Krueger RF, Derringer J, Markon KE, et al. Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychol Med 2012; 42: 1879–1890. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Preece DA, Mehta A, Petrova K, et al. The perth alexithymia questionnaire-short form (PAQ-S): a 6-item measure of alexithymia. J Affect Disord 2023; 325: 493–501. [DOI] [PubMed] [Google Scholar]
  • 57.Gainotti G, Azzoni A, Marra C. Frequency, phenomenology and anatomical-clinical correlates of major post-stroke depression. Br J Psychiatry 1999; 175: 163–167. [DOI] [PubMed] [Google Scholar]
  • 58.Ryff CD. Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol 1989; 57: 1069–1081. [Google Scholar]
  • 59.Eapen V, Crnčec R, Walter Aet al. et al. Conceptualisation and development of a quality of life measure for parents of children with autism spectrum disorder. Autism Res Treat 2014; 2014: 160783. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Picardi A, Mannino G. Le organizzazioni di significato personale: verso una validazione empirica. Riv Psichiatr 2001; 36: 224–233. [Google Scholar]
  • 61.Bodfish JW, Symons FJ, Parker DEet al. et al. Varieties of repetitive behavior in autism: comparisons to mental retardation. J Autism Dev Disord 2000; 30: 237–243. [DOI] [PubMed] [Google Scholar]
  • 62.Vickrey BG, Hays RD, Harooni R, et al. A health-related quality of life measure for multiple sclerosis. Qual Life Res 1995; 4: 187–206. [DOI] [PubMed] [Google Scholar]
  • 63.Weinstein S. Fifty years of somatosensory research: from the semmes-weinstein monofilaments to the weinstein enhanced sensory test. J Hand Ther 1993; 6: 11–22. discussion 50. [PubMed] [Google Scholar]
  • 64.Cooper ML, Shapiro CM, Powers AM. Motivations for sex and risky sexual behavior among adolescents and young adults: a functional perspective. J Pers Soc Psychol 1998; 75: 1528–1558. [DOI] [PubMed] [Google Scholar]
  • 65.Dunn W. Sensory profile. San Antonio, TX Psychological Corporation.—References—Scientific Research Publishing [Internet]. [cited 2025 Feb 14]. Available from: https://www.scirp.org/reference/referencespapers?referenceid=380145. 1999.
  • 66.Ho AK, Sidanius J, Kteily N, et al. The nature of social dominance orientation: theorizing and measuring preferences for intergroup inequality using the new SDO₇ scale. J Pers Soc Psychol 2015; 109: 1003–1028. [DOI] [PubMed] [Google Scholar]
  • 67.Skapinakis P. Spielberger state-trait anxiety inventory. In: Michalos AC. (eds) Encyclopedia of quality of life and well-being research [internet]. Dordrecht: Springer Netherlands, 2014. [cited 2025 Feb 14], pp.6261–6264. Available from: 10.1007/978-94-007-0753-5_2825. [DOI] [Google Scholar]
  • 68.Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 1997; 38: 581–586. [DOI] [PubMed] [Google Scholar]
  • 69.Bagby RM, Parker JD, Taylor GJ. The twenty-item Toronto alexithymia scale–I. Item selection and cross-validation of the factor structure. J Psychosom Res 1994; 38: 23–32. [DOI] [PubMed] [Google Scholar]
  • 70.Development of the world health organization WHOQOL-BREF quality of life assessment. The WHOQOL group. Psychol Med 1998; 28: 551–558. [DOI] [PubMed] [Google Scholar]
  • 71. jamovi—open statistical software for the desktop and cloud [Internet]. [cited 2025 Feb 14]. Available from: https://www.jamovi.org/
  • 72.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101. [Google Scholar]
  • 73.Munro Cullum C, Hynan LS, Grosch M, et al. Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. J Int Neuropsychol Soc 2014; 20: 1028–1033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Brearly TW, Shura RD, Martindale SL, et al. Neuropsychological test administration by videoconference: a systematic review and meta-analysis. Neuropsychol Rev 2017; 27: 174–186. [DOI] [PubMed] [Google Scholar]
  • 75.Fox-Fuller JT, Rizer S, Andersen SLet al. et al. Survey findings about the experiences, challenges, and practical advice/solutions regarding teleneuropsychological assessment in adults. Arch Clin Neuropsychol 2022; 37: 274–291. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Wadsworth HE, Galusha-Glasscock JM, Womack KB, et al. Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Arch Clin Neuropsychol 2016; 31: 420–425. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Lacritz LH, Carlew AR, Livingstone J, et al. Patient satisfaction with telephone neuropsychological assessment. Arch Clin Neuropsychol 2020; 35: 1240–1248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Marra DE, Hamlet KM, Bauer RMet al. et al. Validity of teleneuropsychology for older adults in response to COVID-19: a systematic and critical review. Clin Neuropsychol 2020; 34: 1411–1452. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Zanin E, Aiello EN, Diana L, et al. Tele-neuropsychological assessment tools in Italy: a systematic review on psychometric properties and usability. Neurol Sci 2022; 43: 125–138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Hildebrand R, Chow H, Williams C, et al. Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. J Telemed Telecare 2004; 10: 130–134. [DOI] [PubMed] [Google Scholar]
  • 81. (PDF) New and Emerging Risk Factors in Occupational Health [Internet]. [cited 2025 Feb 14]. Available from: https://www.researchgate.net/publication/346974841_New_and_Emerging_Risk_Factors_in_Occupational_Health.
  • 82.Um Din N, Maronnat F, Le Boterff Q, et al. Contribution of a tablet-based tests to the diagnosis of neurocognitive disorders in older adults: a feasibility study. Stud Health Technol Inform 2024; 316: 1163–1164. [DOI] [PubMed] [Google Scholar]
  • 83.Berron D, Olsson E, Andersson F, et al. Remote and unsupervised digital memory assessments can reliably detect cognitive impairment in Alzheimer’s disease. Alzheimers Dement 2024; 20: 4775–4791. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Wosny M, Strasser LM, Hastings J. Experience of health care professionals using digital tools in the hospital: qualitative systematic review. JMIR Hum Factors 2023; 10: e50357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Ahmed A, Pereira L, Jane K. Mixed Methods Research: Combining both qualitative and quantitative approaches. 2024.
  • 86.Stoumpos AI, Kitsios F, Talias MA. Digital transformation in healthcare: technology acceptance and its applications. Int J Environ Res Public Health 2023; 20: 3407. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Maqbool B, Herold S. Potential effectiveness and efficiency issues in usability evaluation within digital health: a systematic literature review. J Syst Softw 2023; 208: 111881. [Google Scholar]

Articles from Digital Health are provided here courtesy of SAGE Publications

RESOURCES