Skip to main content
BMC Health Services Research logoLink to BMC Health Services Research
. 2021 Jan 15;21:68. doi: 10.1186/s12913-021-06069-0

Optimising the integration of technology-enabled solutions to enhance primary mental health care: a service mapping study

Haley M LaMonica 1,, Tracey A Davenport 1, Antonia Ottavio 1, Shelley C Rowe 1, Shane P Cross 1, Frank Iorfino 1, Tanya A Jackson 2, Michael A Easton 2, Jennifer Melsness 2, Ian B Hickie 1
PMCID: PMC7811218  PMID: 33451328

Abstract

Background

Despite the widely acknowledged potential for health information technologies to improve the accessibility, quality and clinical safety of mental health care, implementation of such technologies in services is frequently unsuccessful due to varying consumer, health professional, and service-level factors. The objective of this co-design study was to use process mapping (i.e. service mapping) to illustrate the current consumer journey through primary mental health services, identify barriers to and facilitators of quality mental health care, and highlight potential points at which to integrate the technology-enabled solution to optimise the provision of care based on key service performance indicators.

Methods

Interactive, discussion-based workshops of up to six hours were conducted with representative stakeholders from each participating service, including health professionals, service managers and administrators from Open Arms – Veterans & Families Counselling Service (Sydney), a counselling service for veterans and their families, and five headspace centres in the North Coast Primary Health Network, primary youth mental health services. Service maps were drafted and refined in real time during the workshops. Through both group discussion and the use of post-it notes, participants worked together to evaluate performance indicators (e.g. safety) at each point in the consumer journey (e.g. intake) to indicate points of impact for the technology-enabled solution, reviewing and evaluating differing opinions in order to reach consensus.

Results

Participants (n=84 across participating services) created service maps illustrating the current consumer journey through the respective services and highlighting barriers to and facilitators of quality mental health care. By consensus, the technology-enabled solution as facilitated by the InnoWell Platform was noted to enable the early identification of risk, reduce or eliminate lengthy intake processes, enable routine outcome monitoring to revise treatment plans in relation to consumer response, and serve as a personal data record for consumers, driving person-centred, coordinated care.

Conclusions

Service mapping was shown to be an effective methodology to understand the consumer’s journey through a service and served to highlight how the co-designed technology-enabled solution can optimise service pathways to improve the accessibility, quality and clinical safety of care relative to key service performance indicators, facilitating the delivery of the right care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06069-0.

Keywords: Mental health, Service mapping, Health information technology, Digital health solutions, Mental health services reform, Service performance indicators

Background

Mental health services reform

With the aim of achieving long-term, sustainable mental health reform, several governments have established strategic priorities specific to mental health care. In the United Kingdom, for example, NHS England and the Department of Health published Future in Mind, which highlighted the need for better access to crisis support, the integration of physical and mental health care, and early intervention and prevention [1]. These recommendations were echoed and elaborated on in a recent report from the Australian Government Productivity Commission that identified several target areas for reform, including: 1) prevention and early intervention for mental illness and suicide attempts; 2) expansion of services to close critical gaps in health care services; 3) provision of funding for services beyond health; 4) employment assistance for people with mental illness, including early intervention for work-related mental illness; and 5) commitment to fundamental reform to care coordination, governance and funding arrangements [2].

Technology-enabled solutions for mental health care

Technology holds great promise for contributing to health care reform. For example, a review of randomised controlled trials of web-based interventions showed improvements in depression and anxiety symptoms as well as mental health literacy, reductions in the risk for eating disorders, and improvements in sleep for individuals with insomnia [3]. Furthermore, it has also been shown that ecological momentary assessment, or the repeated digital assessment of thoughts, feelings, and behaviours in real-time in association with a stated experience (e.g., therapeutic intervention), is more sensitive to change over time as it eliminates the need for retrospective reporting [4].

Despite the growing evidence base supporting the use of technologies for mental health care, the implementation of technology-enabled solutions in mental health services remains relatively rare. Certainly there are some notable exceptions as pointed out by Titov et al., who highlight the success of integrating Internet-delivered cognitive behavioural therapy (CBT) as part of clinical care with a mental health professional in five clinics internationally [5]. Our group has also had success in co-designing, implementing and evaluating technology-enabled solutions to support the mental health and wellbeing of young people, including for those attending university [6], living in disadvantaged communities [7], at risk of suicide [8], and seeking help at primary mental health services in Australia (i.e. headspace) [9]. Whilst these are examples of successful implementations of technology-enabled solutions, failures in the implementation of technologies as part of mental health care are prevalent. As summarised in our implementation science strategy [10], several studies have investigated barriers to successful implementation. Critical service-level factors include negative staff attitudes, staff resistance to change, and changes to work practices, such as increased workload [11, 12] as well as the importance of leadership from senior organisational and local service management to champion the technology [12, 13]. In a study of blended CBT care, or the provision of care through a combination of in-person and web-based sessions, the blended model of care was found to have equivalent treatment effects but poorer uptake by both consumers and health professionals and required longer treatment duration, thus resulting in higher costs [14]. Whilst the effectiveness of the web-based sessions may not have been equivalent to the in-person sessions, the researchers also suggested that the findings may relate to limitations in the implementation of blended care. Further research into the most effective ways to optimise routine mental health service delivery through the integration of technology-enabled solutions is still required.

Service mapping

In recent years, health care systems have taken a lesson from the field of manufacturing to employ process mapping methods for the purposes of quality improvement [15]. Specifically, process improvement strategies have been defined as “systematic, organisation-wide programs that are adopted to improve quality and/or efficiency” [15]. Based on a review of eight quality improvement projects undertaken by the NHS, eight benefits of process mapping in health care were identified, including: 1) understanding of the complexity of the service or system; 2) identifying service gaps and opportunities for improvement; 3) engaging with key stakeholders; 4) aligning the project’s aims with the proposed intervention; 5) identifying leaders or champions to drive project progress; 6) learning collaboratively; 7) increasing empathy between stakeholders/professional groups; and 8) a tangible output – the process map [16]. Process mapping can be used in combination with other quality improvement techniques such as Lean, which emphasises waste reduction, improved customer outcomes, and greater return on investment [17]. However, as Lean has rarely been used to improve whole organisations, rather has typically been applied to discrete procedures or a single organisational process (e.g. accessibility of care), it has not been shown to be well suited to the complexities of mental health services due to the high variability in processes as well as difficulties in defining ‘waste’ [18, 19]. As such, we have chosen to apply process mapping as a distinct methodology in this study with the aim of better understanding the way in which to maximise the integration of technology-enabled solutions within mental health services in Australia to enhance the accessibility, quality and clinical safety of care. We have used the term ‘service mapping’ to refer to the structured approach to understanding the needs, existing processes, gaps in care, and performance of a mental health service as mapped against the consumer’s journey through the service. This information is then utilised to determine potential points of impact for the proposed technology in order to design a technology-enabled solution to optimise care.

Objective

This study aimed to employ service mapping to: 1) illustrate the current consumer journey through a service from intake, assessment and treatment planning through to clinical review and service exit; 2) identify potential barriers to and facilitators of quality mental health care; and 3) highlight the potential points at which to integrate the technology-enabled solution as facilitated by a digital tool (i.e. the InnoWell Platform described in greater detail in the Methods section) within the service to optimise the provision of care based on key service performance indicators [20].

Methods

Design

This is a co-design study employing service mapping methodology (i.e. process mapping) to illustrate the current consumer journey through primary mental health services. As described by the World Health Organisation, primary mental health care is the first level of care within the broader mental health system, providing a range of services including the early identification of mental health symptoms and clinical trajectories, treatment of common mental health disorders, and referral to secondary and tertiary care as required [21].

The InnoWell platform

In 2017, the Australian Government Department of Health and InnoWell (a joint venture between The University of Sydney and PwC [Australia]) entered into a three-year funding agreement to deliver Project Synergy (2017–20). As described by Hickie et al., Project Synergy’s objective is to develop and implement innovative health information technologies (including the InnoWell Platform) to enable improved mental health service delivery in Australia, facilitating better outcomes for people with lived experience, supportive others, health professionals and service providers [22]. As detailed in Davenport et al. [23] and Iorfino et al. [24], the InnoWell Platform is comprised of a multidimensional self-assessment targeting a range of biopsychosocial domains to capture a holistic view of the consumer. The assessment results are designed to be reviewed collaboratively by the consumer and their health professional to promote shared decision making in relation to care options, accounting for consumer preferences, as well as early identification of risk.

Participating services and participants

Participating services included: 1) Open Arms – Veterans & Families Counselling Service (Sydney), a primary mental health counselling service for veterans and their families; and 2) headspace centres in the North Coast Primary Health Network (Coffs Harbour, Grafton, Lismore, Port Macquarie, Tweed Heads), primary youth mental health services. All staff involved in the implementation of the InnoWell Platform in participating services were invited to participate in the service mapping workshops including health professionals, service managers and administrators. Where staff from the services’ funding and/or governing bodies (i.e. service providers and/or lead agencies) were associated with implementation, these staff were also invited to participate. This wide-ranging recruitment is critical to ensure that data are captured from stakeholders at all levels of participating services. The Participant Information Sheet describing the study in more detail was distributed via email to eligible participants by an implementation officer embedded within the services. At the beginning of each workshop, the facilitators provided the participants with an opportunity to ask questions and clarify details of the research before providing written informed consent. Importantly, each participant was explicitly told that their participation was voluntary and they were free to withdraw from the workshops at any time without consequences. There were no formal inducements for participating in the workshops; all sessions were conducted during business hours, thus participants were paid as part of their normal work day.

Service mapping

Service mapping workshops of up to 6 h in duration, including breaks and lunch, were conducted with each participating service. The workshops were coordinated by two facilitators, at least one of whom was a mental health professional. A scribe was present to take notes throughout each workshop. As previously described in LaMonica et al. [10], the interactive, discussion-based service mapping workshops were conducted with representative stakeholders from each participating service, including health professionals, service managers and administrators, in order to co-design the optimised technology-enabled solution for service delivery. In the first half of the workshop, the pre-existing service pathway (i.e. consumer’s journey through the service) and related staff roles and responsibilities were mapped, including intake, initial assessment, treatment planning and intervention, routine outcome monitoring, and service exit (or discharge). Gaps in current service delivery were reviewed relative to key features of high-quality mental health care to identify areas for improvement or reform as identified by the respective services (i.e. improved suicide risk identification, reduced wait times at intake) [10]. Service quality is an overarching concept that includes eight interrelated and internationally adopted domains shown in Table 1 [20]. Each of the eight safety and clinical quality domains were mapped to the point of interest on the consumer journey that may be enhanced via the technology-enabled solution. In other words, the workshop participants might first identify barriers to service access at the point of intake and then hypothesise how the technology-enabled solution could be implemented to improve this aspect of care.

Table 1.

Key performance indicators of high-quality mental health care

Performance indicator Example metric for measurement
Clinical safety How suicide risk is assessed and mitigated at service entry
Accessibility Ease of access for high risk sub-populations
Effectiveness Proportion of users who return to work or education
Acceptability and satisfaction Consumer satisfaction with care
Efficiency Cost-effectiveness of care
Appropriateness Matching service provision to clinical stage, which is an adjunct to mental health diagnosis that incorporates illness severity and risk of progression to facilitate appropriate treatment matching
Continuity and coordination Successful transitions from primary to secondary care
Workforce competence and capability Assignment of skilled staff to specific interventions

In the second half of the workshop, a technology-enabled solution was then co-designed, intertwining established service processes with the additional technology elements and processes (e.g. web-based initial assessment, clinical and non-clinical care options) with an emphasis on enhanced service provision as measured by identified service performance indicators. Importantly, participants from multiple services were included in this study to highlight the utility of service mapping as a means by which to illustrate the variability in the consumer journey through individual primary health services. Service mapping allowed for the identification of unique elements of the consumer flow (i.e. by whom is the referral and intake managed, how are consumers allocated to appropriate health professionals, etc.) as well as barriers to and facilitators of quality care for the respective services. A sample service mapping workshop agenda is provided in Additional file 1.

Data collection and process map development

To align with how process mapping methods have been applied previously in the health service literature, the facilitators worked collaboratively with participants to map the current consumer journey through the respective participating services and then overlay the intersection and impact of the InnoWell Platform at key points in care (e.g. referral, assessment, treatment planning, intervention, review, and service exit) [25]. The service map was also reviewed from the perspective of health professionals working with consumers, including review of the data collected via the InnoWell Platform as well as in-person sessions, and service managers to understand the impact of the clinical digital tool at all levels of service delivery. Maps were drafted on a white board or butchers paper sheets, allowing for real time review and refinement during the workshops. Following the workshop, one of the facilitators created a final electronic version of the service map. Participants also worked together to identify the potential technology-enabled impacts on key performance indicators at each step of the process. Through both group discussion and the use of post-it notes, participants evaluated each service performance indicator (e.g. safety) relative to each point in the service pathway (e.g. intake). Differing opinions were reviewed, discussed, and evaluated by the participants, ultimately resulting in agreement by consensus. Importantly, decisions were reached by the participants and were not directed by the facilitators.

Results

Participants

Twenty-one staff members from Open Arms – Veterans & Families Counselling (Sydney), including 20 health professionals and 1 service manager, and 63 staff members from five headspace centres, including 43 health professionals, 7 service managers and 13 administrators, consented to participate in the service mapping workshops at their respective services.

Service maps

Standard process mapping symbols have been used in the service maps presented below, including rectangles to indicate a task that needs to be completed, arrows to represent the consumer’s journey in the service, and diamonds to represent decision points (see Figs. 1, 2 and 3). Additionally, green reflects the existing service pathway, whereas blue indicates the impact of the technology.

Fig. 1.

Fig. 1

Technology-enabled service map for Open Arms

Fig. 2.

Fig. 2

Technology-enabled service map for headspace Lismore, Port Macquarie and Grafton

Fig. 3.

Fig. 3

Technology-enabled service map for headspace Coffs Harbour and Tweed Heads

The initial questionnaire refers to the multidimensional, self-report, web-based assessment facilitated by the InnoWell Platform [23]. To ensure appropriateness for the consumer-base, each respective service implementing the InnoWell Platform has the option to select from a library of evidence-based psychometric tools frequently used in clinical practice (e.g. Kessler Psychological Distress Scale, Patient Health Questionnaire-9, etc.) [24]. Depending on the services selections, the initial questionnaire is expected to take up to 45 min to complete.

Defining standard service delivery

Service mapping provides a critical opportunity to understand how the technology-enabled solution facilitated by the InnoWell Platform could be embedded within standard service delivery for each of the participating services. More specifically, participating services have the opportunity to implement the InnoWell Platform in varying ways within their service delivery models. At Open Arms, for example, it was determined initially that consumers would be invited to the InnoWell Platform by their health professional, either when scheduling their first appointment or thereafter based on clinical judgment. Due to the burden on the health professionals, the invite was later transferred to the administrative staff and included as part of the initial eligibility screening process, with consumers being asked to complete the multidimensional assessment (i.e. the initial questionnaire) prior to attending the first session with a health professional.

Whilst some variability in the invite process was evident across the headspace centres, reflecting the diversity in service models, young people were invited to the InnoWell Platform either by an administrative staff member or by a youth access clinician at the initial point of contact with the service or as part of community outreach programs. The young person was encouraged to complete the multidimensional assessment prior to completing the headspace specific intake assessment at which time they would be allocated to a health professional based on clinical stage (for those services employing staged care) and/or level of need. Across all services, the InnoWell Platform can then be used collaboratively by the consumer and their health professional to track and monitor outcomes over time and, in turn, modify treatment plans as needed if the initial approach proves ineffective (i.e. outcomes remain unchanged), the clinical presentation worsens, or the consumer’s circumstances change.

Potential impact on key performance indicators

At a high-level and as agreed upon by consensus, the service mapping workshops served to highlight potential points of impact of the technology-enabled solution based on key performance indicators. In relation to clinical safety, participants noted that the multidimensional assessment had the potential to improve the early identification of suicide risk, thus enabling fast tracking into care. Whilst all services had a procedure in place to identify risk of suicide (e.g. consumers indicating distress when contacting Open Arms are immediately connected to a health professional), including referrals to appropriate specialist services thereafter, participants recognised that a digital tool had the potential to respond in real time rather than as determined by service operating hours and health professional availability.

Participants also recognised the considerable clinical value of the InnoWell Platform’s multidimensional assessment. Participants from Open Arms, for example, noted that the assessment would replace the need for the required telephone intake which, at the time of this workshop frequently was associated with a wait time (the service model has subsequently been redesigned so that intake assessments are offered at the time of the initial contact with the service [26]), thus improving accessibility. Similarly, participants from headspace indicated that the assessment could identify the need for and support the drafting of a mental health plan to enable timely access to specialist care. It was also recognised that a uniform and service-specific initial assessment had the potential to streamline the assessment process, reducing or eliminating the variable and, at times, lengthy intake process, resulting in improved service efficiency.

The use of reliable psychometrics validated for the target consumer base was also thought to improve effectiveness by facilitating the assessment of a consumer’s clinical presentation and daily functioning rather than relying solely on clinical opinion. Furthermore, routine outcome monitoring of a consumer’s treatment response over time as evidenced by changes in symptom severity, functioning and wellbeing assessed via the self-report assessment in the InnoWell Platform, would serve to rapidly identify when a treatment approach was not effective, thus facilitating change, including potential change in care team or referral to more intensive specialist care.

Whilst not an electronic medical record, it was recognised that the InnoWell Platform provides a comprehensive treatment record both for consumers (i.e. personal health record) and health professionals to inform referrals to specialist services as well as future episodes of care, thus enabling continuity of care and care coordination. In other words, the consumer retains a full record of their data from the InnoWell Platform which can then be shared with other health professionals, preventing the need to retell their story and start again from the beginning should changes occur or be required in their care team.

With regard to acceptability, it was noted that the InnoWell Platform serves as a clinical toolbox for both health professionals and consumers, ensuring both are aware of and informed about available care options. In this way, the InnoWell Platform positions the consumer at the centre of care. Additionally, participants from both Open Arms and headspace concluded that consumer satisfaction could easily be assessed via a simple and user-friendly survey delivered via the InnoWell Platform, with automatic prompts to facilitate completion.

Finally, it was highlighted by participants from Open Arms that the InnoWell Platform would facilitate communication between health professionals, facilitating joint case reviews and supervision, thus improving workforce capacity. The library of clinical resources available as part of the InnoWell Platform, including clinical training guides, factsheets, links to reputable organisations and websites, and apps and etools, also were noted to have the potential to support professional development.

Discussion

Technology-enabled enhancements in care based on key performance indicators

The service mapping process served to engage key stakeholders at the respective services to identify gaps in care and opportunities for improvement at each step in the consumer’s journey as well as to align the aims of implementing the technology-enabled solution with the services’ goals for reform. Improved clinical safety reflects one of the primary aims of the implementation of the co-designed technology-enabled solution within both Open Arms [26] and headspace services [27]. Importantly, the InnoWell Platform’s suicide escalation protocol is designed to facilitate risk identification and detection of suicidal thoughts and behaviours [23, 28]. Although the potential for new technologies to aid in suicide prevention is widely recognised, such tools are frequently under-utilised [29] and have not been rigorously evaluated for effectiveness [30]. Nevertheless, studies have shown that consumers are more likely to disclose suicidal ideation via web-based approaches rather than in-person assessment [31, 32], thus facilitating intervention, which underscores the importance of optimising implementation within standard service delivery.

In addition to facilitating disclosure, web-based assessments have good concordance with traditional paper-and-pencil measures [33] and clinician-based structured interviews [34] and are associated with lower costs and greater convenience for consumers. Importantly, our team’s previous work shows that web-based assessments are both more efficient than in-person clinical assessments and enhance the subsequent intervention sessions, enabling health professionals to focus on the delivery of interventions matched to a consumer’s level of need [35]. Additionally, the systematisation of the assessment and monitoring process ensures transparency of outcomes for both consumers and health professionals, which is particularly relevant as health professionals tend to overestimate the benefits of care relative to measured outcomes [36]. Importantly, our own research has shown that the ability to track data over time is valued by consumers as a means to better understand what information, resources and intervention strategies are associated with positive health outcomes [37]. Furthermore, symptom tracking and real-time feedback improves engagement and promotes behaviour change [38].

Whilst consumer satisfaction with service delivery, including in this case technology-enabled care, has been shown to be associated with clinical factors, such the presence of major mental illness (i.e. psychosis, bipolar or unipolar depression), it is also impacted by age and general quality of life (i.e. housing, social connections, financial circumstances, etc.) [39]. Nevertheless, a systematic review highlighted that consumer experience (i.e. satisfaction) is positively correlated with both self-rated and objectively measured health outcomes as well as treatment adherence and engagement with preventative care options [40] and as such, consumer satisfaction is increasingly valued as an indicator of service performance. With that being said, there is neither a consensus on how to define satisfaction nor a gold standard assessment measure.

Limitations

This study has some limitations that are important to note. As participants were recruited from all levels of participating services, there is the possibility that some participants may have perceived there to be an unequal relationship. Importantly, participation was voluntary; therefore, no staff members were required to attend or contribute to the workshops if they felt uncomfortable. Furthermore, the participation of staff members with differing roles within the services was not raised as an issue at any time (the contact details of the researchers was available on the Participant Information Sheet). The understanding of how the technology-enabled solution might impact workforce capacity requires further exploration and reflects a limitation of this study. It is our hypothesis that the use of data analytics embedded within technologies will allow health professionals to examine their clinical performance based on consumer outcomes and in relation to consumer demographics, mental health disorders, stage of illness, and intervention method, thus identifying areas of strength as well as areas that would benefit from training, professional development, or supervision [41]. Additionally, it is important to note that the co-design process was undertaken without contributions from consumers with lived-experience of mental ill health. Our group recognises the importance of including the voice of those with lived experience in mental health service reform efforts, and aim to include consumers in all aspects of our research related to the design, development, implementation and evaluation of health information technologies.

Conclusions

Service mapping, a processing mapping methodology, was shown to be an effective tool to engage key stakeholders to understand existing service pathways and, in turn, to identify barriers to and facilitators of quality mental health care. In this study, the resultant service maps highlighted potential points at which the technology-enabled solution could be embedded in the process to drive improvement on key performance indicators. The use of service mapping prevents a one-size-fits-all approach to service reform, but rather takes into account specific factors impacting the quality of care at each individual service, thus facilitating the delivery of the right care first time.

Future directions

Whilst service mapping identified potential ways in which to enhance care based on key performance indicators at a high-level, it is now essential that the hypothesised technology-enabled service models be implemented and rigorously evaluated. To that end, the co-designed technology-enabled solutions as facilitated by the InnoWell Platform have been implemented in four of the above mentioned headspace services (Coffs Harbour, Lismore, Port Macquarie, and Tweed Heads) as well as Open Arms (Sydney and Lismore). As described in LaMonica et al. [42], we are using web-based surveys, semi-structured interviews, workshops, observational logs, and service audit data to gain valuable insights as to the impact of the implementations on consumer outcomes, health professional practices, and key service performance indicators as well as social return on investment (i.e. social, environmental, and/or economic value) [43].

Additionally, our team has further developed our service mapping methodologies by applying systems science approaches that makes use of dynamic simulation modelling. This recognises that services represent a collection of individual agents (e.g. patients, clinicians) whose actions are dynamic and interconnected, which often gives rise to common features of complex systems, such as nonlinear relationships, feedback loops and contextual effects [44, 45]. Dynamic simulation modelling is a technique which allows us to create an in-silico laboratory whereby we can model existing service pathways (derived from service mapping), the roles of various agents within these pathways and the role of technology to test proposed changes and their potential impact in a safe (simulated) environment before implementation. Simulations can be run multiple times using different input parameters or assumptions so that service administrators can compare outcomes under a range of hypothetical scenarios. This provides a systems perspective of the service and facilitates a deeper understanding of which factors may influence the success or failure of any given implementation. Agent-based modelling is one such approach which allows us to model system behaviour in terms of the agent-to-agent interactions (e.g. patient to clinician, or service to patient), and discrete event modelling allows us to transform the existing and proposed service maps into resource-constrained processes so that we can more accurately understand how staff resourcing and service pathways influence service efficiencies and patient outcomes within the complex mental health system [46]. The resulting simulation model can be used as a dynamic tool to guide decision-making about implementation, to set implementation targets and track progress against an ‘ideal’ benchmark by supplementing it with new data during and post implementation.

Supplementary Information

12913_2021_6069_MOESM1_ESM.docx (25.3KB, docx)

Additional file 1. This file documents a sample agenda for conducting a service mapping workshop as outlined in the Methods of this paper.

Acknowledgements

The authors would like to thank participants from the North Coast Primary Health Network, the headspace centres (Coffs Harbour, Grafton, Lismore, Port Macquarie, and Tweed Heads) and Open Arms – Veterans & Families Counselling (Sydney) for their involvement in this study.

The authors acknowledge and thank the Project Synergy Lived Experience Advisory Function (LEAF) led by Ms. Sue Muller for their contribution to this research.

Abbreviations

BMC

Brain Mind Centre

DOH

Department of Health

HREC

Human Research Ethics Committee

PHN

Primary health network

OPC

Outreach program counsellors

Authors’ contributions

Authors IBH, TAD, and SPC were integral in securing funding to support the study. IBH served as the scientific advisor for this work, guiding all aspects of the design, data collection, analysis and interpretation. The study was designed by TAD, HML, AO, and SPC, with data collection and analysis being completed by HML, AO, SPC, SCR, TAJ, MAE and JM. FI further refined the methods in this paper, providing valuable insights for the future of our service mapping research. The first draft of the manuscript was prepared by HML with all authors contributing thereafter and providing final approval of the manuscript.

Funding

This research is being conducted on behalf of The Australian Government Department of Health (DOH) as part of Project Synergy (2017–20). Funding is secured. InnoWell has been formed by the University of Sydney and PwC (Australia) to deliver the AUD $30 m Australian Government-funded Project Synergy.

Availability of data and materials

The data used and analysed during the current study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate

This research required multiple ethics approvals by various Human Research Ethics Committees (HRECs) due to the diverse organisational structures governing each of the mental health services involved in the service mapping workshops. More specifically, the governing body for Open Arms – Veterans & Families Counselling Service required applications to be submitted through the Department of Defence and Veterans’ Affairs HREC (Project numbers: E016/027 and 017–17), whilst ethics applications to conduct research with all headspace centres were submitted through the University of Sydney HREC (Project numbers: 2017/944 and 2018/849). All participants provided written informed consent prior to participating in this study.

Consent for publication

Not applicable.

Competing interests

Professor Ian Hickie was an inaugural Commissioner on Australia’s National Mental Health Commission (2012–18). He is the Co-Director, Health and Policy at the Brain and Mind Centre (BMC) University of Sydney. The BMC operates an early-intervention youth services at Camperdown under contract to headspace. He is the Chief Scientific Advisor to, and a 5% equity shareholder in, InnoWell Pty Ltd. InnoWell was formed by the University of Sydney (45% equity) and PwC (Australia; 45% equity) to deliver the $30 M Australian Government-funded Project Synergy (2017–20; a three-year program for the transformation of mental health services) and to lead transformation of mental health services internationally through the use of innovative technologies. Tracey Davenport is now Director (Research and Evaluation), Design and Strategy Division, Australian Digital Health Agency. The other authors have nothing to disclose.

The source of funding does not entail any potential conflict of interest for the other members of the Project Synergy Research and Development Team, or any other members of the governing bodies, such as PNHs and Lead Agencies, and health services involved in the study.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Mental Health Taskforce to National Health Service in England. The five year forward view for mental health. Leeds: NHS England; February 2016. [cited 2020 Oct 6]. Available from: https://www.england.nhs.uk/wp-content/uploads/2016/02/Mental-Health-Taskforce-FYFV-final.pdf.
  • 2.Productivity Commission. Mental health, Draft Report, Canberra: Australian Government; October 2019. [cited 2020 Oct 6]. Available from: https://www.pc.gov.au/inquiries/completed/mental-health/draft/mental-health-draft-overview.pdf.
  • 3.Griffiths KM, Christensen H. Review of randomised controlled trials of internet interventions for mental disorders and related conditions. Clin Psychol. 2006;10(1):16–29. doi: 10.1080/13284200500378696. [DOI] [Google Scholar]
  • 4.Moore RC, Depp CA, Wetherell JL, Lenze E. Ecological momentary assessment versus standard assessment instruments for measuring mindfulness, depressed mood, and anxiety among older adults. J Psychiatr Res. 2016;75:116–123. doi: 10.1016/j.jpsychires.2016.01.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Titov N, Dear B, Nielssen O, Staples L, Hadjistavropoulos H, Hugent M, et al. ICBT in routine care: a descriptive analysis of successful clinics in five countries. Internet Interv. 2018;13:108–115. doi: 10.1016/j.invent.2018.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Davenport TA, Ospina-Pinillos L, Ricci CS, Milton AC, Burns JM, Hickie IB. Fit Uni Life to thrive: an online health and wellbeing prototype for young people. Med J Aust. 2019;Suppl (7):S12–S16. [Google Scholar]
  • 7.Davenport TA, Whittle L, Ospina-Pinillos L, Milton AC, Burns JM, Hickie IB. Evaluating engagement with a prototypic online platform to improve the mental health and wellbeing of young people living in disadvantaged communities. Med J Aust. 2019;Suppl (7):S17–S23. [Google Scholar]
  • 8.Davenport TA, Milton AC, Whittle L, McLoughlin LT, Ospina-Pinillos L, Mendoza J, et al. Co-designing, user testing and evaluating digital suicide prevention functionality. Med J Aust. 2019;Suppl (7):S24–S29. [Google Scholar]
  • 9.Cross SP, Piper SE, Davenport TA, Milton AC, Iorfino F, Ricci CS, et al. Med J Aust. 2019;Suppl (7):S30–S36. [Google Scholar]
  • 10.LaMonica HM, Davenport TA, Braunstein K, Ottavio A, Piper S, Martin C, et al. Technology-enabled person-centred mental health services reform: strategy for implementation science. JMIR Ment Health. 2019;6(9):e14719. doi: 10.2196/14719. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Granja C, Janssen W, Johansen MA. Factors determining the success and failure of ehealth interventions: systematic review of the literature. J Med Internet Res. 2018;20(5):e10235. doi: 10.2196/10235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Vis C, Mol M, Kleiboer A, Bührmann L, Finch T, Smit J, et al. Improving implementation of emental health for mood disorders in routine practice: systematic review of barriers and facilitating factors. JMIR Ment Health. 2018;5(1):e20. doi: 10.2196/mental.9769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367. doi: 10.2196/jmir.8775. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kenter RMF, van de Ven PM, Cuijpers P, Koole G, Niamat S, Gerrits RS, et al. Costs and effects of internet cognitive behavioural treatment blended with face-to-face treatment: results from a naturalistic study. Internet Interv. 2015;2:77–83. doi: 10.1016/j.invent.2015.01.001. [DOI] [Google Scholar]
  • 15.Robbins J, Garman AN, Song PH, McAlearney AS. How high-performance work systems drive health care value: an examination of leading process improvement strategies. Qual Manage Health Care. 2012;21(3):188–202. doi: 10.1097/QMH.0b013e31825e88f6. [DOI] [PubMed] [Google Scholar]
  • 16.Antonacci G, Reed JE, Lennox L, Barlow J. The use of process mapping in healthcare quality improvement projects. Health Serv Manag Res. 2018;31(2):74–84. doi: 10.1177/0951484818770411. [DOI] [PubMed] [Google Scholar]
  • 17.Lawal AK, Rotter T, Kinsman L, Sari N, Harrison L, Jeffery C, et al. Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol) Syst Rev. 2014;3:103. doi: 10.1186/2046-4053-3-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.D’Andreamatteo A, Ianni L, Lega F, Sargiacomo M. Lean in healthcare: a comprehensive review. Health Policy. 2015;199:1197–1209. doi: 10.1016/j.healthpol.2015.02.002. [DOI] [PubMed] [Google Scholar]
  • 19.de Souza LB. Trends and approaches in lean healthcare. Leadersh Health Serv. 2009;22(2):121–139. doi: 10.1108/17511870910953788. [DOI] [Google Scholar]
  • 20.Lauriks S, Buster MC, de Wit MA, et al. Performance indicators for public mental healthcare: a systematic international inventory. BMC Public Health. 2012;12:214. doi: 10.1186/1471-2458-12-214. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.World Health Organisation (WHO) Integrating mental health into primary care: A global perspective. Geneva: WHO.; 2008. [Google Scholar]
  • 22.Hickie IB, Davenport TA, Burns JM. Overview of Project Synergy: building an online platform to deliver right care, first time. Med J Aust. 2019;Suppl (7):S4–S7. [Google Scholar]
  • 23.Davenport TA, LaMonica HM, Whittle L, English A, Iorfino F, Cross S, et al. Validation of the InnoWell platform: protocol for a clinical trial. JMIR Res Protoc. 2019;8(5):e13955. doi: 10.2196/13955. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Iorfino F, Cross SP, Davenport T, Carpenter JS, Scott E, Shiran S, et al. A digital platform designed for youth mental health services to deliver personalized and measurement-based care. Front Psychiatry. 2019;10:595. doi: 10.3389/fpsyt.2019.00595. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Johnson JK, Farnan JM, Barach P, Hesselink G, Wollersheim H, Pijnenborg L, et al. Searching for the missing pieces between the hospital and primary care: mapping the patient process during care transitions. BMJ Qual Saf. 2012;0:1–9. doi: 10.1136/bmjqs-2012-001215. [DOI] [PubMed] [Google Scholar]
  • 26.LaMonica HM, Davenport TA, Burns J, Cross S, Hodson S, Veitch J, et al. Technology-enabled mental health services reform for open arms – veterans and families Counselling: a participatory design study. JMIR Formative Res. 2019;3(3):e13662. doi: 10.2196/13662. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Rowe SC, Davenport TA, Easton MA, Jackson TA, Melsness J, Ottavio A, et al. Co-designing the InnoWell platform to deliver the right mental health care first time to regional youth. Aust J Rural Health. 2020;28:190–194. doi: 10.1111/ajr.12617. [DOI] [PubMed] [Google Scholar]
  • 28.Iorfino F, Davenport TA, Ospina-Pinillos L, Hermens DF, Cross S, Burns J, et al. Using new and emerging technologies to identify and respond to suicidality among help-seeking young people: a cross-sectional study. J Med Internet Res. 2017;19(7):e247. doi: 10.2196/jmir.7897. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Muñoz-Sánchez JL, Delgado C, Sánchez-Prada A, Pérez-López M, Franco-Martín MA. Use of new Technologies in the Prevention of suicide in Europe: an exploratory study. JMIR Ment Health. 2017;4(2):e23. doi: 10.2196/mental.7716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Witt K, Spittal MJ, Carter G, Pirkis J, Hetrick S, Currier D, et al. Effectiveness of online and mobile telephone applications (‘apps’) for the self-management of suicidal ideation and self-harm: a systematic review and meta-analysis. BMC Psychiatry. 2017;17:297. doi: 10.1186/s12888-017-1458-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Milton AC, Ellis LA, Davenport TA, Burns JM, Hickie IB. Comparison of self-reported telephone interviewing and web-based survey responses: findings from the second Australian young and well National Survey. JMIR Ment Health. 2017;4(3):e37. doi: 10.2196/mental.8222. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Torous J, Staples P, Shanahan M, Lin C, Peck P, Keshavan M, et al. Utilizing a personal smartphone custom app to assess the patient health Questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Ment Health. 2015;2(1):e8. doi: 10.2196/mental.3889. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Vallejo MA, Jordán CM, Díaz MI, Comeche MI, Ortega J. Psychological assessment via the internet: a reliability and validity study of online (vs paper-and-pencil) versions of the general health Questionnaire-28 (GHQ-28) and the symptoms check-List-90-revised (SCL-90-R) J Med Internet Res. 2007;9(1):e2. doi: 10.2196/jmir.9.1.e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ballester L, Alayo I, Vilagut G, Almenara J, Cebrià AI, Echeburu’a E, et al. Accuracy of online survey assessment of mental disorders and suicidal thoughts and behaviors in Spanish university students. Results of the WHO World Mental Health- International College Student initiative. PLoS ONE. 2019;14(9):e0221529. doi: 10.1371/journal.pone.0221529. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Ospina-Pinillos L, Davenport T, Iorfino F, Tickell A, Cross S, Scott EM, et al. Using new and innovative technologies to assess clinical stage in early intervention youth mental health services: evaluation study. J Med Internet Res. 2018;20(9):e259. doi: 10.2196/jmir.9966. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Lambert MJ. Maximizing psychotherapy outcome beyond evidence-based medicine. Psychother Psychosom. 2017;86:80–89. doi: 10.1159/000455170. [DOI] [PubMed] [Google Scholar]
  • 37.LaMonica HM, Davenport TA, Roberts AE, Hickie IB. Understanding technology preferences and requirements for health information technologies designed to improve mental health and maintain wellbeing for older adults: a participatory design study. JMIR Aging. 2021;4(1):e21461. doi: 10.2196/21461. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bort-Roig J, Gilson ND, Puig-Ribera A, Contreras RS, Trost SG. Measuring and influencing physical activity with smartphone technology: a systematic review. Sports Med. 2014;44(5):671–686. doi: 10.1007/s40279-014-0142-5. [DOI] [PubMed] [Google Scholar]
  • 39.Blenkiron P, Hammill CA. What determines patients’ satisfaction with their mental health care and quality of life? Postgrad Med J. 2003;79:337–340. doi: 10.1136/pmj.79.932.337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3:e001570. doi: 10.1136/bmjopen-2012-001570. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Cross SP, Davenport TA, LaMonica HM, Hickie IB. Potential of real-time and integrated clinical data to drive continuous quality improvement in youth mental health services. Med J Aust. 2019;Suppl (7):S37–S39. [Google Scholar]
  • 42.LaMonica HM, Milton A, Braunstein K, Rowe SC, Ottavio A, Jackson T, Easton MA, Hambleton A, Hickie IB, Davenport TA. Technology-enabled solutions for Australian mental health services reform: impact evaluation. JMIR Formative Res. 2020;4(11):e18759. doi: 10.2196/18759. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Willis E, Semple AC, de Waal H. Quantifying the benefits of peer support for people with dementia: a social return on investment (SROI) study. Dementia. 2018;17(3):266–278. doi: 10.1177/1471301216640184. [DOI] [PubMed] [Google Scholar]
  • 44.Marshall BD, Galea S. Formalizing the role of agent-based modeling in causal inference and epidemiology. Am J Epidemiol. 2015;181(2):92–99. doi: 10.1093/aje/kwu274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ. 2001;323(7313):625–628. doi: 10.1136/bmj.323.7313.625. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Osgood N. Frontiers in health modeling. In: E-Sayed AM, Galea S, editors. Systems science and population health. New York: Oxford University Press; 2017. pp. 191–215. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

12913_2021_6069_MOESM1_ESM.docx (25.3KB, docx)

Additional file 1. This file documents a sample agenda for conducting a service mapping workshop as outlined in the Methods of this paper.

Data Availability Statement

The data used and analysed during the current study are available from the corresponding author on reasonable request.


Articles from BMC Health Services Research are provided here courtesy of BMC

RESOURCES