Abstract
Background
Changing population demography and patterns of disease are increasing demands on the health system. Telehealth is seen as providing a mechanism to support community-based care, thus reducing pressure on hospital services and supporting consumer preferences for care in the home.
Objective
This study examined the processes involved in developing a prototype telehealth intervention to support palliative care patients involved with a palliative care service living in the community.
Methods
The challenges and considerations in developing the palliative care telehealth prototype were reviewed against the Center for eHealth Research (CeHRes) framework, a telehealth development model. The project activities to develop the prototype were specifically mapped against the model’s first four phases: multidisciplinary project management, contextual inquiry, value specification, and design. This project has been developed as part of the Telehealth in the Home: Aged and Palliative Care in South Australia initiative.
Results
Significant issues were identified and subsequently addressed during concept and prototype development. The CeHRes approach highlighted the implicit diversity in views and opinions among participants and stakeholders and enabled issues to be considered, resolved, and incorporated during design through continuous engagement.
Conclusions
The CeHRes model provided a mechanism that facilitated “better” solutions in the development of the palliative care prototype by addressing the inherent but potentially unrecognized differences in values and beliefs of participants. This collaboration enabled greater interaction and exchange among participants resulting in a more useful and clinically valuable telehealth prototype.
Keywords: telemedicine, palliative care, delivery of care, home care
Introduction
Given an aging population and changing patterns of disease, health systems are being challenged by an increasing number and type of care needs. Part of the policy response has been to try to stabilize the demand on hospitals by building capacity in primary care and by supporting care provision in the community. This in turn has driven the need for innovative approaches to facilitate care in community settings [1-3]. Telehealth is gaining increasing prominence within the health system as one solution, driven by the promise of benefits for patients, their families, health providers, and health services coupled with the possibility of cost savings [4-6]. The possibilities afforded by telehealth in community-based care have led to a rapid expansion of telehealth resources and options [7-11].
Community-based care includes care of patients with palliative care needs. Most patients in the final stage of their life will be cared for in their home for some or for all of this period. Many of these patients will have some form of engagement or interaction with a palliative care service. Involvement with a palliative care service has been shown to improve a person’s likelihood of dying at home and to reduce the symptom burden associated with advanced illness [12,13]. While care delivery for patients supported by palliative care services can be structured with a sequenced pattern of contacts or home visits, engagement is not continuous. Patients may decline rapidly or unexpectedly between scheduled visits with little opportunity for proactive intervention by the palliative care service. Patient self-reporting processes with real-time feedback would enable early identification of changes and facilitate targeted clinical and service responses, potentially enhancing care and outcomes. Such self-reporting could be provided through telehealth. Telehealth modules could allow patients to enter information about their symptoms and functional status with algorithms triggering automated clinical alerts based on the data entered. Furthermore, telehealth could potentially support family carers who are integral to enabling the care of palliative care patients at home [14,15]. Some clinical areas have already investigated the possibilities of telehealth-enabled patient self-report in the community [16-18]. These studies have shown a range of potential benefits including increased communication, early intervention, better symptom control, and enhanced patient satisfaction and empowerment. However, the telehealth evidence base within palliative care is more limited [19,20].
The processes involved in developing resources that are clinically meaningful and that interface with, or enhance, work practices are complex and multidimensional. Telehealth resources must satisfy the utility and usability criteria of clinicians and consumers of care as well as meet the policy and system requirements of funders. Telehealth modules may not be successfully deployed where there is a limited understanding of the physical and social structures of the clinical environment and a lack of appreciation of the implications of technical decisions on functional outcomes. Aligning clinical utility within technological capabilities requires consideration of many elements such as:
the health context and current service delivery model
what opportunities are enabled by changing practice and by incorporating technological capabilities
whether knowledge and evidence exists that support both the clinical components and the telehealth choices
the available technological frameworks and systems
processes needed to ensure effective and timely decision making
mechanisms for collaborative resolution of developmental issues
support for iterative refinement of the telehealth resources before use in research studies and clinical practice.
Resources developed in isolation of the intended use and user, and simply released to the market to determine their potential use and value, may have limited value. However, those that are built to meet only a specific local clinical purpose may be too limited for sustainability and scalability. Westbrook and Braithwaite [21] have argued that there is a need to look at how information and communications technology can be conducted in real clinical settings that acknowledges the complex and collaborative work between colleagues and that involves clinicians from the frontlines in the developmental work. This means that concept selection, prototype design, and construction need to integrate clinical worth and technical feasibility.
A recent review and critical appraisal of eHealth frameworks with respect to the fit between human, organizational, and technological factors has highlighted the interdependent factors underpinning telehealth innovation [22]. The authors noted that while many studies in the review highlighted individual components such as collaboration between developers and researchers or input from users and stakeholders, these components were not reflected in cohesive approaches that collectively enhanced the likelihood of successful eHealth development. Consequently, based on their analysis of the studies, they defined a holistic framework to guide the development of eHealth technologies. Their framework, the Center for eHealth Research (CeHRes) roadmap, is an iterative model that maps the research and developmental activities involved in developing eHealth applications from concept definition through development to summative evaluation. These activities can be described as follows:
Multidisciplinary project management: facilitates cooperation between those who build the technology and those who are using or affected by it.
Contextual inquiry: entails gathering information from end users and building an understanding of the environment where the technology will be implemented.
Value specification: identifies the underpinning value of the various stakeholders to define the critical purposes of the technology intervention.
Design: assigning and testing the functional characteristics needed to develop a workable and usable prototype.
Operationalization: deploying the prototype for use and supporting the implementation with training and education.
Summative evaluation: assessing the effect and the impact of the technology in its environment.
This paper reports on the sequences involved in designing and developing the prototype of a telehealth intervention to support palliative care patients and their carers living in the community. It aims to identify the challenges and considerations in creating a palliative care telehealth prototype mapped against the four formative phases of the CeHRes roadmap, namely multidisciplinary project management, contextual inquiry, value specification, and design.
Methods
This palliative care telehealth module was developed as one part of the Telehealth in the Home: Aged and Palliative Care in South Australia project, which examined potential benefits associated with the integration, supplementation, or novel development of telehealth as a key component of care delivery to the home in three clinical care areas (ie, aged care, rehabilitation, and palliative care). Each work stream was led by a clinical research team supported by the project’s technical and operational team. Ethics approval was gained through Southern Adelaide Clinical Human Research Ethics committee, application number HREC/13/SAC/88(168.13). The whole project was overseen by the Project Steering Committee. Input and reporting relationships are outlined in Figure 1.
Results
Overview
Significant issues were identified in all aspects of the concept and prototype development that reflected the phases and activities outlined below against the CeHRes model elements. Examples of types of activities and decisions against these four stages for concept ideation and prototype development are included in Table 1.
Table 1.
|
Concept development | Prototype development |
Multidisciplinary project management | Recognizing that a finding from a randomized controlled trial (initiating a case conference at a point of functional decline identified by a standard tool) could be translated into an online app | Opportunities to test and evaluate different technical options for service against multiple criteria |
Staff from another eHealth project identified the importance of a Web-based system for data entry | Including a Quality Improvement/usability phase with patients in the community | |
Contextual inquiry | Awareness of palliative care service’s previous involvement in clinical studies | Clinicians should not be required to undertake atypical behavior patterns (eg, go to another building for a virtual service) |
Discussions with the clinical team identified that many had no experience with tablets and only limited computer experience in the workplace | Developing required specification of implicit clinical practice | |
Health service providers were facing funding difficulties and hence were supportive of approaches to maintain or enhance community service provision | Assessing trade-offs between device functions and the capabilities of intended users | |
Value specification | Enhancing access to patient and carer’s state of health/well-being between visits | Ensuring continuity of care across patient and carer and pre/post-bereavement |
Supporting clinicians in moving to telehealth | Usability as the priority for prototype | |
Doing more with less (or same) | “You’re not a geek, it’s ok to not know things” | |
Design | Using commonly available devices to support post-trial sustainability | Modifying features based on feedback from patients who assisted in a quality assurance phase |
Recognizing the usability requirements of older people who may have accessibility issues | Remote facility to update carer resources after death of a participant |
Multidisciplinary Project Management
The Palliative Care (Telehealth) Research Team (PCTRT) was established to guide the development of a telehealth model for use by the community team of a specialist palliative care service. Membership of the PCTRT included the Director of the Clinical Service, clinical staff (ie, medicine, nursing, allied health), and researchers with expertise in clinical trial design, health services research, and evaluation. A project manager was appointed to support the project development. Input was sought and received during concept and module development from service providers, stakeholders, and patients and carers involved with the service. Meetings were held with the clinicians providing direct care to enable input and feedback on the proposals and the development of the prototype.
The PCTRT had access to, and ongoing support from, members of the Technical and Operational Team who were responsible for the network architecture, systems, and applications used to deliver the telehealth interventions for each of the three clinical streams. The skill base for the PCTRT was enhanced by the inclusion of staff from an associated eHealth project providing access to additional resources and expertise [23].
Contextual Inquiry
The contextual framework for the telehealth intervention was pivotal. Preliminary work on the environment and clinical needs had been undertaken in the process of grant application. Members of the PCTRT were integral to this process. This provided continuity from concept to prototype development and ensured that the original concept idea was rooted in clinical utility. The application process also meant that relationships among potential participants needed to be investigated and established and that key stakeholders needed to be contacted to formalize their support. This provided the prompt for meetings and workshops to explore aspects of telehealth in the local environment.
For those seeking to incorporate telehealth into clinical care practices, being able to use what has been shown to be effective from research in innovative telehealth solutions is critical. While technological innovation in itself may show potentials and opportunities, it is the quality of the clinical content of a telehealth module and its relevance to practice that ensures its value and contribution to the provider and patient community. Several elements of this palliative care module used findings from previous research studies in which the associated clinical service had been involved [24,25]. In effect, this meant that the module used research evidence that improved its clinical value. Further, incorporating the results of this research into the telehealth module offered a mechanism by which the research evidence could be translated for use in practice.
Value Specification
While all stakeholders believed that incorporating telehealth in community service models offered the possibility of enhanced care, there were different views and attitudes on the shape, purpose, and outcomes of such interventions. The meetings and workshops held during the grant application development process facilitated the identification of values held by different participants. This was further explored in meetings held with service staff, technical teams, community members and providers, and funders and stakeholders during project start-up and design activities. For clinical staff, the prospect of enhanced care through more frequent patient-clinician communication, remote monitoring, and change triggers was significant. For the service manager and funders, the capacity to optimize resources while retaining care standards was pivotal. For patients and carers, connectedness through continuous monitoring and videoconferencing was attractive. For researchers and technology developers, the chance to demonstrate feasibility and to assess effectiveness was important. This range of views and attitudes informed the concept design and testing specifications as well as the research and evaluation processes.
These processes of negotiation and clarification led the PCTRT to realize that, in order to bring about the desired outcomes, the palliative care service needed to see that the telehealth intervention had a direct and real clinical value for the patient and the carer. This central proposition guided a series of decisions during design and prototype testing.
Design
The design process involved careful description of the standard care processes delivered by the palliative care community team and an analysis of how data captured through patient and carer self-report in the community could be integrated into work processes and data systems. This clinical review provided the framework for decision points that needed to be built into the telehealth functionality. While a more detailed technical specification would be developed, this practical specification represented the point of transition between the clinical perception of telehealth as a possibility and the technical production of functional and robust prototypes. Figure 2 outlines the development in the design from initial concept description through clinical articulation to prototype.
While other elements such as the hardware and networks for delivery of the telehealth intervention could be led by the technical team, detailed clinical leadership in defining the characteristics and logistics of the telehealth application during design was fundamental to developing resources that could be acknowledged as valuable in the clinical setting.
Discussion
Summary
The focus of this paper is on the complexity of the environment in which decisions that shape the nature and development of a telehealth concept are made. Moving from idea to application is not linear but iterative, informed by what is learned and what is experienced. Feedback, testing, and incorporation of multiple perspectives can enhance the quality and the utility of telehealth modules. Initial concept decisions that reflect a clear and apparent central value proposition but that respect diversity in values among the stakeholders provide a strong basis in moving from idea to practical resource. This process particularly needs to be shaped by critical input from those who will need to engage with the module, most notably consumers (patients and carers) and health professionals [26]. However, even in initial concept discussions, enabling multidisciplinary participation offers an environment where the relative weight of decisions can be tested and determined, providing some assessment of possible return for effort and technical feasibility. Early engagement with those from a range of discipline-relevant backgrounds and with different roles and experiences helps to adjust the attitudes of participants and build an atmosphere that encourages exchange and inclusion.
The importance of the multidisciplinary team was demonstrated throughout the planning and design work as choices about platforms, devices, and systems all had the potential to affect the experience of both patients and clinicians. For example, the clinical understanding of the functional and cognitive capacities of the patient population became an important element in highlighting the relative importance of simplicity of use for a videoconferencing system over advanced functionalities and security settings. Cost and security options for different approaches were also robustly debated given the implications for post-trial sustainability. These discussions again reflected different values held by different participants and stakeholders. For example, systems that could engage with hospital record systems could not be deployed for patient use in the community. Provision of tablets rather than self-contained commercial products were seen to offer the best option for service continuation after the trial at the expense of some functionality that could be used by older people with impairments in physical and cognitive function.
Meetings between the PCTRT and the technical advisors also provided a forum where complex problems could be reviewed from clinical, technical, and research perspectives. For example, in palliative care community outreach, death is seen as an expected event. However, the issue of how to handle the effect of the death of a patient within the telehealth environment requires careful analysis. While the telehealth intervention provides support to both the patient and the carer in their home, the death of the patient would mean there is a need to reassess the carer’s virtual relationship with the service as well as the carer’s experience and use of the tablet in a changed environment, that is, without the presence of their loved one. Various options such as the remote dismantling of the patient resources and/or the enablement of bereavement-specific resources were examined by the PCTRT from the viewpoints of technical feasibility, clinical value, and preferences of the intended user, namely the newly bereaved carer. The resulting dialogue provided the opportunity to illuminate specific aspects of this problem and to examine potential solutions in terms of system capacities and human sensitivities with regard to continuity of relationships and care.
However, while robust discussions about technologies and technical issues were being held at the project level, discussions with the clinical service team identified that many clinicians had no experience and limited confidence in using tablets such as iPads, which were the preferred project device. Early engagement with the clinicians who would be delivering the telehealth service enabled sufficient lead time for clinical members to be provided with training and experience in using the technology that would be provided to patients. This meant that, at the point where clinical staff began a quality assurance exercise with patients, they felt comfortable in introducing patients to the tablet and the apps contained on them.
The CeHRes framework highlights the implicit diversity in views and opinions that can lead to potential divergence in values and competencies among participants and stakeholders. Such inherent conflict requires those involved in planning and developing to be able to articulate underlying assumptions and be involved in the assessment of the relative importance of different options. Greenhalgh et al’s discourse analysis [27] identified conflicting but intersecting discourses on telehealth that reflected different views and values of participants and protagonists in the health sector. Their proposal that learning communities are needed to bridge these gaps reflects the values specification aspect of the CeHRes framework. It also reinforces the need for the initial and ongoing involvement of different parties.
The difficulty is in forming and maintaining teams that can assimilate these varying perspectives and strengthen the developed resources by accommodating technical, clinical, and political complexity. Informed collective decision making assumes that technical, clinical, and social decisions should not be made independently. However, this also implies that participants are able to deal with potentially uncomfortable and unfamiliar sets of knowledge to ensure that these perspectives are integrated. While such team input provides a rich appreciation of the complex nature of the task being undertaken, it also means that there is a need to acknowledge and understand the expertise and roles of different contributors. The challenges associated with understanding non-shared concepts and terminologies and respecting different processes and paradigms has been previously reported [28]. However, it is also important to acknowledge that establishing working relationships within and across the clinical and technical teams requires a substantial contribution of time and focus. This was challenging in this project as all members of the PCTRT, except the project manager, were participating in the project in addition to their normal clinical and management responsibilities. Tensions associated with positional authority, inability to attend all activities that could influence the design and development of the telehealth modules, and the persistent and detailed analysis and specification required, created pressures for participants and for teams. So, given that the time commitment needed to ensure purposeful engagement and contribution is significant, and recognizing that it is this contribution that drives the contextual inquiry and values analysis, projects need to incorporate this resource requirement adequately into planning.
Conclusions
Telehealth module development is complex and represents a balance between clinical need, consumer benefit, and technical and financial feasibility. A clear health value proposition appears to provide a basis for measurement of different viewpoints and gives clarity to assessing purpose, application, and effect. There may not be a “perfect” answer for any specific telehealth intervention, so the articulation of stages and activities in the CeHRes model that can guide the development and uptake of eHealth provides a mechanism to support “better” solutions that have addressed the underlying, and often unstated, values and beliefs of different participants.
Acknowledgments
The Telehealth in the Home: Aged and Palliative Care in South Australia project is an initiative funded by the Australian government.
Abbreviations
- CeHRes
Center for eHealth Research
- PCTRT
Palliative Care (Telehealth) Research Team
Footnotes
Conflicts of Interest: None declared.
References
- 1.Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, Patel V, Haines A. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013;10(1):e1001363. doi: 10.1371/journal.pmed.1001363. http://dx.plos.org/10.1371/journal.pmed.1001363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Enguidanos S, Portanova J. The provision of home-based palliative care for those with advanced heart failure. Curr Opin Support Palliat Care. 2014 Mar;8(1):4–8. doi: 10.1097/SPC.0000000000000024. [DOI] [PubMed] [Google Scholar]
- 3.Kripalani S, Theobald CN, Anctil B, Vasilevskis EE. Reducing hospital readmission rates: current strategies and future directions. Annu Rev Med. 2014;65:471–85. doi: 10.1146/annurev-med-022613-090415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.OECD Internet Economy Report . ICTs and the Health Sector: Towards Smarter Health and Wellness Models 2013. OECD Publishing; 2013. [2013-11-26]. http://www.keepeek.com/Digital-Asset-Management/oecd/science-and-technology/icts-and-the-health-sector_9789264202863-en. [Google Scholar]
- 5.Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006 May 16;144(10):742–52. doi: 10.7326/0003-4819-144-10-200605160-00125. [DOI] [PubMed] [Google Scholar]
- 6.Directorate for Employment. Labour and Social Affairs . Achieving Efficiency Improvements in the Health Sector through the Implementation of Information and Communication Technologies. OECD Publishing; 2010. [2013-11-26]. http://www.ehealthnews.eu/images/stories/pdf/oecd_ict_en.pdf. [Google Scholar]
- 7.Geraedts H, Zijlstra A, Bulstra SK, Stevens M, Zijlstra W. Effects of remote feedback in home-based physical activity interventions for older adults: a systematic review. Patient Educ Couns. 2013 Apr;91(1):14–24. doi: 10.1016/j.pec.2012.10.018. [DOI] [PubMed] [Google Scholar]
- 8.Johansen MA, Henriksen E, Horsch A, Schuster T, Berntsen GK. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. Part 1: state of the art. J Med Internet Res. 2012;14(5):e118. doi: 10.2196/jmir.2214. http://www.jmir.org/2012/5/e118/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Cartwright M, Hirani SP, Rixon L, Beynon M, Doll H, Bower P, Bardsley M, Steventon A, Knapp M, Henderson C, Rogers A, Sanders C, Fitzpatrick R, Barlow J, Newman SP, Whole Systems Demonstrator Evaluation Team Effect of telehealth on quality of life and psychological outcomes over 12 months (Whole Systems Demonstrator telehealth questionnaire study): nested study of patient reported outcomes in a pragmatic, cluster randomised controlled trial. BMJ. 2013;346:f653. doi: 10.1136/bmj.f653. http://www.bmj.com/cgi/pmidlookup?view=long&pmid=23444424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Stroetmann KA, Kubitschke L, Robinson S, Stroetmann V, Cullen K, McDaid D. How can telehealth help in the provision of integrated care? Health Systems and Policy Analysis Policy Brief#13. European Observatory on Health Systems and Policies; 2010. [2013-11-26]. http://www.euro.who.int/__data/assets/pdf_file/0011/120998/E94265.pdf. [Google Scholar]
- 11.Ahern DK, Woods SS, Lightowler MC, Finley SW, Houston TK. Promise of and potential for patient-facing technologies to enable meaningful use. Am J Prev Med. 2011 May;40(5 Suppl 2):S162–72. doi: 10.1016/j.amepre.2011.01.005. [DOI] [PubMed] [Google Scholar]
- 12.Gomes B, Calanzani N, Curiale V, McCrone P, Higginson IJ. Effectiveness and cost-effectiveness of home palliative care services for adults with advanced illness and their caregivers. Cochrane Database Syst Rev. 2013;6:CD007760. doi: 10.1002/14651858.CD007760.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Candy B, Holman A, Leurent B, Davis S, Jones L. Hospice care delivered at home, in nursing homes and in dedicated hospice facilities: A systematic review of quantitative and qualitative evidence. Int J Nurs Stud. 2011 Jan;48(1):121–33. doi: 10.1016/j.ijnurstu.2010.08.003. [DOI] [PubMed] [Google Scholar]
- 14.Wolff JL, Dy SM, Frick KD, Kasper JD. End-of-life care: findings from a national survey of informal caregivers. Arch Intern Med. 2007 Jan 8;167(1):40–6. doi: 10.1001/archinte.167.1.40. [DOI] [PubMed] [Google Scholar]
- 15.National Alliance of Caregiving . e-Connected family caregiver: bringing caregiving into the 21st century. Bethesda, MD: National Alliance of Caregiving; 2011. [2013-11-26]. http://www.caregiving.org/data/FINAL_eConnected_Family_Caregiver_Study_Jan%202011.pdf. [Google Scholar]
- 16.Bennett AV, Jensen RE, Basch E. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin. 2012 Oct;62(5):337–47. doi: 10.3322/caac.21150. http://dx.doi.org/10.3322/caac.21150. [DOI] [PubMed] [Google Scholar]
- 17.Cox A, Illsley M, Knibb W, Lucas C, O'Driscoll M, Potter C, Flowerday A, Faithfull S. The acceptability of e-technology to monitor and assess patient symptoms following palliative radiotherapy for lung cancer. Palliat Med. 2011 Oct;25(7):675–81. doi: 10.1177/0269216311399489. [DOI] [PubMed] [Google Scholar]
- 18.Kroenke K, Theobald D, Wu J, Norton K, Morrison G, Carpenter J, Tu W. Effect of telecare management on pain and depression in patients with cancer: a randomized trial. JAMA. 2010 Jul 14;304(2):163–71. doi: 10.1001/jama.2010.944. http://europepmc.org/abstract/MED/20628129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Demiris G, Parker Oliver D, Wittenberg-Lyles E. Technologies to support end-of-life care. Semin Oncol Nurs. 2011 Aug;27(3):211–7. doi: 10.1016/j.soncn.2011.04.006. http://europepmc.org/abstract/MED/21783012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Kuziemsky CE, Jahnke JH, Lau F. The e-Hospice: beyond traditional boundaries of palliative care. Telematics and Informatics. 2006 May;23(2):117–133. doi: 10.1016/j.tele.2005.05.003. [DOI] [Google Scholar]
- 21.Westbrook JI, Braithwaite J. Will information and communication technology disrupt the health system and deliver on its promise? Med J Aust. 2010 Oct 4;193(7):399–400. doi: 10.5694/j.1326-5377.2010.tb03968.x. [DOI] [PubMed] [Google Scholar]
- 22.van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, Seydel ER. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. 2011;13(4):e111. doi: 10.2196/jmir.1672. http://www.jmir.org/2011/4/e111/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Tieman JJ. Filters and hubs: shortening the distance to palliative care evidence. Aust J Prim Health. 2012;18(4):268–73. doi: 10.1071/PY11103. [DOI] [PubMed] [Google Scholar]
- 24.Eagar K, Watters P, Currow DC, Aoun SM, Yates P. The Australian Palliative Care Outcomes Collaboration (PCOC)--measuring the quality and outcomes of palliative care on a routine basis. Aust Health Rev. 2010 May;34(2):186–92. doi: 10.1071/AH08718. [DOI] [PubMed] [Google Scholar]
- 25.Abernethy AP, Currow DC, Shelby-James T, Rowett D, May F, Samsa GP, Hunt R, Williams H, Esterman A, Phillips PA. Delivery strategies to optimize resource utilization and performance status for patients with advanced life-limiting illness: results from the "palliative care trial" [ISRCTN 81117481] J Pain Symptom Manage. 2013 Mar;45(3):488–505. doi: 10.1016/j.jpainsymman.2012.02.024. [DOI] [PubMed] [Google Scholar]
- 26.Van Velsen L, Wentzel J, Van Gemert-Pijnen JE. Designing eHealth that Matters via a Multidisciplinary Requirements Development Approach. JMIR Res Protoc. 2013;2(1):e21. doi: 10.2196/resprot.2547. http://www.researchprotocols.org/2013/1/e21/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Greenhalgh T, Procter R, Wherton J, Sugarhood P, Shaw S. The organising vision for telehealth and telecare: discourse analysis. BMJ Open. 2012;2(4):e001574. doi: 10.1136/bmjopen-2012-001574. http://bmjopen.bmj.com/cgi/pmidlookup?view=long&pmid=22815469. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pagliari C. Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J Med Internet Res. 2007 May;9(2):e15. doi: 10.2196/jmir.9.2.e15. http://www.jmir.org/2007/2/e15/ [DOI] [PMC free article] [PubMed] [Google Scholar]