Skip to main content
PLOS One logoLink to PLOS One
. 2020 Jul 6;15(7):e0235274. doi: 10.1371/journal.pone.0235274

A qualitative exploration of cardiovascular disease patients’ views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project

Orlagh O’Shea 1,*, Catherine Woods 2, Lauri McDermott 3, Roselien Buys 4, Nils Cornelis 5, Jomme Claes 4, Véronique Cornelissen 5, Anne Gallagher 6, Helen Newton 7, Niall Moyna 8, Noel McCaffrey 3, Davide Susta 8, Clare McDermott 8, Ciara McCormack 8, Werner Budts 4, Kieran Moran 8,9
Editor: Wen-Jun Tu10
PMCID: PMC7337342  PMID: 32628688

Abstract

The aim of this study is to explore participants’ views and experiences of an eHealth phase 3 cardiac rehabilitation (CR) intervention: Physical Activity Towards Health (PATHway). Sixty participants took part in the PATHway intervention. Debriefs were conducted after the six-month intervention. All interviews were audio recorded and transcribed verbatim. Transcripts were analysed with Braun and Clarke’s thematic analysis. Forty-four (71%) debriefs were conducted (n = 34 male, mean (SD) age 61 (10) years). Five key themes were identified: (1) Feedback on the components of the PATHway system, (2) Motivation, (3) Barriers to using PATHway, (4) Enablers to using PATHway, and (5) Post programme reflection. There were a number of subthemes within each theme, for example motivation explores participants motivation to take part in PATHway and participants motivation to sustain engagement with PATHway throughout the intervention period. Participant engagement with the components of the PATHway system was variable. Future research should focus on optimising participant familiarisation with eHealth systems and employ an iterative approach to development and evaluation.

Background

Globally, physical activity is a fundamental factor for the prevention of morbidity and mortality [1]. Specifically, lower levels of physical activity are associated with an increased incidence of cardiovascular disease (CVD) [2]. Cardiac rehabilitation (CR) is an exercise and education-based programme for the secondary prevention of CVD and is associated with up to 26% reduction in cardiac mortality [3]. CR is defined in three stages including an inpatient phase, outpatient phase and a lifelong maintenance phase [4] However, despite the proven benefits, uptake and adherence to CR is low [5]. Researchers have explored the barriers to participation which include: a lack of access, a perceived lack of need, time and financial constraints, and a lack of individualised programmes [6, 7]. In the past decade there has been a focus on the development of interventions which use technology to overcome the barriers to attendance at centre-based CR programmes; these interventions appear to be as effective at increasing physical activity as centre-based programmes [8]. However, technology-based CR interventions are heterogeneous and have utilised several different components including, for example, biosensors, websites, mobile phones, fixed line phones in conjunction with exercise prescription, education, psychosocial support, behaviour change, text messaging and online tutorials (8). Much of the research examining eHealth CR interventions has mainly focused on the effectiveness by employing quantitative methods [8, 9]. Qualitative research enables us to gain an insight into users’ views and experiences of the various components used in technology-based CR. This is required to expand our understanding of which components of an intervention are of most value to the user and how to improve their experience.

A mixed methods randomized controlled multicenter trial was undertaken to evaluate the acceptability, feasibility and clinical effectiveness of an eHealth phase 3 CR intervention: Physical Activity Towards Health (PATHway) [10]. PATHway is a personalized, lifestyle intervention which uses an integrated behaviour change approach with an internet-enabled and sensor-based home exercise platform as the core component. The aim of this study is to explore participants’ views and experiences of using the PATHway system, an eHealth CR intervention.

Methods

Intervention

The PATHway-I trial took place between June 2016 and July 2018. PATHway was designed to enable participants to manage their CVD risk factors following discharge from outpatient CR programmes. PATHway was developed with patient and key stakeholder involvement through an iterative co-design process [11, 12]. Patients participating in outpatient CR were invited during the last four weeks of outpatient CR to take part in the trial. Written informed consent was obtained and participants were then randomized to either the intervention group (PATHway) or the control group (usual care) [10]. A detailed description of the PATHway-I trial and quantitative results can be found elsewhere [10, 13]. In brief, one hundred and twenty participants were recruited across three sites in two countries: The Mater Misericordiae University Hospital (Dublin), Beaumont Hospital (Dublin) and University Hospital Leuven (UZ Leuven, Belgium). Sixty participants were randomized to the intervention group and 60 to control group. Participants in the intervention group received the intervention (the PATHway system) for six months. The PATHway system is a home-based, technology enabled complex behavior change intervention. It provides regular exercise sessions as the basis upon which to provide a personalized, comprehensive lifestyle intervention program to enable patients to self-manage their CVD and to lead a healthier lifestyle in general. PATHway targeted specific lifestyle behaviors (diet, physical activity, smoking cessation, alcohol, stress reduction and medication adherence) which were personalized to each individual based on the results obtained from baseline assessments. A battery of outcome measures were used to assess these lifestyle behaviors Physical activity: Actigraph GT9X Link (worn for seven days), diet: Mediterrean Diet Score, alcohol: Alcohol Use Disorders test, stress: perceived stress scale and medication adherence: Medication Adherence), full details of these are available in Claes et al. 2017 [10]. PATHway consists of 6 devices (portable PC including PATHway software, Microsoft Kinect camera, Microsoft Band 2 heart rate monitor, Blood pressure device, Zensor 3-lead ECG device, a headset) which enabled the delivery of the eleven components of the system: (1) ExerClass: this component included dynamic aerobic and resistance exercises. Participant movements, repetition count, energy expenditure and heart rate (HR) were continuously monitored to provide personalised feedback via a virtual ‘avatar’ coach. (2) Screening: this component evaluated the participants resting HR and blood pressure, medication adherence and eating behaviour prior to engaging with ExerClass, this was utilised to help participants determine whether it was safe for them to engage in exercise. (3) Dashboard: combined data derived from ExerClass, ExerGame and outdoor physical activity was aggregated to generate a physical activity report, allowing participants to monitor their overall physical activity behaviour (4). Text messages: participants received text messages with information on reducing lifestyle-related risk factors for CVD. These text messages were tailored to the individual. Several lifestyle related cardiovascular risk factors were covered by PATHway: nutrition, stress, smoking, alcohol and medication adherence. Automated motivational physical activity messages were also sent congratulating participants on their activity levels, encouraging them to become more active or engaged, based on the activity recorded by the system. (5) Assessment: participants could self-assess their fitness with a two minute step test (6) ExerGame: this component provided participants with an opportunity to engage in game based exercise, the Microsoft Kinect sensor captured participants’ movements as they were required to conduct certain exercises for example a squat, and their game avatar would jump on logs so as to cross a river without falling into water. (7) Instructions: this component contained detailed instructions on how to use the system. (8) Good Habits Visualisation (GHV): this ‘Good Habits Visualisation’ was personalised to each individual, based on the total scores from the lifestyle assessment completed by each individual at baseline. Their data was used to help them visualise how their current lifestyle fits in relation to CVD self-management guidelines and explores their willingness to change. Depending on their willingness to change participants could for example become involved in goal setting or be provided with educational support [13]. (9) Settings: the settings component enabled participants to alter the system to suit their needs, for example they could eliminate certain exercises from the ExerClass that aggravated their comorbidities or that they found uncomfortable. (10) Practice exercises: the practice exercises component allowed participants to isolate a certain exercise and practice it. (11) Calendar/events: to facilitate social support within a community context, the calendar/events component enabled small groups of remote participants to exercise together by allowing them to communicate during the exercise session. The calendar also allowed participants to promote events and to invite others to join. Additional detail on each of these components is available in (S1 Table). A demo video of the system and all its components is available online https://www.youtube.com/watch?v=FI39khtb0lg&t=148s. Ethics was obtained from the Ethics Committee UZ Leuven-KU Leuven and the Research Ethics Committee of both Irish hospital partners (KU Leuven: S59023; Mater Misericordiae Hospital Dublin: 1/378/1846; Beaumont Hospital Dublin: 16/50), as well as Dublin City University (DCU: REC2016/12). Written and informed consent was obtained from all participants. The consent procedures were approved by all the ethics committees involved.

Following randomisation, the PATHway system was installed in the participants’ homes by a member of the research team. All participants were guided through how to use the equipment as well as each of the systems’ 11 components (S1 Table) during a standardised familiarisation process of four sessions. During these sessions participants were systematically guided through how to use each piece of equipment and each of the eleven core components. Participants then demonstrated competency with these at the subsequent sessions. Participants were notified of who to contact if they had any difficulty in operating the system.

Data collection

Participant debriefs were conducted with all consenting participants who returned for post intervention testing at six months. The purpose and procedure for the debrief was explained to the participant at the start of each debrief and verbal consent obtained. In DCU debriefs were conducted in a quiet meeting room while in KUL debriefs took place in the participants home. Participants were initially shown a screen shot, one at a time, of each of the eleven components of PATHway to remind them of the component (S1 Table) and were asked: whether they used the element (if no, why not), how often they used it in a typical week and what they liked/disliked about it. Participants were then asked eight open ended questions regarding their views and experience of using the system (Table 1). Authors OOS and LMcD conducted the interviews in Dublin. Author RB conducted all interviews in Leuven. Interviews were audio recorded and transcribed verbatim.

Table 1. PATHway debrief script, open ended questions.

1. What do you feel is the key contribution, if any, that PATHway has made to you?
2. Tell us a little about how you used PATHway?
3. What were some of the reasons that motivated you to used PATHway?
4. What were some of the barriers you encountered when using PATHway?
5. What were some of the strategies you used to overcome these barriers?
6. Do you believe PATHway can be considered of equal value/effectiveness as the existing supervised group based phase 4 cardiac rehabilitation (for example Med-ex at DCU)?
7. Can you give us three recommendations for change in order to improve PATHway in the future?
8. Is there anything else you would like to add regarding your experience with PATHway?

Data analysis

The interviews were analysed using Braun and Clarke [14] framework for thematic analysis. The steps involved in the framework are listed as follows:

  1. Step one includes familiarising yourself with data through multiple readings.

  2. Step two generates an initial list of ideas about what is in the data and what is interesting about them and involves the production of initial codes from the data.

  3. Step three, themes begin to emerge, and this refocuses the analysis at the broader level of themes.

  4. Step four involves reviewing themes whereby a set of candidate themes are explored and refined, including similarities and differences between interviews. This is an important step given the multisite approach in PATHway, which may offer conflicting findings.

  5. Step five involves defining and naming themes

Steps 1 and 2 were conducted by authors OOS, LMcD and CW in Dublin and RB and NC in Leuven. The codes generated across the two sites in step 1 and 2 were then pooled together by OOS and presented to a senior member of the research team (CW). Steps 3 to 5 were then conducted in Dublin by OOS and CW. Provisional themes were generated and agreed upon by OOS and CW. Through an iterative process the themes were refined and re-defined until it was clear how they related to each other. All results were corroborated by authors from Leuven to ensure that codes and representative quotes were integrated appropriately. Finally, quotes were selected to demonstrate each theme and the report was completed.

Results

In total 44 debriefs were conducted, lasting a mean (standard deviation) of 23 (10) minutes. A flow diagram of participants is available in Fig 1, including reasons for non-participation in the debriefs. Thirty-four (77%) of the participants were male, full details of participants’ characteristics are available in Table 2.

Fig 1. Participant flow.

Fig 1

Table 2. Characteristics of participants who completed a debrief.

Characteristic Mean (SD) or frequency (n =)
Age mean (SD) 61 (10)
Gender M:F 34:10
Reason for referral to cardiac rehabilitation
Post PCI* 14
Post MI** 15
Post CABG*** 9
Post pacemaker 3
Post valve surgery 1
Unknown 2
Civil status ^
Married or living with a partner 38
Widowed 2
Single/divorced 3
Baseline moderate physical activity (minutes/day) mean (SD)^ 125 (63)
Baseline daily step count mean (SD)^ 12,575 (3,048)

*PCI = percutaneous coronary intervention.

**MI = Myocardial infraction.

***CABG = Coronary artery bypass graph ^missing data n = 1.

Five key themes were identified from the analysis of the participant debriefs: (1) Feedback on the components of the PATHway system, (2) Motivation, (3) Barriers to using PATHway, (4) Enablers to using PATHway, and (5) Post programme reflection. There were a number of subthemes within each of these themes.

1. Feedback on components of the PATHway system

Given that the PATHway trial was an acceptability and feasibility trial, it was of paramount importance to explore participants’ thoughts on each of the eleven components, to help inform the further development of the PATHway system. Through this exploration it was identified that some components were used more than others and the reasons for this disparity in use were also identified. The usage and participant feedback on each component are summarised in Table 3.

Table 3. Theme 1: Participant usage and feedback on the eleven components of PATHway.

Component Participants reporting using this component at least once (%) Feedback on component
ExerClass 95% “This really was the greatest added value of the entire system and very meaningful for me.” (Male, 50 years)
“What I liked about it was I was able to skip some of the exercises that I couldn’t do. I was able to take a 10 minute session and then sometimes I’d actually just go and do another 10 minute session, because I felt I could do it. So I was able to manage my time that way. (Male, 61 years)
Screening 93% “Yes, I found that to be very great and very reassuring and kind of just nice to start off with, it kind of gave you a few reference numbers and you could kind of you know compare those with what they were before you know, so yes that bit I liked.(Male, 47)
“I thought it was good to view and follow up on my own data.” (Male, 50 years)
Dashboard 86% “I found this interesting to see an overview of my trainings here. (Female, 40 years)
“Oh, it was simple and I was interested in the statistics. I spent a good bit of time on that app. I’d come back from a walk, for instance, checking distance, logging the stuff first and then going to the PATHway and checking. (Male, 77 years)
Text messages 80% “You reach your goal activity and they were good, they were good little motivators too……, they focused the mind, even if I didn’t do it at least it made me feel guilty about it, so it did encourage yeah. (Male, 67 years)
“I received text messages for 'stress'. There were many and not always useful, but some messages did and I could use.” (Male, 60 years)
Assessment 70% "Now this was not necessary because I already did bike tests" (Female 66 years)
“It was actually, it was a very good, energetic test and actually would be a very interesting part of the programme, I found, that it’s actually there so. ……. I only tried it twice. I just went back into, I went into using the programme then. So I don’t.. I just thought, maybe I thought… it was part of the programme, there were step tests in the programme. I just felt they were more suited to what I was capable of, so.” (Male, 61 years)
ExerGame 57% I think it was quite nice, the one time I actually tried it with my grandson and he loved it…. (Male, 55 years)
It didn’t appeal to me, well maybe I’m just old fashioned but I don’t think computers and exercise go together, you know. For me exercise is getting out of the house…. (Male, 54 years)
Instructions 55% “Only in the beginning I really looked at it. once you know it, all instructions do not necessarily need to be shown every time”(Female, 56 years)
Didn't need it. (Female, 50 years)
Good Habits Visualisation 43% I did not feel the need to use it … because my lifestyle was already in line with what is heart-friendly”. (Female, 64 years)
I didn’t know it was there.” (Female, 58 years)
Settings 40% “I think I was shown it, but I didn’t use it. I’d just skip on the programme. I’d just press the skip button if I didn’t want to do the exercise. I’d press the skip button, so that was much easier to use. (Male, 61 years)
Never saw it” (Female, 50 years)
Practice exercises 18% I did not feel I needed this, because most exercises are the same as what we did during the rehabilitation” (Female, 40 years)
Didn’t do it, I didn’t know it was there … I can’t remember being shown it. (Male, 56 years)
Calendar/events 5% I looked at it, but I never used it … I don’t think I actually set up a date to you know because my exercises are all at different times and it’s when I get a chance to do it, usually it’s in the evening but then it’s all over the place. (Male, 55 years)
"This is not necessary for me" (Male, 74 years)

Components such as the ExerClass, Screening, Dashboard and Text messages were individually reported to have the highest frequency of use and engagement. The ExerClass was viewed by some participants as the most important component of the PATHway system. Participants found it useful to be able to tailor the exercises and the length of the class; this allowed them to self-manage their exercises to suit their own time schedule. The Screening component was found to be reassuring for participants with regards to exercising safely, as well as providing a self-monitoring tool for their heart rate, blood pressure, medication adherence and eating behaviour. In relation to the Dashboard, some participants enjoyed being able to objectively see their level of activity and found it easy to use. Finally, nearly all participants reported receiving the Text Messages. While those participants who engaged with PATHway reported finding the messages motivational, some other participants reported that they did not always engage with them.

Instructions, ExerGame, Calendar/events, practice exercises, Settings and Good Habits Visualisation (GHV) appeared to have lower levels of engagement. Reasons for this included lack of awareness, perceived lack of need or lack of appeal. For example, despite each individual undergoing a standardised familiarisation protocol, which involved checking that they could use the components, some participants reported not being aware or having never seen the GHV, Settings or Practice Exercise components. Other participants reported being aware of these components but did not feel that they needed them. For example, in relation to the GHV component some participants felt that as they did not engage in the CVD risk related behaviours e.g. smoking, alcohol, high levels of stress then they only focused on physical activity and did not use GHV. In relation to the Calendar/Events a high number of participants reported that this did not meet their needs.

2. Motivation

Motivation was defined as participants’ reasons for both initially taking part in PATHway and sustaining engagement with PATHway throughout the six-month intervention period.

Participants’ motivation for taking part in PATHway

Varied and was mainly for health reasons, to continue to exercise with some level of support, and to continue to learn about their condition. A small number were influenced by the cardiac rehabilitation staff or felt the need to give back after the care they received.

For my health it is really necessary that I train, I know that I have to do it” (Female, 40 years)

To carry on the supervision of my condition, that I’d be monitored for an extra six months. I found it would be beneficial to me, to carry it on and give me a guide to what way to carry on in my life” (Male, 62 years)

Participants’ motivation to sustain engagement with PATHway

Was due to a range of factors. Self-monitoring of activity through wearing the Microsoft wrist band was motivational as participants could objectively see their results (for example how many calories they had burned) or monitor their daily activity (for example step count).

Yes. I'd check it when I'd be going around, to see what steps I was going on … I was getting about 17,000. (Male 62 years)

For others the text messages received as part of PATHway were motivational or they felt a sense of satisfaction from engaging with the system.

I used them all the time. Continuous, motivational texts, weekend, weekday, Bank Holidays, just to keep–very encouraging … and motivational. (Male, 61 years)

When you have done it, you are still happy.” (Female, 58 years)

For a small number of participants knowing they were going to be tested again by the research team was a motivating factor.

… apart from the Pathway programme at home with the laptop, the three-monthly visits to DCU were, again, motivational and it inspired me because it gave me then a level of fitness. They were able to tell me how I was doing, and I thought that was brilliant.” (Male, 61 years)

3. Barriers to using the PATHway system

Barriers to using the PATHway system describes problems that participants faced that either prevented or hampered their participation and/or performance of the PATHway system. Two subthemes were identified here: PATHway barriers and personal barriers.

PATHway barriers

PATHway barriers are defined as anything that specifically relates to the system which hampered a participant’s engagement or use of the PATHway system. Some participants found elements of the PATHway system were unnecessarily complicated and that there were too many pieces of equipment. For example, participants reported that getting to complete the ExerClass took time as that they had to go through multiple steps before being able to exercise, for example, turning on the system and then completing the Screening component (assessing whether it was safe to exercise).

[screening]was a bit cumbersome, it was another element to the whole start-up, so it was just another layer of … hassle. (Male, 45 years)

I found that there was too many bits … you had a computer, you had the X-Box … and everything had to be plugged in a certain way and you didn’t have enough power sockets. Then you kept running out of power and there were cables trailing. So it was a bit cumbersome. It wouldn’t be something I’d set up myself. “(Male, 61 years)

A number of participants experienced technical barriers in that the system did not work or parts of the system broke or were updating. The Microsoft band, and in particular its short battery life, was identified by participants as problematic.

"If I could not practice due to technical problems, I did not train anymore as I often planned to train in the evening. If I had lost a lot of time with technical problems, it was too late to train" (Male, 66 years)

It [Microsoft Band] didn't work on a couple of occasions,… so I found that very frustrating”. (Male, 56 years)

Finally, a small number of participants found that the exercises in the ExerClass were too strenuous and others found that the class lacked variation.

Star jumps, after five minutes of doing them … you are nearly fit to quit. (Male, 54 years)

Personal barriers

Personal barriers are defined as any barriers encountered by participants which were not directly related to the design of PATHway. A barrier to using the PATHway system for some participants was their low level of IT literacy.

[I am] not computer literate. No knowledge of it [IT] at all. (Male, 75 years)

"The starting level was too high for me, I am 75 and I have never used a computer" (Female, 75 years)

A number of participants had existing comorbidities with their CVD and for some this impacted on their use of the system. For example, one participant had rheumatoid arthritis which they felt limited their ability to engage with the system.

"I did not find the exercises unpleasant, although they were rather fierce on the legs and there was little variation” (Female, 66 years)

Sometimes my body was very painful … I didn’t feel up to it at the time.” (Male, 72 years)

Time is a frequently cited barrier to physical activity [15]. Even though PATHway was designed to provide flexibility in scheduling of exercise and physical activity, some participants had family or work commitments that still presented as a barrier to participation.

I think I had one or two golden weeks and then like I had you know the odd time then for a while and then I just kind of gave it up because just work and everything” (Male, 47 years)

"I have little time because I am still working and also active as a musician" (Female, 66 years)

For a small number of participants, bad weather and total lack of engagement presented as barriers.

I would get up in the morning and get the weather forecast and say ‘oh, it’s going to be a fine day, I’ll go for a walk in the evening’. It could turn out in the evening it was lashing rain.” (Male, 77 years)

Yeah, I didn’t, it was … I’d no engagement with it whatsoever. The avatar, the fact it was a laptop, it was … you know, just didn’t … didn’t do it for me.” (Male 45 years)

4. Enablers to using PATHway

Enablers refer to actions taken by participants or naturally occurring events that improved user engagement with the system and helped them overcome barriers. Two subthemes were identified under enablers: PATHway enablers and personal enablers.

PATHway enablers

PATHway enablers specifically relate to factors that improved engagement with the PATHway system or physical activity. When participants cited specific barriers to using the system, the interviewer asked how they overcame these. Technical support from the research team was available for all participants throughout the intervention and calling the PATHway team for IT support was a common enabler for participants when they encountered any technical barriers to using the system.

[Support Staff] came and fixed the system and got me back on the right track. (Male, 47 years)

The PATHway system was specifically designed to be individualised so that participants could tailor the time of day, mode and location (indoors/outdoors) of activity to meet their needs. This enabled participants to successfully complete their exercises and to overcome bad weather.

What I liked about it was I was able to skip some of the exercises that I couldn’t do. And I was able to take a 10 minute session and then sometimes I’d actually just go and do another 10 minute session, because I felt I could do it. So I was able to manage my time that way. Sometimes I would do 20 minutes or sometimes I’d just do 10.” (Male 61 years)

You know, so even when it was lashing rain or freezing cold outside you could exercise.”(Male 61 years)

Personal enablers

Personal enablers refer to factors outside of the PATHway system that enhanced participant performance; for example, some participants modified the exercises slightly to suit their personal ability.

I would slightly modify it, it would be the same intensity but I wouldn't be jumping as high and landing on the ground” (Male, 65 years)

Finally, support from family members was a commonly cited enabler. For example some participants received IT support from family, while for others their physical activity/exercise was supported by family members.

My daughter is very good at IT. I would ask her and she would sort it out for me.” (Male, 69 years)

"It was interesting that my wife also participated from the other side of the table, in her own way." (Male, 74 years)

5. Post programme reflection

As part of the debriefs participants were asked: what contributions (if any) the system had made to them, their recommendations for improving the system, and if they felt that PATHway was equal to a structured and supervised cardiac rehabilitation class. Participants could also add any additional comments. The answers to these questions informed the theme of post programme reflection. The following subthemes were included: outcome evaluation, recommendations for improvement and whether PATHway was equal to a structured and supervised class.

Outcome evaluation

Participants who engaged with the system felt the system had impacted on them by helping them to form a habit or routine around exercise.

Oh, it has developed a regime of exercise that I know I should do every day as a result of being in PATHway and it has reinforced that and reinforced diet.“(Male, 69 years)

A high number of participants reported improvements in their health and fitness, including for example smoking cessation, pain reduction and improved strength

Yeah, I feel much better. [I am] off the cigarettes… walking up and down stairs. I think it has made me stronger. Before, walking the backs of my legs and all would be killing me, I just put that down to unhealthy, but it wasn’t, it was the condition. Not getting that as much now. (Male, 47 years)

In general, most participants enjoyed utilising the PATHway system and participating in this research.

I thought it was very enjoyable. I enjoyed doing it, like you know what I mean.” (Male 62 years)

Finally, a small number of participants reported improved self-efficacy; an improved ability to complete either every-day or recreational tasks.

It boosted me up, and if I can do that, I can do this. It was like last week, I think that’s the first time we’ve… myself and X [a friend] have played a round of golf without a buggy in two years to two-and-a-half years. So, even though we were knackered after it, it was great to know we could do it. “(Male, 70 years)

Recommendations for improving PATHway

Participants’ recommendations for improvement were varied but included reducing the number of pieces of equipment and improving the technical stability and the accuracy of heart rate measurements.

So, if it was a more portable version or that it plugged in to the television like an Xbox; I mean you could just use it or move it, it would be much better.” (Male, 67 years)

Reliability must be increased both for technical stability and for heart rate measurements. (Male, 69 years)

Some participants reported they would have liked more variety in the exercises available in the ExerClass component.

It was all, overall like jumping jacks or kicking or stepping, and I couldn’t do any of that. So I’d have preferred it if I could have sat in a chair and did some upper body exercises.” (Male, 61 years)

"Now all exercises are upright, but you can also do exercises while lying down and so on." (Male, 74 years)

Whilst the PATHway system can provide regular texts and emails, a small number of participants recommended tailoring the text messages to the individual’s schedule as well as increasing feedback throughout the intervention (telehealth). Some recommended including music for the ExerClass.

"Text messages should be more concrete, for instance you set your training schedule with dates and times and you get messages that it is time to train, that would be more helpful" (Male, 66 years)

I think some sort of a regular email or text message … that provides more up to date information on your individual programme. Could be motivational as opposed to sort of generic bland messages that are trying to be motivational but didn’t really achieve that goal. (Male, 48 years)

Equal to a supervised and structured group class

PATHway was developed to overcome barriers to attendance and adherence at supervised and structured community-based programmes. Participants had mixed feelings as to whether the PATHway system was equal to a structured supervised phase 3, community-based, CR class. A high number felt that the flexibility of the system was very beneficial, and it had the potential to be as effective.

Yes. I do definitely … because time wise. Personally I found the class in [site of phase 2 cardiac rehabilitation] brilliant, but I was struggling to get there time wise. Physically it would be very hard for me to commit to doing it, but PATHway, certainly at home if you had your own system of PATHway at home, absolutely it would be as good. (Male, 56 years)

Other participants felt it was down to an individual preference, whether someone preferred to exercise independently or as part of a group in a structured supervised environment. While some participants felt that PATHway had potential to be equal to a supervised and structured class if the technology was improved.

That really depends on individuals. Some people like to work in groups and get their strong motivation from having to come down and join the group and do it. (Male, 67 years)

If the technical aspects had been in order, it could be good to keep your condition up to date" (Female, 66 years)

Finally, some participants felt that PATHway was lacking both supervision from an expert as well as direct group contact.

"I missed the personal contact with the care providers, for me it was not enough help to get me started with this because I never really used a computer before." (Female, 74 years)

Being on your own operating a software system for exercise certainly has disadvantages compared to being in a group who have a supervisor–and when you have kind of an overseer watching what everybody is doing, that’s an advantage I think.” (Male, 57 years)

Discussion

This study explored participants’ views and experiences of using an eHealth cardiac rehabilitation platform, PATHway. Participant engagement with PATHway was variable. Some components were engaged with more frequently than others. Considering the results of this qualitative exploration in the context of the wider literature can help us gain an understanding of this variation and provide us with important learning for the future development of PATHway and evaluation of future eHealth interventions.

The PATHway intervention is a behaviour change intervention, which used an exercise platform to provide a personalized, comprehensive lifestyle intervention. Specific behaviour change techniques were utilised including: self-monitoring, feedback, social support and individual tailoring [16] and these appeared to be integral to participants motivation to initiate and to sustain engagement in addition to enabling them to overcome barriers. The PATHway components with the highest level of self-reported engagement were ExerClass, Screening and the Dashboard, each of these allowed for self-monitoring of physical activity and health related parameters, including blood pressure and heart rate and provided participants with feedback on these. Self-monitoring has been shown to be an effective tool in improving physical activity in CVD patients [17] and other populations [18, 19]. With improvements in technology, self-monitoring of health status is becoming increasingly used in everyday life [20]. Interestingly a motivation for partaking in the current trial for some participants was to continue to exercise with some degree of safety and support. Therefore, providing patients who are post phase 2 CR with a means to monitor their physical activity and health status, along with appropriate education, may facilitate more sustained engagement in a healthier lifestyle.

This qualitative exploration demonstrated that components such as Good Habits Visualisation, Settings, Practice Exercises and Calendar/Events were used infrequently; with some participants reporting that they were not aware of them and/or did not need them. This lack of awareness may seem surprising given that each participant was exposed to a standardised four-week familiarisation period. Previous qualitative research has found that participants felt they needed more than a familiarization period before they would feel confident about using the technology [19], especially when a system encompasses a wide range of services as was the case with PATHway. It would seem there is a need for dedicated research into the appropriate strategies needed in eHealth interventions to optimise participants’ familiarity with all components of the system. This has the capacity to overcome some of the barriers reported in the current study, including for example awareness of the settings component which would have allowed users to remove exercises that they found difficult or uncomfortable. Furthermore, in an effort to optimise user engagement and acceptability PATHway was informed by extensive formative research and incorporated a co-design approach which involved key stakeholders throughout the development process [12]. Despite this, participants reported a perceived lack of need with some components, specifically in relation to the Good Habits Visualisation and the Calendar/Events. The perceived lack of need of the Good Habits Visualisation is potentially due to a lack of understanding or poor perception of CVD risk and not a lack of motivation to change as participants reported health as a motivation to engage with PATHway in the first instance; current research indicates that patients tend to generally underestimate their CVD risk [21]. All participants had received structured education regarding CVD risk factors during outpatient CR prior to participating in the trial. Therefore, participants might have felt they sufficiently implemented behaviour changes towards a healthier lifestyle already, as demonstrated in their baseline physical activity (Table 2). Despite this, perhaps additional reinforcement and objective measures of individual risk (e.g. food diaries for nutrition) are required to overcome this perceived lack of need as there was room for further improvement [13]. It could also be argued that the delivery of education in a group setting of cardiac rehabilitation during outpatient CR does not adequately meet each individuals’ needs and preferences, although previous research in diabetes patients has shown equal effectiveness between group and individual education [22]. The Calendar/Events was the mechanism by which participants could initiate a group activity (e.g. meeting up for a walk, completing an ExerClass as a small group). The reported lack of need of Calendar/Events may be justified by the availability of social support from family and friends as evidenced in the enablers reported. However, some participants reported that they missed having the group element of the outpatient CR phase, and a suggestion for improvement of the system was to incorporate a group element. Future work is required to engage with participants during the familiarisation stages to identify specifically what their needs are and to match the intervention components to the individual.

Finally, in addition to the variation in engagement there was a lack of uniformity in participants’ responses for how they felt PATHway could be improved and whether it was equal to a structured and supervised exercise class. This demonstrates how individual a person’s needs are in relation to physical activity and exercise. Perhaps the expectation of individuals to use ‘all’ elements of a technology intervention is false, rather research needs to continually observe use of the ‘innovation’ in practice to determine which components are used and the rationale for engagement [23]. Behaviour change research suggests that interventions should include a sufficient number of behaviour change techniques to enable participants to select those which best suit their needs [24]; findings from the current study would indicate the same is true for eHealth intervention components. Therefore, the development of future complex eHealth interventions should include more regular surveillance and monitoring of participant engagement with the components of the intervention [25] to allow for a more iterative approach to the evaluation of eHealth interventions [26]. Ultimately greater understanding of individuals’ preferences and identifying phenotypes could help better stratify participant engagement with eHealth interventions or community-based interventions.

While the current exploration of participants’ views and experiences of the PATHway system is novel and provides us with valuable insights from participants in two different countries, it is not without its limitations. Firstly, the semi structured interviews were conducted in two different countries by different researchers, in different languages, while procedures were put in place to try and ensure rigour and reduce variability across sites, it is possible that some of cultural context of the quotes was lost. It is important to acknowledge that the current qualitative analysis included data from participants who did not use the system beyond the familiarisation stage, the inclusion of these participants’ views was considered important as usability is not all or nothing but is a continuum and these participants’ views provide us with additional insights into PATHway. We did not capture views of participants who dropped out, we therefore do not know what kind of experience these participants had. Finally, given the feasibility nature of the PATHway trial there were issues with the technology in the earlier stages of the intervention which presented as barriers to participants and may have reduced participants engagement with the system as well as their views of the system.

Conclusion

The PATHway system provided participants with a platform to engage in physical activity and exercise within a safe and structured format. Behaviour change techniques including self-monitoring, feedback, social support and tailoring appeared to be useful to promote engagement with the system. However, not all participants engaged with the PATHway system and not all components were engaged with fully. Future research evaluating eHealth interventions should seek to continuously monitor participant engagement with components and allow individuals to tailor a package to meet their specific needs.

Supporting information

S1 Table. Description of the eleven PATHway components.

(DOCX)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

This project has received funding from the European Union’s Horizon 2020 Framework Programme for Research and Innovation Action under Grant Agreement no. 643491:https://ec.europa.eu/digital-single-market/en/policies/ehealth This was awarded to KM, CW, NM, NMcC, WB, VC, and RB. No the funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Ekelund U, Steene-Johannessen J, Brown WJ, Fagerland MW, Owen N, Powell KE, et al. Does physical activity attenuate, or even eliminate, the detrimental association of sitting time with mortality? A harmonised meta-analysis of data from more than 1 million men and women. The Lancet. 2016;388(10051):1302–10. [DOI] [PubMed] [Google Scholar]
  • 2.Booth FW, Roberts CK, Thyfault JP, Ruegsegger GN, Toedebusch RG. Role of Inactivity in Chronic Diseases: Evolutionary Insight and Pathophysiological Mechanisms. Physiol Rev. 2017;97(4):1351–402. 10.1152/physrev.00019.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Ades PA, Keteyian SJ, Wright JS, Hamm LF, Lui K, Newlin K, et al. Increasing Cardiac Rehabilitation Participation From 20% to 70%: A Road Map From the Million Hearts Cardiac Rehabilitation Collaborative. Mayo Clin Proc. 2017;92(2):234–42. 10.1016/j.mayocp.2016.10.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bjarnason-Wehrens B, McGee H Fau—Zwisler A-D, Zwisler Ad Fau—Piepoli MF, Piepoli Mf Fau—Benzer W, Benzer W Fau—Schmid J-P, Schmid Jp Fau—Dendale P, et al. Cardiac rehabilitation in Europe: results from the European Cardiac Rehabilitation Inventory Survey. (1741–8275 (Electronic)).
  • 5.Herber OR, Smith K, White M, Jones MC. 'Just not for me'—contributing factors to nonattendance/noncompletion at phase III cardiac rehabilitation in acute coronary syndrome patients: a qualitative enquiry. J Clin Nurs. 2017;26(21–22):3529–42. 10.1111/jocn.13722 [DOI] [PubMed] [Google Scholar]
  • 6.Dunlay SM, Witt BJ, Allison TG, Hayes SN, Weston SA, Koepsell E, et al. Barriers to participation in cardiac rehabilitation. Am Heart J. 2009;158(5):852–9. 10.1016/j.ahj.2009.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Grace SL, Shanmugasegaram S, Gravely-Witte S, Brual J, Suskin N, Stewart DE. Barriers to cardiac rehabilitation: DOES AGE MAKE A DIFFERENCE? J Cardiopulm Rehabil Prev. 2009;29(3):183–7. 10.1097/HCR.0b013e3181a3333c [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Rawstorn JC, Gant N, Direito A, Beckmann C, Maddison R. Telehealth exercise-based cardiac rehabilitation: a systematic review and meta-analysis. Heart. 2016;102(15):1183–92. 10.1136/heartjnl-2015-308966 [DOI] [PubMed] [Google Scholar]
  • 9.Saner H, van der Velde E. eHealth in cardiovascular medicine: A clinical update. Eur J Prev Cardiol. 2016;23(2 suppl):5–12. [DOI] [PubMed] [Google Scholar]
  • 10.Claes J, Buys R, Woods C, Briggs A, Geue C, Aitken M, et al. PATHway I: design and rationale for the investigation of the feasibility, clinical effectiveness and cost-effectiveness of a technology-enabled cardiac rehabilitation platform. BMJ Open. 2017;7(6):e016781 10.1136/bmjopen-2017-016781 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Walsh DM, Moran K, Cornelissen V, Buys R, Cornelis N, Woods C. Electronic Health Physical Activity Behavior Change Intervention to Self-Manage Cardiovascular Disease: Qualitative Exploration of Patient and Health Professional Requirements. J Med Internet Res. 2018;20(5):e163 10.2196/jmir.9181 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Walsh DMJ, Moran K, Cornelissen V, Buys R, Claes J, Zampognaro P, et al. The development and codesign of the PATHway intervention: a theory-driven eHealth platform for the self-management of cardiovascular disease. Transl Behav Med. 2019;9(1):76–98. 10.1093/tbm/iby017 [DOI] [PubMed] [Google Scholar]
  • 13.Claes J, Cornelissen V, McDermott C, Moyna N, Pattyn N, Cornelis N, et al. Feasibility, Acceptability, and Clinical Effectiveness of a Technology-Enabled Cardiac Rehabilitation Platform (Physical Activity Toward Health-I): Randomized Controlled Trial. J Med Internet Res. 2020;22(2):e14221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101. [Google Scholar]
  • 15.Trost SG, Owen N, Bauman AE, Sallis JF, Brown W. Correlates of adults' participation in physical activity: review and update. Med Sci Sports Exerc. 2002;34(12):1996–2001. 10.1097/00005768-200212000-00020 [DOI] [PubMed] [Google Scholar]
  • 16.Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. 10.1007/s12160-013-9486-6 [DOI] [PubMed] [Google Scholar]
  • 17.Kanejima Y, Kitamura M, Izawa KP. Self-monitoring to increase physical activity in patients with cardiovascular disease: a systematic review and meta-analysis. Aging Clin Exp Res. 2019;31(2):163–73. 10.1007/s40520-018-0960-7 [DOI] [PubMed] [Google Scholar]
  • 18.Eckerstorfer LV, Tanzer NK, Vogrincic-Haselbacher C, Kedia G, Brohmer H, Dinslaken I, et al. Key Elements of mHealth Interventions to Successfully Increase Physical Activity: Meta-Regression. JMIR Mhealth Uhealth. 2018;6(11):e10076 10.2196/10076 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Loeckx M, Rabinovich RA, Demeyer H, Louvaris Z, Tanner R, Rubio N, et al. Smartphone-Based Physical Activity Telecoaching in Chronic Obstructive Pulmonary Disease: Mixed-Methods Study on Patient Experiences and Lessons for Implementation. JMIR Mhealth Uhealth. 2018;6(12):e200 10.2196/mhealth.9774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dias D, Paulo Silva Cunha J. Wearable Health Devices-Vital Sign Monitoring, Systems and Technologies. Sensors (Basel). 2018;18(8). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Webster R, Heeley E. Perceptions of risk: understanding cardiovascular disease. Risk Manag Healthc Policy. 2010;3:49–60. 10.2147/RMHP.S8288 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Rickheim PL, Weaver TD, Flader JL, Kendall DM. Assessment of Group Versus Individual Diabetes Education: A Randomized Study. Diabetes Care. 2002; 25:269–274. 10.2337/diacare.25.2.269 [DOI] [PubMed] [Google Scholar]
  • 23.Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, et al. Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies. J Med Internet Res. 2018;20(11):e292 10.2196/jmir.9397 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Procter S, Mutrie N, Davis A, Audrey S. Views and experiences of behaviour change techniques to encourage walking to work: a qualitative study. BMC Public Health. 2014;14:868 10.1186/1471-2458-14-868 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258 10.1136/bmj.h1258 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.WHO. WHO Guideline: recommendations on digital interventions for health system strengthening. 2019. [PubMed] [Google Scholar]

Decision Letter 0

Wen-Jun Tu

4 Feb 2020

PONE-D-20-00433

A qualitative exploration of cardiovascular disease patients’ views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project

PLOS ONE

Dear Dr O'Shea,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Mar 20 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend your current ethics statement to address the following concerns: Please explain why was written consent was not obtained, how you recorded/documented participant consent, and if the ethics committees/IRBs approved this consent procedure.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The aim of this study was to explore participants’ views and experiences of an eHealth phase 3

cardiac rehabilitation (CR) intervention: Physical Activity Towards Health (PATHway) and next

Authors write “lifestyle behaviors (diet, physical activity, smoking cessation, alcohol, stress reduction and medication adherence) which were personalized to each individual based on the results obtained from baseline assessments” or in another place “participants received text messages with information on reducing lifestyle-related risk factors for CVD. These text messages were tailored to the individual. Several lifestyle related cardiovascular risk factors were covered by PATHway: nutrition, stress, smoking, alcohol and medication adherence” and present Pathway as a system encompassing several health behaviors, but the research/results concern(s) actually physical activity only and no other health behaviors.

And it was not clearly for me what the assessments looked like? In what way they were personalized?

(p.5)

“Participant debriefs were conducted with all consenting participants who returned for post

intervention testing at six months” – I wonder what happened with participants who did not return and why they did not returned; what sort of experiences they had? (p.8)

“At its core, the PATHway intervention is a behaviour change intervention for physical activity, diet, smoking cessation, medication adherence and stress” and next “The PATHway components with the highest level of self-reported engagement were ExerClass, Screening and the Dashboard, each of these allowed for self-monitoring of physical activity and health related parameters, including blood pressure and heart rate and provided participants with feedback on these” – what about the rest of health behaviors mentioned here and above? (p.22)

Please consider more about limitations of the research, e.g. about limitations of applied metodological approach.

p.4 - once “60” and ones “sixty” – my suggestion is to apply APA guidelines

Reviewer #2: The authors report on a qualitative study exploring patients´ views and experiences of using an eHealth cardiac rehabilitation intervention (The PATHway Project). This manuscript is part of a series of papers reporting data from the same trial.

1) Page 3. What is meant with “allows us to adopt a more person centred approach”? Do you mean that qualitative research helps to tailor interventions based on each patients´ experiences, situation and needs?

2) Page 4. What was the rationale for inviting patients during the last four weeks of outpatient CR?

3) Different phases of CR are mentioned in the paper (phase 2, 3 and 4). How are these phases defined?

4) Participants included have a mean age of 61 and 77% were men. Representative? Was a specific group of patients more attracted to participate and use the Pathway system?

5) Where were the debriefs conducted? (at a CR unit). How long did they take? (mean, median and range). Richness in data of each debrief?

6) Any differences between the codes generated at the two sites? Was the codes generated in Leuven translated into English? How?

7) Physical activity seem to be of priority in the Pathway system. However, it was also designed to target other life style factors (nutrition, smoking, stress, alcohol, medication adherence). How the system is supposed to work to, e.g. help participants quit smoking or reduce alcohol consumption, can be further clarified.

8) I suggest considering adding the participants levels of physical activity in table 1. These are presented in REF 10, but the analysis of the debriefs in the present study, may be reflected in light of PA levels (see further my comment 13). Information on civil status can also be added in table 1.

9) Page 5, line 10. I suggest replacing compliance with adherence.

10) The authors suggest using an iterate approach on optimizing participants’ familiarization with eHealth systems. Such an iterative co-design was performed in this project (also described in REF 12), and the participants were systematically guided through how to use each component of the system, but still the engagement with the components in the system was variable. Do you consider the iterative approach that was used in this study as successful? How can it be improved?

11) Ref 25 is not complete. Dou you mean this REF?

Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ : British Medical Journal. 2015;350:h1258.

12) Figure 1. Given that 44 debriefs were conducted, what is meant with that one participant was excluded due to “data saturation”?

13) I think it was a well considered choice by the authors to include participants who did not use the system beyond the familiarisation stage to get a more nuanced picture. Although the participants were equipped with advanced support to implement life style changes this paper illustrates the challenges with implementing life style changes. Do you consider the intervention group as motivated to perform lifestyle changes and as a group with a high CVD risk factor profile (i.e. patients in most need of performing life style changes)? A discussion in light of that may strengthen the paper.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 6;15(7):e0235274. doi: 10.1371/journal.pone.0235274.r002

Author response to Decision Letter 0


20 Mar 2020

Dear Reviewers,

We thank you for taking the time to review this manuscript and for your comments. We have addressed all of the comments below and where appropriate made changes to the manuscript.

Kind regards,

Orlagh O’Shea

Reviewer 1

The aim of this study was to explore participants’ views and experiences of an eHealth phase 3 cardiac rehabilitation (CR) intervention: Physical Activity Towards Health (PATHway) and next Authors write “lifestyle behaviors (diet, physical activity, smoking cessation, alcohol, stress reduction and medication adherence) which were personalized to each individual based on the results obtained from baseline assessments” or in another place “participants received text messages with information on reducing lifestyle-related risk factors for CVD. These text messages were tailored to the individual. Several lifestyle related cardiovascular risk factors were covered by PATHway: nutrition, stress, smoking, alcohol and medication adherence” and present Pathway as a system encompassing several health behaviors, but the research/results concern(s) actually physical activity only and no other health behaviors. And it was not clearly for me what the assessments looked like? In what way they were personalized?

(p.5)

PATHway is described as complex behavior change intervention which uses an exercise platform as the core component but also addresses lifestyle behaviors (diet, smoking cessation, alcohol, stress reduction and medication adherence). The results mainly concern the physical activity/exercise behavior as this was the core component and the component that participants engaged with the most. Other lifestyle behaviors were addressed through the “Good Habits Visualisation” health behavior change component which was personalized to each individual based on their baseline assessments. It is detailed in the results that participants did not engage with the “Good Habits Visualisation” either because they felt they did not need it or they were not aware of it. Both of these issues are addressed in the discussion.

Additional wording has been added to emphasise that exercise was the core component of PATHway and to detail the baseline assessment of the lifestyle behaviors. Page 5 105-107, 110-113 and Page 6 133-137

“Participant debriefs were conducted with all consenting participants who returned for post intervention testing at six months” – I wonder what happened with participants who did not return and why they did not returned; what sort of experiences they had? (p.8)

Reasons for not returning to 6 month assessments have been provided in, reference 14: Claes et al. J Med Internet Res 2020;22(2):e14221) and included serious adverse events, loss of interest, onset of disease with exercise contraindication or mental health issues. Unfortunately we did not capture these participants’ views and this has been commented on in the limitations.

“At its core, the PATHway intervention is a behaviour change intervention for physical activity, diet, smoking cessation, medication adherence and stress” and next “The PATHway components with the highest level of self-reported engagement were ExerClass, Screening and the Dashboard, each of these allowed for self-monitoring of physical activity and health related parameters, including blood pressure and heart rate and provided participants with feedback on these” – what about the rest of health behaviors mentioned here and above? (p.22)

We have amended this sentence, as the reviewer correctly points out that the emphasis of our results and manuscript were on physical activity, page 23 283.

Please consider more about limitations of the research, e.g. about limitations of applied methodological approach. Recognition of further limitations have been added page 25 346-355. once “60” and ones “sixty” – my suggestion is to apply APA guidelines

This manuscript was written in line with APA guidelines, in this instance “sixty,” was written in words as it was at the start of a sentence.

Reviewer 2

1)Page 3. What is meant with “allows us to adopt a more person centred approach”? Do you mean that qualitative research helps to tailor interventions based on each patients´ experiences, situation and needs?

The text has been amended to address any ambiguity with regard to this statement. Please see highlighted text on page 3-4, 79-85.

“Qualitative research enables us to gain an insight into users’ views and experiences of the various components used in technology-based CR. This is required to expand our understanding of which components of an intervention are of most value to the user and how to improve their experience. While quantitative data gives us information with regard to the effectiveness of the intervention it does not tell us whether the participants actually enjoyed or liked the intervention has been documented predictor of maintenance (10).”

2) Page 4. What was the rationale for inviting patients during the last four weeks of outpatient CR?

The rationale for inviting people during the last 4 weeks of rehab was a pragmatic choice: It was to conduct the familiarization phase of PATHway whilst they were concluding phase 3, in this way they could experience the intervention, the technology, complete assignments and ask any questions to the researcher over the familarisation period.

3) Different phases of CR are mentioned in the paper (phase 2, 3 and 4). How are these phases defined?

The phases of cardiac rehabilitation are defined as follows: CR is traditionally divided into three phases. Phase I is typically an inpatient service, which consists of early mobilisation, brief counselling about the nature of the illness, the treatment, risk factor management and follow-up planning. Phase II is mainly a supervised ambulatory outpatient programme. Phase III is a lifetime maintenance phase where the goal is to continue the risk factor- and lifestyle change and exercise training.

An additional sentence and reference have been included to address this page 3 67-68.

4) Participants included have a mean age of 61 and 77% were men. Representative? Was a specific group of patients more attracted to participate and use the Pathway system?

A comparison between eligible consenting (n=120) and nonconsenting participants (n=98) revealed a significant difference in age, with older

participants being less likely to enrol in the study (60.3 [SD 9.2] years vs 64.7 [SD 9.2 years]; P=.001). This is detailed in reference 14: Claes et . J Med Internet Res 2020;22(2):e14221)

Additionally, there is a higher incidence of cardiovascular disease in men and current literature indicates the mean age of participants engaging in cardiac rehab is 64 years and 70% of these are men (Gaalema et al. 2019).

Gaalema, D.E., Savage, P.D., Leadholm, K, Rengo, J., Naud, S., Priest, J.S., Ades, P.A. (2019). Clinical and Demographic Trends in Cardiac Rehabilitation: 1996-2015. Journal of Cardiopulmonary Rehabilitation and Prevention; 39:266-273

5) Where were the debriefs conducted? (at a CR unit). How long did they take? (mean, median and range). Richness in data of each debrief?

The debriefs were conducted in a quiet meeting room at DCU at the 6 month testing in KUL At KUL, the debriefs were conducted at the home of the participants, as the debrief was combined with the collection of the PATHway equipment. Debriefs lasted a mean (standard deviation) of 23 (10) minutes. This detail has been added to page 8 line 10-12 and age 10 line 42 respectively.

6) Any differences between the codes generated at the two sites? Was the codes generated in Leuven translated into English? How?

There was no difference in themes between the two sites. The data from KUL was translated into English by the KUL team who are fluent in English speakers.

7) Physical activity seem to be of priority in the Pathway system. However, it was also designed to target other life style factors (nutrition, smoking, stress, alcohol, medication adherence). How the system is supposed to work to, e.g. help participants quit smoking or reduce alcohol consumption, can be further clarified.

At baseline these health behaviors were assessed and then the “Good Habits Visualisation” component was personalized to them, to communicate which behaviors required some changes in line with CVD self-management guidelines. Participants could choose a health behavior which they wanted to change and the system guided them through this based on their readiness to change for example some participants would have been set a goal or others would have been provided with some educational support. Full details of this are available in reference (13). Changes have been made to the text to reflect this (page 6 133-138).

8) I suggest considering adding the participants levels of physical activity in table 1. These are presented in REF 10, but the analysis of the debriefs in the present study, may be reflected in light of PA levels (see further my comment 13). Information on civil status can also be added in table 1

Information on participants data captured by PATHway system was anonymized, therefore we do not have their physical activity levels during the intervention.

9) Page 5, line 10. I suggest replacing compliance with adherence

This has been done.

10) The authors suggest using an iterate approach on optimizing participants’ familiarization with eHealth systems. Such an iterative co-design was performed in this project (also described in REF 12), and the participants were systematically guided through how to use each component of the system, but still the engagement with the components in the system was variable. Do you consider the iterative approach that was used in this study as successful? How can it be improved?

An iterative process was employed as part of the design of this intervention (reference 12), which appears to have been successful. The iterative approach was not continued during the intervention testing period which may have resulted in variables level of engagement, thus the author suggest using an iterative approach for optimising participant engagement during the intervention period. Further clarification has been added to this paragraph page 24 339-344.

11) Ref 25 is not complete. Do you mean this REF?

Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ : British Medical Journal. 2015;350:h1258.

Thank you for this recommendation this has been updated.

12) Figure 1. Given that 44 debriefs were conducted, what is meant with that one participant was excluded due to “data saturation”? Data saturation refers to the point in the research process when no new information is discovered in data analysis. Researchers in KUL conducting the semi structured interviews did not conduct one interview as they felt that they were not discovering any new information from the interviews.

13) I think it was a well considered choice by the authors to include participants who did not use the system beyond the familiarisation stage to get a more nuanced picture. Although the participants were equipped with advanced support to implement life style changes this paper illustrates the challenges with implementing life style changes. Do you consider the intervention group as motivated to perform lifestyle changes and as a group with a high CVD risk factor profile (i.e. patients in most need of performing life style changes)? A discussion in light of that may strengthen the paper The authors consider the participants in the current study motivated to perform lifestyle changes as a theme that emerged in this study was that health was a key reason for engaging with PATHway in the first instance. However as outlined in the discussion CVD patients can underestimate their CVD risks which potentially manifested as a lack of engagement with some components, additional wording has been added in an attempt to clarify this page 23, 314-315.

Attachment

Submitted filename: response to reviewers comments.docx

Decision Letter 1

Wen-Jun Tu

9 Apr 2020

PONE-D-20-00433R1

A qualitative exploration of cardiovascular disease patients’ views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project

PLOS ONE

Dear Dr O'Shea,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by May 24 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I have re-reviewed this manuscript, which has improved but I have some minor comments.

1) Page 4. I suggest to delete the new sentence “While quantitative data gives us information with regard to the effectiveness of the intervention it does not tell us whether the participants actually enjoyed or liked the intervention has been documented predictor of maintenance (10)”.

I think this sentence is not needed as the sentence before (regarding qualitative) has been clarified.

2) Below is from our previous conversation:

I suggest considering adding the participants levels of physical activity in table 1.

These are presented in REF 10, but the analysis of the debriefs in the present study,

may be reflected in light of PA levels (see further my comment 13). Information on civil status can also be added in table 1

Authors´ response

Information on participants data captured by PATHway system was anonymized,

therefore we do not have their physical activity levels during the intervention.

Additional comment: My suggestion was to add baseline PA levels and civil status in Table 2.

3) Page 23 Referring to this sentence “At its core, the PATHway intervention is a behaviour change intervention...”

Here it can be stated that the exercise platform is the core component in the PATHway system (to be in line with other changes performed in the method section).

4) Page 25. Regarding the following sentence in the discussion:

“The perceived lack of need of the Good Habits Visualisation is potentially due to a lack of understanding or poor perception of CVD risk and not a lack of motivation to change as participants reported health as a motivation to engage with PATHway in the first instance”.

Additional comment: Can it be the case that professionals fails to meet patients as persons with individual preferences, needs and resources (not tailored for each person)?, and which may lead to a lack of understanding. I suggest to change/elaborate the sentence above.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 6;15(7):e0235274. doi: 10.1371/journal.pone.0235274.r004

Author response to Decision Letter 1


17 May 2020

1) Page 4. I suggest to delete the new sentence “While quantitative data gives us information with regard to the effectiveness of the intervention it does not tell us whether the participants actually enjoyed or liked the intervention has been documented predictor of maintenance (10)”.

I think this sentence is not needed as the sentence before (regarding qualitative) has been clarified.

Response: Thank you for this recommendation this sentence has been removed.

2) Below is from our previous conversation:

I suggest considering adding the participants levels of physical activity in table 1.

These are presented in REF 10, but the analysis of the debriefs in the present study,

may be reflected in light of PA levels (see further my comment 13). Information on civil status can also be added in table 1

Authors´ response

Information on participants data captured by PATHway system was anonymized,

therefore we do not have their physical activity levels during the intervention.

Additional comment: My suggestion was to add baseline PA levels and civil status in Table 2.

Response: Baseline physical activity and civil status have been added to Table 2

3) Page 23 Referring to this sentence “At its core, the PATHway intervention is a behaviour change intervention...”

Here it can be stated that the exercise platform is the core component in the PATHway system (to be in line with other changes performed in the method section).

Response: In the methods PATHway is described as “a home-based, technology enabled complex behavior change intervention. It provides regular exercise sessions as the basis upon which to provide a personalized, comprehensive lifestyle intervention program to enable patients to self-manage their CVD and to lead a healthier lifestyle in general.” It was designed for the exercise to be the core component. A minor change has been made to this sentence (page 24, line 286-288):

The PATHway intervention is a behaviour change intervention and specific behaviour change techniques were utilised including: self-monitoring, feedback, social support and individual tailoring (16)

4) Page 25. Regarding the following sentence in the discussion:

“The perceived lack of need of the Good Habits Visualisation is potentially due to a lack of understanding or poor perception of CVD risk and not a lack of motivation to change as participants reported health as a motivation to engage with PATHway in the first instance”.

Additional comment: Can it be the case that professionals fails to meet patients as persons with individual preferences, needs and resources (not tailored for each person)?, and which may lead to a lack of understanding. I suggest to change/elaborate the sentence above.

Response: Thank for you for this comment we have made changes to reflect the lack of personalisation in the group setting out cardiac rehabilitation. See page 25 line 325- 328.

It could also be argued that the delivery of education in a group setting of cardiac rehabilitation during outpatient CR does not adequately meet each individuals’ needs and preferences, although previous research in diabetes patients has shown equal effectiveness between group and individual education (22).

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 2

Wen-Jun Tu

12 Jun 2020

A qualitative exploration of cardiovascular disease patients’ views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project

PONE-D-20-00433R2

Dear Dr. O'Shea,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Wen-Jun Tu

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I am satisfied that all my previous comments have been adequately addressed.

1)In Table 1, civil status is missing for one participant. Add or indicate as missing.

2)In the reference list there are two references with number 24. Check and update.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Acceptance letter

Wen-Jun Tu

16 Jun 2020

PONE-D-20-00433R2

A qualitative exploration of cardiovascular disease patients’ views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project

Dear Dr. O'Shea:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Wen-Jun Tu

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Description of the eleven PATHway components.

    (DOCX)

    Attachment

    Submitted filename: response to reviewers comments.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES