Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Dec 21;15(12):e0244190. doi: 10.1371/journal.pone.0244190

Changes in physiotherapists’ perceptions of evidence-based practice after a year in the workforce: A mixed-methods study

Maureen McEvoy 1,*,#, Julie Luker 1,#, Caroline Fryer 1,#, Lucy K Lewis 2,#
Editor: Catherine M Capio3
PMCID: PMC7751960  PMID: 33347468

Abstract

Background

Few studies have explored evidence-based practice (EBP) knowledge, attitudes and behaviours of health professional graduates transitioning into the workforce. This study evaluated changes in these EBP domains in physiotherapists after one year of working.

Method

A mixed methods design was used. Participants completed two psychometrically-tested EBP questionnaires at two timepoints. The Evidence-Based Practice Profile questionnaire collected self-report EBP data (Terminology, Relevance, Confidence, Practice, Sympathy) and the Knowledge of Research Evidence Competencies collected objective data (Actual Knowledge). Changes were calculated using descriptive statistics (paired t-tests, 95% CI, effect sizes). Qualitative interview data collected at one timepoint were analysed using a descriptive approach and thematic analysis, to examine the lived experience of participants in the context of their first employment. The aim of the mixed methods approach was a broader and deeper understanding of participants’ first year of employment and using EBP.

Results

Data were analysed from 50 participants who completed both questionnaires at the two timepoints. After one year in the workforce, there was a significant decrease in participants’ perceptions of Relevance (p<0.001) and Confidence with EBP (p<0.001) and non-significant decreases in the other domains. Effect sizes showed medium decreases for Relevance (0.69) and Confidence (0.57), small decreases in Terminology (0.28) and Practice (0.23), and very small decreases in Sympathy (0.08) and Actual Knowledge (0.11). Seven themes described participants experience of using EBP in their first working year.

Conclusions

After a year in the workplace, confidence and perceptions of relevance of EBP were significantly reduced. A subtle interplay of features related to workplace culture, competing demands to develop clinical skills, internal and external motivators to use EBP and patient expectations, together with availability of resources and time, may impact early graduates’ perceptions of EBP. Workplace role models who immersed themselves in evidence discussion and experience were inspiring to early graduates.

Introduction

Since the introduction of evidence-based practice (EBP) in medicine in the early 1990’s [1], many professions allied to health and social care have embraced an evidence-based approach to learning and clinical practice [2]. The five-step model of EBP [3] is commonly accepted as core curricula in entry-level health professional training, as evidenced by the inclusion of EBP in accreditation documents for health professional programs to enable registration of graduates in their chosen professions [4].

While there are many quantitative studies investigating the effectiveness of EBP teaching in medicine and allied health, more recently, mixed model studies have emerged, providing for richer exploration of EBP. These studies have been in undergraduate-entry level students [57] and in clinicians with varying experience [810]. The transition period from completion of health professional training to workplace practice is an area of sparse research. A recent mixed methods study was limited by the small number of graduates (n = 13) included in a cross-sectional comparison across year levels in a graduate-entry occupational therapy program [11]. It is well accepted that training entry-level students in EBP results in improved self-reported knowledge and attitudes, a sound understanding of the EBP process and positive attitudes for its application in clinical practice, on graduation [12]. McEvoy et al. [13] also provided quantitative data on changes in EBP knowledge, attitudes and behaviour after transitioning into the workplace for one and two years. However, there was no further exploration of what may influence these changes.

There are likely to be many factors impacting new graduates’ decision making and use of EBP in the workplace including time, access, workplace culture and resources [14]. Workplace dissemination and implementation of EBP may be a complex process relating to the clinician, workplace environment and culture [14], and quality of previous training [15]. However, a systematic review by Beidas et al. [16] reported that there was insufficient information about how clinician, patient and organisational variables influence EBP competence, skill and adherence in the workforce.

Examining EBP competence and behaviours on transition from entry-level health professional programs to the workplace can inform EBP education and practice across professional training years. Recommendations are needed for how best to prepare and support EBP during clinicians’ early years in the workplace. Therefore, the objective of this study was to determine what is influencing the use of EBP by physiotherapists during their first year in the workforce. The specific aims of the study were to quantitatively examine overall changes in domain scores associated with EBP knowledge, attitudes and behaviours, and to qualitatively explore the experience of using EBP in a cohort of physiotherapists after a year in the workforce.

Methods

This paper describes the second stage of a larger study where physiotherapy students’ EBP knowledge, attitudes and practices were tracked during their entry-level physiotherapy training, from baseline to graduation [12]. In the second stage, participants were followed up after their first year in the workforce. Data were collected from 2013 to 2014. Ethical approval was gained from the University of South Australia Human Research Ethics Committee (protocol numbers 0000021077 and 0000030567). All participants provided written informed consent.

Design

Quantitative and qualitative procedures of the study were conducted independently of each other in a convergent mixed methods design [17]. The timepoint 1 quantitative data were collected on participants’ completion of the final EBP course in their final year of the Physiotherapy Program. The timepoint 2 quantitative data were collected after participants had been in the workforce for up to 1 year (September-November 2014). The qualitative interviews were conducted in the immediate period after the timepoint 2 quantitative data were collected (November 2014). The interview questions were independent of the quantitative results and not all participants who completed the survey, consented to the interviews. The quantitative and qualitative data were analysed separately then merged in the interpretation and reporting of results.

A rigorous descriptive qualitative approach was used with semi-structured interviews and thematic analysis [18]. Within an interpretive paradigm, this approach uses low-inference interpretation to provide a rich description of experiences and perspectives in everyday language [19]. A qualitative descriptive method was chosen to provide a pragmatic way of examining the lived experiences of our participants in the context of first employment, with a relativist ontology and a subjectivist epistemology [19, 20]. The two qualitative researchers who led this component of the study (CF, JL) are experienced physiotherapists and qualitative researchers in the field of health science at post-doctoral level.

Participants

The target population was all physiotherapy students completing their final year of training at the University of South Australia in 2013 and entering the physiotherapy workforce in 2014 (n = 125). For inclusion, students needed to have completed all final year courses in late 2013 or early 2014, and to be entering the physiotherapy workforce (i.e. not continuing to further study, not delaying practicing as a physiotherapist). International students leaving Australia were excluded. A minimum number of 34 participants was needed for the quantitative data set in order to obtain 80% power for a two-tailed distribution, with alpha set at 0.05 and a medium effect size (d = 0.5) derived from the study of McEvoy et al [13].

Procedure

Quantitative data collection

Quantitative data were collected using two questionnaires, the Evidence-Based Practice Profile (EBP2) questionnaire and the Knowledge of Research Evidence Competencies (K-REC) questionnaire. The EBP2 questionnaire has been psychometrically-tested [21] and shown to be valid and reliable (test-retest reliability: ICC 0.77 to 0.94, internal consistency: Cronbach’s alpha 0.96, convergent validity: Pearson r = 0.54–0.80, can distinguish between groups for different levels of EBP exposure p<0.05). The EBP2 questionnaire includes 58 items (5-point Likert scale) that relate to five self-reported EBP domains: Relevance (14 items) is the value, emphasis or importance placed on EBP; Terminology (17 items) relates to an understanding of common research terms; Confidence (11 items) is perception of ability in EBP skills; Practice (9 items) is the application of EBP in clinical decision-making; and Sympathy (7 items) is the perceptions of compatibility of EBP with day-to-day professional work [21]. The K-REC questionnaire has 9-items that measure participants’ knowledge of EBP using multiple choice, true and false and an open-ended question, pertaining to a clinical scenario, and has been demonstrated to be a valid and reliable tool (test-retest reliability: Cohen’s Kappa and ICC range 0.62 to perfect agreement, can distinguish between groups with and without formal EBP training p<0.0001) [22].

Participants completed the questionnaires at two timepoints: 1) at completion of entry-level training, Timepoint 1, and 2) one year after entering the workforce, Timepoint 2. At Timepoint 1, participants answered the questionnaires using a pen-and-paper format. For Timepoint 2, participants answered using an electronic version of the questionnaires through Survey Monkey, due to the participants being geographically dispersed. All participants were allocated a unique identifier to allow matching of data from both timepoints. Follow-up reminders were sent to those who did not open their individual link to the electronic questionnaire.

Qualitative data collection

Qualitative data were collected after one year in the workforce using telephone interviews. A semi-structured interview guide was developed by the research team independent of the quantitative data findings. Content validity of the interview guide was supported by seeking feedback during its development from a reference group of six physiotherapists with broad EBP teaching experience, including a researcher in this field (S1 Appendix). Topics covered by the interview questions included: how EBP is used in the workplace, the relevance and value of EBP in the workplace, the impact of EBP role models, how EBP workplace behaviours are encouraged, and usefulness of EBP training to prepare for graduate practice. An interviewer, independent of the research team and experienced in qualitative interviewing, conducted telephone interviews with the participants. Each interview was recorded then transcribed verbatim by a professional service. Transcript data were de-identified and entered in NVivo 10 software for analysis.

Data management and analysis

Quantitative analysis

De-identified data were entered in Predictive Analytic Software (PASW) Statistics 17.0 (Chicago, IL). Participants’ scores for the domains were only included if matched data for the domain were available for the two timepoints. If all items in a domain on either occasion were not competed, this domain score was not included in the analysis. The Likert scores for the EBP2 questionnaire were treated as interval data. The maximum domain scores varied (Relevance 70, Terminology 85, Confidence 55, Practice 45, Sympathy 35), due to the different number of items per domain. The K-REC instrument gives a maximum score of 12. Participant responses were scored using set scoring guidelines. Descriptive statistics were calculated for each of the five EBP2 domain scores, the K-REC domain total score and demographic information. Paired t-tests, 95% CI and effect sizes (ES) were used to examine changes between the two timepoints. The ES were classified as very small (0.01), small (0.20), medium (0.50) and large (0.80) [23]. Alpha was set at 0.05. As maximum domain scores varied due to the different numbers of items, the scores were calculated as a percentage of possible maximum (100%) at each timepoint, for graphical presentation.

Qualitative analysis

Two researchers (CF and JL) separately analysed the qualitative data using a staged process of thematic analysis. First researchers read the transcripts repeatedly to familiarize themselves with the data. Second, codes were inductively allocated to small sections. Third, comparison across transcripts and codes were done, inductively grouping the codes in a meaningful manner to form categories and themes within each category [24]. This was an iterative process requiring the researchers to meet and discuss regularly to eventually reach a consensus.

The quantitative and qualitative findings of the study were integrated narratively to address the study objective [17]. The quantitative findings are presented first then the subsequent reporting of qualitative findings uses a weaving approach to integrate the qualitative themes with the quantitative domain results.

Results

Participants

Fig 1 illustrates the flow of participants through the study. Of the 125 eligible participants, 87 had complete questionnaire data at timepoint 1 [12]. Of these, 84 participants consented for follow-up questionnaires at timepoint 2 after one year in the workforce, but 19 were ineligible for follow-up (failed to successfully complete final courses in the physiotherapy program, planning to work overseas or not to work in physiotherapy in the first year after graduation), resulting in 65 eligible participants for timepoint 2. Of these, 50 (70%) participants completed the questionnaires at timepoint 2. Of these 50 participants, 14 participated in interviews after timepoint 2 completion of questionnaires.

Fig 1. Flow of participants through the study.

Fig 1

At timepoint 1, of the 50 participants there were 35 females and 15 males. The mean age was 22 +/- 4 years (range 20–47). At timepoint 2, 14 participants were interviewed. There were 10 females and 4 males, with an average of 22 +/- 1 years (range 20 to 23). The interviewees worked in a range of settings in hospitals (n = 4), private practice (n = 7) and community health (n = 3), in both metropolitan (n = 9) and regional (n = 5) areas. Most interviewees treated both inpatients and outpatients ± aged care (n = 7), while others treated outpatients only ± sports (n = 5) and inpatients only (n = 2). While 50 participants completed both questionnaires at the two timepoints, there was not complete matched data from all participants for each of the six EBP domains (Practice n = 50; Relevance, Terminology, Confidence and Actual Knowledge n = 49; Sympathy n = 48). The domain structure of the questionnaire allowed for this analysis provided all items in a domain were completed.

Quantitative

Table 1 presents the domain scores (mean, change, CI, p values and effect sizes) for the 50 participants with matched data at the two timepoints. After one year in the workforce, there was a significant decrease in participants’ perceptions of the Relevance of EBP (p<0.001) and self-reported Confidence with EBP (p<0.001). There were non-significant decreases in the other domains of Terminology, Practice, Sympathy and Actual Knowledge. In terms of effect sizes, there were medium decreases in the Relevance and Confidence domains, small decreases in Terminology and Practice, and very small decreases in Sympathy and Actual Knowledge.

Table 1. EBP domain scores, change, p values and effect sizes for participants at completion of entry level training and after one year in the workforce (n = 50)*.

EBP domain Timepoint 1 mean (SD) Timepoint 2 mean (SD) Change (95% CI) Raw p values Effect size (ES)
Relevance n = 49 (max. score 70) 64.9 (4.4) 60.9 (5.4) 4.0 (2.4 to 5.7) p<0.001 ES 0.69↓
Terminology n = 49 (max. score 85) 66.6 (9.1) 64.2 (11.0) 2.4 (-0.0 to 4.8) p = 0.055 ES 0.28↓
Confidence n = 49 (max. score 55) 44.6 (6.0) 40.9 (7.4) 3.7 (1.8 to 5.5) p<0.001 ES 0.57↓
Practice n = 50 (max. score 45) 26.9 (5.6) 25.5 (5.6) 1.4 (-0.35 to 3.3) p = 0.11 ES 0.23↓
Sympathy n = 48 (max. score 35) 24.0 (3.5) 23.7 (3.0) 0.3 (0.80 to 1.4) p = 0.59 ES 0.08↓
Actual Knowledge n = 49 (max. score 12) 8.9 (1.8) 8.7 (1.2) 0.2 (-0.35 to 0.81) p = 0.43 ES = 0.11↓

*Complete data was not provided for all domains by the 50 participants; Timepoint 1: completion of entry-level training; Timepoint 2: one year in the workforce; Bolded p values are statistically significant (p<0.05)

The maximum domain scores in the EBP2 questionnaire vary due to the different numbers of items in each domain. Fig 2 presents the domain scores as a percentage of the possible maximum (100%) score in each domain across the two timepoints.

Fig 2. Domain scores from the EBP2 questionnaire shown as a percentage of the possible maximum score for each domain, across the two timepoints.

Fig 2

Qualitative

Three categories were developed from the descriptive analysis of interview data: ‘Using EBP in the first year’, ‘The EBP undergraduate course’, and ‘First year experience’. The category ‘Using EBP in the first year’ is reported in the current paper. The second category ‘The EBP undergraduate course’ was used to inform changes to the program curriculum. The final category ‘First Year experience’ described findings relevant to a broader context than the topic of this paper and will be published separately.

The experience of participants ‘Using EBP in the first year’ is described by the following seven key themes:

  1. Looking up research evidence when unsure

  2. Clients appreciate hearing about evidence for their treatment

  3. Workplace culture supports EBP behaviours

  4. Difficulties accessing time and databases for EBP

  5. Confidence in EBP skills comes with practice

  6. Learning a lot from colleagues' clinical expertise

  7. Self-motivated to be EBP user

Each theme is presented narratively with illustrative data quotes [18] and integrated with the quantitative results.

Theme 1: Looking up research evidence when unsure

Participants’ primary application of EBP skills and knowledge in their first working year was to search for research evidence to inform clinical reasoning when they were unsure about what to do. This was usually in the context of treatment decisions for individual clients as Participant 7 explained,

‘You want to make sure, if someone comes in with a condition you’re not too sure about or has had something done, then you’ll look it up in response to that’,

but was also used by a few participants to develop intervention programs for specific clinical populations,

‘We came up with a program for hamstring training, so we seemed to be getting a fair few come through, so I had to pretty much go back and do almost like a Uni-type assignment’ (participant 44).

Only three participants reported using their own clinical expertise and incorporating the patient’s goals and views in addition to the research evidence in their reasoning,

‘I obviously don’t rely heavily on what it says in the literature all the time. I take to mind what it says and my clinical experience and the patient goals—like the three bits of EBP’ (Participant 14).

This finding that participants regularly searched and appraised evidence in their first year supports the maintenance of participants’ performance in the quantitative ‘Practice’ domain.

Theme 2: Clients don’t ask but appreciate hearing about evidence for their treatment

Participants generally perceived that clients do not have much idea about EBP and do not ask for evidence for their treatment. Yet most participants believed that clients appreciated being told about research evidence as it encouraged them and gave them confidence in the physiotherapy treatment. Participant 56 explained,

‘I’ve had a few patients that they may have been a little bit apprehensive about some of the treatments that we use, but then we sort of explain to them about the evidence behind it and it really does help them to feel confident in what we’re doing and that we’re not just doing some sort of weird treatment.’

Interest in research evidence was noted to differ between client groups, with greater interest perceived in clients with a health background such as personal trainers. This finding that patients do not ask for evidence may have influenced the reduction in the quantitative domain of ‘Relevance’.

Theme 3: Workplace culture supports EBP behaviours

The role modelling of an EBP approach by work colleagues, and direct encouragement by supervisors to be evidence-based were key extrinsic motivators for participants to use their own EBP skills. Regular in-service education and professional development were perceived as helpful to develop EBP knowledge. Frequent informal discussions of recent evidence between colleagues and widespread sharing of journal articles in the workplace strongly encouraged participants to use EBP. The following two quotes illustrate this experience,

‘They’re all role models, because every time they do something, or I see them reading an article, it kind of reminds me that, oh yeah I should do that, or I haven’t done that in a while.’ (Participant 12)

‘At my clinic work they view EBP obviously quite high in a sense that they always want to find out whether you have an opinion and where’s the evidence to that opinion and where’s the evidence to back it up.’ (Participant 22)

Nine participants identified key role models, often in high-ranking positions, who worked in or visited their workplace and inspired them with dedication to conducting and using research evidence. In contrast, three participants experienced older colleagues who demonstrated disinterest in EBP by failing to update their practice. Mostly this was not perceived to be a barrier to participants’ own EBP behaviour,

‘I guess they’re stuck in the stuff that they were taught when they were at Uni still. They use a lot of EPAs and stuff like that, which I’m not 100% keen on.’ (Participant 14).

but one participant experienced it as actively discouraging their use of EBP,

‘…we just have a couple of senior physios and my perception is that they’re more inclined to sort of go with, like their clinical experience and so sometimes that can get a little bit, “Well we know this, like so just do this,” rather than spend that time looking it up. (Participant 62).

The strength of an EBP culture was perceived to differ between clinical areas by participants who worked across areas in their first year. Outpatient rehabilitation, intensive care and private musculoskeletal practice were viewed as areas where there was a lot of research evidence available and used. Aged care, hospital inpatients and paediatrics were identified as less relevant for EBP as treatment techniques were perceived as more restricted and repetitive. The finding of regular in-service education and sharing of evidence between colleagues in workplaces supports participants’ strong performance in the quantitative ‘Terminology’ domain for common research terms. Perceived differences in the use of EBP between clinical areas may have contributed to the reduction in the quantitative domain of ‘Relevance’.

Theme 4: Difficulties accessing time and databases for EBP

Key barriers to participants using their EBP skills and knowledge were difficulty finding time to access research evidence and lacking access to online databases or journals at their workplace. A lack of time was associated with full patient loads, understaffing and the absence of dedicated time for EBP practice,

‘I think sometimes when we’re busy we’re just trying to get everything done and just get it done quickly and we don’t have time to sit down and go through that stuff or think about that stuff. I think that’s one of the main reasons it doesn’t get used sometimes.’ (Participant 49).

Access to online database access was not available at many workplaces or the participants had not been orientated to the process of gaining access,

‘It was kind of hard, like I felt like even if I wanted to, I didn’t really know where to go for it. But I guess they weren’t actively discouraging it, it was just no-one knew about the access.’ (Participant 12).

The impact of these barriers on participants use of skills is reflected in the reduced quantitative domain of ‘Confidence’ in ability to use their skills.

Theme 5: Confidence in EBP skills comes with practice

Many participants reported a reduction in their confidence to use EBP skills and knowledge during the year. Confidence in EBP skills was strongly associated by participants with the amount they were able to practice the skills they had learned during their university training. A lack of practice in using statistical terms and critically appraising evidence was specifically highlighted

‘I think it’s probably gone down a bit because I’m not constantly refreshing and critiquing articles. I probably look up an article or two every week but it’s more I’m not being very critical of it.’ (Participant 40)

The few participants who reported they gained confidence in their use of EBP variously identified this to be associated with attending presentations, observing others using evidence, and putting their EBP training into practice. This finding suggests a lack of regular practice of all EBP knowledge and skills contributed to the reduced quantitative domain of ‘Confidence’ in ability to use their skills.

Theme 6: Learning a lot from colleagues’ clinical expertise

Nine of the 14 participants reported seeking advice from senior colleagues about patient treatment. They valued the clinical expertise of their more experienced colleagues about ‘what works well’ (Participant 37). The advice received from senior colleagues was considered by participants in addition to, and sometimes in preference to, research evidence. Participant 56 explained this experience,

‘I’ve got some very experienced physios working where I am, so I am sort of using their experience as well and hearing what they’ve got to say. Sort of asking questions from them. They’ve been really good as well and being able to sort of look at the evidence and go yeah that’s great but for this patient it may not necessarily work for these reasons.’

This finding that participants frequently sought advice from colleagues based on clinical experience may have reduced the comparative perceived importance of using research evidence, therefore reducing the quantitative domain of ‘Relevance’.

Theme 7: Self-motivated to be EBP user

The majority of participants expressed an intrinsic motivation to use EBP to become a ‘good’ and effective physiotherapist. This self-motivation was present in participants who did and did not work within a strong EBP culture. Participant 44 insisted their intrinsic motivation was independent of external influences to use EBP,

‘I think I’ve got a pretty high drive to use it anyway. Particularly like that, if you want to be good at what you are doing, you try to take that on board, you can’t really ignore EBP and all that stuff.’ (Participant 44).

This finding that self-motivation to use EBP was strong within the group may explain the maintained level of the ‘Practice’ domain in the quantitative results.

Discussion

The key findings of this study were that physiotherapy graduates after one year in the workforce reported small reductions in knowledge, practice and sympathy for EBP, and significant declines in confidence and perceptions of the relevance of EBP compared to these measures at graduation. These quantitative domain declines appeared from qualitative results to be influenced by a range of inter-related influences, including workplace culture and the opportunity to practice EBP skills.

Relevance of EBP in clinical practice showed an overall decline after one year in the workforce but the qualitative findings suggest that this varied according to area of clinical practice. Participants reported that EBP had greatest relevance in the management of musculoskeletal conditions where presentations were varied and progressed through stages of rehabilitation. There was a perception of greater autonomy in management and integration of best research evidence in clinical reasoning. By comparison, participants felt the value and use of EBP in other clinical areas was limited by little or slow changes in practice. All clinical areas in physiotherapy are actively researched and have research evidence available to clinicians. It is possible that the large quantity of musculoskeletal research in physiotherapy conference programs and many journals influenced the perception of relevance, rather than the quantity or quality of the research actually available. It may also be that wider health care systems impact on physiotherapists’ practice and ability to use EBP e.g. where funding models direct care. Furthermore, the perceived relevance of EBP appeared to be influenced by competing demands for early career physiotherapists to learn from experienced colleagues and improve clinical skills. Relevance may also have been impacted by the perceived lack of expectation regarding EBP from patients. However, when evidence is explained, many patients appreciate the decision-making underpinning treatment choices and communicating evidence needs to be recognised by practitioners as a professional obligation relevant to the communication requirements of informed consent [25].

The overall decline in the Confidence domain identified in this current study may have been influenced by participants reported difficulties in accessing the time and database evidence for practicing EBP. Participants reported retaining skills for searching databases, but were generally less critical of research with poorer ability to interpret the statistical measures and the quality of the research. A lack of consistent practice and a loss of knowledge in skills for accessing, appraising and integrating best research evidence were cited as contributors to having less confidence. Interestingly, following an initial decline after a year of working, McEvoy et al [13] reported improved confidence scores after two years of working. The authors hypothesised that early graduates may need an initial period to establish workplace relationships and clinical routines before their focus and confidence returns to EBP.

A decline in confidence in clinical practice in the first year of practice in physiotherapy has also been previously reported [26], with a greater ‘outward’ focus and confidence in the second year of practice. When their EBP skills are viewed in the context of the five stages of learning, graduates in the current study may have moved through novice and advanced beginner levels during EBP training across the physiotherapy program, and enter the workforce at a competent level [27]. Coaching and a balance of supervision and autonomy, with encouragement to self-reflect and justify decisions may have supported achievement of this level of EBP skills [28]. To reach the fourth level of proficiency in EBP skill, there needs to be support in decision-making and self-reflection in relation to more complex experiences to build confidence [28]. This level, which is characterised by taking responsibility for one’s decisions, identifying opportunities to teach, and being responsible to others, may be stalled in the first year of working with the potential to re-emerge after two years as a working physiotherapist.

The results of this study indicate that a workplace culture that values research evidence strongly supports EBP use and helps in maintaining confidence and supporting EBP practice in the workplace. Some of the practices that cultivate this culture can be implemented in all workplaces, including ongoing discussions of research evidence, sharing of journal articles, regular in-service education, and the support and encouragement by supervisors to make evidence-based decisions. Role models within and outside the workplace who championed and practiced EBP were inspiring to new graduates and can be considered key motivators to using EBP in the first year of work.

There are no known previous studies that have evaluated the changes in EBP knowledge, attitudes and behaviours in this transitional period from graduation to a year in the workplace. Several studies have suggested that EBP training should be integrated across the professional continuum rather than constrained to entry-level programs prior to graduation and registration [29, 30]. Relating to EBP in psychology, Leffler et al [29] proposed individualised training and active strategies that are supported and have measurable outcomes of learning and effects. Examples of these approaches during training, during internship and for clinicians were provided. While not always available, internship is closest to the first year of practice. Leffler et al [29] proposed a dedicated period to train psychologists to integrate clinical research and practice, by the collaborative development of projects under the supervision of faculty members who engage in clinical research. Tilson and colleagues [810] developed a program for clinicians to support integration of research evidence into clinical decision-making. In the Physical therapist-driven Education for Actionable Knowledge translation program (PEAK), opportunities are provided for expert and peer support to explore new skills, using small group learning with an experienced EBP expert, librarian and with peers [9]. The PEAK program improved short term self-reported EBP confidence and behaviours, but this was not sustained at six months [10]. Tilson et al [9, 10] did not report on whether participants had exposure to EBP during physiotherapy training. McEvoy et al [12] found significant improvement in self-reported EBP knowledge, attitudes and behaviours prior to graduation, after exposure to EBP courses. These improvements in the same cohort after graduation were not sustained, as reported in the current study. Lessons may be learned from Tilson et al [9, 10], to build further on a strong EBP foundation gained prior to graduation.

Recommendations from this research relate to clinical practice and education. A practice recommendation for the future may be to incorporate greater organisational support, with more monitoring, feedback and problem-solving offered in the transition period using EBP experts, librarians and peers. In addition, building stronger links between workplaces and physiotherapy training institutions may allow the mutual strengths of both to be better utilised. For example, students often have research and analysis skills to share, but need consolidation of clinical skills that can be provided by experienced clinicians. Together there can be integration of clinical and research evidence along with evidence from the patient, to provide authentic EBP.

Education recommendations may be to target statistics training focussing on application of statistics, to build confidence in this area. This should not be at the expense of continued development of all EBP skills, as entry-level education resulted in significant improvements in all domains [12]. A further recommendation may be to better prepare students for the challenges of the transition period where workplaces may provide limited support, and to encourage new graduates to seek role-models and opportunities to maintain EBP skills.

There are limitations to acknowledge in our study. Firstly, the study was undertaken in one institution and in a single profession potentially limiting generalisability. Secondly, it is possible that there were confounders such as place of employment, setting, rural, metropolitan and remote locations. As the primary aim of the quantitative arm of this study was to assess the change in domain scores after a year in the workforce, these variables were not assessed or included in the analyses. This is a possible area for future research.

Future mixed-method studies may be undertaken to collect data beyond the first year in the workplace where further changes in EBP knowledge, attitudes and behaviour may be explored. Studies exploring how graduate EBP knowledge, attitudes and behaviours may contribute to a successful workplace may also be of interest. Collecting data on access to resources, availability of professional development, role models and mentors to enhance EBP and further investigation of aspects of an EBP-supportive workplace culture may be valuable.

In conclusion, one year into working, physiotherapists showed a decline in all EBP profile domains, most significantly for confidence and the perceived relevance of EBP. In the first year of work, a subtle interplay of features related to workplace culture, competing demands to develop clinical skills, internal and external motivators to use EBP and expectations of patients, together with availability of resources and time, may impact early graduates’ perceptions of EBP. Role models in and outside of the work environment who immersed themselves in evidence-based discussion and experience were identified by early graduates as inspiring.

Supporting information

S1 Appendix. Semi-structured interview guide.

(DOCX)

S2 Appendix. Quantitative dataset.

(PDF)

S3 Appendix. Coded interview dataset.

(XLSX)

Acknowledgments

The authors would like to acknowledge and thank statistician Alvin Atlas (International Centre of Allied Health Evidence, iCAHE, University of South Australia) for his assistance with data management and statistical analysis. The authors would like to thank the participants who were transitioning into the workforce for engaging in this research.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

MM, LL, JL received a University of South Australia Learning and Teaching Grant 2013 ($9985.23) (no number). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

References

  • 1.Guyatt G. Evidence-Based Medicine. ACP J Club. 1991;A-16: 114. [Google Scholar]
  • 2.Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al. Sicily statement on evidence-based practice. BMC Med Educ. 2005;5: 1–7. 10.1186/1472-6920-5-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Cook DJ, Jaeschke R, Guyatt GH. Critical appraisal of therapeutic interventions in the intensive care unit: human monoclonal antibody treatment in sepsis. Journal Club of the Hamilton Regional Critical Care Group. J Intensive Care Med. 1992, 7: 275–282. 10.1177/088506669200700601 [DOI] [PubMed] [Google Scholar]
  • 4.McEvoy M, Crilly M, Young T, Farrelly J, Lewis LK. (2016) How comprehensively is evidence-based practice represented in Australian health professional accreditation documents? A systematic audit. Teach Learn Med. 2016;28: 1–9. 10.1080/10401334.2015.1107490 [DOI] [PubMed] [Google Scholar]
  • 5.Bozzolan M, Simoni G, Balboni M, Fiorini F, Bombardi S, Bertin N, et al. Undergraduate physiotherapy students’ competencies, attitudes and perceptions after integrated educational pathways in evidence-based practice: a mixed methods study. Physiother Theory Pract. 2014;30: 557–571. 10.3109/09593985.2014.910285 [DOI] [PubMed] [Google Scholar]
  • 6.Ilic D, Hart W, Fiddes P, Misso M, Villanueva E. Adopting a blended learning approach to teaching evidence based medicine: a mixed methods study. BMC Med Educ. 2013. December 17;13: 169 10.1186/1472-6920-13-169 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ilic D, Nordin RB, Glasziou P, Tilson J, Villaneuva E. A randomized controlled trial of a blended learning education intervention for teaching evidence-based medicine. BMC Med Educ. 2015;15: 39 10.1186/s12909-015-0321-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Tilson J, Mickan S. Promoting physical therapists' of research evidence to inform clinical practice: Part 1—Theoretical foundation, evidence, and description of the PEAK program. BMC Med Educ. 2014;14: 125 10.1186/1472-6920-14-125 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Tilson J, Mickan S, Sum J, Zibell M, Dylla J, Howard R. Promoting physical therapists’ use of research evidence to inform clinical practice: part 2-a mixed methods evaluation of the PEAK program. BMC Med Educ. 2014;14: 126 10.1186/1472-6920-14-126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Tilson JK, Mickan S, Dylla JM, Howard R, Sum JC, Zibell M, et al. Promoting physical therapists’ use of research evidence to inform clinical practice: part 3 –long term feasibility assessment of the PEAK program. BMC Med Educ. 2016;16:144 10.1186/s12909-016-0654-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Thomas A, Han L, Osler BP, Turnbull EA, Douglas E. Students; attitudes and perceptions of teaching and assessment of evidence-based practice in an occupational therapy professional Master’ curriculum: a mixed methods study. BMC Med Educ. 2017;17: 64 10.1186/s12909-017-0895-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.McEvoy MP, Lewis LK, Luker J. Changes in physiotherapy students’ knowledge and perceptions of EBP from first year to graduation: a mixed methods study. BMC Med Educ. 2018;18: 109 10.1186/s12909-018-1212-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.McEvoy MP, Williams MT, Olds TS, Lewis LK, Petkov J. Evidence-based practice profiles of physiotherapists transitioning into the workforce: a study of two cohorts. BMC Med Educ. 2011;11: 100 10.1186/1472-6920-11-100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Scurlock-Evans L, Upton P, Upton D. Evidence-based practice in physiotherapy: a systematic review of barriers, enablers and interventions Physiotherapy. 2014;100: 208–219. 10.1016/j.physio.2014.03.001 [DOI] [PubMed] [Google Scholar]
  • 15.Sanders MR, Turner KMT. Reflections on the challenges of effective dissemination of behavioural family intervention: Our experience with the Triple P-Positive Parenting Program. Child Adolesc Ment Health. 2005;10: 158–169. 10.1111/j.1475-3588.2005.00367.x [DOI] [PubMed] [Google Scholar]
  • 16.Beidas RS, Kendall PC. Training therapists in evidence‐based practice: A critical review of studies from a systems‐contextual perspective. Clin Psychol:Sci Pract. 2010;17: 1–30. 10.1111/j.1468-2850.2009.01187.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health Serv Res. 2013;48(6 pt2): 2134–2156. doi:10.1111/1475-6773.12117. 10.1111/1475-6773.12117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Thorne S, Kirkham SR, O'Flynn-Magee K. The analytic challenge in interpretive description. Int J Qual Methods. 2004;3: 1–11. [Google Scholar]
  • 19.Denzin NK, Lincoln YS. Introduction: The discipline and practice of qualitative research In Denzin NK, Lincoln YS, editors. The SAGE handbook of qualitative research. (3rd ed,). Thousand Oaks, CA: SAGE; 2005. pp. 1–32. [Google Scholar]
  • 20.Stanley M. Qualitative descriptive—a very good place to start In: Nayar S, Stanley M editors. Qualitative Research Methodologies for Occupational Sciences and Therapy. New York: Routledge; 2015. pp. 21–36. [Google Scholar]
  • 21.McEvoy MP, Williams MT, Olds TS. Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire. Med Teach. 2010;32: e373–e380. 10.3109/0142159X.2010.494741 [DOI] [PubMed] [Google Scholar]
  • 22.Lewis LK, Williams MT, Olds TS. Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals. BMC Med Educ. 2011;11: 77 10.1186/1472-6920-11-77 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Cohen J. Statistical Power Analysis for the Behavioural Sciences. 2nd ed Hillsdale, New Jersey: Lawrence Erlbaum Associates; 1988. [Google Scholar]
  • 24.Braun V, Clarke V. Thematic Analysis In Cooper H, Camic PM, Long DL, Panter AT, Rindskopf D, K. Sher J editors. APA Handbook of Research Methods in Psychology Vol. 2: Research Designs: Quantitative, qualitative, neuropsychological, and biological. Washington, DC: APA books; 2012. pp. 57–71. 10.1037/13620-004. [DOI] [Google Scholar]
  • 25.Delany CM. 2005. Respecting patient autonomy and obtaining their informed consent: ethical theory—missing in action. Physiotherapy 2005, 91(4): 197–203. [Google Scholar]
  • 26.Haywood LM, Black LL, Mostrom E, Jensen GM, Ritzline PD, Perkins J. The first two years of practice: a longitudinal perspective on the learning and professional development of promising novice physical therapists. Phys Ther 2013;93(3): 369–383. 10.2522/ptj.20120214 [DOI] [PubMed] [Google Scholar]
  • 27.Dreyfuss HL, Dreyfuss SE. 2005 Expertise in the real world context. Organ. Stud. 2005;26(5): 779–792. doi: 10.1177/0170840605053102. [Google Scholar]
  • 28.Persky AM, Robinson JD, Moving from Novice to Expertise and its implications for Instruction. Am J Pharm Educ. 2017;81(9): 72–80. doi:10.5688/ajpe6065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Leffler JM, Jackson Y, West AE, McCarty CA, Atkins MS. Training in evidence-based practice across the professional continuum. Prof Psychol Res Pr. 2013;44: 20. [Google Scholar]
  • 30.Lizarondo L, Grimmer-Somers K, Kumar S. A systematic review of the individual determinants of research evidence use in allied health. J Multidiscip Healthc. 2011;4: 261 10.2147/JMDH.S23144 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Catherine M Capio

23 Jul 2020

PONE-D-20-07294

Changes in physiotherapists perceptions of evidence-based practice after a year in the workforce: a mixed-methods study

PLOS ONE

Dear Dr. McEvoy,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Both reviewers highlighted major points that needed to be clarified with respect to the methodology, and I concur that these points are important in enhancing the our understanding of the study, and our confidence with the findings being reported.

Please submit your revised manuscript by Sep 06 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Catherine M. Capio

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: OVERALL REVIEW

The contribution to knowledge gap of this research report is undeniable. There are hardly any studies on evidence uptake after having learned the principles of EBP in entry-level education particularly in Physiotherapy. Therefore it is important that the findings of this research be communicated with clarity so that readers and follow through the data collection procedures, data analysis and insights of the authors.

Major concerns are the following:

Background/introduction. The objective depicts a qualitative study when the entire paper talks about mixed- methods. Provide an objective that would justify quantitative data collection and process.

Design. Explain more clearly how qualitative and quantitative procedures were used for the study. Was one dependent on the other? If qualitative data was used to support quantitative data, how and when was the qualitative arm of the study done? Did the authors analyzed the quantitative findings in order to direct or focus their interview questions? Or did they ask the interview questions independent of the quantitative results?

Description of participants; who was the target population, how many were they? What are the inclusion and exclusion criteria?

How was quantitative data treated? The authors mentioned that only respondents who answered both sets of questionnaire in Times 1 and 2 were included. Yet there are respondents who did not answer all items as expressed in lines 182-184? ‘there was not complete matched data from all participants for each of the six EBP domains’?

The authors stated that a limitation of this study is the method of analysis for the qualitative data. It puts into question the results of the study; why wasn’t an “in-depth” analysis conducted when that was the intention for doing a qualitative arm as stated in the design? This has to be clarified in order to align methodology and results.

Discussion. Most of the concepts were not followed through and requires further explanation and insights from the authors. This is very important if the results of the studies are to be useful for readers.

Minor to moderate concerns are the following:

Sentence and paragraph construction could be greatly improved for readability and clarity.

Formatting of tables for ease of reading the results and findings.

I gave some suggestions that could be useful but authors are free to work around this.

Addressing these concerns could make this manuscript more acceptable. Please find below specifics of my general review:

ABSTRACT

Line 22. May I suggest to use physiotherapy participants or simply participants, instead of physiotherapy students since they were not students at the time of the study.

BACKGROUND

Lines 79 to 80. I suggest to include an aim or objective that would pertain to the quantitative aspect of the research in order to anticipate the collection of quantitive data. Eg. To determine changes in EBP profile…

METHODS

Design

Line 94, remove period after workforce since the sentence is not yet completed.

How did the researchers treat the two methods for data collection? Was one dependent on the other or were they treated independent of each other. Were the interviews conducted taking into consideration the changes in scores of the quantitative data?

Participants

Line 106, Is it possible that one can complete entry-level of training in university and not graduate? If completion of entry-level training subsequently leads to being ‘graduated' then you can delete the words ‘and graduated’ to go straight to ‘and entered the physiotherapy workforce…’.

Are there exclusion criteria for the participants? (I think you mentioned these in the results part. You can mention it instead here).

Lines 107 - 108. Consider revising the sentence, starting with your intention to achieve a 80% power. Example. In order to achieve a power of 80% for the quantitative data……a minimum of 34 participants were needed.

Or: A minimum number of 34 participants was needed for the quantitative data set in order to obtain an 80% power for a two-tailed distribution, with alpha set at 0.05 and a medium effect size (d=0.5).

Procedure

Line 112. Consider improving the sentence construction in describing the questionnaires for easier reading and comprehension. Example:

Quantitative data were collected using two questions, the EBP2 and the KREC. The EBP2 has been psychometrically tested and shown to be valid and reliable etc. It may not be necessary to state that it is developed, since it has been used several times already. Then move on to describe its features; number of items, domains etc.

Line 119. Is 'actual knowledge’ used as a proper noun here? also why is it italicized? When using the word "subsequent", do you mean it was answered AFTER the EBP2? Was this an important or significant step in the process? Would it have mattered if participants answered K-REC first before EBP2? If the sequence in which the questionnaires were answered does not matter, then no need to write the word ‘subsequent'. If the sequence mattered, kindly give a brief explanation for this. The K-REC questionnaire has nine items that measures a participants knowledge of EBP using… It has been found to be valid and reliable….etc.

Line 123. Use an active voice when possible. Example: Participants completed the questionnaires at two timepoints; 1) upon their completion of entry-level training, Time 1, and 2) one year after entering the workforce, Time 2. At time point 1, participants answered the questionnaires using a pen-and-paper format. For time point 2, participants answered using an electronic version of the questionnaire through Survey Monkey, due to the participants' being geographically dispersed

Suggestion. How about using Time 1 and Time 2 instead of Timepoint 1, Timepoint 2.? If you agree, please revise throughout the manuscript.

Lines 131 to 133. When you say that “feedback from a reference group of six ….”, were you talking about content validation of the interview guide or did you pilot test the interview guide with this reference group? Also, my downloaded copy of the manuscript did not include S1 Appendix being referred to at this part.

Line 136. Under Design, I commented/recommended that you state the relationship of the two methods of data collection. It might be better to place lines 136 - 138 in that area of the paper. So that this part of the paper, similar to quantitative data collection, will discuss data collection tools and data collection process.

So instead, you can proceed by describing the interview guide in terms of the topics covered.

Line 141 onwards. An interviewer, independent of the research team and experienced in qualitative interviewing, conducted telephone interviews with the participants.

DATA MANAGEMENT AND ANALYSIS

Line 148 onwards. Suggestion: The predictive Analytic Software (PASW) Statistics 17.0 was used for quantitative data analysis. Only completed matched data (timepoints 1 and 2) were included for analysis.

Consider breaking down sentences when conveying different ideas or thoughts. Eg. Separate the sentences when talking about Likert scores and the fact that the domains have different number of items. Example: The Likert-scores for the EBP2 were treated as interval data. Then move on to describe the domain score.

Is there something more that you would want to discuss in reference to the different domain scores? Did this matter in data analysis. Because if this sentence (lines 150-152) just means to say that the scores will be different, it can be derived from the earlier description of the instrument, wherein the number of items for each domain was listed. But if this was transformed to make them ‘equal' for data analysis, then maybe this should be describe.

Line152. I don’t think it is necessary to include ‘for Actual Knowledge' to this. The K-REC gives a maximum score of 12. The participants responses were sacred using the set scoring guidelines.

Line 154. delete 'Actual Knowledge domain’

Line 160 to 168. I think this paragraph can be refined by using an active voice; state clearly what steps were taken for analysis; then towards the end describe the entire process as iterative so that it does not have to be stated repeatedly in the paragraph.

Two researchers (CF and JL) independently (or separately) analyzed the qualitative data using a staged process of thematic analysis. First researchers read the transcripts repeatedly to familiarize themselves with the data. Second, codes were inductively allocated to small sections. Third, comparison across transcripts and codes were done, inductively grouping the codes in a meaningful manner to form categories and themes within each category. This was an iterative process requiring the researchers to meet and discuss regularly to eventually reach a consensus.

In reference to line 163: Do the researchers think that analysis using software and hard copies affected the data? If so, maybe a short explanation is warranted. If not, this then can be deleted.

RESULTS

QUANTITATIVE

May I suggest to use 'completed an entry-level physiotherapy program’ as descriptors for participants to veer away from their ‘student’ status. This would help in focusing the readers, that the study is following through working physios instead of students.

The count of the participants is hard to follow through but it would be helpful if you keep in mind your target participants (physios who competed their final year of entry-level training at USA in 2013). So start with this number (how many were they actually). From this number, subtract those that copy with your exclusion criteria (plan to work overseas, not work in physio and did not consent to participate after one year). I think you will end up with 65 eligible participants. Then continue to discuss what happened to these eligible participants and how many viable data were left. Coming up with an illustration or figure for this might be helpful for the reader to follow.

At this point, I am confused as to how many viable data were analyzed? What do the researchers mean by lines 182-184? ‘there was not complete matched data from all participants for each of the six EBP domains’? how then was this treated?

Best also to describe participants at timepoints 1 and time point 2.

At Time 1, 50 participants were mostly female with a mean age of 22 +/- 4 (range 20 - 47 years)

At Time 2, 14 participants were interviewed, there were 10 females, with an average of 22 +/- 1 year (range 20 to 23).

I think it is important to give characterization as to their workplace or work setting. This could give a better context of the succeeding discussion of results.

Table 1 can be further improved for easy reading. Separate the cells for Change “findings”; one cell each for raw score difference, p-value and effect size. You can also put as footer for the table, the meaning of Time 1 (completion of entry-level training) and Time 2 (one year working?). The title of table can also be improved. It should be able to answer the following; what is being presented? how is the data classified? Indicate number of data/participants. It might help if you look at other tables

Figure 1 is a good illustration to show the change. It could be more informative if the data re: ES, p-values be shown there as well. Eg. Relevance (p-<.001, ES = .69)

Lines 207-209. Elaborate and describe a bit more what happened to the maximum domain scores. i believe this could be better situated and described under data management and analysis.

QUALITATIVE

I think the results should answer the aim or objective of the research as indicated in the background; "To explore the changes in EBP knowledge, attitudes and behaviors from graduation to one year in workforce of a cohort of physiotherapists."

Therefore, just present the themes gathered that best represents this aim. It is unnecessary to discuss how the other categories will be treated if it has nothing to do with the current paper. I think this adds to confusion and questions regarding the paper.

I would suggest further improving your table that shows qualitative findings. Tables are meant for the reader to see at a glance the most significant findings of a study. Having 12 pages of this makes it difficult to do that.

My suggestion…include samples of quotations from the respondents in the text instead of put them on the table. For the table, you may reformat to just include the themes and sub-themes.

Example:

Example in text:

Most participants reported using EBP skills and knowledge in their first year to inform their clinical reasoning, empower clients with knowledge or learn from the clinical expertise of experienced colleagues. Some example to attest to these are:

"So I’ve seen a few patients that I was having trouble with, searched some evidence, had a look at some new treatment techniques and stuff like that and obviously searched if they were significantly… sort of if they were going to work and tried them clinically and they did

work, which was very helpful." (Participant 14 for informing clinical reasoning)

"Look I’ve had a few patients that they may have been a little bit apprehensive about some of the treatments that we use but then we sort of explain to them about the evidences behind it and it really does help them to feel confident in what we’re doing and that we’re not

just doing some sort of weird treatment, that we actually have got evidence behind it and we’ve done research into it." (Participant 56, Empowering patients)

When using this format, the reader is easily referred to sample quotations without having to go back to the table.

This is a suggestion. There may be other ways to improve this. The main goal is to make the table an easy reference point.

DISCUSSION. (No line numbers in this part)

Paragraph 2.

Most of the ideas presented in this paragraph pertaining to relevance needs to be elaborated on. For example, the concept that since there is a large quantity of MS research then it is perceived to be more relevant? What is the basis for saying this? Similarly the sentence/concept related to wider health care system and funding model of direct care need explanation and elaboration to better understand how this is related to decrease in Relevance domain of physios in the workplace. Finally the last concept there on competing demands of improving clinical skills…etc. needs further explanation on how it affected perception of relevance for EBP.

Paragraph 3. On reduced confidence.

Improving sentence construction of this could help in delivering the message clearly.

Eg. The overall decline in the Confidence domain of the participants may have been influenced by their reported barriers to use EBP. These barriers would lead to less frequent practice of looking up evidence and thus possibly decrease confidence. Similarly, McEvoy’s study showed that….

You mentioned that McEvoy [13] study did not use qualitative data to explore…how then do you think your data is better or different from this study and how does this current study better explain the decrease in confidence?

Paragraph 4. on workplace culture.

Shifting to an active voice could better deliver the message. Ex.

Results of this study indicate that a workplace culture that values research evidence strongly supports EBP use and helps in maintaining/improving ? confidence. Some of the practices that cultivate this culture include….(state here).

Paragraph 5. Transition to workplace

Is this all about PEAK? Maybe just give a summary of what this is about and then provide your own insight about this? Maybe there are other options?

Paragraph 6. Recommendations.

It might be helpful to organize your thoughts for this…recommendations in education and recommendation in practice? (you referred to this in your introduction, line 77). Did the data lead you to believe that improvement in EBP education in entry-level could help maintain the Profile domain scores? You mentioned that there are several recommendations to be considered but actually only mentioned the ‘re-fresh’ training. It might help if you outline the recommendations and discuss each.

Paragraph 7. Limitations.

No need to state strengths, just disclose limitations. I question your second limitation; "of using descriptive thematic analysis and not allowing for rich in-depth exploration of the findings”. Your purpose for collecting qualitative data is to gain a deeper and broader understanding (line 94-95). You further described the use of an interpretive paradigm to allows rich description of lived experiences. Your description of qualitative data analysis emphasized an iterative approach to make sure that nothing is left undiscussed and undecided. Yet you say that this is not a rich in-depth exploration of the findings? This limitation does not follow through with your intention in using qualitative analysis.

Your third limitation also puts to question the validity of the quantitative data. What is the objective of your study? Did you aim to determine how these factors influence the data? (I mentioned that you should also include an objective for your quantitative arm in the introduction).

CONCLUSION.

This part should go back to the research questions/ or research objective as stated.

One year into working, physiotherapists showed decline in all EBP profile domains, most signicantly for…. In the first year of work, the participants experience of EBP revolved around the themes of…

Reviewer #2: This is a well written manuscript with the authors evidencing their expertise and research capacity spanning many years in evidence-based practice and development of EBP competences for entry level health professionals. The authors ask an interesting question: do perceptions of evidence based practice change during the transition from physiotherapy student to entry level clinician? This is an important topic as EBP is now a core component and often statutory requirement in entry level professional programmes but whether and how effectively this translates to autonomous professional practice is not clear.The authors adopt a mixed methods approach to allow broad insight in this area.

It would however, be beneficial to identify for the reader whether a convergent or sequential (explanatory/exploratory) design was taken for this mixed methods approach. This would help to situate the qualitative work better in the study design. While the qualitative methodology describes a staged inductive approach to thematic analysis, the descriptive approach used to report results leads to many (maybe too many) sub-themes which tended to match back to the questions asked. To this end it would be helpful to know more about the design of the question schedule and whether the quantitative data findings informed this process. Overall descriptive thematic analysis would not be my preferred choice as the results generating 9 themes with multiple sub-themes made for lengthy and difficult reading with limited meaningful synthesis to take away. In the qualitative results table some participants are labelled xx and this needs to be addressed to assure fidelity of data.

With respect to the quantitative study, more detail relating to the data (sd etc) and sources of this data used in the power calculation would be helpful for readers. The authors highlight that the EBP questionnaire which uses Likert scales would be treated as interval data, however the same information and justification for parametric testing of the K-REC instrument is not provided. Similarly in the reported results, it would be better to address the K-REC results separately as it is a different construct with different psychometric properties to those in the EBP profile questionnaire.

The discussion section adopted a very narrow approach to the findings, lacking higher level discourse which was disappointing. In fact only two new references to the literature were introduced at this stage. Acknowledging the paucity of studies directly related to this research question, I would have expected to see a wider discussion in relation to the qualitative literature addressing transitioning to professional practice following graduation and similarities with the findings in this study. Similarly, I would have expected reference to stages of learning as novice, advance beginner, proficient, competent, and finally expert where ones does see greater confidence in novices than beginner/proficient learners as recognition of contextual factors and greater insight into deficits in knowledge become more apparent.

One minor consideration that was confusing was that in the intro pg4 line 65 they cite McEvoy et al [13] as providing workplace transition qualitative data and in the discussion paragraph 3 they cite the same study as providing longitudinal data that lacks qualitative insights.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Olive Lennon

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Dec 21;15(12):e0244190. doi: 10.1371/journal.pone.0244190.r002

Author response to Decision Letter 0


31 Oct 2020

1. The authors have attempted to ensure the manuscript meets PLOS ONE's style requirements, including those for file naming.

2. Data availability has been complied with. Data not included within the manuscript, has been provided in Supporting Information

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Catherine M Capio

7 Dec 2020

Changes in physiotherapists perceptions of evidence-based practice after a year in the workforce: a mixed-methods study

PONE-D-20-07294R1

Dear Dr. McEvoy,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Catherine M. Capio

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This version of the manuscript now shows coherence of the objectives, methods and discussion. It is well-written such that it is easy to understand and follow. After reading the manuscript, I reviewed the comments I had previously given and the authors were able to adequately respond and act on them. Congratulations to the authors for this work!

Reviewer #2: I am satisfied that the authors have adequately addressed the reviewers' comments and the manuscript is improved.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Olive Lennon

Acceptance letter

Catherine M Capio

11 Dec 2020

PONE-D-20-07294R1

Changes in physiotherapists’ perceptions of evidence-based practice after a year in the workforce: a mixed-methods study

Dear Dr. McEvoy:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Catherine M. Capio

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Semi-structured interview guide.

    (DOCX)

    S2 Appendix. Quantitative dataset.

    (PDF)

    S3 Appendix. Coded interview dataset.

    (XLSX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES