Abstract
Objectives
The objectives of this study are to (1) identify Graduate Public Health (GPH) programmes with an integrated practicum, (2) determine current practice for practicum design and (3) use the information to make recommendations to inform the design of Public Health Graduate programme practicums.
Design
Scoping review.
Data sources
Academic Ranking World Universities 2019 was used to identify top 10 institutions in each geographical hub offering GPH programmes. Each GPH programme website was searched for practicum information.
Eligibility criteria
GPH programmes offering a practice-based component as a requirement in their curriculum.
Data extraction and synthesis
One reviewer screened GPH websites for eligibility and extracted data. Verification of data for accuracy and completeness was done on 10% of the sample by the second author. Data were compiled into an Excel file and were analysed to describe the duration, timing, credit, contact hours, preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component.
Results
Out of the 108 GPH programmes screened, a total of 35 programmes were included. There was a significant variation in required practicum duration ranging from 4 to 16 weeks. Only 31% specifically outlined prerequisites to be completed before the initiation of the practicum. More than half (57%) had a published list of core competencies. A majority of practicum did not provide criteria for appropriate preceptors (63%) and their responsibilities (66%). All programmes listed assessment criteria however the majority (57%) did not specify if the practicum was graded or a for-credit component.
Conclusions
The integration of practical components into curricula is inconsistent. This research resulted in 14 recommendations intended to guide GPH practicum design. We propose that this study be used as a tool to spark a global dialogue about best practices in GPH education through the identification of common practices and opportunities for improvement.
Keywords: public health, medical education & training, epidemiology
Strengths and limitations of this study.
The major strength of this review is that it is based on a global sample of graduate public health programmes, allowing for a global perspective on the current practices in Public Health Graduate programme design.
The information collection was restricted by what was publicly available on programme websites. We acknowledge this as a potential source of bias. Given that the information in the public domain is under the control of the academic programmes and not subject to peer-review, the assumption was made that the details were accurate and up to date.
Programmes were identified based on the Academic Ranking World Universities. This ranking is based on factors that is related public health research outputs. These factors are not related to the quality of practice-based component as a requirement in their curriculum.
The sample was limited to programmes offering information available in English which led to the exclusion of institutions in Central and South America.
Background
Public health is increasingly moving to the forefront of graduate education within the health sector. As many of the relevant educational entities have begun the slow shift to an integrative approach to care, competency in public health is now being recognised as critical to success in many healthcare fields as new members enter the workforce.
Over the past 20 years, the model of graduate education in public health has undergone multiple stages of development. Best practices have rapidly diverged from the traditionalist dialectical teaching approach towards one placing more emphasis on student-led learning in competency-based educational models.1 As an example, for certain institutions affiliated with the Council on Education for Public Health (CEPH)2 or the Public Health Agency of Canada (PHAC),3 accreditation is contingent on all Masters of Public Health (MPH) students completing a practicum. Capacity building has been the primary motivation behind these changes.
While relatively new to public health education, the value of experiential learning in education is well described in the literature relating to other allied health fields such as medicine, nursing and social work.4–6 Akin to these sectors, public health occurs primarily in the field and it has been demonstrated that experiential learning is critical to capacity building in public health education.7–9 Practice-based learning puts theory into action, allowing students to work towards competency development through the application of theoretical knowledge to real-world issues. These mentored experiences are also critical to career development, providing unique opportunities to develop professional networks, gain experience in different work-environments and collaborate with others in the field of public health.10 This model builds on the traditional research-focused thesis paradigm towards one of implementation science, where the new generation of public health practitioners are supported to develop interdisciplinary skills for multisector engagement to move from research to action.9 11
The growing integration of practice-based learning into graduate public health (GPH) curricula signals a divergence from the traditional education model. Many GPH institutions are beginning to capitalise on this by offering programmes with the option of a thesis-based or practice-based culminating project. That being said, there is significant variation in the method of integrating an experience-based component into the curriculum. Multiple different terms are used including practicum, internship, applied practical experience (APE), culminating experience, field placement, residency and professional placement, to name a few. There is meaningful diversity here. However, practicum-based programmes are still not the norm, especially in Europe. This is evidenced by the vast majority of globally ranked institutions in the region continuing to offer only thesis-based programmes, with no practice-based element required. While this approach may have once served a research-driven culture of healthcare, the future of public health education lies in practice to action.
When considering the design of public health programmes going forward, we hoped to answer the research question ‘what are the current best practices in GPH education?’ The objectives of this review are to (1) identify leading GPH programmes with an integrated practicum, (2) determine current practice for practicum design through a global lens and (3) use the information to make recommendations to inform the design of public health graduate programme practicum.
Methods
This scoping review of GPH programmes was conducted by adopting a methodological framework first described by Arksey and O’Malley12 and later refined by Levac et al.13 As our inquiries were focused primarily on ‘grey literature, we chose this methodology given that research indicates it is particularly useful for ‘reconnaissance’ into subject matter that has not yet been comprehensively reviewed.14–16 The steps include (1) identifying research questions, (2) identifying all relevant programmes, (3) selecting significant programmes, (4) charting the relevant data and then (5) summarising and reporting the results. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Scoping Reviews (PRISMA-ScR) checklist report was completed to ensure all measures were achieved.
Purpose
The purpose of the research is to review the structure of GPH practicums using a globally diverse sample to identify common themes and inform current practice for practicum design moving forward.
Search strategy
Data collection for this research was entirely web based. As described in more detail below, potential programmes were identified using online university ranking systems and were then stratified by geographical region into ranked lists. To be included in the sample, GPH programmes must incorporate a practice-based component into the curriculum. In some instances, the regionally top 10 ranked GPH programmes did not include a practice-based component. As such, the goal was to create a sample representing the top five practice-based GPH programmes in each of the regions identified.
Identifying relevant programs
The goal in data collection was to create a globally descriptive sample of GPH programmes offering a practice-based component as a requirement in their curriculum. Top-ranked GPH programmes were divided based on continental hubs to ensure a geographically diverse sample. The hubs included were Africa, Asia, Australia, Canada, European Union, South America, UK and the USA. Examination of databases created by World University Ranking 2019 (WUR) and Academic Ranking World Universities 2019 (AWRU) identified the top 10 (ranked) institutions in each geographical hub offering GPH programmes. It should be noted that initial database queries were done using both WUR and AWRU. However, WUR ranking focused at the university level as compared with AWRU, which ranked the GPH programmes themselves as opposed to the university as a whole. Due to the specificity of the search parameters, we chose to focus our search on the AWRU system, although there was significant overlap between the two algorithms. AWRU methodology of subject ranking is mainly based on public health research outputs rather than the components of the programme or the curriculum. To be included in the public health subject ranking, the universities need to have a minimum of 200 publications during the period of 2014–2018. Universities are then ranked based on five indicators: (1) Q1 is the number of papers published in Q1 Journal Impact Factor Quartile, (2) Category Normalised Citation Impact, (3) Publications with International collaboration, (4) The number of papers published in Top Journals and (5) The number of the staff wining a significant award.
Selecting the programmes for inclusion (eligibility criteria)
Phase two screening and subsequent data collection was based on global AWRU GPH programme rankings for each respective geographical region. The AWRU was used as a framework to systematically assess the programmes offered, starting with the highest-ranking region. Any of the top-ranked GPH programmes not requiring a practice-based component in the curriculum were excluded from the sample. Programmes were also excluded if a practice-based component was mentioned but the information was unavailable through (1) university website, (2) programme website, (3) student prospectus, (4) graduate handbook, (5) student guide or (6) practicum guide. Search parameters are outlined in a PRISMA-ScR chart (figure 1).
Figure 1.
PRISMA-ScR flow diagram outlining the process of public health programme selection for the sample. The PRISMA-ScR diagram details our search and selection process applied during the research. PRISMA-ScR, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews.
Information sources
The university website, programme website, student prospectus, graduate handbook, student guide and practicum guide of each selected university were searched for available information about the practice-based component.
Search
The following keywords were used for the search: Practicum, workplace practicum, APE, internship, practice internship, residency, placement, professional placement, project in public health, pathways to public health in the workplace, community placement, professional practice, professional project, field study or field work.
Data charting process
Information about the programme and the practice-based component was downloaded and stored in a series of electronic files. To collect data systematically, an electronic abstraction proforma was created in Excel. Information on each practice-based component was reviewed and the data was entered into a master file comparing all the selected institutions based on domains of interest. The lead author was mainly responsible for screening the programmes using the inclusion and exclusion criteria. The second author performed verification of data for accuracy and completeness on 10% of the sample. All the coauthors had meetings at regular intervals during the review process to discuss the emerging results, and to resolve any issues arising in the search process.
Sample
We screened 108 GPH programmes. Our search strategy yielded 40 GPH programmes representing all continents across the globe. Due to lack of translation support at the time of data collection, 5 schools in Chile, Brazil, Mexico and Puerto Rico were excluded, leaving 35 GPH programmes in the sample.
Data items
Data were collected on the duration, timing, credit and contact hours of the programme practice-based component, as well as data on preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component. This study was considered exempt from institutional ethical board review as it did not involve human subjects.
Synthesis of results
Data were compiled from available online sources and collated into an Excel file. Descriptive statistics were computed for each study variable and are presented in the following section.
Patient and public involvement
Patients or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.
Results
Characteristics of Public health programmes reviewed
Data were collected on the duration, timing, credit and contact hours of the programme practice-based component, as well as data on preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component.
As seen in table 1, the programmes included in the sample compose a snapshot of a variety of accrediting bodies that GPH programmes may affiliate with. Of the sample institutions with accredited programmes, the majority (n=6) received accreditation through CEPH, while others maintain accreditation through Agency for Public Health Education Accreditation (APHEA) (n=3), Netherlands Flemish Accreditation Organisation (n=2) as well as International Union for Health Promotion and Education, Training Programme in Epidemiology and Public Health Interventions Network and several national ministries of education (collective n=4). The majority of the programmes were not accredited (n=20, 57%). In terms of overall programme structure, programme duration followed a bimodal distribution, with 34% of programmes requiring a minimum of 12 months for completion and 66% requiring 13–24 months.
Table 1.
Characteristics of universities reviewed (n=35)
Characteristic | No | Percentage |
Geographical region | ||
Africa | 5 | 14 |
Asia | 5 | 14 |
Australia | 5 | 14 |
Canada | 5 | 14 |
European Union | 5 | 14 |
UK | 5 | 14 |
USA | 5 | 14 |
Accrediting body | ||
Council on Education for Public Health | 6 | 17 |
Training Programme in Epidemiology and Public Health Interventions Network | 1 | 2.75 |
International Union for Health Promotion | 1 | 2.75 |
Agency for Public Health Education Accreditation | 3 | 9 |
Netherlands Flemish Accreditation Organisation | 2 | 6 |
Ministry of education | 2 | 6 |
No accrediting body | 20 | 57 |
Programme duration | ||
12 months or less | 12 | 34 |
13–24 months | 23 | 66 |
Structural characteristics of GPH practicums
Prerequisites and practicum scheduling
Approximately one-third of the programmes evaluated (n=11, 31%) specifically outlined prerequisites to be completed before the initiation of the practicum. The remainder of the programmes (n=24, 69%) did not list prerequisites in any of the available course information. However, some of these schools may have accounted for that omission through the practicum schedule. The majority of programmes (n=24, 68%) stipulated that the practicum could only take place after a minimum of two terms were completed (ie, summer semester in 12-month programmes, semester three or four in 16–24 months programmes).
Practicum contact hours and duration
As seen in table 2, there was significant variation in required practicum duration with a range measured both in hours or weeks depending on the institution. For placements measured in hours, two (6%) of the practicums were in the range of 50–100 hours, four (11%) were in the range of 101–200 and one (3%) was in the range of 201 or more hours. For placements measured in weeks, three (9%) were between 4 and 8 weeks, nine (26%) were between 9 and 12 weeks and 6 (17%) were between 13 and 16 weeks. Ten (28%) of the practicums did not have a defined time requirement.
Table 2.
Structural characteristics of GPH practicums reviewed (n=35)
Characteristic | No | Percentage |
Prerequisites required before practicum initiation | ||
Prerequisite courses required | 11 | 31 |
Prerequisite courses not listed | 24 | 69 |
Timing of practicum scheduling | ||
Semester 2 | 3 | 9 |
Semester 3/summer | 13 | 37 |
Year 2 | 11 | 31 |
Variable term/undefined | 8 | 23 |
Practicum duration | ||
50–100 hours | 2 | 6 |
101–200 hours | 4 | 11 |
201 or more hours | 1 | 3 |
4–8 weeks | 6 | 17 |
9–12 weeks | 9 | 26 |
13–16 weeks | 6 | 17 |
Practicum duration not defined | 10 | 28 |
Contact hours | ||
Stated minimum number contact hours only | 6 | 17 |
Stated minimum and maximum number contact hours | 2 | 6 |
Contact time measured in weeks | 17 | 49 |
Contact time not specified | 10 | 28 |
Credit hours | ||
No credit hours for practicum | 1 | 3 |
Fixed number of credit hours for practicum | 32 | 91 |
Practicum credit hours not provided | 2 | 6 |
Ratio of credits to overall degree | ||
No credit hours for practicum | 1 | 3 |
1%–10% overall credits | 8 | 22 |
11%–20% overall credits | 15 | 43 |
21%–30% overall credits | 3 | 9 |
31%–40% overall credits | 5 | 14 |
Information unavailable | 3 | 9 |
GPH, Graduate Public Health.
In terms of contact hours, a significant portion of the institutions reviewed (49%) did not specify the number of contact hours to be completed within a set duration placement duration measured in weeks. Additionally, over a quarter of programmes (28%) did not specify a required contact time at all. Of those that did specify a finite number of contact hours (23%), six stated only the minimum number of contact hours required whereas the other two gave both the minimum and maximum hours required.
Credit hours and overall credit weighting
As seen in table 2, one, (3%) of the practicums reviewed did not earn any credit hours and two (6%) programmes did not provide a credit-hour equivalency for the practical component in the course information. The vast majority (91%) of practicums reviewed had a fixed number of credit hours associated. The units of measurement of the credit hours were varied but included credits, credit hours, weighted marks and European Credit Transfer System credits.
GPH practicum domains
In addition to analysing the operational elements of practicum design, data collection also focused on core domains including (1) competencies, (2) supervision, (3) written agreement and objectives and (4) assessment.
Competencies
As seen in table 3, more than half (n=20, 57%) of the GPH programmes reviewed had a published list of core programme competencies. The competencies associated with programmes offered by the North American institutions are derived from national standards developed by CEPH and PHAC. In other centres, core competencies were institution specific. The remainder of the sample (n=15, 43%) did not list programme competencies.
Table 3.
Domains of GPH practicums reviewed (n=35)
Domain | No | Percentage |
Competencies | ||
Core competencies | ||
Core public health competencies listed | 20 | 57 |
Core public health competencies not listed | 15 | 43 |
Practicum-specific competencies | ||
Practicum-specific competencies defined | 8 | 23 |
Practicum-specific competencies referenced, undefined | 1 | 3 |
Practicum-specific competencies not listed/missing | 26 | 74 |
Supervision | ||
Practicum supervisor criteria | ||
Stated criteria to define appropriate supervisor | 13 | 37 |
No criteria listed to define appropriate supervisor | 23 | 63 |
Practicum supervisor responsibilities | ||
Stated responsibilities of practicum supervisor | 12 | 34 |
Did not state responsibilities of practicum supervisor | 23 | 66 |
Written agreement and objectives | ||
Written agreement | ||
Written agreement required | 14 | 40 |
Written agreement not referenced | 21 | 60 |
Practicum objectives | ||
Objectives included in the written agreement | 12 | 34 |
Objectives not included/unclear if in written agreement | 2 | 6 |
Practicum objectives defined | 29 | 83 |
Final deliverables (multiple per programme) | ||
No requirement | 0 | 0 |
Oral presentation | 13 | 37 |
Written report | 17 | 49 |
Portfolio/reflections | 3 | 8 |
Poster/abstract | 5 | 14 |
Practicum-specific deliverables | 16 | 46 |
Not listed/unclear requirement | 6 | 17 |
Assessment | ||
Assessment Intervals | ||
Pre-practicum (learning agreement) | 14 | 40 |
Mid-practicum | 9 | 26 |
Postpracticum | 21 | 60 |
Assessment information not available | 9 | 26 |
Final grading system | ||
Pass/fail | 8 | 23 |
Letter grade | 7 | 20 |
No grade/unclear | 20 | 57 |
GPH, Graduate Public Health.
In addition to programme-centred competencies, several centres also defined practicum-specific competencies. Eight (23%) of the practicums had clearly listed competencies that guided the development of the practicum deliverables and one (3%) referenced practicum-specific competencies without further definition of their content. However, for the majority of practicums (74%), no practicum specific was included in any of the course guidelines available. It is unclear if these programmes had not developed practicum-specific competencies or if they were not listed in the available programme documentation.
Supervision
As seen in table 3, institutional oversight into practicum supervisors occurred at several levels, both through the definition of eligibility criteria and supervisory responsibilities. Approximately one-third (37%) of practicums had stated criteria used to define appropriate preceptors as outlined in table 4, whereas the majority (67%) did not provide criteria or the information was not listed. A similar proportion of programmes (34%) clearly stated the responsibilities of the supervising preceptors, but the majority (66%) did not.
Table 4.
Practicum supervisor requirements (n=13)
Criteria defined | No | Percentage |
Expertise in project area | 5 | 38 |
Experience and status within the organisation | 5 | 38 |
Interest and competence in supervising and mentoring | 5 | 38 |
Professional credentialing | 8 | 62 |
3–5 years experience with advanced master or doctoral degree | 1 | 8 |
10 years experience with bachelor degree or equivalent combination of education and experience | 4 | 30 |
MPH or master degree in the related field | 1 | 8 |
MPH, Masters of Public Health.
Written agreement, objectives and deliverables
Over one-third (40%) of the programmes required a written agreement to be in place before the student could begin working on the practicum. This was a universal requirement in the North American programmes (n=10), however, approximately two-thirds of programmes in the sample (60%) did not reference any form of written agreement as a requirement for the practicum. In terms of practicum objectives, the majority of programmes provided a defined list (83%), however, only one-third (34%) of institutions reviewed contracted these objectives into a learning agreement. All of the practicum written agreements outline some specific deliverables to be completed and used as part of the assessment metric. The majority (83%) required students to submit or present a product at the completion of the practicum. Of all 35 practicums reviewed, 6 (17%) had no stated final deliverables, 3 (8%) required a portfolio or reflection, 5 (14%) required a poster or abstract, 13 (37%) required an oral presentation, 16 (46%) required ‘practicum-specific deliverables’ and 17 (49%) required a written report. It should be noted that one practicum may have had a combination of multiple deliverables required.
Approach to assessment
As seen in table 3, of those practicums which listed the grading information, eight (23%) were graded on a pass/fail basis and seven (20%) were evaluated using a letter grade system. All programmes listed assessment criteria, however, the majority in this sample (57%) did not provide specify if the practicum was graded or a for-credit component. The majority of the practicums (74%) had defined assessment intervals with 40% requiring a preplacement assessment, that is, learning agreement, 26% requiring an interim assessment and 60% requiring a postplacement assessment. Assessment information was not available for nine (26%) programmes.
Definitions and terminology
As seen in table 5, the language used to describe the ‘practicum’ component was quite diverse across all the GPH programmes assessed. The term practicum or workplace practicum was most common (40%), the internship was the next most common term (20%) and placement was also used by several programmes (8%). Other less commonly used terms include Applied practical experience, residency, professional practice or project and field work.
Table 5.
Descriptive terminology for practical placements (n=35)
Terms used | No | Percentage |
Practicum/workplace practicum | 14 | 40 |
Applied practical experience | 2 | 6 |
Internship/practice internship | 7 | 20 |
Residency | 2 | 6 |
Placement/professional placement | 3 | 8 |
Project in public health | 1 | 2.75 |
Pathways to public health in the workplace | 1 | 2.75 |
Community placement module | 1 | 2.75 |
Professional practice | 1 | 2.75 |
Professional project | 1 | 2.75 |
Field study/work | 2 | 6 |
Discussion
When considering the design of public health programmes going forward, it is important to review recent developments to establish current best-practice in GPH education.
Challenges
Practical placements are extremely beneficial to students,10 17 as evidenced by their integration into many of the leading public health masters' programmes worldwide. However, this review demonstrated significant variation in practicum design, use of guidelines, and accreditation between the programmes reviewed. Overall, there were several interesting trends identified in the data that warrant further discussion.
Practicum design
Many of the programmes included in this review in Europe were thesis based. These programmes have not yet progressed to incorporate a mandatory practice requirement into their education model when the evidence indicates the many benefits of practicums.
Although practicums are becoming more ubiquitous in GPH education, there is significant variation in the methods by which academic institutions integrate a practice-based component into their MPH programmes. In the North American, context design is highly regulated, where CEPH and PHAC have issued explicit guidelines that dictate the design of GPH practicums. However, the public health community has yet to develop a clearly defined and globally accepted set of guidelines outlining a superior practicum scheme that gives students better experience and prepare them for their career, in addition to meeting the needs of the communities being served and the people they intend to educate. In this way, practicums are being used as a response to the need for social accountability in health professional education.18 19 While this variation poses a logistic challenge to implementing quality measures in public health education, it also emphasises the need to integrate flexibility into programme design to ensure the needs of both students and communities served are being met.
A current example of emerging innovation in GPH practice-based education is the virtual practicum. It has been suggested as a pioneering solution to meet the needs of GPH students in distance learning programmes or those who are pursuing a GPH in parallel with an existing career.20 In the era of COVID-19, we anticipate programmes will face increasing challenges with in-person practicum placements and that exploration of virtual or blended practicum models should be prioritised. While the virtual practicum design is not yet widely integrated into GPH practicums on a global scale, it is reasonable to anticipate that this approach will become more commonplace in years to come.
Practicum design guidelines
Another finding of note relates to the global variation in guidelines for practicum design. Some institutions are operating off a national standard that defines the required elements of a practice-based experience,2 3 but many are not. Likely, the diversity of ‘practicum types’ encountered in this review is due in large part to the regional variation in design standards. For example, institutions in North America follow clear guidelines set out by CEPH and PHAC and GPH programmes. Institutions in India follow a national set of recommendations that inform practicum design. Conversely, the majority of programmes in other settings seem to rely on community needs or working group recommendations to guide the practicum design. Based on our review, it is unclear if creating an ‘international standard’ is feasible as there is such diversity in educational needs.
Accreditation
Accreditation often provides a clear set of guidelines defining the expectations for programme design. There are multiple accrediting bodies, some being public health institutions and others general education institutions, operating both at national and international levels. It is reasonable to infer that institutions being accredited by public health bodies have programmes that are more specifically tailored to the needs of public health education as opposed to those that are not. However, the majority of programmes reviewed were not accredited. This variation in accreditation status raises the question of the necessity of guiding principles in practicum design. Perhaps an interesting example to consider is the Canadian context. In Canada, the majority of programmes are not accredited however they are required to meet the MPH practicum guidelines as defined by PHAC. This effectively has the same outcome as following criteria set by an accrediting body. Currently, it is unclear if universal accreditation would be useful for GPH programmes given the profile of the diverse needs of the global community.
Current practice
Our comprehensive review of GPH practicum designs around the world have informed the development of an initial framework of recommendations based on current best practices (table 6). The following discussion will focus on the elements identified as critical when considering the design of a GPH practicum.
Table 6.
Relationship between competencies, objectives and deliverables in practicum design
Competencies | Competencies are the central knowledge, skills and attitudes necessary for the public health workforce to practice effectively and achieve the core functions of public healthcare. Competencies define aptitudes or educational outcomes students must acquire on completion of a GPH programme. |
Objectives | Objectives are actionable goals developed by the student in conjunction with the onsite practicum supervisor and university-based practicum coordinator. Objective development is based on educational outcomes defined by the programme’s core competencies. |
Deliverables | Deliverables are tangible work products created by the student during the practicum. Deliverables are informed by objectives that are developed based on competencies. |
GPH, Graduate Public Health.
Learning contract
The learning contract (LC) is a crucial element to the success of a practicum. The LC is a memorandum of understanding between the student, academic institution and host institution that defines the objectives, expectations and deliverables necessary for successful completion of the placement.21 Practicums are often structured differently, as we have seen in our sample and there can be significant variation in the objectives defined and competencies assessed. Nonetheless, a well-designed LC is a key to the success of any practicum. The goal is to translate required competencies into specific objectives that will result in deliverables the student will be able to produce during their practical placement. Well-defined, specific practicum guidelines and objectives should be developed internally, based on competencies established by the university and any relevant accrediting body. Agreement on objectives is essential, not only for the students but also host institutions, to ensure the practicum is beneficial to all parties involved.22 In addition, the roles and responsibilities of each partner must be clearly delineated in the LC. This includes a specific agreement about honoraria, data ownership, research products and authorship of publications.
Prerequisite competency training
GPH programmes should communicate the requirements to students to be prepared to undertake a practicum. We found that some programmes clearly state the prerequisites, while in others it is inherent in the programme schedule. This was a point of interest identified in our review. It highlights the institutional assumptions being made regarding the ethical competence of students. While many programmes emphasise prerequisites that focus on epidemiology and biostatistical analysis, there is little emphasis on the need for ethics training in practicum-based programmes. This is in contrast to thesis-based programmes which consistently integrate the need for ethical approval of research projects into the project authorisation process. There is also a need for training on professionalism, business etiquette and workplace savvy as a prerequisite competency training.
Competency-based training
Institutions must define the public health competencies that their graduates will attain following programme completion. Some programmes reviewed define key competencies based on frameworks created by an accrediting body such as CEPH, PHAC or APHEA,2 3 23 while others developed competencies based on internal standards. It should be noted that while the specific competencies assessed varied, there were consistent themes between accredited and non-accredited institutions. Once competencies are outlined by the institution, best practice is to create practicum objectives. Objectives are actionable goals developed by the student in conjunction with the onsite practicum supervisor and university-based practicum coordinator. Objectives can then be used to inform the development of specific practicum deliverables, that is, what the student will achieve during the practicum placement (table 6). The current best practice is consistent with the literature in requiring that deliverables are (1) of use to the host institution and (2) meet the criteria determined by the competency-based practicum objectives.24 While competency acquisition can be difficult to assess, the LC is a key tool that can be used to measure a student’s competency development throughout the programme and practicum.
Practicum supervisor requirements
The definition of supervisor requirements is another area that must be addressed in the design of a new GPH practicum. A clear definition is essential to ensure that practicum supervisors (1) are qualified to supervise, (2) have the skill set necessary to be a public health mentor and (3) have the capacity to evaluate students’ competency attainment. Many of the institutions reviewed reference the need for a preceptor, and some outline specific qualifications necessary. However, the challenge in this area is that qualifications may be highly practicum specific, with extensive variation in qualifications between medicine, epidemiology, community intervention and programme evaluation. For this reason, many programmes have very vague supervisor requirements, stating that preceptors must be ‘experts in their field’. It is clear that supervisors must be qualified and that the requirements must be well defined such that a potential supervisor can be made aware of the expectations around their role in guiding the student through the practicum process. We recommend that institutions define supervisor requirements in a general sense, as seen in many of the North American centres reviewed. In this way, centres allow for variation in supervisor experience while ensuring that each is qualified to provide project-specific support/oversight to a student in the field.
Effective mentorship and evaluation
Open communication and continuous student feedback are critical to the success of practical placements. This emphasises the importance of the role of the practicum supervisor and the need for continuous assessment.25 26 The supervisor plays a dual role in the practicum, both as a mentor and evaluator.27 It is the responsibility of the supervisor to work with the student to ensure that they are operating within the scope of their LC and can complete any stated deliverables within the time frame agreed. We recommend conducting periodic evaluations of the students and the placement to assess if the practicum is an appropriate tool to facilitate competency building as required by the programme.28 Besides, as the evaluations must be tailored to fit the design of the practicum, it is recommended that both short and long-term assessments are completed from multiple perspectives. While evaluation of student performance is essential to competency development, it is equally important that students are able to assess their supervisors and remain in contact with their home school throughout the practicum should they need support. This emphasises the importance of the role played by the practicum coordinator. The coordinator is a designated faculty member whose role, among other things, is to ensure the lines of communication between student and institution remain open for the duration of the practicum. Based on our review, the use of periodic evaluation is commonplace in current practicum designs. Also, many programmes reviewed required assessments to be carried out by key stakeholders (students, supervisors, host organisation) at mid and final term. These assessments should evaluate both the placement and the student performance.
Strengths and limitations of this study
The major strength of this review is that it is based on a global sample of GPH programmes, allowing for a global perspective on the current practice in public health graduate programme design. As this has not been done before, this work may serve as an initial foray into the evaluation of global trends in the GPH educational approach. The information gathered has been used to design a proposed set of recommendations to guide future practice. This review can also be used to identify areas in GPH programme design that could benefit from further evaluation.
There were several limitations in this review. Foremost among them, information collection was restricted by what was publicly available on programme websites. We acknowledge this as a potential source of bias. Given that the information in the public domain is under the control of the academic programmes and not subject to peer-review, the assumption was made that the details were accurate and up to date. Besides, programmes were identified based on world ranking systems. While these systems operate off specific methodologies, it is likely discrepancies exist between the assessment algorithms which could easily lead to incompletely representative sampling. Furthermore, only the highest-ranked five programmes with practicum component from each hub were included. This implies that only top-ranked programmes have best practices which may not be the case. In addition, the sample was limited to programmes offering information available in English which led to the exclusion of institutions in Central and South America.
Conclusions and recommendations
In 2008, Cashman and Seifer29 described practice based or experiential learning as ‘an effective and appropriate vehicle for teaching public health and developing public health literacy’. After over a decade of development in public health education, this was an opportunity to revisit the statements made in 2008 and reflect on the degree to which we have to be able to align public health education with competency building through practice. The goal in undertaking this review was to develop a deeper understanding of the current practice in GPH programme design, relating to the structure of the practice-based component.
This analysis offers a description of current global best practices in practicum design for GPH education. We have shown that there is meaningful variation in the approach to GPH practicum design, with a significant proportion of the leading public health education centres across the world emphasising the practical elements of training. This speaks to the growing value of practice-based training in the global public health community.
Currently, there are no global criteria that define the key elements necessary to guide the design of successful GPH practicums. While variation is expected given the different needs profiles seen in a global context, we feel that a general set of guidelines could be beneficial to ensure programmes are all meeting a high educational standard.
Based on our review of current best practice, we have developed a set of fourteen recommendations intended to guide the development and design of GPH programme practicums:
Design
Develop clear practicum prerequisites in order to ensure students are equipped with sufficient ethical and theoretical background knowledge to complete a practicum placement.
Schedule the practicum after the completion of practicum prerequisites, that is, second term.
Develop a learning contract, that is, a memorandum of understanding between the student, academic and host institutions that define the objectives, expectations and deliverables.
Develop a comprehensive practicum handbook.
Develop a flexible format that is adaptable to both student and community need with an opportunity to integrate virtual, home-based, e-practicum and in-person elements.
Mentorship and supervision
Define clearly the required qualifications or experience for practicum supervisors.
Outline clearly the responsibilities of practicum supervisors and coordinators.
Learning outcomes
List and define the Public health competencies. Competencies describe the essential knowledge, skills and attitudes necessary to practice public health. This may be in alignment with those competencies defined by an accrediting body.
Use competencies to create practicum objectives or learning outcomes which are actionable goals developed in collaboration with student, supervisor and coordinator.
Use objectives to inform the development of practicum-specific deliverables, that is, what the student will achieve during the placement.
Deliverables must be (A) of use to the host institution and (B) meet the criteria determined by competency-based practicum objectives.
Evaluation
Practicum placements should be assessed on a ‘for credit’ basis.
Learning contracts, supervisor evaluations and final reflective reports are used as a metric to determine if the student has completed the deliverables to a professional standard and as agreed.
The final assessment is a collaborative effort between the practicum supervisor and coordinator.
The evidence is there supporting the utility of practice-based education and we would recommend that the public health education community continue to shift towards the integration of practice-based experiences into GPH programmes worldwide.
Supplementary Material
Footnotes
Twitter: @elmusharaf1
Contributors: KE conceived the basic idea for the research and supervise the research process. HG conducted early scoping searches, returning to KE and SRG at intervals for advice. HG developed a detailed plan for the conduct of comprehensive searches. Any difficulties with the search process arising were discussed with KE at regular intervals. SRG verified data for accuracy and completeness. HG summarised all data found and presented it to KE and SRG for comment and feedback. HG, SRG and KE have made substantial contributions to conception, design, drafting the manuscript and revising it critically for important intellectual content. All the authors have read and approved the final manuscript.
Funding: No external funding was applied for or used in the conduct of this research. The School of Medicine at the University of Limerick funded this article.
Disclaimer: The funder had no role in construction, evaluation, manuscript preparation, or decision for publication.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Author note: HG is a medical student at the University of Limerick School of Medicine and a research assistant at the Public Health Master program at the University of Limerick. SRG is a postdoctoral researcher at the Public Health Master program at the University of Limerick. KE is a senior lecturer in public health and the director of the Public Health Master program at the School of Medicine at University of Limerick.
Data availability statement
All data relevant to the study are included in the article. All data generated or analysed during this study are included in this published article.
References
- 1.Frenk J, Hunter DJ, Lapp I. A renewed vision for higher education in public health. Am J Public Health 2015;105:S109–13. 10.2105/AJPH.2014.302468 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.CEPH . Accreditation criteria [online], 2016. Available: www.ceph.org [Accessed 1 Dec 2019].
- 3.PHAC . CORE competencies for public health in Canada release 1.0 [online]. Available: https://www.canada.ca/content/dam/phac-aspc/documents/services/public-health-practice/skills-online/core-competencies-public-health-canada/cc-manual-eng090407.pdf [Accessed 1 Dec 2019].
- 4.Kelly T, Lazenby M. Developing and validating learning domains, competencies, and evaluation items for global health clinical immersion practicums for graduate-level nursing programs. J Adv Nurs 2019;75:234–52. 10.1111/jan.13851 [DOI] [PubMed] [Google Scholar]
- 5.Worley J, Heyland M. Evaluating competency based education modules in an online nurse practitioner course. J Nurs Educ Pract 2019;9. [Google Scholar]
- 6.Bogossian FE, Cant RP, Ballard EL, et al. Locating “gold standard” evidence for simulation as a substitute for clinical practice in prelicensure health professional education: A systematic review. J Clin Nurs 2019;28:3759–75. 10.1111/jocn.14965 [DOI] [PubMed] [Google Scholar]
- 7.Bennett CJ, Walston SL. Improving the use of competencies in public health education. Am J Public Health 2015;105:S65–7. 10.2105/AJPH.2014.302329 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Steigerwald D, Nolan C, Loux T, et al. Improving public health competencies through required practice experience. Public Health 2016;140:265–7. 10.1016/j.puhe.2016.07.001 [DOI] [PubMed] [Google Scholar]
- 9.Ramaswamy R, Mosnier J, Reed K, et al. Building capacity for public health 3.0: introducing implementation science into an mph curriculum. Implementation Sci 2019;14. 10.1186/s13012-019-0866-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hernandez KE, Bejarano S, Reyes FJ, et al. Experience preferred: insights from our newest public health professionals on how internships/practicums promote career development. Health Promot Pract 2014;15:95–9. 10.1177/1524839913507578 [DOI] [PubMed] [Google Scholar]
- 11.Sullivan LM, Velez A, Edouard VM. Realigning the master of public health (MPH) to meet the evolving needs of the workforce. Perspect Pedagog 2017. [Google Scholar]
- 12.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8:19–32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
- 13.Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010;5:69. 10.1186/1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Adams J, Hillier-Brown FC, Moore HJ, et al. Searching and synthesising ‘grey literature’ and ‘grey information’ in public health: critical reflections on three case studies. Syst Rev 2016;5:164. 10.1186/s13643-016-0337-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Paez A. Gray literature: an important resource in systematic reviews. J Evid Based Med 2017;10:233–40. 10.1111/jebm.12266 [DOI] [PubMed] [Google Scholar]
- 16.Peters MDJ, Godfrey CM, Khalil H, et al. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc 2015;13:141–6. 10.1097/XEB.0000000000000050 [DOI] [PubMed] [Google Scholar]
- 17.Villanueva AM, Hovinga ME, Cass JL. Master of public health community-based Practicum. J Public Heal Manag Pract 2011;17:337–43. 10.1097/PHH.0b013e3182140c78 [DOI] [PubMed] [Google Scholar]
- 18.Boelen C. Coordinating medical education and health care systems: the power of the social accountability approach. Med Educ 2018;52:96–102. 10.1111/medu.13394 [DOI] [PubMed] [Google Scholar]
- 19.Global consensus for social accountability of medical schools [online]. Available: https://healthsocialaccountability.org/ [Accessed 23 Mar 2019].
- 20.Goodman J. Virtual practicums within an MPH program: a career development case study. Health Promot Pract 2015;16:7–11. 10.1177/1524839914555572 [DOI] [PubMed] [Google Scholar]
- 21.Brambleby P, Coates R. Learning contracts in higher professional training: a user’s guide. Postgrad Med J 1997;73:279–82. 10.1136/pgmj.73.859.279 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Harden RM. Developments in outcome-based education. Med Teach 2002;24:117–20. 10.1080/01421590220120669 [DOI] [PubMed] [Google Scholar]
- 23.APHEA - core curriculum areas [online]. Available: https://www.aphea.be/Pages/A2.CURRICULA/Curriculum_core_areas.html [Accessed 7 Mar 2019].
- 24.Calhoun JG, Ramiah K, Weist EM, et al. Development of a core competency model for the master of public health degree. Am J Public Health 2008;98:1598–607. 10.2105/AJPH.2007.117978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Schuster W, Stevens KB. Supervising Practicum students. Teacher Education and Special Education 1991;14:169–76. 10.1177/088840649101400303 [DOI] [Google Scholar]
- 26.Beck C, Kosnik C. Professors and the Practicum. J Teach Educ 2002;53:6–19. 10.1177/0022487102053001002 [DOI] [Google Scholar]
- 27.Carraccio C, Englander R, Holmboe ES, et al. Driving care quality: aligning trainee assessment and supervision through practical application of entrustable professional activities, competencies, and milestones. Acad Med 2016;91:199–203. 10.1097/ACM.0000000000000985 [DOI] [PubMed] [Google Scholar]
- 28.Landmark BT, Hansen GS, Bjones I, et al. Clinical supervision - factors defined by nurses as influential upon the development of competence and skills in supervision. J Clin Nurs 2003;12:834–41. 10.1046/j.1365-2702.2003.00813.x [DOI] [PubMed] [Google Scholar]
- 29.Cashman SB, Seifer SD. Service-learning: an integral part of undergraduate public health. Am J Prev Med 2008;35:273–8. 10.1016/j.amepre.2008.06.012 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data relevant to the study are included in the article. All data generated or analysed during this study are included in this published article.