Skip to main content
BMJ Open logoLink to BMJ Open
. 2021 May 5;11(5):e047512. doi: 10.1136/bmjopen-2020-047512

Public health practicum: a scoping review of current practice in graduate public health education

Hannah Gummeson 1, Sonika Raj Goel 1, Khalifa Elmusharaf 1,
PMCID: PMC8103934  PMID: 33958343

Abstract

Objectives

The objectives of this study are to (1) identify Graduate Public Health (GPH) programmes with an integrated practicum, (2) determine current practice for practicum design and (3) use the information to make recommendations to inform the design of Public Health Graduate programme practicums.

Design

Scoping review.

Data sources

Academic Ranking World Universities 2019 was used to identify top 10 institutions in each geographical hub offering GPH programmes. Each GPH programme website was searched for practicum information.

Eligibility criteria

GPH programmes offering a practice-based component as a requirement in their curriculum.

Data extraction and synthesis

One reviewer screened GPH websites for eligibility and extracted data. Verification of data for accuracy and completeness was done on 10% of the sample by the second author. Data were compiled into an Excel file and were analysed to describe the duration, timing, credit, contact hours, preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component.

Results

Out of the 108 GPH programmes screened, a total of 35 programmes were included. There was a significant variation in required practicum duration ranging from 4 to 16 weeks. Only 31% specifically outlined prerequisites to be completed before the initiation of the practicum. More than half (57%) had a published list of core competencies. A majority of practicum did not provide criteria for appropriate preceptors (63%) and their responsibilities (66%). All programmes listed assessment criteria however the majority (57%) did not specify if the practicum was graded or a for-credit component.

Conclusions

The integration of practical components into curricula is inconsistent. This research resulted in 14 recommendations intended to guide GPH practicum design. We propose that this study be used as a tool to spark a global dialogue about best practices in GPH education through the identification of common practices and opportunities for improvement.

Keywords: public health, medical education & training, epidemiology


Strengths and limitations of this study.

  • The major strength of this review is that it is based on a global sample of graduate public health programmes, allowing for a global perspective on the current practices in Public Health Graduate programme design.

  • The information collection was restricted by what was publicly available on programme websites. We acknowledge this as a potential source of bias. Given that the information in the public domain is under the control of the academic programmes and not subject to peer-review, the assumption was made that the details were accurate and up to date.

  • Programmes were identified based on the Academic Ranking World Universities. This ranking is based on factors that is related public health research outputs. These factors are not related to the quality of practice-based component as a requirement in their curriculum.

  • The sample was limited to programmes offering information available in English which led to the exclusion of institutions in Central and South America.

Background

Public health is increasingly moving to the forefront of graduate education within the health sector. As many of the relevant educational entities have begun the slow shift to an integrative approach to care, competency in public health is now being recognised as critical to success in many healthcare fields as new members enter the workforce.

Over the past 20 years, the model of graduate education in public health has undergone multiple stages of development. Best practices have rapidly diverged from the traditionalist dialectical teaching approach towards one placing more emphasis on student-led learning in competency-based educational models.1 As an example, for certain institutions affiliated with the Council on Education for Public Health (CEPH)2 or the Public Health Agency of Canada (PHAC),3 accreditation is contingent on all Masters of Public Health (MPH) students completing a practicum. Capacity building has been the primary motivation behind these changes.

While relatively new to public health education, the value of experiential learning in education is well described in the literature relating to other allied health fields such as medicine, nursing and social work.4–6 Akin to these sectors, public health occurs primarily in the field and it has been demonstrated that experiential learning is critical to capacity building in public health education.7–9 Practice-based learning puts theory into action, allowing students to work towards competency development through the application of theoretical knowledge to real-world issues. These mentored experiences are also critical to career development, providing unique opportunities to develop professional networks, gain experience in different work-environments and collaborate with others in the field of public health.10 This model builds on the traditional research-focused thesis paradigm towards one of implementation science, where the new generation of public health practitioners are supported to develop interdisciplinary skills for multisector engagement to move from research to action.9 11

The growing integration of practice-based learning into graduate public health (GPH) curricula signals a divergence from the traditional education model. Many GPH institutions are beginning to capitalise on this by offering programmes with the option of a thesis-based or practice-based culminating project. That being said, there is significant variation in the method of integrating an experience-based component into the curriculum. Multiple different terms are used including practicum, internship, applied practical experience (APE), culminating experience, field placement, residency and professional placement, to name a few. There is meaningful diversity here. However, practicum-based programmes are still not the norm, especially in Europe. This is evidenced by the vast majority of globally ranked institutions in the region continuing to offer only thesis-based programmes, with no practice-based element required. While this approach may have once served a research-driven culture of healthcare, the future of public health education lies in practice to action.

When considering the design of public health programmes going forward, we hoped to answer the research question ‘what are the current best practices in GPH education?’ The objectives of this review are to (1) identify leading GPH programmes with an integrated practicum, (2) determine current practice for practicum design through a global lens and (3) use the information to make recommendations to inform the design of public health graduate programme practicum.

Methods

This scoping review of GPH programmes was conducted by adopting a methodological framework first described by Arksey and O’Malley12 and later refined by Levac et al.13 As our inquiries were focused primarily on ‘grey literature, we chose this methodology given that research indicates it is particularly useful for ‘reconnaissance’ into subject matter that has not yet been comprehensively reviewed.14–16 The steps include (1) identifying research questions, (2) identifying all relevant programmes, (3) selecting significant programmes, (4) charting the relevant data and then (5) summarising and reporting the results. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Scoping Reviews (PRISMA-ScR) checklist report was completed to ensure all measures were achieved.

Purpose

The purpose of the research is to review the structure of GPH practicums using a globally diverse sample to identify common themes and inform current practice for practicum design moving forward.

Search strategy

Data collection for this research was entirely web based. As described in more detail below, potential programmes were identified using online university ranking systems and were then stratified by geographical region into ranked lists. To be included in the sample, GPH programmes must incorporate a practice-based component into the curriculum. In some instances, the regionally top 10 ranked GPH programmes did not include a practice-based component. As such, the goal was to create a sample representing the top five practice-based GPH programmes in each of the regions identified.

Identifying relevant programs

The goal in data collection was to create a globally descriptive sample of GPH programmes offering a practice-based component as a requirement in their curriculum. Top-ranked GPH programmes were divided based on continental hubs to ensure a geographically diverse sample. The hubs included were Africa, Asia, Australia, Canada, European Union, South America, UK and the USA. Examination of databases created by World University Ranking 2019 (WUR) and Academic Ranking World Universities 2019 (AWRU) identified the top 10 (ranked) institutions in each geographical hub offering GPH programmes. It should be noted that initial database queries were done using both WUR and AWRU. However, WUR ranking focused at the university level as compared with AWRU, which ranked the GPH programmes themselves as opposed to the university as a whole. Due to the specificity of the search parameters, we chose to focus our search on the AWRU system, although there was significant overlap between the two algorithms. AWRU methodology of subject ranking is mainly based on public health research outputs rather than the components of the programme or the curriculum. To be included in the public health subject ranking, the universities need to have a minimum of 200 publications during the period of 2014–2018. Universities are then ranked based on five indicators: (1) Q1 is the number of papers published in Q1 Journal Impact Factor Quartile, (2) Category Normalised Citation Impact, (3) Publications with International collaboration, (4) The number of papers published in Top Journals and (5) The number of the staff wining a significant award.

Selecting the programmes for inclusion (eligibility criteria)

Phase two screening and subsequent data collection was based on global AWRU GPH programme rankings for each respective geographical region. The AWRU was used as a framework to systematically assess the programmes offered, starting with the highest-ranking region. Any of the top-ranked GPH programmes not requiring a practice-based component in the curriculum were excluded from the sample. Programmes were also excluded if a practice-based component was mentioned but the information was unavailable through (1) university website, (2) programme website, (3) student prospectus, (4) graduate handbook, (5) student guide or (6) practicum guide. Search parameters are outlined in a PRISMA-ScR chart (figure 1).

Figure 1.

Figure 1

PRISMA-ScR flow diagram outlining the process of public health programme selection for the sample. The PRISMA-ScR diagram details our search and selection process applied during the research. PRISMA-ScR, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews.

Information sources

The university website, programme website, student prospectus, graduate handbook, student guide and practicum guide of each selected university were searched for available information about the practice-based component.

Search

The following keywords were used for the search: Practicum, workplace practicum, APE, internship, practice internship, residency, placement, professional placement, project in public health, pathways to public health in the workplace, community placement, professional practice, professional project, field study or field work.

Data charting process

Information about the programme and the practice-based component was downloaded and stored in a series of electronic files. To collect data systematically, an electronic abstraction proforma was created in Excel. Information on each practice-based component was reviewed and the data was entered into a master file comparing all the selected institutions based on domains of interest. The lead author was mainly responsible for screening the programmes using the inclusion and exclusion criteria. The second author performed verification of data for accuracy and completeness on 10% of the sample. All the coauthors had meetings at regular intervals during the review process to discuss the emerging results, and to resolve any issues arising in the search process.

Sample

We screened 108 GPH programmes. Our search strategy yielded 40 GPH programmes representing all continents across the globe. Due to lack of translation support at the time of data collection, 5 schools in Chile, Brazil, Mexico and Puerto Rico were excluded, leaving 35 GPH programmes in the sample.

Data items

Data were collected on the duration, timing, credit and contact hours of the programme practice-based component, as well as data on preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component. This study was considered exempt from institutional ethical board review as it did not involve human subjects.

Synthesis of results

Data were compiled from available online sources and collated into an Excel file. Descriptive statistics were computed for each study variable and are presented in the following section.

Patient and public involvement

Patients or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.

Results

Characteristics of Public health programmes reviewed

Data were collected on the duration, timing, credit and contact hours of the programme practice-based component, as well as data on preceptor requirements, prerequisites, objectives, deliverables and methods of evaluation of the practice-based component.

As seen in table 1, the programmes included in the sample compose a snapshot of a variety of accrediting bodies that GPH programmes may affiliate with. Of the sample institutions with accredited programmes, the majority (n=6) received accreditation through CEPH, while others maintain accreditation through Agency for Public Health Education Accreditation (APHEA) (n=3), Netherlands Flemish Accreditation Organisation (n=2) as well as International Union for Health Promotion and Education, Training Programme in Epidemiology and Public Health Interventions Network and several national ministries of education (collective n=4). The majority of the programmes were not accredited (n=20, 57%). In terms of overall programme structure, programme duration followed a bimodal distribution, with 34% of programmes requiring a minimum of 12 months for completion and 66% requiring 13–24 months.

Table 1.

Characteristics of universities reviewed (n=35)

Characteristic No Percentage
Geographical region
 Africa 5 14
 Asia 5 14
 Australia 5 14
 Canada 5 14
 European Union 5 14
 UK 5 14
 USA 5 14
Accrediting body
 Council on Education for Public Health 6 17
 Training Programme in Epidemiology and Public Health Interventions Network 1 2.75
 International Union for Health Promotion 1 2.75
 Agency for Public Health Education Accreditation 3 9
 Netherlands Flemish Accreditation Organisation 2 6
 Ministry of education 2 6
 No accrediting body 20 57
Programme duration
 12 months or less 12 34
 13–24 months 23 66

Structural characteristics of GPH practicums

Prerequisites and practicum scheduling

Approximately one-third of the programmes evaluated (n=11, 31%) specifically outlined prerequisites to be completed before the initiation of the practicum. The remainder of the programmes (n=24, 69%) did not list prerequisites in any of the available course information. However, some of these schools may have accounted for that omission through the practicum schedule. The majority of programmes (n=24, 68%) stipulated that the practicum could only take place after a minimum of two terms were completed (ie, summer semester in 12-month programmes, semester three or four in 16–24 months programmes).

Practicum contact hours and duration

As seen in table 2, there was significant variation in required practicum duration with a range measured both in hours or weeks depending on the institution. For placements measured in hours, two (6%) of the practicums were in the range of 50–100 hours, four (11%) were in the range of 101–200 and one (3%) was in the range of 201 or more hours. For placements measured in weeks, three (9%) were between 4 and 8 weeks, nine (26%) were between 9 and 12 weeks and 6 (17%) were between 13 and 16 weeks. Ten (28%) of the practicums did not have a defined time requirement.

Table 2.

Structural characteristics of GPH practicums reviewed (n=35)

Characteristic No Percentage
Prerequisites required before practicum initiation
 Prerequisite courses required 11 31
 Prerequisite courses not listed 24 69
Timing of practicum scheduling
 Semester 2 3 9
 Semester 3/summer 13 37
 Year 2 11 31
 Variable term/undefined 8 23
Practicum duration
 50–100 hours 2 6
 101–200 hours 4 11
 201 or more hours 1 3
 4–8 weeks 6 17
 9–12 weeks 9 26
 13–16 weeks 6 17
 Practicum duration not defined 10 28
Contact hours
 Stated minimum number contact hours only 6 17
 Stated minimum and maximum number contact hours 2 6
 Contact time measured in weeks 17 49
 Contact time not specified 10 28
Credit hours
 No credit hours for practicum 1 3
 Fixed number of credit hours for practicum 32 91
 Practicum credit hours not provided 2 6
Ratio of credits to overall degree
 No credit hours for practicum 1 3
 1%–10% overall credits 8 22
 11%–20% overall credits 15 43
 21%–30% overall credits 3 9
 31%–40% overall credits 5 14
 Information unavailable 3 9

GPH, Graduate Public Health.

In terms of contact hours, a significant portion of the institutions reviewed (49%) did not specify the number of contact hours to be completed within a set duration placement duration measured in weeks. Additionally, over a quarter of programmes (28%) did not specify a required contact time at all. Of those that did specify a finite number of contact hours (23%), six stated only the minimum number of contact hours required whereas the other two gave both the minimum and maximum hours required.

Credit hours and overall credit weighting

As seen in table 2, one, (3%) of the practicums reviewed did not earn any credit hours and two (6%) programmes did not provide a credit-hour equivalency for the practical component in the course information. The vast majority (91%) of practicums reviewed had a fixed number of credit hours associated. The units of measurement of the credit hours were varied but included credits, credit hours, weighted marks and European Credit Transfer System credits.

GPH practicum domains

In addition to analysing the operational elements of practicum design, data collection also focused on core domains including (1) competencies, (2) supervision, (3) written agreement and objectives and (4) assessment.

Competencies

As seen in table 3, more than half (n=20, 57%) of the GPH programmes reviewed had a published list of core programme competencies. The competencies associated with programmes offered by the North American institutions are derived from national standards developed by CEPH and PHAC. In other centres, core competencies were institution specific. The remainder of the sample (n=15, 43%) did not list programme competencies.

Table 3.

Domains of GPH practicums reviewed (n=35)

Domain No Percentage
Competencies
Core competencies
 Core public health competencies listed  20  57
 Core public health competencies not listed  15  43
 Practicum-specific competencies
 Practicum-specific competencies defined  8  23
 Practicum-specific competencies referenced, undefined  1  3
 Practicum-specific competencies not listed/missing  26  74
Supervision
Practicum supervisor criteria
 Stated criteria to define appropriate supervisor 13 37
 No criteria listed to define appropriate supervisor 23 63
Practicum supervisor responsibilities
 Stated responsibilities of practicum supervisor 12 34
 Did not state responsibilities of practicum supervisor 23 66
Written agreement and objectives
Written agreement
 Written agreement required 14 40
 Written agreement not referenced 21 60
Practicum objectives
 Objectives included in the written agreement 12 34
 Objectives not included/unclear if in written agreement 2 6
 Practicum objectives defined 29 83
Final deliverables (multiple per programme)
 No requirement 0 0
 Oral presentation 13 37
 Written report 17 49
 Portfolio/reflections 3 8
 Poster/abstract 5 14
 Practicum-specific deliverables 16 46
 Not listed/unclear requirement 6 17
Assessment
Assessment Intervals
Pre-practicum (learning agreement) 14 40
Mid-practicum 9 26
Postpracticum 21 60
Assessment information not available 9 26
Final grading system
 Pass/fail 8 23
 Letter grade 7 20
 No grade/unclear 20 57

GPH, Graduate Public Health.

In addition to programme-centred competencies, several centres also defined practicum-specific competencies. Eight (23%) of the practicums had clearly listed competencies that guided the development of the practicum deliverables and one (3%) referenced practicum-specific competencies without further definition of their content. However, for the majority of practicums (74%), no practicum specific was included in any of the course guidelines available. It is unclear if these programmes had not developed practicum-specific competencies or if they were not listed in the available programme documentation.

Supervision

As seen in table 3, institutional oversight into practicum supervisors occurred at several levels, both through the definition of eligibility criteria and supervisory responsibilities. Approximately one-third (37%) of practicums had stated criteria used to define appropriate preceptors as outlined in table 4, whereas the majority (67%) did not provide criteria or the information was not listed. A similar proportion of programmes (34%) clearly stated the responsibilities of the supervising preceptors, but the majority (66%) did not.

Table 4.

Practicum supervisor requirements (n=13)

Criteria defined No Percentage
Expertise in project area 5 38
Experience and status within the organisation 5 38
Interest and competence in supervising and mentoring 5 38
Professional credentialing 8 62
3–5 years experience with advanced master or doctoral degree 1 8
10 years experience with bachelor degree or equivalent combination of education and experience 4 30
MPH or master degree in the related field 1 8

MPH, Masters of Public Health.

Written agreement, objectives and deliverables

Over one-third (40%) of the programmes required a written agreement to be in place before the student could begin working on the practicum. This was a universal requirement in the North American programmes (n=10), however, approximately two-thirds of programmes in the sample (60%) did not reference any form of written agreement as a requirement for the practicum. In terms of practicum objectives, the majority of programmes provided a defined list (83%), however, only one-third (34%) of institutions reviewed contracted these objectives into a learning agreement. All of the practicum written agreements outline some specific deliverables to be completed and used as part of the assessment metric. The majority (83%) required students to submit or present a product at the completion of the practicum. Of all 35 practicums reviewed, 6 (17%) had no stated final deliverables, 3 (8%) required a portfolio or reflection, 5 (14%) required a poster or abstract, 13 (37%) required an oral presentation, 16 (46%) required ‘practicum-specific deliverables’ and 17 (49%) required a written report. It should be noted that one practicum may have had a combination of multiple deliverables required.

Approach to assessment

As seen in table 3, of those practicums which listed the grading information, eight (23%) were graded on a pass/fail basis and seven (20%) were evaluated using a letter grade system. All programmes listed assessment criteria, however, the majority in this sample (57%) did not provide specify if the practicum was graded or a for-credit component. The majority of the practicums (74%) had defined assessment intervals with 40% requiring a preplacement assessment, that is, learning agreement, 26% requiring an interim assessment and 60% requiring a postplacement assessment. Assessment information was not available for nine (26%) programmes.

Definitions and terminology

As seen in table 5, the language used to describe the ‘practicum’ component was quite diverse across all the GPH programmes assessed. The term practicum or workplace practicum was most common (40%), the internship was the next most common term (20%) and placement was also used by several programmes (8%). Other less commonly used terms include Applied practical experience, residency, professional practice or project and field work.

Table 5.

Descriptive terminology for practical placements (n=35)

Terms used No Percentage
Practicum/workplace practicum 14 40
Applied practical experience 2 6
Internship/practice internship 7 20
Residency 2 6
Placement/professional placement 3 8
Project in public health 1 2.75
Pathways to public health in the workplace 1 2.75
Community placement module 1 2.75
Professional practice 1 2.75
Professional project 1 2.75
Field study/work 2 6

Discussion

When considering the design of public health programmes going forward, it is important to review recent developments to establish current best-practice in GPH education.

Challenges

Practical placements are extremely beneficial to students,10 17 as evidenced by their integration into many of the leading public health masters' programmes worldwide. However, this review demonstrated significant variation in practicum design, use of guidelines, and accreditation between the programmes reviewed. Overall, there were several interesting trends identified in the data that warrant further discussion.

Practicum design

Many of the programmes included in this review in Europe were thesis based. These programmes have not yet progressed to incorporate a mandatory practice requirement into their education model when the evidence indicates the many benefits of practicums.

Although practicums are becoming more ubiquitous in GPH education, there is significant variation in the methods by which academic institutions integrate a practice-based component into their MPH programmes. In the North American, context design is highly regulated, where CEPH and PHAC have issued explicit guidelines that dictate the design of GPH practicums. However, the public health community has yet to develop a clearly defined and globally accepted set of guidelines outlining a superior practicum scheme that gives students better experience and prepare them for their career, in addition to meeting the needs of the communities being served and the people they intend to educate. In this way, practicums are being used as a response to the need for social accountability in health professional education.18 19 While this variation poses a logistic challenge to implementing quality measures in public health education, it also emphasises the need to integrate flexibility into programme design to ensure the needs of both students and communities served are being met.

A current example of emerging innovation in GPH practice-based education is the virtual practicum. It has been suggested as a pioneering solution to meet the needs of GPH students in distance learning programmes or those who are pursuing a GPH in parallel with an existing career.20 In the era of COVID-19, we anticipate programmes will face increasing challenges with in-person practicum placements and that exploration of virtual or blended practicum models should be prioritised. While the virtual practicum design is not yet widely integrated into GPH practicums on a global scale, it is reasonable to anticipate that this approach will become more commonplace in years to come.

Practicum design guidelines

Another finding of note relates to the global variation in guidelines for practicum design. Some institutions are operating off a national standard that defines the required elements of a practice-based experience,2 3 but many are not. Likely, the diversity of ‘practicum types’ encountered in this review is due in large part to the regional variation in design standards. For example, institutions in North America follow clear guidelines set out by CEPH and PHAC and GPH programmes. Institutions in India follow a national set of recommendations that inform practicum design. Conversely, the majority of programmes in other settings seem to rely on community needs or working group recommendations to guide the practicum design. Based on our review, it is unclear if creating an ‘international standard’ is feasible as there is such diversity in educational needs.

Accreditation

Accreditation often provides a clear set of guidelines defining the expectations for programme design. There are multiple accrediting bodies, some being public health institutions and others general education institutions, operating both at national and international levels. It is reasonable to infer that institutions being accredited by public health bodies have programmes that are more specifically tailored to the needs of public health education as opposed to those that are not. However, the majority of programmes reviewed were not accredited. This variation in accreditation status raises the question of the necessity of guiding principles in practicum design. Perhaps an interesting example to consider is the Canadian context. In Canada, the majority of programmes are not accredited however they are required to meet the MPH practicum guidelines as defined by PHAC. This effectively has the same outcome as following criteria set by an accrediting body. Currently, it is unclear if universal accreditation would be useful for GPH programmes given the profile of the diverse needs of the global community.

Current practice

Our comprehensive review of GPH practicum designs around the world have informed the development of an initial framework of recommendations based on current best practices (table 6). The following discussion will focus on the elements identified as critical when considering the design of a GPH practicum.

Table 6.

Relationship between competencies, objectives and deliverables in practicum design

Competencies Competencies are the central knowledge, skills and attitudes necessary for the public health workforce to practice effectively and achieve the core functions of public healthcare. Competencies define aptitudes or educational outcomes students must acquire on completion of a GPH programme.
Objectives Objectives are actionable goals developed by the student in conjunction with the onsite practicum supervisor and university-based practicum coordinator. Objective development is based on educational outcomes defined by the programme’s core competencies.
Deliverables Deliverables are tangible work products created by the student during the practicum. Deliverables are informed by objectives that are developed based on competencies.

GPH, Graduate Public Health.

Learning contract

The learning contract (LC) is a crucial element to the success of a practicum. The LC is a memorandum of understanding between the student, academic institution and host institution that defines the objectives, expectations and deliverables necessary for successful completion of the placement.21 Practicums are often structured differently, as we have seen in our sample and there can be significant variation in the objectives defined and competencies assessed. Nonetheless, a well-designed LC is a key to the success of any practicum. The goal is to translate required competencies into specific objectives that will result in deliverables the student will be able to produce during their practical placement. Well-defined, specific practicum guidelines and objectives should be developed internally, based on competencies established by the university and any relevant accrediting body. Agreement on objectives is essential, not only for the students but also host institutions, to ensure the practicum is beneficial to all parties involved.22 In addition, the roles and responsibilities of each partner must be clearly delineated in the LC. This includes a specific agreement about honoraria, data ownership, research products and authorship of publications.

Prerequisite competency training

GPH programmes should communicate the requirements to students to be prepared to undertake a practicum. We found that some programmes clearly state the prerequisites, while in others it is inherent in the programme schedule. This was a point of interest identified in our review. It highlights the institutional assumptions being made regarding the ethical competence of students. While many programmes emphasise prerequisites that focus on epidemiology and biostatistical analysis, there is little emphasis on the need for ethics training in practicum-based programmes. This is in contrast to thesis-based programmes which consistently integrate the need for ethical approval of research projects into the project authorisation process. There is also a need for training on professionalism, business etiquette and workplace savvy as a prerequisite competency training.

Competency-based training

Institutions must define the public health competencies that their graduates will attain following programme completion. Some programmes reviewed define key competencies based on frameworks created by an accrediting body such as CEPH, PHAC or APHEA,2 3 23 while others developed competencies based on internal standards. It should be noted that while the specific competencies assessed varied, there were consistent themes between accredited and non-accredited institutions. Once competencies are outlined by the institution, best practice is to create practicum objectives. Objectives are actionable goals developed by the student in conjunction with the onsite practicum supervisor and university-based practicum coordinator. Objectives can then be used to inform the development of specific practicum deliverables, that is, what the student will achieve during the practicum placement (table 6). The current best practice is consistent with the literature in requiring that deliverables are (1) of use to the host institution and (2) meet the criteria determined by the competency-based practicum objectives.24 While competency acquisition can be difficult to assess, the LC is a key tool that can be used to measure a student’s competency development throughout the programme and practicum.

Practicum supervisor requirements

The definition of supervisor requirements is another area that must be addressed in the design of a new GPH practicum. A clear definition is essential to ensure that practicum supervisors (1) are qualified to supervise, (2) have the skill set necessary to be a public health mentor and (3) have the capacity to evaluate students’ competency attainment. Many of the institutions reviewed reference the need for a preceptor, and some outline specific qualifications necessary. However, the challenge in this area is that qualifications may be highly practicum specific, with extensive variation in qualifications between medicine, epidemiology, community intervention and programme evaluation. For this reason, many programmes have very vague supervisor requirements, stating that preceptors must be ‘experts in their field’. It is clear that supervisors must be qualified and that the requirements must be well defined such that a potential supervisor can be made aware of the expectations around their role in guiding the student through the practicum process. We recommend that institutions define supervisor requirements in a general sense, as seen in many of the North American centres reviewed. In this way, centres allow for variation in supervisor experience while ensuring that each is qualified to provide project-specific support/oversight to a student in the field.

Effective mentorship and evaluation

Open communication and continuous student feedback are critical to the success of practical placements. This emphasises the importance of the role of the practicum supervisor and the need for continuous assessment.25 26 The supervisor plays a dual role in the practicum, both as a mentor and evaluator.27 It is the responsibility of the supervisor to work with the student to ensure that they are operating within the scope of their LC and can complete any stated deliverables within the time frame agreed. We recommend conducting periodic evaluations of the students and the placement to assess if the practicum is an appropriate tool to facilitate competency building as required by the programme.28 Besides, as the evaluations must be tailored to fit the design of the practicum, it is recommended that both short and long-term assessments are completed from multiple perspectives. While evaluation of student performance is essential to competency development, it is equally important that students are able to assess their supervisors and remain in contact with their home school throughout the practicum should they need support. This emphasises the importance of the role played by the practicum coordinator. The coordinator is a designated faculty member whose role, among other things, is to ensure the lines of communication between student and institution remain open for the duration of the practicum. Based on our review, the use of periodic evaluation is commonplace in current practicum designs. Also, many programmes reviewed required assessments to be carried out by key stakeholders (students, supervisors, host organisation) at mid and final term. These assessments should evaluate both the placement and the student performance.

Strengths and limitations of this study

The major strength of this review is that it is based on a global sample of GPH programmes, allowing for a global perspective on the current practice in public health graduate programme design. As this has not been done before, this work may serve as an initial foray into the evaluation of global trends in the GPH educational approach. The information gathered has been used to design a proposed set of recommendations to guide future practice. This review can also be used to identify areas in GPH programme design that could benefit from further evaluation.

There were several limitations in this review. Foremost among them, information collection was restricted by what was publicly available on programme websites. We acknowledge this as a potential source of bias. Given that the information in the public domain is under the control of the academic programmes and not subject to peer-review, the assumption was made that the details were accurate and up to date. Besides, programmes were identified based on world ranking systems. While these systems operate off specific methodologies, it is likely discrepancies exist between the assessment algorithms which could easily lead to incompletely representative sampling. Furthermore, only the highest-ranked five programmes with practicum component from each hub were included. This implies that only top-ranked programmes have best practices which may not be the case. In addition, the sample was limited to programmes offering information available in English which led to the exclusion of institutions in Central and South America.

Conclusions and recommendations

In 2008, Cashman and Seifer29 described practice based or experiential learning as ‘an effective and appropriate vehicle for teaching public health and developing public health literacy’. After over a decade of development in public health education, this was an opportunity to revisit the statements made in 2008 and reflect on the degree to which we have to be able to align public health education with competency building through practice. The goal in undertaking this review was to develop a deeper understanding of the current practice in GPH programme design, relating to the structure of the practice-based component.

This analysis offers a description of current global best practices in practicum design for GPH education. We have shown that there is meaningful variation in the approach to GPH practicum design, with a significant proportion of the leading public health education centres across the world emphasising the practical elements of training. This speaks to the growing value of practice-based training in the global public health community.

Currently, there are no global criteria that define the key elements necessary to guide the design of successful GPH practicums. While variation is expected given the different needs profiles seen in a global context, we feel that a general set of guidelines could be beneficial to ensure programmes are all meeting a high educational standard.

Based on our review of current best practice, we have developed a set of fourteen recommendations intended to guide the development and design of GPH programme practicums:

Design

  1. Develop clear practicum prerequisites in order to ensure students are equipped with sufficient ethical and theoretical background knowledge to complete a practicum placement.

  2. Schedule the practicum after the completion of practicum prerequisites, that is, second term.

  3. Develop a learning contract, that is, a memorandum of understanding between the student, academic and host institutions that define the objectives, expectations and deliverables.

  4. Develop a comprehensive practicum handbook.

  5. Develop a flexible format that is adaptable to both student and community need with an opportunity to integrate virtual, home-based, e-practicum and in-person elements.

Mentorship and supervision

  1. Define clearly the required qualifications or experience for practicum supervisors.

  2. Outline clearly the responsibilities of practicum supervisors and coordinators.

Learning outcomes

  1. List and define the Public health competencies. Competencies describe the essential knowledge, skills and attitudes necessary to practice public health. This may be in alignment with those competencies defined by an accrediting body.

  2. Use competencies to create practicum objectives or learning outcomes which are actionable goals developed in collaboration with student, supervisor and coordinator.

  3. Use objectives to inform the development of practicum-specific deliverables, that is, what the student will achieve during the placement.

  4. Deliverables must be (A) of use to the host institution and (B) meet the criteria determined by competency-based practicum objectives.

Evaluation

  1. Practicum placements should be assessed on a ‘for credit’ basis.

  2. Learning contracts, supervisor evaluations and final reflective reports are used as a metric to determine if the student has completed the deliverables to a professional standard and as agreed.

  3. The final assessment is a collaborative effort between the practicum supervisor and coordinator.

The evidence is there supporting the utility of practice-based education and we would recommend that the public health education community continue to shift towards the integration of practice-based experiences into GPH programmes worldwide.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @elmusharaf1

Contributors: KE conceived the basic idea for the research and supervise the research process. HG conducted early scoping searches, returning to KE and SRG at intervals for advice. HG developed a detailed plan for the conduct of comprehensive searches. Any difficulties with the search process arising were discussed with KE at regular intervals. SRG verified data for accuracy and completeness. HG summarised all data found and presented it to KE and SRG for comment and feedback. HG, SRG and KE have made substantial contributions to conception, design, drafting the manuscript and revising it critically for important intellectual content. All the authors have read and approved the final manuscript.

Funding: No external funding was applied for or used in the conduct of this research. The School of Medicine at the University of Limerick funded this article.

Disclaimer: The funder had no role in construction, evaluation, manuscript preparation, or decision for publication.

Competing interests: None declared.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Author note: HG is a medical student at the University of Limerick School of Medicine and a research assistant at the Public Health Master program at the University of Limerick. SRG is a postdoctoral researcher at the Public Health Master program at the University of Limerick. KE is a senior lecturer in public health and the director of the Public Health Master program at the School of Medicine at University of Limerick.

Data availability statement

All data relevant to the study are included in the article. All data generated or analysed during this study are included in this published article.

References

  • 1.Frenk J, Hunter DJ, Lapp I. A renewed vision for higher education in public health. Am J Public Health 2015;105:S109–13. 10.2105/AJPH.2014.302468 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.CEPH . Accreditation criteria [online], 2016. Available: www.ceph.org [Accessed 1 Dec 2019].
  • 3.PHAC . CORE competencies for public health in Canada release 1.0 [online]. Available: https://www.canada.ca/content/dam/phac-aspc/documents/services/public-health-practice/skills-online/core-competencies-public-health-canada/cc-manual-eng090407.pdf [Accessed 1 Dec 2019].
  • 4.Kelly T, Lazenby M. Developing and validating learning domains, competencies, and evaluation items for global health clinical immersion practicums for graduate-level nursing programs. J Adv Nurs 2019;75:234–52. 10.1111/jan.13851 [DOI] [PubMed] [Google Scholar]
  • 5.Worley J, Heyland M. Evaluating competency based education modules in an online nurse practitioner course. J Nurs Educ Pract 2019;9. [Google Scholar]
  • 6.Bogossian FE, Cant RP, Ballard EL, et al. Locating “gold standard” evidence for simulation as a substitute for clinical practice in prelicensure health professional education: A systematic review. J Clin Nurs 2019;28:3759–75. 10.1111/jocn.14965 [DOI] [PubMed] [Google Scholar]
  • 7.Bennett CJ, Walston SL. Improving the use of competencies in public health education. Am J Public Health 2015;105:S65–7. 10.2105/AJPH.2014.302329 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Steigerwald D, Nolan C, Loux T, et al. Improving public health competencies through required practice experience. Public Health 2016;140:265–7. 10.1016/j.puhe.2016.07.001 [DOI] [PubMed] [Google Scholar]
  • 9.Ramaswamy R, Mosnier J, Reed K, et al. Building capacity for public health 3.0: introducing implementation science into an mph curriculum. Implementation Sci 2019;14. 10.1186/s13012-019-0866-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hernandez KE, Bejarano S, Reyes FJ, et al. Experience preferred: insights from our newest public health professionals on how internships/practicums promote career development. Health Promot Pract 2014;15:95–9. 10.1177/1524839913507578 [DOI] [PubMed] [Google Scholar]
  • 11.Sullivan LM, Velez A, Edouard VM. Realigning the master of public health (MPH) to meet the evolving needs of the workforce. Perspect Pedagog 2017. [Google Scholar]
  • 12.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8:19–32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
  • 13.Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci 2010;5:69. 10.1186/1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Adams J, Hillier-Brown FC, Moore HJ, et al. Searching and synthesising ‘grey literature’ and ‘grey information’ in public health: critical reflections on three case studies. Syst Rev 2016;5:164. 10.1186/s13643-016-0337-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Paez A. Gray literature: an important resource in systematic reviews. J Evid Based Med 2017;10:233–40. 10.1111/jebm.12266 [DOI] [PubMed] [Google Scholar]
  • 16.Peters MDJ, Godfrey CM, Khalil H, et al. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc 2015;13:141–6. 10.1097/XEB.0000000000000050 [DOI] [PubMed] [Google Scholar]
  • 17.Villanueva AM, Hovinga ME, Cass JL. Master of public health community-based Practicum. J Public Heal Manag Pract 2011;17:337–43. 10.1097/PHH.0b013e3182140c78 [DOI] [PubMed] [Google Scholar]
  • 18.Boelen C. Coordinating medical education and health care systems: the power of the social accountability approach. Med Educ 2018;52:96–102. 10.1111/medu.13394 [DOI] [PubMed] [Google Scholar]
  • 19.Global consensus for social accountability of medical schools [online]. Available: https://healthsocialaccountability.org/ [Accessed 23 Mar 2019].
  • 20.Goodman J. Virtual practicums within an MPH program: a career development case study. Health Promot Pract 2015;16:7–11. 10.1177/1524839914555572 [DOI] [PubMed] [Google Scholar]
  • 21.Brambleby P, Coates R. Learning contracts in higher professional training: a user’s guide. Postgrad Med J 1997;73:279–82. 10.1136/pgmj.73.859.279 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Harden RM. Developments in outcome-based education. Med Teach 2002;24:117–20. 10.1080/01421590220120669 [DOI] [PubMed] [Google Scholar]
  • 23.APHEA - core curriculum areas [online]. Available: https://www.aphea.be/Pages/A2.CURRICULA/Curriculum_core_areas.html [Accessed 7 Mar 2019].
  • 24.Calhoun JG, Ramiah K, Weist EM, et al. Development of a core competency model for the master of public health degree. Am J Public Health 2008;98:1598–607. 10.2105/AJPH.2007.117978 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Schuster W, Stevens KB. Supervising Practicum students. Teacher Education and Special Education 1991;14:169–76. 10.1177/088840649101400303 [DOI] [Google Scholar]
  • 26.Beck C, Kosnik C. Professors and the Practicum. J Teach Educ 2002;53:6–19. 10.1177/0022487102053001002 [DOI] [Google Scholar]
  • 27.Carraccio C, Englander R, Holmboe ES, et al. Driving care quality: aligning trainee assessment and supervision through practical application of entrustable professional activities, competencies, and milestones. Acad Med 2016;91:199–203. 10.1097/ACM.0000000000000985 [DOI] [PubMed] [Google Scholar]
  • 28.Landmark BT, Hansen GS, Bjones I, et al. Clinical supervision - factors defined by nurses as influential upon the development of competence and skills in supervision. J Clin Nurs 2003;12:834–41. 10.1046/j.1365-2702.2003.00813.x [DOI] [PubMed] [Google Scholar]
  • 29.Cashman SB, Seifer SD. Service-learning: an integral part of undergraduate public health. Am J Prev Med 2008;35:273–8. 10.1016/j.amepre.2008.06.012 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Data Availability Statement

All data relevant to the study are included in the article. All data generated or analysed during this study are included in this published article.


Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES