Abstract
Background
Pokémon GO, an augmented reality game with widespread popularity, can potentially influence players’ physical activity (PA) levels and psychosocial well-being.
Objective
This review aims to systematically examine the scientific evidence regarding the impact of Pokémon GO on PA and psychosocial well-being in children and adolescents.
Methods
Using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework, we conducted keyword and reference searches in the PubMed, CINAHL, Web of Science, and Scopus databases. We performed title and abstract screening, full-text review, evidence synthesis, and identified research gaps.
Results
Our review included 10 studies that explored the effect of Pokémon GO on PA or psychosocial well-being among children and adolescents. These studies used diverse designs across multiple countries and regions. Pokémon GO use measures encompassed frequency, experience, adherence, and motivation. PA assessment methods ranged from self-reported questionnaires to technology-based evaluations and qualitative approaches. Psychosocial well-being measures included emotional intelligence, personal well-being, self-control, emotionality, and sociability. In general, the estimated impact of Pokémon GO on PA was positive, with gaming elements and engagement correlating with increased PA levels. However, the effect on psychosocial well-being presented mixed results, with positive associations for sociability but a complex relationship involving well-being and internet gaming disorder. The limitations of these studies comprised the absence of randomized controlled trials, heterogeneity in study designs and outcome measures, and potential confounding bias.
Conclusions
Overall, Pokémon GO tends to positively affect PA levels, while the impact on psychosocial well-being remains complex and requires further investigation. Future research should investigate the mechanisms connecting Pokémon GO use with PA and psychosocial well-being and the potential risks of excessive gameplay. These findings can help inform public health interventions to harness gaming technologies for promoting PA and enhancing well-being among the younger generation.
Trial Registration
PROSPERO International Prospective Register of Systematic Reviews CRD42023412032; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=412032
Keywords: Pokémon GO, artificial intelligence, physical activity, psychosocial well-being, children, adolescent
Introduction
Physical activity (PA) and psychosocial well-being are essential components of a healthy lifestyle, particularly for children and adolescents, as they contribute to overall physical and mental health, cognitive development, academic performance, and social skills [1-3]. In children and adolescents, PA refers to any form of exercise or bodily movement that promotes cardiovascular health, muscle strength, flexibility, and bone density, thereby facilitating growth, development, and the establishment of lifelong fitness habits [4]. Psychosocial well-being refers to the interrelation of psychological factors and social elements in children and adolescents that contribute to their overall mental and emotional health [5]. This encompasses aspects of cognitive performance, emotional intelligence, and the balance of recreational activities [5]. Cognitive performance can be understood through indicators such as memory, attention, concentration, and creativity [6]. Emotional intelligence pertains to factors such as self-awareness, emotional regulation, and interpersonal effectiveness, with attributes such as well-being, self-control, emotionality, and sociability [7]. Balanced psychosocial well-being also considers the potential risks of excessive gaming, such as addiction or compulsive behaviors, and how these might impact the broader aspects of a young individual’s life, such as their relationships and academic performance [8].
In recent years, the growing availability and use of mobile health apps have presented unique opportunities to promote PA and an active lifestyle on a broader scale [9]. Pokémon GO (Niantic Inc), an augmented reality game, has captured the interest of millions of users worldwide and holds the potential to promote PA and enhance psychosocial well-being among children and adolescents. While not explicitly designed for this purpose, Pokémon GO shares similarities with exergames, a genre of active video games that promotes energy expenditure, weight loss, and overall health [1]. GPS-based games such as Pokémon GO incorporate mobile gameplay and exploration, provide an engaging alternative to traditional PA, and foster social interaction and outdoor exploration [2]. Despite the mixed evidence on the effectiveness of exergames and activity-based video games in promoting PA [10], Pokémon GO represents a promising avenue for public health efforts to encourage an active lifestyle and improved well-being among young populations.
Pokémon GO’s unique features and characteristics make it a potentially effective tool for promoting PA and psychosocial well-being among children and adolescents. The game’s incorporation of augmented reality, exploration, and social interaction aligns with the fundamental principles of health behavior and well-being theories [11]. For instance, the self-determination theory (SDT) [12] posits that individuals are more likely to engage in activities that satisfy their innate psychological needs for competence, autonomy, and relatedness. Pokémon GO’s gameplay encourages players to develop skills, make choices, and connect with others to pursue digital creatures, fostering an environment conducive to intrinsic motivation and sustained engagement [13]. Furthermore, the social cognitive theory [14] emphasizes the role of observational learning and reinforcement in shaping behavior [15]. Pokémon GO facilitates positive reinforcement through rewards, such as catching rare Pokémon or leveling up, which can encourage continued PA [16]. The game’s social features, such as cooperative raids and player versus player battles, provide opportunities for children and adolescents to interact, learn from one another, and develop social connections, potentially enhancing their psychosocial well-being [17]. However, it is crucial to consider the potential risks associated with excessive or addictive gameplay [18,19]. The dual systems model of adolescent risk-taking highlights the imbalance between the development of reward-driven impulses and cognitive control systems during adolescence. This imbalance may predispose children and adolescents to excessive gameplay, resulting in negative consequences such as reduced time for other essential activities, social isolation, or even physical injuries.
While previous reviews have shed light on the impact of Pokémon GO on PA and psychosocial well-being, they have primarily focused on adult populations. For instance, Baranowski et al [1] found modest increases in PA among older adults, while Khamzina et al [3] reported a statistically significant but clinically modest increase in daily steps taken by Pokémon GO players. Furthermore, Lee et al [2] suggested that the game could improve walking behavior and psychological and social well-being. To our knowledge, no review has specifically examined the effects of Pokémon GO on children and adolescents.
Considering the unique developmental stages and health behavior formation processes of younger populations, our systematic review sought to address this gap by focusing exclusively on children and adolescents [2]. We concurrently examined PA and psychosocial well-being, as PA has been consistently shown to positively influence psychosocial well-being in this age group, leading to improved self-esteem, social skills, and mental health outcomes [20]. One potential avenue for Pokémon GO to affect psychosocial well-being may be through increased PA. By offering the most recent review in this area, we aimed to inform public health interventions and policy making, harnessing the potential of popular gaming technologies to promote PA and enhance well-being among the young generation.
Methods
Overview
The review was carried out following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines (Multimedia Appendix 1) [21,22]. The review was registered in PROSPERO (CRD42023412032).
Study Selection Criteria
Studies that met all of the following criteria were included in the review: (1) study design: experimental studies (eg, randomized controlled trials [RCTs], pre-post interventions, and cross-over trials), observational studies (eg, cross-sectional and prospective cohort studies), and qualitative studies (eg, interviews and focus groups); (2) study subjects: children and adolescents (younger than 18 years old); (3) outcomes: PA measures (eg, daily steps and exercise duration) or psychosocial well-being measures (eg, self-esteem and social support); (4) article type: original, empirical, and peer-reviewed journal publications; (5) time window of search: from the inception of an electronic bibliographic database to March 20, 2023; and (6) language: articles written in English.
Studies were excluded from the review if they met any of the following criteria: (1) studies with a focus on outcomes unrelated to PA (eg, diet and sleep) and psychosocial well-being; (2) studies focusing on adults; (3) non-English language articles; and (4) letters, editorials, study or review protocols, case reports, or review articles.
Search Strategy
A keyword search was performed in 4 electronic bibliographic databases such as PubMed, CINAHL, Web of Science, and Scopus. The search algorithm included “Pokemon GO” or “Pokémon GO.” Multimedia Appendix 2 presents the search algorithm used in each database. The search algorithm was intentionally made simple without incorporating other terms related to PA, psychological well-being, or children and adolescents. This arrangement ensured we minimized the risk of missing relevant studies during the comprehensive literature search stage. Two coauthors (HL and XW) of this review independently screened the title and abstract for the articles found through the keyword search, obtained potentially relevant articles, and reviewed their full texts. The interrater agreement between these 2 authors (HL and XW) was evaluated using Cohen κ (κ=0.89). Disagreements were settled through discussion.
A reference list search (ie, backward reference search) and a cited reference search (ie, forward reference search) were conducted based on the full-text articles identified from the keyword search that met the study selection criteria. Articles identified from the backward and forward reference search were further screened and evaluated using the same study selection criteria. Such procedures were repeated on all newly identified articles until no additional relevant article was found.
Data Extraction and Synthesis
Using a standardized data extraction form, the following methodological and outcome variables were collected from each study: author, publication year, country or region, study design, intervention design, sample size, age range, the proportion of female participants, measures of Pokémon GO use, measures of PA, measures of psychosocial well-being, estimated effect of Pokémon GO on PA, and estimated effect of Pokémon GO on psychosocial well-being. Two coauthors (HL and XW) independently conducted the data extraction, and discrepancies were resolved through discussion with a third coauthor (RA). Heterogeneous exposure and outcome measures prevented meta-analysis, so we narratively summarized the common themes and findings of the included studies.
Study Quality Assessment
GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) is a framework for developing and presenting evidence summaries and provides a systematic approach to making clinical practice recommendations [23]. GRADE evaluates and assigns each study 1 of the 4 levels of evidence: very low, low, moderate, and high. RCTs start at high quality or evidence; due to residual confounding, observational studies start at low quality or evidence. The level of quality or evidence for a study is increased or decreased during the evaluation process using the GRADE criteria concerning the risk of bias, imprecision, inconsistency, indirectness, and publication bias [24].
Results
Study Selection
Figure 1 shows the study selection flowchart. We identified 731 articles through keyword and reference searches, including 96 from PubMed, 156 from CINAHL, 221 from Web of Science, and 258 from Scopus. After removing duplicates, 370 articles underwent title and abstract screening, of which 349 were excluded. The remaining 21 articles were reviewed in the full text against the study selection criteria. Of these, 11 were excluded—6 reported no outcomes concerning PA and psychosocial well-being and the remaining 5 exclusively focused on adults. Therefore, a final pool of 10 articles was included in the review [25-34].
Figure 1.
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram.
Study Characteristics
Table 1 summarizes the essential characteristics of the 10 studies included in the review. All studies were published within the last 5 years, with 4 studies in 2018 [27,29,30,34], 3 in 2019 [28,32,33], and 3 in 2022 [25,26,31]. The studies were conducted in various countries and regions, including Sweden [30], Hong Kong [29], the United States [25,27], Spain [26,34], Taiwan [32,33], Peru [28], and Indonesia [31]. Different study designs were used, including qualitative (interview and focus group) [30,31], cross-sectional [27-29,33], prospective cohort [25], and pre-post studies [26,31,32,34]. The intervention duration ranged from 6 to 10 weeks. Sample sizes ranged from 13 to 944 participants. The age of participants also varied across studies, with some focusing on younger children (ages 5-12 y) and others on adolescents (ages 13-18 y). Two studies included both children or adolescents and adults [27,29]. The percentage of female participants ranged from 23% (7/31) to 56.2% (86/153) across the included studies.
Table 1.
Essential characteristics of the studies included in the reviewa.
| Study ID | Authors (year) | Country or region | Study design | Intervention design | Sample size, n | Age range (y) | Female, n (%) | GRADE qualityb |
| 1 | Lindqvist et al [30] (2018) | Sweden |
|
N/Ac | 13 | 7-12 | 4 (30.8) | Low |
| 2 | Ma et al [29] (2018) | Hong Kong |
|
N/A | 210 (25 of them were 13-17 years old) | 13-17 | 71 (33.8） | Low |
| 3 | Militello et al [27] (2018) | The United States |
|
N/A | 160 parents and 31 children | 5-17 | 7 (23) | Low |
| 4 | Ruiz-Ariza et al [34] (2018) | Spain |
|
The control group did not play Pokémon GO, but the experiment group played for 7 weeks | 190 | 12-15 | 94 (49.5) | Moderate |
| 5 | Cheng [33] (2019) | Taiwan |
|
Playing Pokémon GO for 6 weeks | 466 | 13-15 | 192 (41.2) | Low |
| 6 | Hsieh and Chen [32] (2019) | Taiwan |
|
The control group did not play Pokémon GO, but the experiment group played for 10 weeks | 123 | 11-13 | 63 (51.2) | Moderate |
| 7 | Mejia et al [28] (2019) | Peru |
|
N/A | 944 | 13-16 | 450 (47.7) | Low |
| 8 | Jumareng et al [31] (2022) | Indonesia |
|
The control group did not play Pokémon GO, but the experiment group played for 7 weeks | 94 | 15-18 | 44 (46.8) | Moderate |
| 9 | Martínez-López et al [26] (2022) | Spain |
|
The control group did not play Pokémon GO, but the experiment group played for 8 weeks | 164 | 12-15 | 81 (49.4) | Moderate |
| 10 | Wang et al [25] (2022) | The United States |
|
N/A | 153 | 9-11 | 86 (56.2) | Moderate |
aThe column on intervention design has missing values for the nonintervention studies.
bGRADE: Grading of Recommendations, Assessment, Development, and Evaluations.
cN/A: not applicable.
Measures of Pokémon GO Use
The measures of Pokémon GO use adopted by the included studies are summarized in Table 2. These include frequency of play, such as times played in a month and app installation status [29,30]. Some studies also considered the players’ experience, differentiating between current players and those who played in the past [25,27,31]. The level of adherence and the amount of PA were frequently measured using accumulated points, the number of Pokémon captured, distance traveled in kilometers, or daily game time in minutes [26,28,32,34]. Furthermore, motivation for playing was assessed, as well as categorizing use into levels such as no use, playing a little (less than 2 hours per day), and playing a lot (over 2 hours per day) [28,33].
Table 2.
Measures and estimated impact of Pokémon GO.
| Study ID | Authors (year) | Measures of Pokémon GO use | Measures of PAa | Measures of psychosocial well-being | Estimated effect of Pokémon GO on PA | Estimated effect of Pokémon GO on psychosocial well-being |
| 1 | Lindqvist et al [30] (2018) |
|
|
|
|
|
| 2 | Ma et al [29] (2018) |
|
|
|
|
|
| 3 | Militello et al [27] (2018) |
|
|
|
|
|
| 4 | Ruiz-Ariza et al [34] (2018) |
|
|
|
|
|
| 5 | Cheng [33] (2019) |
|
|
|
||
| 6 | Hsieh and Chen [32] (2019) |
|
|
|
|
|
| 7 | Mejia et al [28] (2019) |
|
|
|
|
|
| 8 | Jumareng et al [31] (2022) |
|
|
|
|
|
| 9 | Martínez-López et al [26] (2022) |
|
|
|
|
|
| 10 | Wang et al [25] (2022) |
|
|
|
|
|
aPA: physical activity.
bN/A: not applicable.
cLSI: Leisure Score Index.
dTEIQue-SF: Trait and Emotional Intelligence Questionnaire Short Form.
eANCOVA: analysis of covariance.
fCG: control group.
gIG: intervention group.
hIGD-20: Internet Gaming Disorder Test-20.
iSEM: structural equation modeling.
jAMOS 22.0: Analysis of Moment Structures 22.0.
kPR: prevalence ratio.
lIPAQ: International Physical Activity Questionnaire.
mCRF: cardiorespiratory fitness.
nMS: muscular strength.
oS/A: speed/agility.
pMVPA: moderate to vigorous physical activity.
Measures of PA
Among the 10 studies included in the review, 6 [25-27,29-31] reported measures of PA encompassing various assessment methods (Table 2). Common measures include self-reported questionnaires such as the Godin-Shephard Leisure-Time Physical Activity Questionnaire or the International Physical Activity Questionnaire [27,31]. Some studies used technology-based assessments such as the iPhone “health” app to measure daily walking and running distances and accelerometers to measure moderate-to-vigorous intensity physical activity [25,29]. Some studies focused on the parental influence on children’s PA and general parenting support [27]. In addition, some studies used qualitative approaches such as focus groups (followed by latent content analysis) and in-depth interviews (followed by thematic analysis) [30,31]. Physical fitness measures such as cardiorespiratory fitness, muscular strength, speed or agility, body weight status, BMI, body fat, or waist-hip index were also used [26].
Measures of Psychosocial Well-Being
Among the 10 studies included in the review, 4 reported measures of psychosocial well-being (Table 2) [28,32-34]. Common measures across these studies encompassed emotional intelligence, personal well-being, self-control, emotionality, and sociability, often assessed using the Trait Emotional Intelligence Questionnaire-Short Form [32,34]. Additionally, 1 study [33] focused on temperament, using a 10-item questionnaire based on Rothbart and Hwang [39], and well-being, assessed by the Well-being Questionnaire by Kurtz and Welch [33]. Two studies also investigated internet or video game addiction, where 1 used the Internet Gaming Disorder-20 and the other used MULTICAGE CAD-4 tests [28,33].
Estimated Effect of Pokémon GO on PA
Among the 6 studies that reported PA-related outcomes [25-27,29-31], the overall estimated effect of Pokémon GO on PA measures was generally positive (Table 2) [25,31]. The findings suggest that gaming elements such as cooperation and exploration are positively associated with players’ PA levels [30]. Moreover, installing the Pokémon GO app and playing the game was positively associated with daily walking and running distances, leisure-time PA, and physical fitness measures [26,27,29]. In some cases, parents’ involvement in Pokémon GO was also positively associated with their children’s PA levels [27].
The duration of increased PA varied across the studies [25-27,29-31]. Of the 6 studies, 4 reported significant increases in PA associated with playing Pokemon GO [26,27,29,31]. The increased PA duration aligned with active gameplay duration in most studies. Specifically, Jumareng et al [31] found increased PA over a 7-week gameplay period. Martínez-López et al [26] showed increased PA after 8 weeks of gameplay. Wang et al [25] and Lindqvist et al [30] did not specify the exact gameplay duration but found higher PA among active players compared to nonplayers cross-sectionally. Only 1 study, Militello et al [27], examined whether increased PA was sustained beyond active gameplay. They surveyed players at 1, 6, and 12 months after the release of Pokemon GO and found significant increases in mild and moderate PA at all 3 time points, suggesting the PA benefits persisted beyond active gameplay [27]. In summary, most studies demonstrated increased PA during active gameplay for 1 week to 2 months. Only 1 study reported that PA increases sustained for at least 12 months after downloading the game [30]. Further research is needed to determine whether playing Pokemon GO yields lasting PA improvements after gameplay ceases.
Estimated Effect of Pokémon GO on Psychosocial Well-Being
Among the 4 studies that reported psychosocial well-being-related outcomes, the overall estimated effect of Pokémon GO on psychosocial well-being is mixed (Table 2) [28,32-34]. On the one hand, playing Pokémon GO has been found to be positively associated with sociability scores in 2 studies, with intervention groups showing higher sociability scores compared to control groups [32,34]. On the other hand, motivation for playing Pokémon GO was positively associated with internet gaming disorder and well-being, indicating a more complex relationship [33]. Additionally, 1 study reported a positive association between the level of Pokémon GO use and video game addiction [28].
Study Quality Assessment
We assessed the quality of the studies included in the review using the GRADE framework (Table 1) [24]. Five studies were rated “moderate” [25,26,31,32], while the remaining 5 were rated “low” in study quality [27-30,33]. The primary reason for a “low” rating was the cross-sectional or qualitative study design, which is prone to confounding bias. On the other hand, the “moderate” rating was primarily due to studies adopting a pre-post or longitudinal study design, which offers more robust causal inferences than cross-sectional or qualitative study designs. However, these studies are still subject to confounding issues due to the lack of randomization.
Discussion
Principal Findings
This study systematically reviewed the existing scientific evidence to discern the effects of Pokémon GO, a globally popular augmented reality game, on PA and psychosocial well-being in children and adolescents. By systematically searching 4 databases, this review scrutinized 10 divergent studies from various countries and regions. The assessments and resultant analysis of these studies revealed that engagement with Pokémon GO is generally correlated with increased levels of PA among the youth, which supports the game’s potential use as a public health intervention tool to combat physical inactivity. Nonetheless, the game’s impact on psychosocial well-being was multifaceted, demonstrating favorable outcomes in sociability [32-34] but illustrating a nuanced interplay between well-being and internet gaming disorder [28,33]. This inconsistency underscores the imperative for more granular research to unweave the intricate relationships between augmented reality gaming, PA, and various dimensions of psychosocial well-being in young populations and to formulate interventions that maximize benefits and mitigate risks associated with gameplay.
Comparison With Prior Work
The findings of this systematic review, which focused on children and adolescents, align with previous reviews that primarily investigated the effects of Pokémon GO on adults. Baranowski et al [1] found that although PA increases from playing Pokémon GO appeared to be small and short-lived among young adults, there may be mental and social health benefits [1]. Similarly, Khamzina et al [3] reported a statistically significant but clinically modest increase in the daily steps taken among game players, emphasizing the challenge of retaining active engagement once the novelty wears off [3]. In our review, Pokémon GO was found to have a generally positive effect on PA measures, with gaming elements and engagement positively associated with PA levels. Lee et al [2] found that Pokémon GO players had greater PA than nonplayers and experienced improved social interactions, mood, selective attention, and concentration [2]. The game also promoted meaningful improvements in walking behavior and psychological and social well-being [2]. Our review discovered similar findings, with positive associations between playing Pokémon GO and sociability scores among children and adolescents but also indications of a more complex relationship involving both well-being and internet gaming disorder.
The underlying mechanisms linking Pokémon GO use to increased PA and improved psychosocial well-being among children and adolescents could be understood through health behavior and psychosocial theories. The social cognitive theory posits that personal factors, environmental factors, and human behavior influence behavior change [14,15]. Pokémon GO, as an augmented reality game, creates a unique environment that combines digital elements with real-world exploration, which can intrinsically motivate children and adolescents to be more physically active [13]. Furthermore, the game encourages social interactions by enabling players to collaborate, compete, and communicate with others, thereby fostering a sense of community and social support [30]. These social aspects may improve psychosocial well-being by satisfying the need for relatedness, as described in the SDT [12]. The SDT also emphasizes the importance of autonomy and competence in promoting intrinsic motivation [41]. Pokémon GO allows players to make choices, set personal goals, and develop skills, which may further enhance their engagement in PA and contribute to improved well-being.
On the other hand, excessive and addictive Pokémon GO gameplay among children and adolescents can have various negative consequences. From a behavioral and psychological standpoint, excessive gameplay can be attributed to operant conditioning [28]. Players become conditioned to seek immediate rewards and gratification through in-game achievements, ultimately leading to addictive behavior [42]. The time spent on Pokémon GO may displace other essential activities such as sleep, academic work, and social interactions, potentially impacting overall well-being and development. Moreover, studies have reported safety concerns related to Pokémon GO gameplay, such as traffic violations, trespassing, and other risky behaviors [43]. These concerns may stem from a lack of situational awareness and impaired decision-making as players become immersed in the game, consistent with the Limited Capacity Model of Motivated Mediated Message Processing [44]. The model suggests that when cognitive resources are devoted to gameplay, individuals may have a reduced capacity to process and respond to real-world environmental cues, increasing the likelihood of engaging in risky behaviors [44]. Therefore, it is crucial to promote responsible gameplay and parental supervision, emphasizing the importance of balancing digital activities with other essential aspects of life and ensuring that Pokémon GO and similar games do not adversely affect the health and safety of children and adolescents.
Multiple factors informed our review’s exclusive focus on Pokémon GO rather than other GPS and location-based games. First, Pokémon GO, with its augmented reality interface, stands out from many other location-based games due to its blend of real-world interaction and digital gameplay [45]. This distinct feature uniquely positions the game to potentially foster both PA and social interaction in an immersive environment, a combination not commonly found in most GPS-based games [46]. Second, the immense popularity and global reach of Pokémon GO, with millions of users spanning various age demographics, offer a more extensive and diverse data pool than lesser-known games [47]. Significantly, Pokémon GO’s allure is not limited solely to children and adolescents. It uniquely engages family units, often with parents or older siblings participating alongside younger players, creating a rich dynamic that integrates recreational activity with family bonding [48]. Furthermore, the game’s significant media coverage and its sparking of global phenomena have led to abundant research specifically focused on Pokémon GO, allowing for a more comprehensive and robust analysis [49]. While previous reviews explored Pokémon GO’s impact on adults, a discernable gap existed in literature specific to younger populations [50]. Given the game’s potential implications for child and adolescent health, especially considering their developmental stages and the formation of health behaviors, it was imperative to address this gap [51]. By concentrating on Pokémon GO, we could delve deeper into its intricate impacts on PA and psychosocial well-being among children and adolescents, providing valuable insights for potential interventions and policies targeted at this age group.
Limitations and Strengths
The systematic review and the included studies exhibit several limitations that should be considered when interpreting the findings. First, none of the included studies adopted an RCT design. This limitation raises concerns about the internal validity of the findings. Second, the relatively small number of studies included in the review may limit the comprehensiveness and generalizability of the results. Additionally, the diverse measures used for PA and psychosocial well-being across the included studies prevented a meta-analysis, thus limiting the review to a narrative synthesis. Furthermore, the small or medium sample sizes in the included studies were not nationally or regionally representative, which may affect the generalizability of the findings to the broader child and adolescent population. Another limitation is the heterogeneity of the studies in terms of geographical location, setting, and study design, further complicating the generalization of the findings. In addition, no study evaluated PA and psychosocial well-being simultaneously, making it difficult to understand how these 2 factors may interact and influence the overall impact of Pokémon GO on children and adolescents.
The existing body of literature assessing Pokémon GO’s impact on psychosocial well-being in children and adolescents has primarily focused on direct associations. However, 1 area that merits further exploration is the potential mediating role of PA in this relationship. Pokémon GO’s influence on well-being might be multifaceted, with direct and indirect effects channeled through enhanced PA. While the direct effects of the game on well-being are noteworthy, it is imperative to consider that some observed benefits might be, in part, attributed to increased PA, a recognized enhancer of psychosocial health. Future studies could offer a more comprehensive understanding by incorporating measures of PA. This would allow for a clearer distinction between the direct effects of gameplay and the potential mediating influence of associated physical activities. Such an approach promises a more nuanced appreciation of how digital games such as Pokémon GO can shape the psychosocial health of young individuals.
The assessment of PA and psychosocial well-being in the included studies presents methodological challenges. The diversity of tools, from objective measures such as the GT3X model accelerometer [25] to qualitative methods such as focus groups [30] and subjective measures such as the iPhone health app [29], introduces potential inconsistencies in capturing PA behaviors. Similarly, the range of instruments for evaluating psychosocial well-being, including the Trait Emotional Intelligence Questionnaire-Short Form [32,34] and the Internet Gaming Disorder-20 test [33], suggests potential discrepancies in operational definitions and assessments. While these tools are grounded in empirical research, their varied use can complicate cross-study comparisons and may not provide a comprehensive understanding of the impacts of Pokémon GO.
Future Directions
Future research would benefit from greater standardization in measurement tools to ensure consistent and comprehensive evaluations of PA and psychosocial well-being. For assessing psychosocial well-being among children and adolescents, recognized measures such as the Strengths and Difficulties Questionnaire [52], Pediatric Quality of Life Inventory [53], and Kidscreen Instruments [54] provide comprehensive insights. Regarding PA, objective tools such as ActiGraph accelerometers [55] and the SenseWear Armband [56] offer reliable data capture, while structured recalls such as the Pediatric Physical Activity Recall [57] can present a more structured self-reporting method. Using these validated measures in research can enhance the robustness of findings and support cross-study comparisons.
Conclusions
This systematic review investigated the effects of Pokémon GO on PA and psychosocial well-being among children and adolescents, incorporating 10 diverse studies conducted in various countries and regions. The main findings indicate that Pokémon GO use generally has a positive effect on PA levels, while the impact on psychosocial well-being is more mixed, revealing both positive associations with sociability scores and a complex relationship involving well-being and internet gaming disorder. Despite the limitations of the included studies and the review itself, such as the lack of RCT designs, small sample sizes, and heterogeneity in measurements and populations, the findings contribute to understanding how Pokémon GO influences the health and well-being of children and adolescents. Future research should address these limitations and explore the potential interaction between PA and psychosocial well-being. Additionally, researchers should investigate the underlying mechanisms and pathways that contribute to both positive and negative outcomes associated with Pokémon GO use, which could inform the development of more effective and engaging interventions to promote health and well-being in young populations.
Abbreviations
- GRADE
Grading of Recommendations, Assessment, Development, and Evaluations
- PA
physical activity
- PRISMA
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
- RCT
randomized controlled trial
- SDT
self-determination theory
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
Search algorithm in databases.
Footnotes
Authors' Contributions: HL and RA conceptualized the review and wrote the original draft. HL and XW performed data curation and formal analysis. HL and XW reviewed and edited the draft under the supervision of RA.
Conflicts of Interest: None declared.
References
- 1.Baranowski T, Lyons EJ. Scoping review of Pokémon GO: comprehensive assessment of augmented reality for physical activity change. Games Health J. 2020;9(2):71–84. doi: 10.1089/g4h.2019.0034. https://europepmc.org/abstract/MED/31386564 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lee JE, Zeng N, Oh Y, Lee D, Gao Z. Effects of Pokémon GO on physical activity and psychological and social outcomes: a systematic review. J Clin Med. 2021;10(9):1860. doi: 10.3390/jcm10091860. https://www.mdpi.com/resolver?pii=jcm10091860 .jcm10091860 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Khamzina M, Parab KV, An R, Bullard T, Grigsby-Toussaint DS. Impact of Pokémon GO on physical activity: a systematic review and meta-analysis. Am J Prev Med. 2020;58(2):270–282. doi: 10.1016/j.amepre.2019.09.005. https://www.ajpmonline.org/article/S0749-3797(19)30410-6/fulltext .S0749-3797(19)30410-6 [DOI] [PubMed] [Google Scholar]
- 4.Landry BW, Driscoll SW. Physical activity in children and adolescents. PM R. 2012;4(11):826–832. doi: 10.1016/j.pmrj.2012.09.585.S1934-1482(12)01052-0 [DOI] [PubMed] [Google Scholar]
- 5.Kumar C. Psychosocial well-being of individuals. In: Leal Filho W, Azul AM, Brandli L, Özuyar PG, Wall T, editors. Quality Education. Cham: Springer International Publishing; 2020. pp. 676–686. [Google Scholar]
- 6.Benedek M, Fink A. Toward a neurocognitive framework of creative cognition: the role of memory, attention, and cognitive control. Curr Opin Behav Sci. 2019;27:116–122. doi: 10.1016/j.cobeha.2018.11.002. [DOI] [Google Scholar]
- 7.Bru-Luna LM, Martí-Vilar M, Merino-Soto C, Cervera-Santiago JL. Emotional intelligence measures: a systematic review. Healthcare (Basel) 2021;9(12):1696. doi: 10.3390/healthcare9121696. https://www.mdpi.com/resolver?pii=healthcare9121696 .healthcare9121696 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Scott J, Porter-Armstrong AP. Impact of multiplayer online role-playing games upon the psychosocial well-being of adolescents and young adults: reviewing the evidence. Psychiatry J. 2013;2013:464685. doi: 10.1155/2013/464685. https://www.hindawi.com/journals/psychiatry/2013/464685/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Mollee JS, Middelweerd A, Kurvers R, Klein M. What technological features are used in smartphone apps that promote physical activity? a review and content analysis. Pers Ubiquit Comput. 2017;21(4):633–643. doi: 10.1007/s00779-017-1023-3. https://link.springer.com/article/10.1007/s00779-017-1023-3 . [DOI] [Google Scholar]
- 10.Sun H. Impact of exergames on physical activity and motivation in elementary school students: a follow-up study. J Sport Health Sci. 2013;2(3):138–145. doi: 10.1016/j.jshs.2013.02.003. https://www.sciencedirect.com/science/article/pii/S2095254613000343?via%3Dihub . [DOI] [Google Scholar]
- 11.An JY, Nigg CR. The promise of an augmented reality game-Pokémon GO. Ann Transl Med. 2017;5(Suppl 1):S11–S11. doi: 10.21037/atm.2017.03.12. https://europepmc.org/abstract/MED/28567393 .atm-05-S1-S11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ntoumanis N, Ng JYY, Prestwich A, Quested E, Hancox JE, Thøgersen-Ntoumani C, Deci EL, Ryan RM, Lonsdale C, Williams GC. A meta-analysis of self-determination theory-informed intervention studies in the health domain: effects on motivation, health behavior, physical, and psychological health. Health Psychol Rev. 2021;15(2):214–244. doi: 10.1080/17437199.2020.1718529. https://eprints.whiterose.ac.uk/155741/ [DOI] [PubMed] [Google Scholar]
- 13.Hall J. Creativity and learning in digital entertainment games [PhD thesis] The Open University. 2021. [2023-10-06]. https://oro.open.ac.uk/74894/
- 14.Young MD, Plotnikoff RC, Collins CE, Callister R, Morgan PJ. Social cognitive theory and physical activity: a systematic review and meta-analysis. Obes Rev. 2014;15(12):983–995. doi: 10.1111/obr.12225. [DOI] [PubMed] [Google Scholar]
- 15.Mobley CC, Sandoval VA. Integrating risk and health-promotion counseling (chapter 10) In: Cappelli DP, Mobley CC, editors. Prevention in Clinical Oral Health Care. St. Louis, Mo: Mosby Elsevier; 2008. pp. 122–133. [Google Scholar]
- 16.Kari T, Arjoranta J, Salo M. Behavior change types with Pokémon GO. FDG '17: Proceedings of the 12th International Conference on the Foundations of Digital Games; August 14-17, 2017; Hyannis, Massachusetts. New York, NY, US: Association for Computing Machinery; 2017. [DOI] [Google Scholar]
- 17.Ewell PJ, Quist MC, Øverup CS, Watkins H, Guadagno RE. Catching more than pocket monsters: Pokémon GO's social and psychological effects on players. J Soc Psychol. 2020;160(2):131–136. doi: 10.1080/00224545.2019.1629867. [DOI] [PubMed] [Google Scholar]
- 18.Li Y, Liu Y, Ye L, Sun J, Zhang J. Pokémon GO! GO! GO! the impact of Pokémon GO on physical activity and related health outcomes. Mhealth. 2021;7:51. doi: 10.21037/mhealth-20-121. https://europepmc.org/abstract/MED/34345628 .mh-07-20-121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Grajek M, Olszewski Ł, Krupa-Kotara K, Białek-Dratwa A, Sas-Nowosielski K. Selected behaviors and addiction risk among users of urban multimedia games. Front Psychol. 2022;13:862891. doi: 10.3389/fpsyg.2022.862891. https://europepmc.org/abstract/MED/35418911 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Committee on Physical Activity and Physical Education in the School Environment. Food and Nutrition Board. Institute of Medicine . In: Educating the Student Body: Taking Physical Activity and Physical Education to School. Kohl HW, Cook HD, editors. Washington, D.C: National Academies Press; 2013. [PubMed] [Google Scholar]
- 21.Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, McKenzie JE. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ. 2021;372:n160. doi: 10.1136/bmj.n160. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=33781993 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi: 10.1136/bmj.n71. http://www.bmj.com/lookup/pmidlookup?view=long&pmid=33782057 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann Holger J. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–926. doi: 10.1136/bmj.39489.470347.AD. https://europepmc.org/abstract/MED/18436948 .336/7650/924 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, Group G. What is "quality of evidence" and why is it important to clinicians? BMJ. 2008;336(7651):995–998. doi: 10.1136/bmj.39490.551019.BE. https://europepmc.org/abstract/MED/18456631 .336/7651/995 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wang SD, Dzubur E, Naya CH, Mason TB, Dunton GF. Dyadic effects of Pokémon GO on physical activity and sedentary behavior in mothers and children. Int J Exerc Sci. 2022;15(5):142–151. doi: 10.70252/GWXW4068. https://europepmc.org/abstract/MED/36896453 .ijes-15-5-142 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Martínez-López EJ, López-Serrano S, de la Torre-Cruz M, Ruiz-Ariza A. Effects of the augmented reality game Pokémon GO on fitness and fatness in secondary school students. Health Education Journal. 2021;81(1):54–68. doi: 10.1177/00178969211047800. https://journals.sagepub.com/doi/10.1177/00178969211047800 . [DOI] [Google Scholar]
- 27.Militello LK, Hanna N, Nigg CR. Pokémon GO within the context of family health: retrospective study. JMIR Pediatr Parent. 2018;1(2):e10679. doi: 10.2196/10679. https://pediatrics.jmir.org/2018/2/e10679/ v1i2e10679 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Mejia CR, Mena LS, Mogollón CA, Figueroa-Romero R, Hernández-Calderón EN, Aguilar-Fernández AM, Chacon JI, Miñan-Tapia A, Tovani-Palone MR, Hernández-Arriaga G. Compulsive gaming in secondary school students from five Peruvian cities: usage and addiction to the Pokémon GO game. Electron J Gen Med. 2019;16(5):em164. doi: 10.29333/ejgm/114664. https://www.ejgm.co.uk/download/compulsive-gaming-in-secondary-school-students-from-five-peruvian-cities-usage-and-addiction-to-the-7560.pdf . [DOI] [Google Scholar]
- 29.Ma BD, Ng SL, Schwanen T, Zacharias J, Zhou M, Kawachi I, Sun G. Pokémon GO and physical activity in Asia: multilevel study. J Med Internet Res. 2018;20(6):e217. doi: 10.2196/jmir.9670. https://www.jmir.org/2018/6/e217/ v20i6e217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lindqvist AK, Castelli D, Hallberg J, Rutberg S. The praise and price of Pokémon GO: a qualitative study of children's and parents' experiences. JMIR Serious Games. 2018;6(1):e1. doi: 10.2196/games.8979. https://games.jmir.org/2018/1/e1/ v6i1e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Jumareng H, Setiawan E, Németh Z. Augmented Pokémon GO in times of COVID-19: does it have any effect on promoting teenagers' physical activity? Teor metod fiz vihov. 2022;22(3):360–365. doi: 10.17309/tmfv.2022.3.09. https://tmfv.com.ua/journal/article/view/1623 . [DOI] [Google Scholar]
- 32.Hsieh CY, Chen T. Effect of Pokémon GO on the cognitive performance and emotional intelligence of primary school students. J Educ Comput Res. 2019;57(7):1849–1874. doi: 10.1177/0735633119854006. [DOI] [Google Scholar]
- 33.Cheng YH. The mediating effects of motivation for playing Pokémon GO on internet gaming disorder and well-being. Am J Fam Ther The. 2019;47(1):19–36. doi: 10.1080/01926187.2019.1583614. [DOI] [Google Scholar]
- 34.Ruiz-Ariza A, Casuso RA, Suarez-Manzano S, Martínez-López EJ. Effect of augmented reality game Pokémon GO on cognitive performance and emotional intelligence in adolescent young. Comput Educ. 2018;116:49–63. doi: 10.1016/j.compedu.2017.09.002. [DOI] [Google Scholar]
- 35.Graneheim U H, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004 Feb;24(2):105–112. doi: 10.1016/j.nedt.2003.10.001.S0260691703001515 [DOI] [PubMed] [Google Scholar]
- 36.Petrides KV. Psychometric properties of the trait emotional intelligence questionnaire. In: Parker J, Saklofske D, Stough C, editors. Advances in the Assessment of Emotional Intelligence. New York, NY: Springer; 2009. pp. 85–101. [Google Scholar]
- 37.Korgaonkar P, Wolin L. A multivariate analysis of web usage. J Advert Res. 1999;39(2):53–68. https://www.semanticscholar.org/paper/A-Multivariate-Analysis-of-Web-Usage-Korgaonkar/41f60f5bd4dea8c91503d4a496a99579c2203125 . [Google Scholar]
- 38.Liu CH, Huang BH, Su CL, Chen SC, Wu YC. The development of learning motivation scale for primary and junior high school students. Psychol Test. 2010;57(2):371–102. [Google Scholar]
- 39.Rothbart MK, Hwang J. Temperament and the development of competence and motivation. In: Elliot AJ, Dweck CS, editors. Handbook of Competence and Motivation. New York, NY, US: Guilford Publications; 2005. pp. 167–184. [Google Scholar]
- 40.Prochaska J J, Sallis J F, Long B. A physical activity screening measure for use with adolescents in primary care. Arch Pediatr Adolesc Med. 2001 May;155(5):554–559. doi: 10.1001/archpedi.155.5.554.poa00312 [DOI] [PubMed] [Google Scholar]
- 41.Matosic D, Ntoumanis N, Quested E. Antecedents of need supportive and controlling interpersonal styles from a self-determination theory perspective: a review and implications for sport psychology research (chapter 7) In: Raab M, Wylleman P, Seiler R, Elbe AM, Hatzigeorgiadis A, editors. Sport and Exercise Psychology Research: From Theory to Practice. San Diego: Academic Press; 2016. pp. 145–180. [Google Scholar]
- 42.James RJE, Tunney RJ. The need for a behavioural analysis of behavioural addictions. Clin Psychol Rev. 2017;52:69–76. doi: 10.1016/j.cpr.2016.11.010. https://linkinghub.elsevier.com/retrieve/pii/S0272-7358(16)30379-8 .S0272-7358(16)30379-8 [DOI] [PubMed] [Google Scholar]
- 43.Barbero EM, Carpenter DM, Maier J, Tseng DS. Healthcare encounters for Pokémon GO: risks and benefits of playing. Games Health J. 2018;7(3):157–163. doi: 10.1089/g4h.2017.0180. [DOI] [PubMed] [Google Scholar]
- 44.Fisher JT, Weber R. Limited capacity model of motivated mediated message processing. In: Roskos-Ewoldsen DR, van den Bulck J, editors. The International Encyclopedia of Media Psychology. Chichester: John Wiley & Sons, Ltd; 2020. pp. 1–14. [Google Scholar]
- 45.Chong Y, Sethi DK, Loh CHY, Lateef F. Going forward with Pokémon GO. J Emerg Trauma Shock. 2018;11(4):243–246. doi: 10.4103/JETS.JETS_87_17. http://www.onlinejets.org/article.asp?issn=0974-2700;year=2018;volume=11;issue=4;spage=243;epage=246;aulast=Chong .JETS-11-243 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Alha K, Leorke D, Koskinen E, Paavilainen J. Augmented play: an analysis of augmented reality features in location-based games. Convergence. 2023;29(2):342–361. doi: 10.1177/13548565231156495. https://journals.sagepub.com/doi/10.1177/13548565231156495 . [DOI] [Google Scholar]
- 47.Althoff T, White RW, Horvitz E. Influence of Pokémon GO on physical activity: study and implications. J Med Internet Res. 2016;18(12):e315. doi: 10.2196/jmir.6759. https://www.jmir.org/2016/12/e315/ v18i12e315 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Malik A, Hiekkanen K, Hussain Z, Hamari J, Johri A. How players across gender and age experience Pokémon GO? Univ Access Inf Soc. 2019;19(4):799–812. doi: 10.1007/s10209-019-00694-7. https://link.springer.com/article/10.1007/s10209-019-00694-7 . [DOI] [Google Scholar]
- 49.Serino M, Cordrey K, McLaughlin L, Milanaik RL. Pokémon GO and augmented virtual reality games: a cautionary commentary for parents and pediatricians. Curr Opin Pediatr. 2016;28(5):673–677. doi: 10.1097/MOP.0000000000000409. [DOI] [PubMed] [Google Scholar]
- 50.Micallef D, Brennan L, Parker L, Schivinski B, Jackson M. Where do online games fit into the health behaviour ecology of emerging adults: a scoping review. Nutrients. 2021;13(8):2895. doi: 10.3390/nu13082895. https://www.mdpi.com/resolver?pii=nu13082895 .nu13082895 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Zsila Á, Orosz G. Motives for playing Pokémon GO and their associations with problematic and health behaviors. In: Geroimenko V, editor. Augmented Reality Games I: Understanding the Pokémon GO Phenomenon. Cham: Springer International Publishing; 2019. pp. 71–93. [Google Scholar]
- 52.Goodman R, Ford T, Simmons H, Gatward R, Meltzer H. Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000;177:534–539. doi: 10.1192/bjp.177.6.534. https://www.cambridge.org/core/journals/the-british-journal-of-psychiatry/article/using-the-strengths-and-difficulties-questionnaire-sdq-to-screen-for-child-psychiatric-disorders-in-a-community-sample/77B6D9AB0A02DF2455847634A704F1C5 .S0007125000156065 [DOI] [PubMed] [Google Scholar]
- 53.Varni JW, Seid M, Kurtin PS. PedsQL 4.0: reliability and validity of the pediatric quality of life inventory version 4.0 generic core scales in healthy and patient populations. Med Care. 2001;39(8):800–812. doi: 10.1097/00005650-200108000-00006. [DOI] [PubMed] [Google Scholar]
- 54.Befus EG, Helseth S, Mølland E, Westergren T, Fegran L, Haraldstad K. Use of KIDSCREEN health-related quality of life instruments in the general population of children and adolescents: a scoping review. Health Qual Life Outcomes. 2023;21(1):6. doi: 10.1186/s12955-023-02088-z. https://hqlo.biomedcentral.com/articles/10.1186/s12955-023-02088-z .10.1186/s12955-023-02088-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Kim Y, Beets MW, Welk GJ. Everything you wanted to know about selecting the "right" Actigraph accelerometer cut-points for youth, but…: a systematic review. J Sci Med Sport. 2012;15(4):311–321. doi: 10.1016/j.jsams.2011.12.001. https://www.jsams.org/article/S1440-2440(11)00475-0/fulltext .S1440-2440(11)00475-0 [DOI] [PubMed] [Google Scholar]
- 56.Drenowatz C, Eisenmann JC. Validation of the SenseWear Armband at high intensity exercise. Eur J Appl Physiol. 2011;111(5):883–887. doi: 10.1007/s00421-010-1695-0. [DOI] [PubMed] [Google Scholar]
- 57.Trost SG, Ward DS, McGraw B, Pate RR. Validity of the Previous Day Physical Activity Recall (PDPAR) in fifth-grade children. Pediatr Exerc Sci. 1999;11(4):341–348. doi: 10.1123/pes.11.4.341. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.
Search algorithm in databases.