Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2022 Oct 19;19(20):13514. doi: 10.3390/ijerph192013514

Comparative Review of Environmental Audit Tools for Public Open Spaces from the Perspective of Children’s Activity

Xue Meng 1,2, Mohan Wang 3,*
Editor: Yongli Cai
PMCID: PMC9602785  PMID: 36294093

Abstract

Public open spaces are important venues for children’s participation in outdoor activities and social life. This study performs a comparative and qualitative review of the tools that can be used to audit the environments of children-focused public open spaces. The analysis reviews 25 studies involving 11 tools for comparison. The results reveal that (1) the tools were developed in different fields; (2) the tools use two data resources, field investigation and geographic databases; (3) the tool dimensions are diverse, as are the number of items covered, and are generally related to four categories: surrounding environment and accessibility, activity and perceived safety, children’s sports and play opportunities, and aesthetic and comfort of the environment; (4) the reliability of most tools has been verified, with some validity still to be confirmed; (5) there are differences in tool users, settings, and aims. Among the tools, the CPAT and the EAPRS are the most comprehensive. Comparative analysis of the tools provides a reference for studies on children-focused public open spaces and for the development and improvement of corresponding tools in the future.

Keywords: children, built environment, parks, play, physical activity, child-friendly environment

1. Introduction

Public open spaces are vital as venues for leisure and recreational activities, social interaction, and sports and fitness activities, among others. Thus, they are particularly important as spatial supports for social and cultural life in cities. Studies have shown that the use of public open spaces by residents, especially children, can significantly impact their physical and mental health [1,2,3,4,5]. Moreover, attractive public open spaces can effectively encourage children to participate more often in physical and play activities as well as promote their ability to interact with peers while playing a positive role in boosting attention, language, cognition, and general capabilities [6,7,8,9,10]. Moreover, general, public spaces are particularly valuable for children with disabilities and autistic disorders [11,12]. In addition, since the outbreak of COVID-19, many child-oriented facilities, such as schools and museums, have been closed for various periods, limiting the options for child-focused activities to some extent [13,14]. As such, the importance of public open spaces for children’s outdoor play, social interaction, and contact with nature has increased dramatically.

Evaluations of public open space environments through quantitative analyses of their availability and environmental quality can be valuable references for improving solutions to existing space environment-related problems. Such evaluations can also provide an in-depth understanding of the impact of environmental mechanisms on specific users and assist in optimal urban resource allocation planning.

Over the past several decades, scholars have researched and systematically evaluated various types of public open spaces, including green spaces in neighborhoods and urban parks. At the same time, environmental audit tools have been developed in the fields of public health, urban and environmental design, and environmental psychology, among others. These include the Public Open Space Tool (POST), the Bedimo-Rung Assessment Tool–Direct Observation (BRAT-DO), and the Environmental Assessment of Public Recreation Spaces (EAPRS) [15,16,17]. Overall, this research stream has become more detailed and focused, with various scholars considering the characteristics of children and conducting relevant environmental assessments from this perspective.

Researchers have also analyzed and reviewed audit tools related to neighborhood physical environments. Nickelson and colleagues reviewed the audit tools used to study the domains and subdomains of neighborhood physical environments [18]. Kan and colleagues [19] focused on audit tools measuring neighborhood built environments from the perspective of aging in place. Other scholars have reviewed neighborhood environmental audit tools from the perspective of walking and cycling [20,21,22]. In terms of open public spaces and parks, Joseph and Maddock analyzed five observational tools used to evaluate the suitability of park environments for physical activity, two of which focused on children’s needs [23]. However, no study has investigated park audit tools from the perspective of children’s usage.

Our study is the first to focus exclusively on audit tools that can assess a park’s physical environment from the perspective of children’s activities. Our objective is to summarize and describe the studies that cover park audit tools for children-focused public open spaces. We describe the basic information and characteristics of the tools, and compare them from the perspectives of field and development goals, data sources and tool forms, dimensions and items, public open space users, tool users, settings, and audit results. Our findings can help provide a basis for child-related environmental behavior research, help improve relevant tools, and support the improvement of public open space quality and the allocation of urban public space resources.

2. Literature Review Process

In our literature review, we systematically investigated studies that focused on assessing the environment of child-focused public open spaces, with the aim of summarizing and categorizing the environmental audit tools described. We conducted our review in June 2022. We used the Web of Science, MEDLINE, and Academic Search Premier databases to identify the appropriate studies and searched using the following keywords in three categories: (1) audit tool-related—audit or instrument or assessment or scale or tool; (2) children-related—child* or toddler or adolescent or teen* or youth* or kid; and (3) space type-related—park or open space or recreation area or green space or play* space. The US-based site Active Living Research (https://activelivingresearch.org/) (accessed on 20 June 2022) was also used to compare public open space-related environmental audit tools to ensure no tool was overlooked. The search was not limited by publication date. Our review process is described in Figure 1.

Figure 1.

Figure 1

Flowchart of the literature review process.

We then screened our search results for studies that met the following criteria: (1) published in a peer-reviewed journal; (2) described children (people under the age of 18) as the main users of the space; (3) included public open spaces in general; (4) focused on the physical environment of the space; (5) included an evaluation of the comprehensive quality of the public space; and (6) had the full text available in English.

Articles were excluded if they: (1) were non-research articles or not primary literature; (2) were not peer-reviewed articles, such as conference articles or academic dissertations; (3) focused on specific types of facilities (e.g., gymnasiums, child-care centers); (4) only evaluated a single dimensional property of public open spaces (e.g., safety); (5) did not mention detailed information on audit tools (e.g., purpose, dimensions, items); or (6) the full-text version was not available or not written in English. In addition, if a study used multiple audit tools but did not propose a new tool, we included it in the corresponding literature on the original tools (e.g., [24,25]). Ultimately, we included 25 studies that met our criteria, and from these we identified 11 unique audit tools for analysis.

3. Overview of Audit Tools and Comparison Analysis

3.1. Audit Tools

These studies included both the introduction of the given tools’ development and the tools’ applications. The tools identified were: the Environmental Assessment of Public Recreation Spaces (EAPRS) [17,26,27,28,29]; the Children’s Public Open Space Tool (C-POST) [30,31]; the Community Park Audit Tool (CPAT) [32,33,34,35,36,37,38]; the Physical Activity Resource Assessment (PARA, adapted version) [39]; the Resilience for Eating and Physical Activity Despite Inequality (READI) park audit tool [40]; the Woolley and Lowe’s play space assessment tool [41,42]; the Parks, Activity and Recreation among Kids (PARK) tool [43,44,45]; the Playable Space Quality Assessment Tool (PSQAT) [46]; the QUality INdex of Parks for Youth (QUINPY) [47]; the Opportunities for Children in Urban Spaces (OCUS) [48]; and the Play Space Audit Tool (PSAT) [49]. Among these, the EAPRS tool does not primarily target children but does include detailed index items and has been used or adapted in multiple studies evaluating children’s playgrounds. Thus, we included it in our comparative analysis.

We present an overview of these 11 tools in Table 1. All the tools were developed over the past 15 years (2006–2020), a relatively concentrated length of time. The EAPRS and the POST-based C-POST were developed relatively early, while the OCUS and the PSAT are more recent. Most of the tools have been used in national or regional projects targeting residents’ physical activity, dietary behavior, or health levels; a few studies do not detail the sources of their tools. The tools assess between 3 and 16 dimensional properties of public open spaces and cover between 22 and 744 individual items. All the tools originate in developed countries in the West, specifically, six in the United States, two in Australia, and one each in the United Kingdom, Canada, and Italy. The United States and Australia were the first to focus on the internal connection between public open spaces and public health. The POST, the BRAT-DO, the EAPRS, and the PARA tools were developed in these countries to evaluate the attributes of public space environments related to users’ physical activity. Subsequently, as the research stream deepened, children-focused audit tools were developed and published. Moreover, due to widespread attention on children as a vital target group in recent years, evaluating public space environments from a children’s activity perspective has become an important direction in public space environmental evaluation. Most of the tools have been developed independently from one another. Overall, we found that different countries and teams were conducting research in parallel while drawing on one another during their research on audit tools.

Table 1.

Summary of the audit tools.

No. Audit Tool Authors Year No. of Dimensions No. of Items Country References
1 EAPRS Saelens et al. 2006 16 744 US [17,26,27,28,29]
2 C-POST Crawford et al. 2008 3 27 Australia [30,31]
3 CPAT Kaczynski et al. 2010 3 118 US [32,33,34,35,36,37,38]
4 PARA (adapted version) DeBate et al. 2011 3 32 US [39]
5 READI park audit tool Veitch et al. 2012 11 84 Australia [40]
6 Woolley and Lowe’s play space assessment tool Woolley & Lowe 2013 3 22 UK [41,42]
7 PARK Bird et al. 2015 5 92 Canada [43,44,45]
8 PSQAT Jenkins et al. 2015 3 24 US [46]
9 QUINPY Rigolon and Nemeth 2016 5 18 US [47]
10 OCUS Garau and Annunziata 2019 4 30 Italy [48]
11 PSAT Gustat et al. 2020 4 47 US [49]

Note: The authors and year the tools were originally reported.

3.1.1. Environmental Assessment of Public Recreation Spaces

The EAPRS tool is aimed at comprehensively measuring the physical environment of public recreational spaces, such as parks and play spaces [17]. Of the 11 tools, it is the most comprehensive and detailed, comprising 16 categories, including paths, water areas, facilities, and play structures, among others. The sixth revision covers 744 individual items targeting children’s activities, including over 200 in the play sets and sports structure category alone [50]. Many scholars have used the items in the tool to observe, evaluate, and empirically investigate children’s recreational spaces. Researchers have also shortened the tool to improve its flexibility and practicality [29].

3.1.2. Children’s Public Open Space Tool

The C-POST is aimed at effectively evaluating the attributes of public open spaces, including parks, playgrounds, and green spaces, which can influence children’s physical activity [30]. It originated as the Public Open Space Tool (POST) [15] proposed by Broomhall and Giles-Corti, and was then simplified and improved to create the C-POST tool by making it more relevant to children. It includes three category dimensions that cover 27 assessment items. The categories are recreational facilities, availability of amenities, and other characteristics related to the environmental quality.

3.1.3. Community Park Audit Tool

The CPAT [32] evaluates the quality of community park environments from a physical activity perspective. Results reflect the level of support a community park can provide for the users’ physical activity, with a focus on the park’s child-related use characteristics. The tool includes three dimensions that cover 118 assessment items. Although the tool includes a relatively high number of items, most of these can be responded to quickly with an objective judgment of “yes/no” or “present/absent.” Thus, the perceived quality of the community park can be assessed in a relatively short time. Another research team developed the eCPAT, an electronic version of the tool, which is a mobile application that offers a youth-friendly alternative to the traditional pencil-and-paper tool [37,38].

3.1.4. Physical Activity Resource Assessment (Adapted Version)

The PARA audit tool aims to evaluate the physical activity resources available in a given neighborhood. It evaluates parks, playgrounds, sports facilities, fitness centers, and other places where residents can engage in physical activities [51]. It involves three dimensions—the features of physical activity resources, amenities, and incivilities (e.g., graffiti, litter, vandalism)—covering a total of 34 items. Subsequently, DeBate et al. proposed an adapted version of the tool focusing on children [39]. The item classifications were not changed, but one item each from amenities and incivilities was deleted in the adapted version, for a total of 32 items.

3.1.5. READI Park Audit Tool

The READI tool is developed based on a study in response to obesity among groups of disadvantaged women and children [40]. It is aimed at identifying and assessing park features associated with the physical activity of park users (children and adults) and comparing environmental differences between urban and rural parks [40]. The tool has 11 category dimensions covering 84 items. Seven categories are child-related, including accessibility, lighting and safety, aesthetics, amenities, and playgrounds.

3.1.6. Woolley and Lowe’s Play Space Assessment Tool

The audit tool proposed by Woolley and Lowe evaluates the level of support a space offers for children’s play [41]. Specifically, it evaluates outdoor activity spaces especially designed and designated as children’s play areas. Woolley and Lowe [41] have used the tool to evaluate 10 play areas in the English Midlands and validated the research assumption that “a more natural play space provides increased play value.” The tool is based on three dimensions: play type, physical elements, and environmental characteristics of the space, covering 22 items.

3.1.7. Parks, Activity and Recreation among Kids

The PARK tool evaluates park features related to children’s physical and recreational activity [43]. This tool draws on and adapts the POST [15] and the BRAT-DO [16], two existing audit tools, adjusting the language of the assessment items and the measurement scale and adding 13 new items for a total of 92. The evolved version explores five dimensions: activities, environmental quality, services, safety, and general impression.

3.1.8. Playable Space Quality Assessment Tool

The PSQAT aims to evaluate the quality of children’s play space considering social–environmental characteristics and factors related to the value of play [46]. It is appropriate for assessing children’s play spaces and activity facilities. It includes three dimensions covering a total of 24 items. The dimensions are location, play value, and care and maintenance. Additionally, PSQAT classifies play spaces into three types according to the size and scale of the park and its distance from the child’s home: door-step, which refers to a park within view of children’s homes; local; and neighborhood, which refers to larger facilities.

3.1.9. Quality Index of Parks for Youth

The QUINPY is aimed at evaluating park quality in urban park systems from the perspective of park users’ needs and park usage [47], specifically focusing on the inclusiveness of parks for young people of different ages. This tool was also developed on the important premise that parks and recreation agencies in many large and medium-sized cities in the United States are continuously collecting basic park information in the process of improving investment decisions, thus providing basic statistical support for evaluations. The QUINPY has five dimensional categories covering 18 items. The dimensions are recreational diversity, natural environment, size, maintenance, and safety [47]. The tool uses publicly available geospatial data to evaluate the parks. Therefore, on-site audits are not required. The significant advantage of this tool is that it saves a considerable amount of time and funds. It also demonstrates a data-driven approach to park environment quality assessment.

3.1.10. Opportunities for Children in Urban Spaces

The OCUS tool evaluates children’s experience in public open spaces. It was designed to evaluate the environmental characteristics of public open spaces considering affordability [48]. It includes four dimensions that cover a total of 30 items. The dimensions include: functional, social, emotional/contextual, and independent accessibility opportunities. The items cover both micro- and macro-scale environmental properties.

3.1.11. Play Space Audit Tool

The PSAT tool quickly and effectively assesses the playability of a children’s playground [49]. It includes four dimensions: general playground overview; playground surface; pathways; and play equipment, covering 47 items. The developers tested the tool with 70 playground samples and verified its reliability.

3.2. Comparison of Audit Tools

As discussed, these audit tools vary in terms of their priorities and scope; thus, each one is more or less applicable in a given setting or scenario. In the following, we present a comparative analysis of the 11 tools (Table 2).

Table 2.

Audit Tool Characteristics.

Tool Field Main Aim Study Subjects
(Age Group)
Data Collection Setting Tool Users Reliability Validity
EAPRS Public health To assess the quality of the physical environment in public recreational spaces General users Field study Parks, playgrounds, green spaces Researchers Some 65% to 69% of the items have a good–excellent range or high percent agreement Not reported
C-POST Public health To assess the features of public open spaces related to children’s physical activity Children
(5 to 12 years old)
Field study Parks, playgrounds, green spaces Researchers All items have at least adequate intra- and inter-rater reliability Not reported
CPAT Public health To assess community park characteristics related to children’s physical activity Children (unspecified age) and general adults Field study Community parks Researchers, community residents, community stakeholders 90% of the items have good to excellent (>70%) agreement
Of the items where kappa coefficients (n = 84) could be calculated, 78.6% have moderate to high agreement (k > 0.40)
Not reported
PARA (adapted version) Public health To assess the features of children’s physical activity resources within neighborhoods Children
(8 to 12 years)
Field study Various physical activity resources Researchers, community residents, community stakeholders Not reported Not reported
READI park audit tool Public health To assess park characteristics related to users’ physical activity Children (5 to 12 years old) and general adults Field study Parks Researchers Intra-rater reliability for each domain ranges from 70% to 100% agreement (mean percent agreement)
Inter-rater reliability for each domain ranges from 81% to 100% agreement (mean percent agreement)
Not reported
Woolley and Lowe’s play space assessment tool Environmental psychology, landscape and environmental design To evaluate the environmental characteristics and play value of children’s playgrounds Children
(all ages)
Field study Playgrounds Researchers Not reported Not reported
PARK Public health To assess park characteristics related to children’s physical activity and recreational activity Children and teenagers
(5 to 18 years old)
Field study Parks Researchers Some 86% of items have good to excellent (≥75%) agreement
Of the items where kappa coefficients (n = 79) could be calculated, 85% have moderate to high agreement (k > 0.40)
Most items (i.e., all but 7) have moderate to high intra-rater reliability (k > 0.40)
Not reported
PSQAT Environmental psychology, landscape and environmental design To evaluate the environmental features of public open spaces considering play value and social environment Children
(all ages)
Field study Play spaces, playgrounds Researchers Inter-rater reliability for each domain is excellent (ICC > 0.85).
Internal consistency reliability for each domain is good to excellent (95% CI = 0.76 to 0.97, 0.53 to 0.95, 0.53 to 0.95)
Not reported
QUINPY Public health, environmental psychology To assess the environmental quality of urban parks for children’s use Children
(all ages)
Geographic databases Parks Researchers, practice designers Not Applicable Excellent (compared to experts’ rankings)
OCUS Environmental psychology To measure and evaluate the affordances of open spaces for children’s use Children
(all ages)
Field study and geographic databases Public open spaces Not reported Not reported Not reported
PSAT Public health To assess the environmental features of playgrounds for children’s play Children
(all ages)
Field study playgrounds Researchers Most domains (all but “general playground overview,” which was not reported) have good to high inter-rater reliability (k ≥ 0.79) Not reported

Note: Reliability and validity estimates are reported according to the original publication of each tool.

3.2.1. Field and Development Purpose

Most of the 11 tools (n = 8) originated in the field of public health and are focused on assessing public open space environmental characteristics that can influence children’s physical activity in the context of health issues such as physical inactivity, obesity, and cardiovascular disease. Among these, the QUINPY tool draws on the results of public health and environmental psychology to evaluate park quality from the perspective of children’s needs and their park utilization [47]. Woolley and Lowe’s play space assessment tool [41], the PSQAT [46], and the PSAT [52] start from the perspective of environmental play value for children. They are based mainly on environmental psychology and landscape design and assess environmental support in public open spaces for children’s play. In general, differences in the field development and the aims of the tools can explain the differences in the dimensions and items covered.

3.2.2. Data Sources and Tool Form

All the tools except the QUINPY require that evaluations be made based on field observations or pictures taken on-site. These field tools are implemented in pencil-and-paper form, with the assessors recording their evaluations manually according to their observations. The QUINPY relies on a publicly available database to obtain information about park environments for evaluation, and information unavailable in the database can be supplemented through aerial photos [47]. The tool is also notable in that scores for each item are computer-calculated, allowing the city parks to be ranked in an urban park system. The CPAT tool is available in an electronic format in the eCPAT app, allowing park users to conduct assessments on their mobile devices (e.g., cell phones and tablets) [37,38]. The OCUS tool combines on-site surveys and the geographic database available, but the form of the tool is not clearly stated [48].

3.2.3. Dimensions and Items

The dimensions of the audit tools are summarized in Table 3. Of the 11 tools, nine have from three to five dimensions, which, in general, include recreational facilities, amenities, and characteristics related to environmental quality. Notably, the READI park audit tool and the EAPRS contain additional dimensions, 11 and 16, respectively. The dimensions in these two tools are also more detailed. For instance, referring to the recreational facilities, some sub-dimensions (e.g., paths, outdoor sports venues, play areas) are treated independently, thus creating additional dimensions.

Table 3.

Summary of tool dimensions.

Audit Tool No. of Dimensions Dimension Names References
EAPRS 16 Trails; Paths; General areas; Water areas; Eating/drinking features; Facilities; Educational/historical features; Sitting or resting features (non-trail); Landscaping; General aesthetics; Access-related features; Directives and information-related features; Safety-related features; Play set or structure features; Other play components (not part of play set); Athletic fields and other recreation areas [50]
C-POST 3 Recreational facilities; Availability of amenities; Other characteristics related to environmental quality [30]
CPAT 3 Access and surrounding neighborhood; Park activity areas; Park quality and safety [32]
PARA (adapted version) 3 Resources for physical activity; Amenities; Incivilities [39]
READI park audit tool 11 Access; Lighting/safety; Aesthetics; Amenities; Playgrounds; Diversity of playground equipment; Safety/condition of playground equipment; Age appropriateness of playground equipment; Paths; Outdoor courts/sports ovals; Informal play spaces [40]
Woolley and Lowe’s play space assessment tool 3 Play types; Physical elements of the space; Environmental characteristics of the space [41]
PARK 5 Activities; Environmental quality; Services; Safety; General impression [43]
PSQAT 3 Location; Play value; Care and maintenance [46]
QUINPY 5 Structured play diversity; Nature; Park size; Maintenance; Safety [47]
OCUS 4 Functional opportunities; Social opportunities; Emotional/contextual opportunities; Independent accessibility opportunities [48]
PSAT 4 General playground overview; Surface, terrain, and vegetation; Pathways; Play structure and equipment [49]

The items the tools cover can be summarized in four categories: surroundings and accessibility, safety and security, children’s sports and play opportunities, and environmental aesthetics and comfort (Figure 2). The surroundings and accessibility category is intended to capture the likelihood that potential users will visit a public open space; the other three categories address the environmental quality of the public open space. Table 4 shows which items from each category are covered by each tool.

Figure 2.

Figure 2

Audit tool dimensions and items.

Table 4.

The relationship between audit tool items and four key categories.

Audit Tool Surroundings and Access Safety and Security Sports and Play Opportunities Environmental Aesthetics and Comfort
Surrounding Land Use Accessibility of Public Transport Streets and Pedestrian Facilities Signage/Notices Location and Entrance Lighting Traffic Calming and Pedestrian Safety Environmental Surveillance Strangers/
Crime Safety
Sports’ Areas Playgrounds Walking and Cycling Paths Access to the Natural Environment Play and Sports Equipment Water and Greenery Landscape Amenities Management and Maintenance
EAPRS
C-POST
CPAT
PARA (Adapted Version)
READI park audit tool
Woolley and Lowe’s play space assessment tool
PARK
PSQAT
QUINPY
OCUS
PSAT

In terms of the scope of the items, the EAPRS, the CPAT, the READI park audit tool, the PARK, and the PSAT cover all four categories, and the items under each category are relatively comprehensive, especially in the CPAT and the EAPRS, the most comprehensive tools. The other tools focus mainly on the latter two categories. Among these, Woolley and Lowe’s play space assessment tool is the most limited in terms of items because it mainly targets the evaluation of children’s play without significant attention to other aspects.

3.2.4. Users of Public Open Spaces

Of the 11 tools, eight have been specifically developed for children, two give special focus to children (i.e., CPAT and READI park audit tool), and one (i.e., EAPRS) does not limit participant groups. The tools target children in the following age ranges: (1) 8–12 years old—the stage characterized by high frequent physical activity during primary school; (2) 5–12 years old—primary school stage; (3) 5–18 years old—primary school and adolescent stage; and (4) children of all age groups. About half of the tools emphasize primary school children’s activities. Although the EAPRS tool does not target specific users, it places considerable importance on the opinions and attitudes of the parents of young children who frequently use parks being considered during the research and development process of park planning, which implies an emphasis on children.

3.2.5. Users of the Tools

Most of the tools (except for OCUS, which is not reported) are suitable for use by researchers. The CPAT and the PARA (adapted version) are also suitable for community residents, community managers, and other non-professionals because the items are easy to understand. The evaluation method is also sufficiently simple that rapid assessment can be realized through assessors’ objective reporting of environmental conditions alone. The eCPAT, the electronic version of the CPAT, is also suitable for use by young people. Generally, the other tools are used only by professional researchers due to the high literacy and experience requirements. Some tools require users to participate in training sessions to ensure a better understanding of the tools and higher evaluation accuracy.

3.2.6. Environmental Setting

In terms of setting, the EAPRS, the C-POST, the PARA (adapted version), and the OCUS apply to parks, play venues, green spaces, and other public open spaces. Among these, the PARA (adapted version) focuses on a physical activity resource evaluation. As such, it is not limited to types of public open spaces but can be applied to stadiums, schools, and other facilities that support physical activity. The CPAT, the PARK, the READI park audit tool, and the QUINPY primarily target parks. Woolley and Lowe’s play space audit tool, the PSAT, and the PSQAT are suitable for evaluating children’s play areas. The former two focus on the quality of specifically designated children’s play spaces, while the latter applies to formal children’s play spaces and informal activity spaces (such as open areas near home).

3.2.7. Auditing Results

Of the 11 tools, seven (EAPRS, C-POST, CPAT, READI park audit tool, PARK, PSQAT, PSAT) report the reliability of their auditing results. The results reveal moderate to high inter-rater reliability. Some tools (C-POST, READI park audit tool, PARK) also show intra-rater reliability. Reliability does not apply to the QUINPY, as the QUINPY is a secondary data-based tool. Since the original version of the PARA confirmed its reliability, we can infer that the adapted version of the PARA also has acceptable reliability [51]. In general, this indicates the reliability of most tools is verified, while the tool proposed by Woolley and Lowe and the OCUS still require verification. Only one tool (QUINPY) confirmed its validity, as the researchers compared it with rankings by experts. Thus, validity still needs to be confirmed for the other tools.

Regarding the application of the audits, most of the tools can be used for auditing public open spaces. Thus, the results of such audits can reflect specific environmental characteristics and be used for environmental behavior research (such as environmental impacts on children’s physical activity). Studies that compare contexts (such as different socio-economic regions) or the environmental equity of open spaces could also be conducted. The QUINPY tool is unique in that it ranks parks within a city’s park system according to their quality scores. Therefore, it is unsuitable for use in evaluating individual parks independently. The audit results can help create a better understanding of the overall quality of park systems within a city and provide reliable support for improvement and maintenance. It can also be helpful for the allocation of public space resources on a larger scale.

4. Discussion

After over a decade of development, scholars from various countries have made significant progress in the environmental assessment of public open spaces, focusing substantial attention on children. According to our comparative study, the 11 audit tools vary in terms of development field and motivation, data source, dimensions, and items covered. Additionally, they can be applied to different needs and scenarios.

The aims of these tools can be summarized as follows. The first is to measure how well different public open spaces support children’s physical activity or play to provide feedback that can guide future design and practice. The second is to validate the key material and environmental factors that affect children’s physical activity and play behavior. This can provide a scientific basis for improving the environment of activity spaces by integrating behavioral observation methods (e.g., SOPARC, SOPLAY, behavior mapping) or behavior recording tools (e.g., GPS, accelerator). The third is to compare public open space environments within different cities/regions and neighborhoods with different social and economic conditions and find solutions by drawing more attention to the improvement of social equality and spatial equity among groups of disadvantaged children. Furthermore, some studies combine one or more audit tools to assess the equity of public open space distribution and its impact in cities or wider areas, considering both quality and quantity [46,52].

In line with the development and improvement of relevant research, we note the following trends among the audit tools. First, data acquisition methods are becoming increasingly diversified, developing from traditional field research and observation techniques to technical approaches, such as geographic information and remote sensing image collection [47,52,53]. Second, the scope of research has gradually expanded from the evaluation of general spaces for children’s activities (such as public open spaces and parks) in the initial stage to the evaluation of specific places such as primary and secondary schools [54]. Third, the research is increasing in depth as it extends beyond the overall evaluation of environmental quality to detailed observations of a particular dimension (such as safety) [55]. Fourth, multiple audit tools have been used simultaneously within one study to obtain environmental characteristics at different scales and conduct a more comprehensive study (e.g., obesogenic environmental assessment, spatial equity) [36,56].

The effectiveness and reliability of all the audit tools have been validated as they have been widely applied and promoted. However, some problems have also been exposed, for example, the fairness of the evaluation results. As the scale of the evaluation object has an important impact on the potential for the allocation of various resources, such as sports and play areas, equipment, and landscapes, larger-scale public open spaces (or parks, play areas) tend to score higher than small- and medium-sized spaces [17,41]. In such cases, the results cannot truly and objectively reflect the quality of the environment and the level of support that a given park provides for children’s activities. Additionally, most tools are limited to use in specific regions, and their effectiveness for wider areas has not been tested. As such, there is still considerable space for further research and regional adaptation of the tools. Moreover, other detailed points for children should be considered when developing future tools. For instance, the distance between the playground and the parking lot can affect children’s respiratory health [57]. Thus, items related to spatial connection or separation should also be considered.

5. Conclusions

Our study is the first to present a literature-based overview of 11 public open space audit tools that focus on children’s activity and then compare their characteristics. Our results indicate that the existing tools for auditing public open spaces focus considerable attention on children and have made numerous breakthroughs in recent years in terms of scope and accuracy owing to in-depth study and the integration of new technologies. However, the results on support for children’s activity in public spaces are not comparable due to different starting points and perspectives among the projects. In the future, relevant tools should be expanded and developed based on previous work while comprehensively considering how children will use and experience the space. Furthermore, new data sources (such as Google Street View and remote sensing images) should be incorporated to increase the efficiency and decrease the costs of public space assessment. Doing so could also enhance the applicability of these audit tools, thereby providing a basis for their promotion, comparison, and validation in different regions and across a wider scope.

The importance of outdoor public spaces for children’s activity cannot be more evident. Reconsidering the environmental quality of urban public spaces from the perspective of children’s activity and conducting relevant scientific assessments remain significant endeavors.

Author Contributions

Conceptualization, X.M. and M.W.; methodology, X.M.; software, X.M. and M.W.; writing—original draft preparation, X.M.; writing—review and editing, X.M. and M.W.; supervision, M.W. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable for studies not involving humans or animals.

Informed Consent Statement

Not applicable for studies not involving humans or animals.

Data Availability Statement

Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research was funded by National Natural Science Foundation of China (Grant No. 52108008, 52008126), China Postdoctoral Science Foundation (Grant No. 2022M710960), Guangdong Basic and Applied Basic Research Foundation (Grant No. 2021A1515010404), Guangdong Educational Science Planning Project (Higher Education Project) (Grant No. 2022GXJK094) and Shenzhen Natural Science Fund (the Stable Support Plan Program) (Grant No. GXWD20220811163342003).

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Herrington S., Brussoni M. Beyond physical activity: The importance of play and nature-based play spaces for children’s health and development. Curr. Obes. Rep. 2015;4:477–483. doi: 10.1007/s13679-015-0179-2. [DOI] [PubMed] [Google Scholar]
  • 2.Taylor A.F., Kuo F.E., Sullivan W.C. Coping with ADD—the surprising connection to green play settings. Environ. Behav. 2001;33:54–77. doi: 10.1177/00139160121972864. [DOI] [Google Scholar]
  • 3.Evans G.W. Child development and the physical environment. Annu. Rev. Psych. 2005;57:423–451. doi: 10.1146/annurev.psych.57.102904.190057. [DOI] [PubMed] [Google Scholar]
  • 4.Zhou Y., von Lengerke T., Dreier M. Comparing different data sources by examining the associations between surrounding greenspace and children’s weight status. Int. J. Health Geogr. 2021;20:24. doi: 10.1186/s12942-021-00278-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bloemsma L.D., Gehring U., Klompmaker J.O., Hoek G., Janssen N.A., Lebret E., Brunekreef B., Wijga A.H. Green space, air pollution, traffic noise and cardiometabolic health in adolescents: The PIAMA birth cohort. Environ. Int. 2019;131:104991. doi: 10.1016/j.envint.2019.104991. [DOI] [PubMed] [Google Scholar]
  • 6.Dunton G.F., Almanza E., Jerrett M., Wolch J., Pentz M.A. Neighborhood park use by children: Use of accelerometry and global positioning systems. Am. J. Prev. Med. 2014;46:136–142. doi: 10.1016/j.amepre.2013.10.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Veitch J., Salmon J., Ball K. Children’s perceptions of the use of public open spaces for active free-play. Child. Geogr. 2007;5:409–422. doi: 10.1080/14733280701631874. [DOI] [Google Scholar]
  • 8.Taylor A.F., Wiley A., Kuo F.E., Sullivan W.C. Growing up in the inner city: Green spaces as places to grow. Environ. Behav. 1998;30:3–27. doi: 10.1177/0013916598301001. [DOI] [Google Scholar]
  • 9.Dadvand P., Nieuwenhuijsen M.J., Esnaola M., Forns J., Basagaña X., Alvarez-Pedrerol M., Rivas I., López-Vicente M., De Castro Pascual M., Su J., et al. Green spaces and cognitive development in primary schoolchildren. Proc. Nat. Acad. Sci. USA. 2015;112:7937–7942. doi: 10.1073/pnas.1503402112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Ahmed S.M., Knibbs L.D., Moss K.M., Mouly T.A., Yang I.A., Mishra G.D. Residential greenspace and early childhood development and academic performance: A longitudinal analysis of Australian children aged 4–12 years. Sci. Total Environ. 2022;833:155214. doi: 10.1016/j.scitotenv.2022.155214. [DOI] [PubMed] [Google Scholar]
  • 11.Canan K.O.Ç., Ahmet K.O.Ç. Engelsiz Parkların Erişilebilirliği: Eskişehir ve Diyarbakır Örnekleri (the accessibility of barrier-free parks: Cases of eskişehir and diyarbakir) Süleyman Demirel Üniversitesi Vizyoner Derg. 2022;13:161–188. [Google Scholar]
  • 12.Lee J., Healy S., Haegele J.A. Environmental and social determinants of leisure-time physical activity in children with autism spectrum disorder. Disabil. Health J. 2022:101340. doi: 10.1016/j.dhjo.2022.101340. [DOI] [PubMed] [Google Scholar]
  • 13.Rajabi M., Ali Afrooz G., Qureshi G., Pombo A. Children’s indoor and outdoor play as potential correlates of mental health during the COVID-19 pandemic in Iran: A brief report on national survey. Int. J. Play. 2021;10:437–447. doi: 10.1080/21594937.2021.2005404. [DOI] [Google Scholar]
  • 14.Towner B.C., Broce R., Battista R.A. Location, type and time: Understanding physical activity in adults and children during Covid-19. Med. Sci. Sports Exerc. 2021;53:342. doi: 10.1249/01.mss.0000763192.15881.c1. [DOI] [Google Scholar]
  • 15.Quality of Public Open Space Tool (POST) [(accessed on 4 October 2019)]. Available online: https://www.science.uwa.edu.au/centres/cbeh/projects/?a=411950.
  • 16.Bedimo-Rung A.L., Gustat J., Tompkins B.J., Rice J., Thomson J. Development of a direct observation instrument to measure environmental characteristics of parks for physical activity. J. Phys. Act. Health. 2006;3:176–189. doi: 10.1123/jpah.3.s1.s176. [DOI] [PubMed] [Google Scholar]
  • 17.Saelens B.E., Frank L.D., Auffrey C., Whitaker R.C., Burdette H.L., Colabianchi N. Measuring physical environments of parks and playgrounds: EAPRS instrument development and inter-rater reliability. J. Phys. Act. Health. 2006;3:190–207. doi: 10.1123/jpah.3.s1.s190. [DOI] [PubMed] [Google Scholar]
  • 18.Nickelson J., Wang A.R., Mitchell Q.P., Hendricks K., Paschal A. Inventory of the physical environment domains and subdomains measured by neighborhood audit tools: A systematic literature review. J. Environ. Psychol. 2013;36:179–189. doi: 10.1016/j.jenvp.2013.07.009. [DOI] [Google Scholar]
  • 19.Kan H.Y., Forsyth A., Molinsky J. Measuring the built environment for aging in place: A review of neighborhood audit tools. J. Plan. Lit. 2020;35:180–194. doi: 10.1177/0885412220903497. [DOI] [Google Scholar]
  • 20.Moudon A.V., Lee C. Walking and bicycling: An evaluation of environmental audit instruments. Am. J. Health Promot. 2003;18:21–37. doi: 10.4278/0890-1171-18.1.21. [DOI] [PubMed] [Google Scholar]
  • 21.Kellstedt D.K., Spengler J.O., Foster M., Lee C., Maddock J.E. A scoping review of bikeability assessment methods. J. Community Health. 2021;46:211–224. doi: 10.1007/s10900-020-00846-4. [DOI] [PubMed] [Google Scholar]
  • 22.Jardim B., de Castro Neto M. Walkability Indicators in the Aftermath of the COVID-19 Pandemic: A Systematic Review. Sustainability. 2022;14:10933. doi: 10.3390/su141710933. [DOI] [Google Scholar]
  • 23.Joseph R.P., Maddock J.E. Comparative analysis of five observational audit tools to assess the physical environment of parks for physical activity. Prev. Chronic Dis. 2016;13:166. doi: 10.5888/pcd13.160176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Flowers E.P., Timperio A., Hesketh K.D., Veitch J. Examining the features of parks that children visit during three stages of childhood. Int. J. Environ. Res. Public Health. 2019;16:1658. doi: 10.3390/ijerph16091658. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Buck C., Bolbos A., Schneider S. Do poorer children have poorer playgrounds? A geographically weighted analysis of attractiveness, cleanliness, and safety of playgrounds in affluent and deprived urban neighborhoods. J. Phys. Act. Health. 2019;16:397–405. doi: 10.1123/jpah.2018-0177. [DOI] [PubMed] [Google Scholar]
  • 26.Hamilton K., Kaczynski A.T., Fair M.L., Lévesque L. Examining the relationship between park neighborhoods, features, cleanliness, and condition with observed weekday park usage and physical activity: A case study. J. Environ. Public Health. 2017;2017:7582402. doi: 10.1155/2017/7582402. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Perry C.K., Saelens B.E., Thompson B. Rural Latino youth park use: Characteristics, park amenities, and physical activity. J. Community Health. 2011;36:389–397. doi: 10.1007/s10900-010-9320-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Reimers A.K., Knapp G. Playground usage and physical activity levels of children based on playground spatial features. J. Public Health. 2017;25:661–669. doi: 10.1007/s10389-017-0828-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Geremia C.M., Cain K.L., Conway T.L., Sallis J.F., Saelens B.E. Validating and shortening the environmental assessment of public recreation spaces observational measure. J. Phys. Act. Health. 2019;16:68–75. doi: 10.1123/jpah.2018-0142. [DOI] [PubMed] [Google Scholar]
  • 30.Crawford D., Timperio A., Giles-Corti B., Ball K., Hume C., Roberts R., Andrianopoulos N., Salmon J. Do features of public open spaces vary according to neighbourhood socio-economic status? Health Place. 2008;14:889–893. doi: 10.1016/j.healthplace.2007.11.002. [DOI] [PubMed] [Google Scholar]
  • 31.Timperio A., Giles-Corti B., Crawford D., Andrianopoulos N., Ball K., Salmon J., Hume C. Features of public open spaces and physical activity among children: Findings from the CLAN study. Prev. Med. 2008;47:514–518. doi: 10.1016/j.ypmed.2008.07.015. [DOI] [PubMed] [Google Scholar]
  • 32.Kaczynski A.T., Stanis S.A.W., Besenyi G.M. Development and Testing of a Community Stakeholder Park Audit Tool. Am. J. Prev. Med. 2012;42:242–249. doi: 10.1016/j.amepre.2011.10.018. [DOI] [PubMed] [Google Scholar]
  • 33.Gallerani D.G., Besenyi G.M., Stanis S.A.W., Kaczynski A.T. “We actually care and we want to make the parks better”: A qualitative study of youth experiences and perceptions after conducting park audits. Prev. Med. 2017;95:S109–S114. doi: 10.1016/j.ypmed.2016.08.043. [DOI] [PubMed] [Google Scholar]
  • 34.Greer A.E., Castrogivanni B., Marcello R. Park use and physical activity among mostly low-to-middle income, minority parents and their children. J. Phys. Act. Health. 2017;14:83–87. doi: 10.1123/jpah.2016-0310. [DOI] [PubMed] [Google Scholar]
  • 35.Hughey S.M., Kaczynski A.T., Child S., Moore J.B., Porter D., Hibbert J. Green and lean: Is neighborhood park and playground availability associated with youth obesity? Variations by gender, socioeconomic status, and race/ethnicity. Prev. Med. 2017;95:S101–S108. doi: 10.1016/j.ypmed.2016.11.024. [DOI] [PubMed] [Google Scholar]
  • 36.Hughey S.M., Kaczynski A.T., Porter D.E., Hibbert J., Turner-McGrievy G., Liu J. Development and testing of a multicomponent obesogenic built environment measure for youth using kernel density estimations. Health Place. 2019;56:174–183. doi: 10.1016/j.healthplace.2019.01.011. [DOI] [PubMed] [Google Scholar]
  • 37.Besenyi G.M., Diehl P., Schooley B., Turner-McGrievy B.M., Wilcox S., Stanis S.A.W., Kaczynski A.T. Development and Testing of Mobile Technology for Community Park Improvements: Validity and Reliability of the eCPAT Application with Youth. Transl. Behav. Med. 2016;6:519–532. doi: 10.1007/s13142-016-0405-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Besenyi G.M., Schooley B., Turner-McGrievy G.M., Wilcox S., Wilhelm Stanis S.A., Kaczynski A.T. The Electronic Community Park Audit Tool (eCPAT): Exploring the use of mobile technology for youth empowerment and advocacy for healthy community policy, systems, and environmental change. Front. Public Health. 2018;6:332. doi: 10.3389/fpubh.2018.00332. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.DeBate R.D., Koby E.J., Looney T.E., Trainor J.K., Zwald M.L., Bryant C.A., McDermott R.J. Utility of the physical activity resource assessment for child-centric physical activity intervention planning in two urban neighborhoods. J. Community Health. 2011;36:132–140. doi: 10.1007/s10900-010-9290-1. [DOI] [PubMed] [Google Scholar]
  • 40.Veitch J., Salmon J., Ball K., Crawford D., Timperio A. Do Features of Public Open Spaces Vary between Urban and Rural Areas? Prev. Med. 2013;56:107–111. doi: 10.1016/j.ypmed.2012.11.016. [DOI] [PubMed] [Google Scholar]
  • 41.Woolley H., Lowe A. Exploring the Relationship between Design Approach and Play Value of Outdoor Play Spaces. Landsc. Res. 2013;38:53–74. doi: 10.1080/01426397.2011.640432. [DOI] [Google Scholar]
  • 42.Bao Y., Gao M., Luo D., Zhou X. Effects of Children’s Outdoor Physical Activity in the Urban Neighborhood Activity Space Environment. Front. Public Health. 2021;9:631492. doi: 10.3389/fpubh.2021.631492. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Bird M.E., Datta G.D., Van Hulst A., Kestens Y., Barnett T.A. A Reliability Assessment of a Direct-observation Park Evaluation Tool: The Parks, Activity and Recreation among Kids (PARK) Tool. BMC Public Health. 2015;15:906. doi: 10.1186/s12889-015-2209-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Chen S., Christensen K.M., Li S. A comparison of park access with park need for children: A case study in Cache County, Utah. Landsc. Urban. Plan. 2019;187:119–128. doi: 10.1016/j.landurbplan.2019.04.001. [DOI] [Google Scholar]
  • 45.Chen S., Sleipness O.R., Christensen K.M., Feldon D., Xu Y. Environmental justice and park quality in an intermountain west gateway community: Assessing the spatial autocorrelation. Landsc. Ecol. 2019;34:2323–2335. doi: 10.1007/s10980-019-00891-y. [DOI] [Google Scholar]
  • 46.Jenkins G.R., Yuen H.K., Rose E.J., Maher A.I., Gregory K.C., Cotton M.E. Disparities in Quality of Park Play Spaces between Two Cities with Diverse Income and Race/Ethnicity Composition: A Pilot Study. Int. J. Environ. Res. Public Health. 2015;12:8009–8022. doi: 10.3390/ijerph120708009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Rigolon A., Németh J.A. Quality Index of Parks for Youth (QUINPY): Evaluating Urban Parks through Geographic Information Systems. Environ. Plan. B Urban Anal. City Sci. 2016;45:275–294. doi: 10.1177/0265813516672212. [DOI] [Google Scholar]
  • 48.Garau C., Annunziata A. Smart city governance and children’s agency: An assessment of the green infrastructure impact on children’s activities in Cagliari (Italy) with the tool “opportunities for children in urban spaces (OCUS) Sustainability. 2019;11:4848. doi: 10.3390/su11184848. [DOI] [Google Scholar]
  • 49.Gustat J., Anderson C.E., Slater S.J. Development and testing of a brief play space audit tool. J. Phys. Act. Health. 2020;17:13–20. doi: 10.1123/jpah.2018-0686. [DOI] [PubMed] [Google Scholar]
  • 50.Saelens B.E. Environmental Assessment of Public Recreation Spaces (EAPRS) Tool. [(accessed on 4 October 2019)]. Available online: https://activelivingresearch.org/environmental-assessment-public-recreation-spaces-eaprs-tool.
  • 51.Lee R.E., Booth K.M., Reese-Smith J.Y., Regan G., Howard H.H. The Physical Activity Resource Assessment (PARA) instrument: Evaluating features, amenities and incivilities of physical activity resources in urban neighborhoods. Int. J. Behav. Nutr. Phys. Act. 2005;2:13. doi: 10.1186/1479-5868-2-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Chaudhury M., Oliver M., Badland H., Garrett N., Witten K. Using the Public Open Space Attributable Index tool to assess children’s public open space use and access by independent mobility. Child. Geogr. 2017;15:193–206. doi: 10.1080/14733285.2016.1214684. [DOI] [Google Scholar]
  • 53.Edwards N., Hooper P., Trapp G.S., Bull F., Boruff B., Giles-Corti B. Development of a Public Open Space Desktop Auditing Tool (POSDAT): A Remote Sensing Approach. Appl. Geogr. 2013;38:22–30. doi: 10.1016/j.apgeog.2012.11.010. [DOI] [Google Scholar]
  • 54.Colabianchi N., Maslow A.L., Swayampakala K. Features and amenities of school playgrounds: A direct observation study of utilization and physical activity levels outside of school time. Int. J. Behav. Nutr. Phys. Act. 2011;8:32. doi: 10.1186/1479-5868-8-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Cradock A.L., Kawachi I., Colditz G.A., Hannon C., Melly S.J., Wiecha J.L., Gortmaker S.L. Playground Safety and Access in Boston Neighborhoods. Am. J. Prev. Med. 2005;28:357–363. doi: 10.1016/j.amepre.2005.01.012. [DOI] [PubMed] [Google Scholar]
  • 56.Iraegui E., Augusto G., Cabral P. Assessing equity in the accessibility to urban green spaces according to different functional levels. ISPRS Int. J. Geo-Inf. 2020;9:308. doi: 10.3390/ijgi9050308. [DOI] [Google Scholar]
  • 57.Birch H., Walter C., Irving L., Dharmage S.C., Smallwood N. Australian childcare centres are too close to car parks exposing children with developing lungs to high levels of traffic pollution. Aust. N. Z. J. Public Health. 2020;44:489–492. doi: 10.1111/1753-6405.13047. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Data sharing is not applicable to this article.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES