Skip to main content
PLOS One logoLink to PLOS One
. 2023 Oct 26;18(10):e0293003. doi: 10.1371/journal.pone.0293003

Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction

Anne U Gold 1,*, Emily M Geraghty Ward 1, Casey L Marsh 1, Twila A Moon 2, Spruce W Schoeneman 3, Alia L Khan 4, Megan K Littrell 1
Editor: Kendra Helen Oliver5
PMCID: PMC10602358  PMID: 37883501

Abstract

Individuals usually develop a sense of place through lived experiences or travel. Here we introduce new and innovative tools to measure sense of place for remote, far-away locations, such as Greenland. We apply this methodology within place-based education to study whether we can distinguish a sense of place between those who have visited Greenland or are otherwise strongly connected to the place from those who never visited. Place-based education research indicates that an increased sense of place has a positive effect on learning outcomes. Thus, we hypothesize that vicarious experiences with a place result in a measurably stronger sense of place when compared to the sense of place of those who have not experienced the place directly. We studied two distinct groups; the first are people with a strong Greenland connection (experts, n = 93). The second are students who have never been there (novices, n = 142). Using i) emotional value attribution of words, ii) thematic analysis of phrases and iii) categorization of words, we show significant differences between novice’s and expert’s use of words and phrases to describe Greenland as a proxy of sense of place. Emotional value of words revealed statistically significant differences between experts and novices such as word power (dominance), feeling pleasantness (valence), and degree of arousal evoked by the word. While both groups have an overall positive impression of Greenland, 31% of novices express a neutral view with little to no awareness of Greenland (experts 4% neutral). We found differences between experts and novices along dimensions such as natural features; cultural attributes; people of Greenland; concerns, importance, or interest in and feeling connected to Greenland. Experts exhibit more complex place attributes, frequently using emotional words, while novices present a superficial picture of Greenland. Engaging with virtual environments may shift novice learners to a more expert-like sense of place, for a far-away places like Greenland, thus, we suggest virtual field trips can supplement geoscience teaching of concepts in far-away places like Greenland and beyond.

Introduction

The warming Arctic is causing rapid changes in the natural and socio-cultural environment of Greenland and other polar regions [1,2]. A changing climate accelerates these changes in the Arctic natural environment, and bold and fast reductions in the global emission of greenhouse gases are critical to slow or mitigate changes that are dramatically changing polar regions [3]. Education plays a central role in building support for policies that reduce greenhouse gas emissions and inspire behavioral change. Prior research suggests that a place-based teaching approach can result in effective learning of scientific concepts and phenomena [4,5], pro-environmental behaviors, attitudes, and awareness [6], and can inspire learners to engage in mitigation of climate change impacts [712].

In the Geosciences, places are commonly defined by their physical attributes, location on Earth and the processes that shape them [13]. In contrast, the social construct of “place” describes the relationship between a physical location and people’s affective response as well as the social values and norms they associate with it [1416]. Thus, a person’s sense of place is defined through the relationships and emotions that connect them to a location [17,18]. Geographically, there is no limitation to the size and characteristics of a place that people are emotionally connected to, it can be vast or locally restricted [19,20].

Place-based science education centers instruction on places to achieve positive learning outcomes, often focusing on locations close to home to build on learners’ own experiences and resulting sense of place [4]. The theoretical frameworks that underpin place-based science education connect science concepts to place-based knowledge [4,2123] or other ways of knowing [24], providing context and relevance to concepts, phenomena or processes that may otherwise appear abstract. Research on place-based learning demonstrates that learning outcomes are more robust and lasting when the content is made relevant through the connection to one’s community or a meaningful place [811,25]. Sense of place is usually developed for locations that hold personal meaning and that people have experienced directly, through lived experiences or visiting [22,25,26] but can be developed for far-away, remote places and through vicarious experiences [4]. Vicarious experiences of a place include virtual field trips [27,28] and exposure to place-related information through stories or other media representations [29]. For example, the tourism or location marketing industries craft deliberate destination images and evoke place-based feelings in their advertisement campaigns to construct their ideal image of a place [3032].

Geoscience educators often teach scientific concepts using examples from field sites at locations far away, many of which students have not visited before, and may never visit. These locations are usually selected because scientific phenomena or processes can be readily observed at these sites. Visiting field sites is an important experience to connect with and learn about places and the processes that shape them [33]. Studying the potential difference between sense of place of those who have strong connections to a place versus novices who have no vicarious experience with the place will provide important insights into geoscience education, both for field education and when using examples of field locations during instructions. Future studies may explore if virtual field trips [3442] may result in an improved sense of place and thus be a valuable addition to instruction in the geosciences.

Here we present new approaches to measure the sense of place that people hold for Greenland—an example of a remote, far-away location. Using tools from cognitive psychology research, we analyze words and phrases that people use to describe Greenland as a means to express their sense of place. We know from linguistics research that language is an important vehicle to share feelings and thoughts and often conveys affect (e.g., emotions, sentiment, attitudes). Words play an important role in our understanding and description of the world around us [43], either explicitly through their core meaning or implicitly through connotation [44]. To generate a baseline understanding of the sense of place that people hold, we surveyed geoscience students who have never visited Greenland and compared these findings to the results from people who either live in or have conducted field research in Greenland. We explored the research questions: In what ways does the sense of place of novices (people who have never visited Greenland before) compare to the sense of place of experts (people who have spent time in Greenland)? We quantified elements of a person’s sense of place and measured the impacts of a more expert-like sense of place on learning outcomes.

Methodology

The goals for this study were i) the development of a methodology to analyze keywords and short phrases that survey respondents used to describe their associations with Greenland to infer their sense of place for Greenland and ii) the development of a comparison set of benchmarks of what sense of place looks like for a group of people who have never been to Greenland (novices) compared to those who have spent time in Greenland (experts).

Theoretical framework for the study design

Research results demonstrate that sense of place is a multidimensional construct that is both shaped by the meaning a place has to people (place meaning, [45,46]) and peoples’ emotional attachment to a particular place (place attachment, [15,20,47]). Place meaning is the symbolic interpretation that people associate with or ascribe to a place and is often grounded in experiences such as shared histories, stories, challenges, or politics of a place [24]. Thus, place meaning varies for individuals or communities and depends on their experience with a place and can be expressed through historical, scientific, aesthetic, or cultural meaning [48,49]. Place attachment describes the emotional bond that individuals have with a specific location. It includes the place itself, the person experiencing the attachment and the cognitive, affective or behavioral connections formed through experiences with the place [20,49]. For this study, we characterize the sense of place for two distinct populations (novices and experts) by eliciting the meaning they hold for Greenland (Fig 1). As with other studies of sense of place, we view place meaning as the foundation for place attachment (e.g., [50]). Thus, place attachment can be considered an outcome of place meaning [5153]. This theoretical framework informed our approach to both the collection and the analysis of the data in order to characterize sense of place.

Fig 1. Theoretical framework illustrating how the subconstructs place meaning and place attachment are related to sense of place.

Fig 1

The bar graphs summarize the findings from this study.

Survey instrument

A brief online survey was developed to measure the sense of place that respondents hold about Greenland (see S1 File). The open-ended survey prompts were based on the place meaning work of [30] and were focused on gathering information about the participants’ feelings for and descriptions of Greenland. To develop his instrument, Young generated a list of place meaning items that characterized his study location, an Australian tourist destination. Based on visitor interviews and coding of information materials about the location, he distilled single meaning items (e.g., pristine) to describe the different facets of place meaning. In our survey, each respondent was asked two questions about Greenland. The first question: “In no more than two sentences, how do you personally feel about Greenland?” was slightly modified from one of Young’s [30] interview questions to be specific to Greenland. In asking respondents to keep their answer to two sentences, we forced sharing of the initial associations with the place and allowed for comparable response length between study subjects. The second survey question “What words would you use to describe Greenland?” was inspired by the list of single place meaning items that are contained in the place meaning instrument that [30] developed based on his analysis. The survey further included two demographic questions asking about the respondent’s age and profession. We tested the validity of the questions through a think-aloud interview with five study subjects. No adjustments were made after the test run. All participants provided electronic consent to participate in the study. We received IRB approval for this study from the University of Colorado IRB office under protocol 21–0189.

Study participants

Novice participants were students recruited from undergraduate science courses at the University of Colorado Boulder through invitation by the course instructors. We selected U.S. undergraduate college students as our novice population because very few students at a U.S. college would have visited Greenland before, thus, responding to the survey with the expertise of a novice. The reason why we surveyed undergraduate students is because this study is part of a larger study that aims to improve undergraduate college instruction using immersive virtual field experiences and therefore, responses from college students provide a meaningful baseline for novices. Experts were recruited as a convenience sample via email, through email lists, online messaging boards and social media in Arctic or Greenland-focused networks and through professional organizations and agencies (such as US Interagency Arctic Research Policy Committee and Association of Polar Early Career Scientists). These networks include many people who are conducting research in Greenland, live in Greenland or spent time in Greenland, and thus provide access to people who have visited, worked, lived or currently live in Greenland. The survey included a question about the respondent’s relationship to Greenland to determine whether a respondent was counted as an expert or a novice.

We collected 142 responses from novices. A total of 102 experts completed the survey, but nine respondents indicated that they had never been to Greenland and thus were excluded from the analysis. Two-thirds of novice respondents (61%) were under 20 years of age and 32% reported an age between 20–29 years, only 8% reported ages above 29 years. All novices reported that they are students. Experts had a wide age distribution; 13% of respondents reported being between ages 20–29, 32% between ages 30–39, 22% between ages 40–49, 18% between ages 50–59 years, 11% between ages 60–60 and 4% over 70 years of age. The majority of the experts (82.5%) described themselves as researchers, scientists, lecturers or science logistic professionals, only 17.5% indicated other professions such as teachers, recreation industry professionals, lawyers or charity managers.

Analysis

Thematic coding of open-ended responses and words

Responses to the first question prompt were coded by one researcher to identify the initial broad themes using thematic analysis [54]. The themes were refined by a single researcher, then applied by a team of three researchers for inter-rater reliability measures. Each researcher coded a sample of survey responses, and further refinements of the theme definitions were made. The researchers coded another subset of survey responses and calculated inter-rater reliability at 94% agreement for novices and 95% for expert responses. Disagreement was resolved through discussion amongst coders before the full set of survey responses was coded for the presence and frequency of themes. The final set of themes and their application are detailed in the code book (see S2 File). Words listed in response to the second prompt were coded into eight different themes using the place meaning coding scheme that [30] developed for an Australian tourism destination. We used the five factors that emerged from his factor analysis on visitors’ descriptions of the place: i) Natural Attributes, ii) Aesthetic Attributes, iii) Remote/Pristine Character, iv) Cultural Attributes and Values, v) Human Impact as our themes, and we added three more emergent themes (Scientific Attributes; Experience/Adventure/Tourism; Unclear) to cover the range of words that were listed by the respondents in this study. Three coders coded each word individually, and any discrepancies between the coders were resolved through discussion.

Affective rating of individual words

To construct the emotional meaning of place, we drew on established emotional ratings for words [44,43,55,56]. The three most important emotional dimensions of words that are described in the theory of emotion [57] are i) valence or pleasantness of the emotions that are evoked by the word and can be described with a range from unhappy to happy; ii) the degree of arousal that is evoked by the word with a range from excited to calm and iii) the dominance or power of the word, which describes the extent to which the word denotes something that ranges from weak-submissive-controlled to strong-dominant-in-control [44,43,55]. Decimal values between 0 and 1 describe the degree of the affective rating. For valence and dominance the value “1” is most positive and most dominant and “0” is most negative and least dominant, and these two affective ratings have a linear relationship (“words that make people feel happier also making them feel more in control”, [55, p. 1196]). However, arousal has a U-shaped correlation to valence and dominance. More positive/dominant words or negative/weak words are more arousing than neutral words [55]. Emotional stimulation of words is also described through positive and negative polarity [56,58,59]. Positive polarity in a word manifests if a word evokes favorable sentiments and negative polarity is measured if a word is associated with unfavorable sentiments [56]. The polarity is treated as binary using “1” for presence and “0” for absence. In our study, we used the lexicon of over 20,000 English words by [43] to determine ratings for valence, arousal and dominance, and the emotion lexicon by [56,59] with more than 14,000 English words to determine the polarity of each word. We generated the list of words provided by novices and experts and conducted minimal data cleaning following [55] (see Table 1). In the data cleaning process, we corrected all typos (icey = icy), used the emotional values for any inflected forms of words that only had the base form of the word in the dictionary (e.g., sparsely = sparse; glaciers = glacier) and if phrases were listed, we used the meaningful fragments of the phrase (e.g., “large island” became “large” and “island”).

Table 1. Summary of word analysis separated by the two respondent groups (experts, novices) with descriptive statistics around the number of words listed and their emotional values (valence, arousal, dominance = VAD), and a description of the modifications conducted during data cleaning.

Sentiment values are available for about 78% of words with a VAD value.

Valid responses % Empty Total # / Unique #, Average # of words Words w/ VAD value (% of all words listed) Word modified
Novice 142 responses 4 responses (3%) 409 words (total)
135 words (unique)
(2.9 total words/ respondent)
385 words
(94% have VAD value)
Plural to Singular 16 words (4%), Typo 5 words (1%), Conjugation 6 words (2%), Fragments from phrases/ sentences 109 words (28%)
Expert 93 responses 2 responses (2%) 380 words (total)
183 words (unique)
(4.1 total words/ respondent)
362 words
(95% have VAD value)
Plural to Singular 17 words (5%), Typo 4 words (1%), Conjugation 7 words (2%), Fragments from phrases/ sentences 65 words (18%)

We conducted descriptive statics and independent samples t-tests to compare expert and novices’ valence, arousal, and dominance measures for the words they reported, as well as the mean percentages of positive emotion words and negative emotion words that experts and novices reported (Table 1).

Limitations

One limitation of this study lies in the characteristics of the novice population, who were recruited from undergraduate Geoscience classes. While none of the respondents had traveled to Greenland before, the views and knowledge of Greenland among geoscience students likely differ from that of the general population, Earth Science undergraduate students’ views may be more expert-like than those of non-geoscientists. We did not collect demographic data beyond age and profession, and are therefore unable to report ethnic and racial backgrounds of the respondents. Respondents with a racial or ethnic background that is grounded in strong place-meaning (e.g., Indigenous or Native), may show a stronger place meaning or attachment. We focused our recruitment on the Greenland research community. Our results may look different, had we recruited only Greenlandic residents, likely showing an even stronger place attachment.

Results

Thematic Analysis of Open-ended Question: “In no more than two sentences, how do you personally feel about Greenland?”

Most survey respondents in both the novice (65%) and expert (87%) groups had an overall positive impression of Greenland. About a third of novices (31%) had neutral responses (neither positive nor negative), often related to having little to no awareness level of Greenland in their survey response (e.g., “I have never been to Greenland”). A small percentage of respondents described contradicting feelings about Greenland, with the expert group responses showing a higher percentage of contradictory feelings (8%). Responses were coded as contradictory if they noted both positive and negative feelings toward Greenland.

In general, both experts and novices noted observations associated with the environment in terms of its beauty (58% and 29% respectively) and remoteness (37% and 20% respectively), however, nearly half of the experts (49%) also noted observations related to Greenland’s people and culture; a theme that was not seen in many of the novice responses (<10%). Fewer novices and experts noted concern for, the importance of, or interest in aspects of Greenland in their responses (≤ 20%). Experts noted emotional connection/attachment to Greenland in the context of its environment (56%) and culture (38%) compared to only a few similar responses from novices (≤5%). Novices had either no or only basic awareness of Greenland, while all experts had either developing or complex awareness (see Table 2 for details and SI1 for description of the codes and example responses).

Table 2. Findings from thematic content analysis and coding of the open-ended responses to the question “In no more than two sentences, how do you personally feel about Greenland? for novice and expert respondents.

Code Frequency % of Responses
Code 1 Overall Impressions Novice Expert Novice Expert
Positive 87 84 64.9% 86.6%
Negative 2 1 1.5% 1.0%
Neutral 41 4 30.6% 4.1%
Contradicting 2 8 1.5% 8.2%
Code 2 Environmental Observations/Associations
Beautiful/Magical/Special Natural Environment 38 56 28.4% 57.7%
Remote/Isolated/Challenging/Wild/Ice Covered Natural Environment 27 36 20.1% 37.1%
Observations surrounding Greenland’s People/Systems/Built Environment 11 47 8.2% 48.5%
Code 3 Concern for Greenland
Environmental/Scientific Concern 12 20 9.0% 20.6%
Cultural/Social/Political Concern 1 12 0.7% 12.4%
Code 4 Greenland’s Importance
Environment/Scientific Importance 14 12 10.4% 12.4%
Cultural/Social/Political Importance 2 9 1.5% 9.3%
Code 5 Interest in Greenland
Environment/Scientific Interest 14 16 10.4% 16.5%
Cultural/Social/Political Interest 3 14 2.2% 14.4%
Code 6 Feelings of Connection or Attachment to Greenland
Environment/Scientific Connection 7 54 5.2% 55.7%
Cultural/Social/Political Connection 2 37 1.5% 38.1%
Code 7 Greenland Awareness Level
No Awareness 41 0 30.6% 0.0%
Basic 73 0 54.5% 0.0%
Developing 19 15 14.2% 15.5%
Complex 1 82 0.7% 84.5%

The word clouds in Fig 2 visualize the difference in responses from experts and novices by highlighting the words they used most frequently in larger and bolder font. The findings corroborate the thematic coding of the responses; novices use more descriptive words (e.g., place, travel, cool, country, Iceland) and words that show uncertainty (e.g., seem, think), while experts in addition to descriptive terms (e.g., ice, landscape, place) use more words associated with emotions (e.g., feel, love, people), words that illustrate a positive emotional connection (e.g., beautiful, amazing, fascinating) and terms that describe the people of Greenland (e.g., people, culture).

Fig 2. Word clouds of the novice and expert responses to the question: “In no more than two sentences, how do you personally feel about Greenland?” (word cloud left: Novice, right: Expert).

Fig 2

Descriptive analysis of words (“What words would you use to describe Greenland?”)

Descriptive analysis

In response to the question “What words would you use to describe Greenland?”, respondents listed 257 different words. Novices (n = 142) listed a total of 409 words (2.9 words/respondent) of which 35% were unique words. The top words were (Fig 3): Cold (68 mentions), Icy (45 mentions), Beautiful (23 mentions), Ice (20 mentions), Island (11 mentions), Large (10 mentions) and Big (9 mentions). Experts (n = 93) listed a total of 380 words (4.1 words/respondent), of these 50% were unique words. The top words were: Beautiful (38 mentions), Vast (15 mentions), Wild (13 mentions), Remote (12 mentions), Nature (8 mentions), Changing (8 mentions) and Fascinating (7 mentions). Experts use more words that describe emotions (e.g., beautiful, fascinating, changing), while novices use more descriptive words (e.g., cold, icy, island, northern).

Fig 3. Word clouds of the novice and expert responses to the question, “What words would you use to describe Greenland?” (word cloud left: Novice, right: Expert).

Fig 3

Emotional value attribution

Emotional value coding of words used by experts and novices showed measurable differences in the emotional values of the words that novices associated with Greenland when compared to experts (Table 3). Experts associated Greenland with words that hold greater emotional meaning: words used by experts had significantly higher ratings for valence, dominance, and arousal (p < .001; Table 3, Fig 4). Table 4 includes examples of the highest values for valence, arousal, and dominance for both novices and experts. The overall percentage of words of positive polarity was significantly higher in our expert respondents (16% difference to novices) and words of negative polarity was lower (9% difference to novices) with a p < .001 (Table 3). Large effect sizes were found for dominance (d = 1.4) and arousal (d = .86). Medium effect sizes were found for valence (d = .56) and percentage of positive emotion words (d = .62). Negative emotion words had a small to medium effect size (d = .39).

Table 3. Descriptive statistics and independent t-test results comparing emotional value ratings of words reported by experts and novices.
n Mean (SD) Median t df p Cohen’s d
Valence Novice 92 0.59 (0.15) 0.60 4.15 228 < .001 0.56
Expert 138 0.67 (0.13) 0.69
Arousal Novice 92 0.45 (0.10) 0.44 6.15 166 < .001 0.86
Expert 138 0.54 (0.13) 0.54
Dominance Novice 92 0.46 (0.12) 0.46 10.39 218 < .001 1.35
Expert 138 0.61 (0.10) 0.61
n Mean (SD) Positive/Negative Words (% of words) t df p Cohen’s d
% Positive Emotion Words Novice 92 17.24 (26.42) 75 (17%) 4.61 228 < .001 0.62
Expert 138 33.4 (25.43) 113 (33%)
% Negative Emotion Words Novice 92 24.88 (27.67) 88 (25%) -3.21 228 0.001 0.39
Expert 138 15.58 (17.58) 63 (16%)
Fig 4. Results of emotional value coding of the words differentiated by novices and experts.

Fig 4

Differences are all statistically significant. Left: Emotional value analysis shows the mean values and standard deviation. Right: Percentage of positive and negative polarity of words.

Table 4. List of the highest and lowest value words for valence, arousal and dominance.

Note that arousal has a u-shaped distribution, while valence and dominance show a linear correlation from positive (high) to negative (low).

Novice Expert
Word (Valence) Word (Arousal) Word (Dominance) Word (Valence) Word (Arousal) Word (Dominance)
High (1st) Magnificent (1) Threatened (0.928) Breathtaking (0.921) Perfect (0.98) Threatened (0.928) Power (0.953)
High (2nd) Love (1) Wild (0.922) Awesome (0.891) Awesome (0.98) Wild (0.922) Majority (0.93)
High (3rd) Awesome (0.98) Awesome (0.897) Extremely (0.886) Fascinating (0.979) Awesome (0.897) Breathtaking (0.9211)
High (4th) Fascinating (0.979) Endangered (0.885) Magnificent (0.886) Wonderful (0.971) Endangered (0.885) Majestic (0.906)
High (5th) Wonderful (0.971) Adventure (0.857) Political (0.875) Freedom (0.969) Amazing (0.837) Force (0.905)
Low (1st) Threatened (0.052) Calm (0.1) Empty (0.188)
Death (0.031) Tranquil (0.094) Empty (0.188)
Low (2nd) Endangered (0.083) Peaceful (0.108) Small (0.12) Threatened (0.052) Calm (0.1) Fragile (0.163)
Low (3rd) Desolate (0.104) Natural (0.118) Unstable (0.15) Endangered (0.083) Quiet (0.105) Sad (0.149)
Low (4th) Raw (0.143) Water (0.123) Unknown (0.204) Desolate (0.104) Calming (0.105) Neglected (0.16)
Low (5th) Unstable (0.167) Serene (0.132) Sparse (0.209) Racism (0.122) Peaceful (0.108) Mosquito (0.198)

Categorization of the words

Categorizing the words from both experts and novices by the place meaning themes that [30] developed, showed that two-thirds of novices used natural attributes or descriptions of Greenland (e.g., cold, icy, island), about a quarter of words described aesthetic attributes or the remote or pristine character of Greenland and only 7% of the words described cultural attributes of Greenland (Table 5). About half the experts used aesthetic attributes or highlighted Greenland’s remote or pristine character and about 11% of the experts included references to cultural attributes of Greenland. A small number of the experts (5%) described the human impact on Greenland, however, even fewer novices’ (0.5%) words described these impacts.

Table 5. Percentage of words used to describe Greenland relative to the total number of words used by experts and novices across themes that emerged from the place meaning study by [30].

Novice Novice Examples (most frequently used words) Experts Expert Examples (most frequently used words)
Natural Attributes and Description 59.7% cold, icy, ice, island, large 24.3% vast, nature, Arctic, ice, icy, rugged
Aesthetic Attributes, Descriptions and Feelings 15.8% beautiful, pretty, interesting, unique, cool 36.6% beautiful, fascinating, awesome, unique, amazing
Remote or Pristine Character 8.2% remote, sparse, untouched, wild, pristine 11.6% wild, remote, pristine, harsh, isolated
Cultural Attributes and Values 7.0% people, population, Viking, Denmark, native 10.9% friendly, people, culture, welcoming, home
Human Impact on Greenland 0.5% threatened, endangered 5.4% changing, threatened, vulnerable, endangered, infrastructure
Experience/Adventure/Tourism 1.4% exotic, adventure, fishing, hiking, tourist 1.0% exotic, fishing, hunting, kayaking
Scientific/Research Attributes 4.3% melting, research, biodiversity, climate, ecological 1.2% research, hydrology, science, elemental
Unclear 3.4% rural, green, clean, Greenland, place 9.4% dynamic, stark, complex, complicated, force

Discussion

A new approach to measuring sense of place in novices and experts

Sense of place is being measured through a variety of quantitative and qualitative instruments and approaches (review in [4]) but is usually studied in cases where participants have in-person place experiences and is based on self-reported data. Here we introduce a novel approach that combines tools from cognitive psychology and linguistics with established instruments to quantify the emotional value of words, categorize them individually, and code the meaning of short answer responses used by survey respondents to describe Greenland–a place that only the expert-like respondents have visited in person. These approaches build on the understanding that words carry important meaning and emotion [43], and we use them here as a proxy for someone’s sense of place. Each of the three approaches (emotional coding, categorization, thematic coding) independently reveals significant differences between the way novices and experts describe Greenland and therefore can be used to quantify where a person falls on the novice to expert continuum (Fig 1). This is the first approach that does not rely on self-report data but instead quantifies proxy data to infer an emotional connection to a place. While the methodological approach was developed for Greenland, we believe that the codes and categories can be applied to other polar and alpine places.

In which ways do novices’ sense of place differ from experts’ sense of place?

We found both a more nuanced place meaning of Greenland by experts when compared to novices, as well as expressions of connection, awareness, and feeling toward Greenland. The lack of awareness of, or sentiments towards, Greenland is an important characteristic of the novices in this study. Experts show a much higher cultural, historic and social awareness of Greenland than novices. Some experts describe contradicting feelings about Greenland, which were often grounded in a love for the natural beauty of the island paired with an awareness of the complex cultural history and environmental or social challenges. The difference between novice and expert data cuts across multiple dimensions (Tables 2 and 5), with the strongest difference between expert and novice responses playing out in connections to, concerns for, and importance of Greenland. The emotional value coding allowed an exploration of the emotions that novices and experts connect with Greenland. Experts frequently used words that carry emotions. In contrast, novices used descriptive words that illustrated a superficial knowledge of Greenland (Tables 35). Feelings of connection or emotional attachment to a place are important components of sense of place [53,60]. Following the definition that sense of place includes both an awareness of the physical location as well as an emotional and cultural component [4], experts’ focus on social, cultural and political aspects of Greenland is likely a reflection of a strong place attachment, a feeling that is mostly absent in novices.

While we see significant differences in the types of attributes used to describe Greenland and the awareness and concern around cultural and social topics, we found that the environmental or scientific importance of Greenland is expressed at similar levels by experts and novices, possibly a representation that much of the communication about Greenland focuses on its unique role in the global climate system [61]. While the respondents that had not yet traveled to Greenland before (novices) built their knowledge about Greenland from sources of information (e.g., news, social media, books, magazine articles, films) and not personal experiences, those who had traveled to or lived in Greenland (experts) grounded their views and feelings about Greenland in direct experiences and an immersion in the culture. If geoscience education aims to increase learners’ sense of place, it is important to expose learners to materials that build awareness of the culture, history and peoples of Greenland in addition to the scientific and environmental concepts.

How can we explain the difference in the view of Greenland between novices and experts?

Sense of place is usually formed through personal experiences [26], however, sense of place around far-away, remote locations is built through exposure to information about the place. This information can be part of intentional branding for a place or random information. Intentional place branding for destinations, regions or nations uses stories or narratives about a location to differentiate one place from another and uses cultural images and representations of place [61,62]. Place branding according to [63] includes the development of a “holistic narrative” around locally relevant and unique elements of a place considered of value to the intended marketing. Branding efforts that are conducted by different organizations often result in incompatible or incoherent narratives, building multi-faceted views of places [64,65]. The traditional and most-wide spread place branding efforts around Greenland are designed as tourism information; documentaries and magazines usually highlight Greenland as a place of nature. In these traditional branding efforts, Greenland is coined as a “colossal, remote and frozen landscape in silence and solitudea frozen Paradise on Earth, inhabited by blissful indigenous people living harmoniously with, in and even ‘as’ nature” [61, p. 445] or alternatively narratives focus on adventure, exploration and discovery. More recent branding efforts have been initiated on the backdrop of increased attention on natural resources, geopolitical changes, changing climate and local efforts for political and economic independence. These recent branding efforts highlight sustainability efforts, modern architecture and mobilization [61,65]), while the reality of travel to and life in Greenland includes climate-impacted changes in the landscape, mineral extraction industry, shortage of qualified workers, transportation challenges and complexity for Greenlandic people [61].

While novices in our study have an overall positive view of Greenland, they display low awareness levels and little concern, interest or knowledge of the culture and history of the island and hold a view of Greenland that is not nuanced and does not include much of the more recent branding content. Novices’ impressions of Greenland focus on the natural environment and hold low emotional value. Experts on the other hand display a more differentiated view and picture of Greenland. While it may be an expected and intuitive finding that those who experience a place directly have a more differentiated view, it is striking that novices in our study strongly subscribe to the traditional place branding that exists around Greenland, a phenomenon that [30] also described for Australia. Efforts in place branding that focus on an expanded view of Greenland and the importance of the culture or thoughtful geoscience instruction, may be able to expand novices’ views.

Why is fostering a sense of place important, especially for a far-away place?

Studies of place-based science education have shown that connecting instructional content to places that are relevant to the learner improves their learning outcomes [5,25,49]. Place-based education helps students develop more nuanced place meanings which can influence their cognitive outcomes (e.g., factual, conceptual and procedural knowledge), behavioral outcomes (e.g., pro-environmental behaviors) and affective outcomes (e.g., increased interest in the discipline, increased connection to the environment) [4]. Place-based education draws from socio-cultural theories of learning to frame the development of curricula; theories that emphasize learning as a social process infusing elements of language and culture [66] and learning done through authentic activity [67,68]. While most place-based education builds on and strengthens direct personal connections to a place, we propose that in a globalized world with readily available access to immersive and virtual imagery and tools, place-based education does not need to be limited to tangible places that learners have experienced. Future research is needed to explore whether virtual field experiences [27,28,3437] and augmented reality [69,70]

make it possible for learners to ‘travel’ to far-away places and use immersive tools for exploration. Educational research has shown the efficacy of immersive experiences and virtual field trips on student learning [27] and others have identified additional outcomes achieved by immersive virtual experiences including increased inclusion and access as compared to in-person field experiences [71,72] and increased engagement and interest to see a place one’s never been to [27]. Virtual field experiences can provide the opportunity to engage in authentic activities, such as environments designed for teaching geologic field mapping (e.g., [73]). The concept of “presence” can help frame the development of virtual field experiences in which the student feels a sense of “being there” in the natural environment and remembers their experience in the virtual environment as having visited a “place” rather than just viewing images on a computer [74]. While socio-cultural elements of places may be more difficult to represent virtually, there have been efforts to incorporate the cultural elements of a place into virtual environments [75]. For these reasons, some argue that virtual environments can be intentionally designed to foster a student’s sense of place [76]. However, this has yet to be a focus of virtual or immersive experiences. Given what we know about the efficacy of local place-based education, we suggest that learners who develop more advanced place meaning will likely see improved learning outcomes as they virtually travel to a far-away place and learn about local phenomena. The next steps in our research will be to study if place-based virtual experiences can lead to deeper place meaning for far-away places and, in turn, improved student outcomes.

Conclusion

Our new methodological approach quantifies sense of place using the emotional value of words and phrases that respondents used to describe their perception of a place as a proxy. Positive learning outcomes for place-based education rely on a strong sense of place, thus the characterization of learners’ sense of place can effectively guide instruction. We found a statistically significant difference between novices’ and experts’ sense of place as expressed in their responses. Following established approaches from cognitive psychology, individual words that respondents shared to describe their association with Greenland allowed us to quantify the emotional value of these words, and we used thematic coding to further categorize the findings. Words and expressions used in experts’ survey responses showed stronger emotional values, awareness of the culture and people, feelings of connection, and concern about and interest for the place than novices’. The findings indicate that this new approach to characterizing sense of place is valid and robust. We suggest that fostering broader perspectives and complex place meaning in learners will increase their sense of place. We suggest that future research is needed to study if virtual visits to remote far-away places can result in an increased sense of place in learners. An increased sense of place may result in positive learning outcomes around geoscience topics and possibly even increase the learners’ hope and desire for environmental stewardship around the place.

Supporting information

S1 File

(XLSX)

S2 File

(DOCX)

Acknowledgments

We are grateful for contributions from Lynne Harden on the research design and discussions with Steven Semken on the framing. Meghan Henderson wrote the Excel Macros that allowed an easy lookup of words in the lexica. Ami Nacu-Schmidt created the illustration in Fig 1.

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

National Science Foundation awards OPP-2021503, OPP-2021275 and OPP-2021543 National Oceanic and Atmospheric Administration award NA17OAR4320101. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Moon TA, Druckenmiller ML, Thoman RL. Arctic Report Card 2021. NOAA: Washington, DC, USA. 2021. [Google Scholar]
  • 2.Curtis T, Kvernmo S, Bjerregaard P. Changing living conditions, life style and health. International Journal of Circumpolar Health. 2005;64(5):442–450. doi: 10.3402/ijch.v64i5.18025 [DOI] [PubMed] [Google Scholar]
  • 3.Intergovernmental Panel on Climate Change. Climate Change. Synthesis Report. Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Pachauri RK, Meyer LA, editors. Geneva, Switzerland; 2014. [Google Scholar]
  • 4.Semken S, Ward EG, Moosavi S, Chinn PW. Place-based education in geoscience: Theory, research, practice, and assessment. Journal of Geoscience Education. 2017;65(4):542–62. [Google Scholar]
  • 5.Apple J, Lemus J, Semken S. Teaching geoscience in the context of culture and place. Journal of Geoscience Education. 2014;62(1):1–4. [Google Scholar]
  • 6.Kudryavtsev Stedman RC, Krasny ME. Sense of place in environmental education. Environmental Education Research. 2012;18(2):229–250. [Google Scholar]
  • 7.Khadka A, Li CJ, Stanis SW, Morgan M. Unpacking the power of place-based education in climate change communication. Applied Environmental Education & Communication. 2021. Jan 2;20(1):77–91. [Google Scholar]
  • 8.Leckey EH, Littrell MK, Okochi C, González-Bascó I, Gold A, Rosales-Collins S. Exploring local environmental change through filmmaking: The Lentes en Cambio Climático program. The Journal of Environmental Education. 2021;52(4):207–22. [Google Scholar]
  • 9.Littrell MK, Tayne K, Okochi C, Leckey E, Gold AU, Lynds S. Student perspectives on climate change through place-based filmmaking. Environmental Education Research. 2020;26(4):594–610. [Google Scholar]
  • 10.Littrell MK, Okochi C, Gold AU, Leckey E, Tayne K, Lynds S, et al. Exploring students’ engagement with place-based environmental challenges through filmmaking: A case study from the Lens on Climate Change program. Journal of Geoscience Education. 2020;68(1):80–93. [Google Scholar]
  • 11.Littrell MK, Gold AU, Koskey KL, May TA, Leckey E, Okochi C. Transformative experience in an informal science learning program about climate change. Journal of Research in Science Teaching. 2022. Feb 3;59:1010–1034. [Google Scholar]
  • 12.Tayne K, Littrell MK, Okochi C, Gold AU, Leckey E. Framing action in a youth climate change filmmaking program: Hope, agency, and action across scales. Environmental Education Research. 2021;27(5):706–26. [Google Scholar]
  • 13.Cresswell T. Place: an introduction. New York: John Wiley & Sons; 2015. [Google Scholar]
  • 14.Williams DR. Making sense of ‘place’: Reflections on pluralism and positionality in place research. Landscape and Urban Planning. 2014;131:74–82. [Google Scholar]
  • 15.Hernández B, Hidalgo MC, Salazar-Laplace ME, Hess S. Place attachment and place identity in natives and non-natives. Journal of Environmental Psychology. 2007;27(4):310–19. [Google Scholar]
  • 16.Walmsley DJ, Young M. Evaluative images and tourism: The use of personal constructs to describe the structure of destination images. Journal of Travel Research. 1998;36(3):65–9. [Google Scholar]
  • 17.Steele F. The sense of place. Boston, MA: CBI publishing company; 1981. [Google Scholar]
  • 18.Stedman RC. Sense of place and forest science: Toward a program of quantitative research. Forest Science. 2003;49:822–9. [Google Scholar]
  • 19.Hay R. Sense of place in developmental context. Journal of Environmental Psychology. 1998;18(1):5–29. [Google Scholar]
  • 20.Scannell L, Gifford R. The relations between natural and civic place attachment and pro-environmental behavior. Journal of Environmental Psychology. 2010;30(3): 289–97. [Google Scholar]
  • 21.Deloria V, Wildcat DR. Power and Place: Indian Education in America. Golden Colorado: Fulcrum Resources; 2001. [Google Scholar]
  • 22.Gruenewald DA. Foundations of place: A multidisciplinary framework for place-conscious education. American Educational Research Journal. 2003;40(3):619–654. [Google Scholar]
  • 23.Lave J, Wenger E. Situated Learning: Legitimate Peripheral Participation. Cambridge: Cambridge University Press; 1991. [Google Scholar]
  • 24.Johnson JT. Place-based learning and knowing: Critical pedagogies grounded in Indigeneity. GeoJournal. 2012;77(6):829–36. [Google Scholar]
  • 25.Sobel D. Place-based education: Connecting classroom and community. Nature and Listening. 2004;4(1):1–7. [Google Scholar]
  • 26.Jolley A, Hampton SJ, Brogt E, Kennedy BM, Fraser L, Knox A. Student field experiences: designing for different instructors and variable weather. Journal of Geography in Higher Education. 2019;43(1):71–95 [Google Scholar]
  • 27.Mead C, Buxner S, Bruce G, Taylor W, Semken S, Anbar AD. Immersive, interactive virtual field trips promote science learning. Journal of Geoscience Education. 2019;67(2):131–142. [Google Scholar]
  • 28.Hamilton D, McKechnie J, Edgerton E, Wilson C. Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education. 2021;8(1):1–32. [Google Scholar]
  • 29.Gunn CA. Vacationscape: Designing tourist regions. Van Nostrand Reinhold: New York; 1988. [Google Scholar]
  • 30.Young M. The social construction of tourist places. Australian Geographer. 1999;30(3):373–89. [Google Scholar]
  • 31.Echtner C, Ritchie J. The measurement of destination image: an empirical assessment. Journal of Travel Research. 1993; 31(4):3–13. [Google Scholar]
  • 32.Cassinger C, Gyimóthy S, Lucarelli A. 20 years of Nordic place branding research: a review and future research agenda. Scandinavian Journal of Hospitality and Tourism. 2021;21(1):70–77. [Google Scholar]
  • 33.Mogk DW, Goodwin C. Learning in the field: Synthesis of research on thinking and learning in the geosciences. Geological Society of America Special Papers. 2012. Apr 1;486(0):131–63. [Google Scholar]
  • 34.Robinson L. Virtual Field Trips: The pros and cons of an educational innovation. Computers in New Zealand Schools: Learning, Teaching, Technology. 2009;21(1):1–17. [Google Scholar]
  • 35.Cliffe AD. A review of the benefits and drawbacks to virtual field guides in today’s Geoscience higher education environment. International Journal of Educational Technology in Higher Education. 2017;14(1):1–14. [Google Scholar]
  • 36.Tjon DM, Tinga AM, Alimardani M, Louwerse MM. Brain activity reflects sense of presence in 360 video for virtual reality. In: 28th International Conference on Information Systems Development. 2019 Aug 28–30; Toulon, France; 2019. [Google Scholar]
  • 37.Tan TTM, Tan AL. 360° Video for Immersive Learning Experiences in Science Education. In: Virtual and Augmented Reality, Simulation and Serious Games for Education. Springer: Singapore. 2021. p.157–175 [Google Scholar]
  • 38.Klippel A, Zhao J, Oprean D, Wallgrün JO, Chang JSK. Research framework for immersive virtual field trips. In: 2019. IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 2019 Mar 23–27; Osaka, Japan: IEE; 2019, p. 1612–1617. [Google Scholar]
  • 39.Zhao J, Wallgrün JO, Sajjadi P, LaFemina P, Lim KY, Springer JP, Klippel A. Longitudinal effects in the effectiveness of educational virtual field trips. Journal of Educational Computing Research. 2022;60(4):1008–1034. [Google Scholar]
  • 40.Turner P, Turner S, Burrows L. Creating a sense of place with a deliberately constrained virtual environment. International Journal of Cognitive Performance Support. 2013;1(1),54–68. [Google Scholar]
  • 41.Arora V, Khazanchi D. Sense of Place in Virtual Learning Environments. Proceedings of the Ninth Midwest Association for Information Systems Conference;2014 Ames May 15–16; Iowa, USA: Association for Information Systems AIS Electronic Library; 2014. p. 1–6. [Google Scholar]
  • 42.Arora V, Khazanchi D. Sense of Virtual Place (SOVP): Conceptual exploration and initial empirical validation. Proceedings of the Americas Conference on Information Systems. Boston, MA: 2017. [Google Scholar]
  • 43.Mohammad S. Obtaining reliable human ratings of valence, arousal, and dominance for 20,000 English words. In: Gurevych I, Miyao Y, editors. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics; 2018 Jul (volume 1: Long papers); Melbourne, Australia: Association for Computational Linguistics. p. 174–184. [Google Scholar]
  • 44.Mohammad SM. Practical and Ethical Considerations in the Effective use of Emotion and Sentiment Lexicons. arXiv preprint arXiv: 2011.03492. 2020 Nov 6. [Google Scholar]
  • 45.Brandenburg AM, Carroll MS. Your place or mine?: The effect of place creation on environmental values and landscape meanings. Society & Natural Resources. 1995;8(5):381–98. [Google Scholar]
  • 46.Manzo LC. For better or worse: Exploring multiple dimensions of place meaning. Journal of Environmental Psychology. 2005;25(1):67–86. [Google Scholar]
  • 47.Williams DR, Stewart SI. Sense of place: An elusive concept that is finding a home in ecosystem management. Journal of Forestry. 1998;96:18–23. [Google Scholar]
  • 48.Ardoin NM. Toward an interdisciplinary understanding of place: Lessons for environmental education. Canadian Journal of Environmental Education. 2006;11(1):112–26. [Google Scholar]
  • 49.Semken S, Freeman CB. Sense of place in the practice and assessment of place‐based science teaching. Science Education. 2008;92(6):1042–57. [Google Scholar]
  • 50.Wynveen CJ, Kyle GT, Sutton SG. Natural area visitors’ place meaning and place attachment ascribed to a marine setting. Journal of Environmental Psychology. 2012; 32:287–296. [Google Scholar]
  • 51.Rajala K, Sorice MG, Thomas VA. The meaning(s) of place: Identifying the structure of sense of place across a social–ecological landscape: People and Nature. 2020;2:718–733. [Google Scholar]
  • 52.Low SM, Altman I. Place Attachment. In: Altman I, Low SM, editors. Place Attachment. Human Behavior and Environment, Boston, MA: Springer; 1992: p. 1–12. [Google Scholar]
  • 53.Stedman RC. Toward a social psychology of place: Predicting behavior from place-based cognitions, attitude, and identity. Environment and behavior. 2002. Sep;34(5):561–81. [Google Scholar]
  • 54.Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101. [Google Scholar]
  • 55.Warriner AB, Kuperman V, Brysbaert M. Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods. 2013;45(4):1191–207. doi: 10.3758/s13428-012-0314-x [DOI] [PubMed] [Google Scholar]
  • 56.Mohammad SM, Turney PD. Crowdsourcing a Word–Emotion Association Lexicon. Computational Intelligence. 2013;29(3):436–65. [Google Scholar]
  • 57.Osgood CE, Suci GJ, Tannenbaum PH. The Measurement of Meaning. Urbana: University of Illinois Press; 1957. [Google Scholar]
  • 58.Plutchik R. A general psychoevolutionary theory of emotion. In: Plutchik R, Kellerman H, editors. Theories of Emotion. Academic Press; 1980. p. 3–33. [Google Scholar]
  • 59.Mohammad S, Turney P. Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. In: Inkpen D, Strapparava C, editors. Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text; 2010 Jun; Los Angeles, CA: Association for Computational Linguistics. p. 26–34. [Google Scholar]
  • 60.Hashemnezhad H, Heidari AA, Mohammad Hoseini P. Sense of place” and “place attachment. International Journal of Architecture and Urban Development. 2013;3(1):5–12. [Google Scholar]
  • 61.Ren C. Cool or hot Greenland? Exhibiting and enacting sustainable Arctic futures. Journal of Cleaner Production. 2016;111:442–50. [Google Scholar]
  • 62.Hankinson G. The management of destination brands: Five guiding principles based on recent developments in corporate branding theory. Journal of Brand Management. 2007;14(3):240–54. [Google Scholar]
  • 63.Anholt S. Competitive Identity: The New Brand Management for Nations, Cities and Regions. New York: Palgrave MacMillan; 2007. [Google Scholar]
  • 64.Ren C, Gyimóthy S. Transforming and contesting nation branding strategies: Denmark at the Expo 2010. Place Branding and Public Diplomacy. 2013;9(1):17–29. [Google Scholar]
  • 65.Thisted K. Pioneering nation: New narratives about Greenland and Greenlanders launched through arts and branding. In: Evengård B, Larsen JM, Paasche Ø, editors. The New Arctic. Cham: Springer International Publishing. 2015. p. 23–38. [Google Scholar]
  • 66.Vygotsky LS. The collected works of L. S. Vygotsky, Vol. 4: The history of the development of higher mental functions. New York: Plenum Press; 1997 Mar 31 (Original work published 1941). [Google Scholar]
  • 67.Brown JS, Collins A, Duguid P. Situated Cognition and the Culture of Learning. Educational Researcher. 1989;18(1):32–42. [Google Scholar]
  • 68.Lave J, Wenger E. Situated learning: Legitimate peripheral participation. Cambridge University Press; 1991. Sep 27. [Google Scholar]
  • 69.Bower M, Howe C, McCredie N, Robinson A, Grover D. Augmented Reality in education–cases, places and potentials. Educational Media International. 2014;51(1):1–15. [Google Scholar]
  • 70.Chen P, Liu X, Cheng W., Huang R. A review of using Augmented Reality in Education from 2011 to 2016. In: Popescu E, Kinshuk, Khribi MKK, Huang R, Jemni M, Chen N-S, Sampson DG, editors: Innovations in smart learning. Singapore: Springer; 2017. p.13–18. [Google Scholar]
  • 71.Marshall A, Thatcher S. Creating Spaces for Geoscientists with Disabilities to Thrive. EOS. 2019. Dec 2;100. [Google Scholar]
  • 72.Whitmeyer S, Fitcher L, Marshall A, Liddle H. The Mid Atlantic Appalachian Orogen Traverse: A Comparison of Virtual and On-Location Field-Based Capstone Experiences. Solid Earth Discuss. 2021. Dec 23; 12(12):2803–20. [Google Scholar]
  • 73.Houghton JJ, Lloyd GE, Robinson A, Gordon CE, Morgan DJ. The Virtual Worlds Project: geological mapping and field skills. Geology Today. 2015. Nov;31(6):227–31. [Google Scholar]
  • 74.Slater M, Wilbur S. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments. 1997. Dec 1;6(6):603–16. [Google Scholar]
  • 75.Robeck E, Awad A, Semken S, Manning C, Daniels M, Blankenbicker A. Earth science all around: Using immersive virtual field trips with place-based instruction in Earth and space science education. The Earth Scientist. 2020;36(1):15–21. [Google Scholar]
  • 76.Hoke K O ’Connell K, Semken S, Arora V. Promoting a Sense of Place Virtually. Bulletin of the Ecological Society of America. 2020. Oct 1;101(4):1–5. [Google Scholar]

Decision Letter 0

Alice Coles-Aldridge

12 Dec 2022

PONE-D-22-27793Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction

PLOS ONE

Dear Dr. Gold,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please note that we have only been able to secure a single reviewer to assess your manuscript. We are issuing a decision on your manuscript at this point to prevent further delays in the evaluation of your manuscript. Please be aware that the editor who handles your revised manuscript might find it necessary to invite additional reviewers to assess this work once the revised manuscript is submitted. However, we will aim to proceed on the basis of this single review if possible.

Please submit your revised manuscript by Jan 23 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Alice Coles-Aldridge

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend your current ethics statement to address the following concerns:

a) Did participants provide their written or verbal informed consent to participate in this study?

b) If consent was verbal, please explain i) why written consent was not obtained, ii) how you documented participant consent, and iii) whether the ethics committees/IRB approved this consent procedure.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

   "The research was funded as part of the PolarPASS project by the National Science Foundation under awards OPP-2021503, OPP-2021275 and OPP-2021543 and National Oceanic and Atmospheric Administration through award NA17OAR4320101. We are grateful for contributions from Lynne Harden on the research design and discussions with Steven Semken on the framing. Meghan Henderson wrote the Excel Macros that allowed an easy lookup of words in the lexica. Ami Nacu-Schmidt created the illustration in figure 1. We received IRB approval for this study from the University of Colorado IRB office under protocol 21-0189."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

 "OPP-2021503

OPP-2021275

OPP-2021543"

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

6. Please ensure that you include a title page within your main document. You should list all authors and all affiliations as per our author instructions and clearly indicate the corresponding author.

7. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. 

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I thought this was a very well-organized, readable manuscript. I learned a great deal about the methodology of using this approach to analyzing sense of place. The only questions I had about the manuscript were the limitations imposed by the two groups--novice and expert--and how these groups were defined. The novice group was mostly young, from a research university. No racial or ethnic demographics were provided. The expert group was highly-educated, older, more experienced. So I wondered first if the novice group had been made up of faculty and other older professionals would they have responded more closely to the expert group? Undergraduates might have a less nuanced understanding of the cultural and geopolitical aspects of a place they've never been than university faculty would, regardless of whether they had been there. Likewise, if the novice group had included students from indigenous populations in the U.S., they might have a very different way of responding than the U Colorado Boulder students.

I thought the limitation of two sentences for the first question in your survey might actually support a less nuanced picture. What would have changed in your research if you had left the amount they wrote open-ended? Some people think while they write so they might reach some of the more complex issues if they were expected to write more. They might reflect more on what they have heard or know about a place rather than hitting on their first impression (cold, remote, beautiful, melting).

Another thought I had was that building knowledge or culture and other aspects of a place is important, but how will you distinguish in your follow-up research whether it's the virtual experience or the type of content that is the most significant in understanding place. For example, I could see where incorporating videos of various people who live in Greenland into your virtual field trip might influence students' perception of that place. Adding readings (novels or articles) that highlight this content might be equally useful. I think you will need to be very careful in distinguishing whether it's the media or the message that matters. I have been very impacted by just meeting one other person from a place I have never been, which can be very influential to how you understand a place. Incorporating a virtual talk from someone who lives there, possibly from the indigenous culture or a faculty member, could be very influential on what someone knows about a place and how they feel about it.

Overall I thought this was extremely well-written and very thought provoking. Thanks so much for providing me the opportunity to review.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Diana M Dalbotten

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Oct 26;18(10):e0293003. doi: 10.1371/journal.pone.0293003.r002

Author response to Decision Letter 0


23 Jan 2023

[copied from response to reviewer file]

Response to Editor and Reviewer Comments and Requests

Editor Request: Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

How we addressed it: We updated the file formatting, and it now meets the PLOS One style requirements.

Editor Request: Please amend your current ethics statement to address the following concerns:

a) Did participants provide their written or verbal informed consent to participate in this study?

b) If consent was verbal, please explain i) why written consent was not obtained, ii) how you documented participant consent, and iii) whether the ethics committees/IRB approved this consent procedure.

How we addressed it: In our study, we collected electronic consent from all survey respondents. We added the following sentence to the ethics statement (located now within Methodology, subsection Survey Instrument: All participants provided electronic consent to participate in the study.

Editor Request: We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

Thank you for stating the following in the Acknowledgments Section of your manuscript:

"The research was funded as part of the PolarPASS project by the National Science Foundation under awards OPP-2021503, OPP-2021275 and OPP-2021543 and National Oceanic and Atmospheric Administration through award NA17OAR4320101. We are grateful for contributions from Lynne Harden on the research design and discussions with Steven Semken on the framing. Meghan Henderson wrote the Excel Macros that allowed an easy lookup of words in the lexica. Ami Nacu-Schmidt created the illustration in figure 1. We received IRB approval for this study from the University of Colorado IRB office under protocol 21-0189."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"OPP-2021503

OPP-2021275

OPP-2021543"

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

How to address – our response:

We removed the funding information from the Acknowledgement section. The funding information and role of the funder is now added to the coverletter. It should read as follows:

“National Science Foundation awards OPP-2021503, OPP-2021275 and OPP-2021543

National Oceanic and Atmospheric Administration award NA17OAR4320101. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

Editor Request: In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

How we addressed it: We have uploaded a file that includes all the data to replicate the study. All data is anonymous and not identifiable.

Editor Request: Please ensure that you include a title page within your main document. You should list all authors and all affiliations as per our author instructions and clearly indicate the corresponding author.

How we addressed it: We have reformatted the title page to match the PLOS One guidelines: Title page: List title, authors, and affiliations as the first page of the manuscript. We have now clearly indicated the corresponding author. Note that our long title does not exceed the character limit of the short title. We, therefore, suggest using the title both as the long and the short title. If you prefer to have a short title that is shorter than the long title please use as the short title: “Measuring novice-expert sense of place for a far-away place”.

Editor Request: Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript.

How we addressed it: We moved the ethics statement to the sub-section “Survey instrument” in the “Methodology” section

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I thought this was a very well-organized, readable manuscript. I learned a great deal about the methodology of using this approach to analyzing sense of place. The only questions I had about the manuscript were the limitations imposed by the two groups--novice and expert--and how these groups were defined. The novice group was mostly young, from a research university. No racial or ethnic demographics were provided. The expert group was highly-educated, older, more experienced. So I wondered first if the novice group had been made up of faculty and other older professionals would they have responded more closely to the expert group? Undergraduates might have a less nuanced understanding of the cultural and geopolitical aspects of a place they've never been than university faculty would, regardless of whether they had been there. Likewise, if the novice group had included students from indigenous populations in the U.S., they might have a very different way of responding than the U Colorado Boulder students.

I thought the limitation of two sentences for the first question in your survey might actually support a less nuanced picture. What would have changed in your research if you had left the amount they wrote open-ended? Some people think while they write so they might reach some of the more complex issues if they were expected to write more. They might reflect more on what they have heard or know about a place rather than hitting on their first impression (cold, remote, beautiful, melting).

Another thought I had was that building knowledge or culture and other aspects of a place is important, but how will you distinguish in your follow-up research whether it's the virtual experience or the type of content that is the most significant in understanding place. For example, I could see where incorporating videos of various people who live in Greenland into your virtual field trip might influence students' perception of that place. Adding readings (novels or articles) that highlight this content might be equally useful. I think you will need to be very careful in distinguishing whether it's the media or the message that matters. I have been very impacted by just meeting one other person from a place I have never been, which can be very influential to how you understand a place. Incorporating a virtual talk from someone who lives there, possibly from the indigenous culture or a faculty member, could be very influential on what someone knows about a place and how they feel about it.

Overall I thought this was extremely well-written and very thought provoking. Thanks so much for providing me the opportunity to review.

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Diana M Dalbotten

How did we address reviewer comments:

1) Limitations of study

Your point is well-taken. The make-up of the pool of respondents is of course very important to the results. The reason why we chose the undergraduate college student as our novice population is that this is a baseline study as part of a larger study in which we implement immersive experiences in undergraduate classrooms. For the follow-on study, we have recruited undergraduate students from a diversity of schools (including students with Indigenous backgrounds and students with a background that is traditionally underrepresented in STEM disciplines). For this study, we did not ask respondents about their racial or ethnic identity.

To address this point in the manuscript, we have added the following text to the Limitations section: ”We did not collect demographic data beyond age and profession, and are therefore unable to report ethnic and racial backgrounds of the respondents. Respondents with a racial or ethnic background that is grounded in strong place-meaning (e.g., Indigenous or Native), may show a stronger place meaning or attachment. We focused our recruitment on the Greenland research community. Our results may look different, had we recruited only Greenlandic residents, likely showing an even stronger place attachment.”

In addition, we have added the following test to the Study Participant section: “We selected U.S. undergraduate college students as our novice population because very few students at a U.S. college would have visited Greenland before, thus, responding to the survey with the expertise of a novice. The reason why we surveyed undergraduate students is because this study is part of a larger study that aims to improve undergraduate college instruction using immersive virtual field experiences and therefore, responses from college students provide a meaningful baseline for novices.” [and further on in the same paragraph, we added about the experts] “These networks include many people who are conducting research in Greenland, live in Greenland or spent time in Greenland, and thus provide access to people who have visited, worked, lived or currently live in Greenland.”

2) Changes in the way open-ended question was asked

The reason why we limited the writing to two sentences is that we wanted to capture what first comes to mind for the respondents. We further wanted to keep the survey short and be able to compare the results of different respondents. Had we left the question without guidance on length, one respondent would have written 10 sentences, while others may have written just one sentence. Providing guidance to keep the answers short allowed for responses that were comparable between all respondents.

To address this point in the manuscript, we have added the following sentence to the Methodology section: “In asking respondents to keep their answer to two sentences, we forced sharing of the initial associations with the place and allowed for comparable response length between study subjects.“

3) Follow on research limitation:

This is a very good point and helpful advice. We will keep this in mind for our future study design.

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

How we addressed this: We uploaded all four figures to PACE and they look clear. See screenshot below.

Attachment

Submitted filename: ResponseToReviewer.docx

Decision Letter 1

Kendra Helen Oliver

11 Jul 2023

PONE-D-22-27793R1Measuring novice-expert sense of place for a far-away place: Implications for geoscience instructionPLOS ONE

Dear Dr. Gold,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 25 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Kendra Helen Oliver, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Hello,

I hope this letter finds you well. I am writing to provide feedback on the manuscript titled "Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction." I would like to commend you on this work and the significant adjustments you have made in addressing the reviewers' comments. The revisions have certainly improved the clarity and quality of your work. However, there is one key aspect that still requires attention, as highlighted by Reviewer 2.

Reviewer 2 pointed out the need for reframing the hypothesis to clearly elucidate the role of the virtual experience in the context of measuring novice-expert sense of place. This is a valid concern and addressing it will greatly enhance the overall contribution of your paper. To this end, I suggest making the following revisions:

Introduction:

a. Clearly state the objective of your study, emphasizing the investigation of how virtual experiences contribute to measuring novice-expert sense of place for a far-away location.

b. Provide a brief overview of the existing literature on the use of virtual experiences in geoscience instruction and their potential impacts on developing a sense of place.

Hypothesis:

a. Revisit your hypothesis and reframe it to explicitly incorporate (or remove the mention of) the role of the virtual experience. Consider highlighting how the virtual experience affects novice-expert sense of place formation and whether it influences participants' spatial understanding, emotional connection, or both.

b. Justify the need for investigating the impact of the virtual experience, particularly in the context of assessing sense of place for a far-away location where physical visits may be limited.

Results and Discussion:

a. Analyze and interpret the data collected in the context of the reframed hypothesis, emphasizing the relationship between the virtual experience and participants' sense of place.

b. Discuss any limitations or challenges associated with using a virtual experience as a proxy for a physical visit, and address how these limitations may impact the interpretation of the results.

By addressing these points, you will provide a clearer understanding of the role and significance of the virtual experience in your study. This reframing will contribute to the broader discussion surrounding the use of virtual experiences in geoscience instruction and the measurement of sense of place. Once again, I would like to express my appreciation for the efforts you have made in revising your manuscript. I believe that incorporating these suggested revisions will strengthen the impact and relevance of your work. Should you have any questions or require further clarification, please do not hesitate to reach out to me.

Thank you for your attention to these revisions. I look forward to reviewing the updated version of your manuscript.

Kendra H. Oliver, Ph.D., M.P.S.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This article looks great. Thanks for the chance to review. All of my comments were addressed in full.

Reviewer #2: The manuscript titled "Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction" by Gold et al. introduces an innovative method to measure individuals' sense of place for remote locations. The objective is to evaluate whether survey data can support the idea that virtual visits to distant locations can enhance learners' sense of place, transitioning them from a novice-like to a more expert-like understanding. The authors discuss virtual learning experiences, behavioral changes, and introduce novel tools for measuring sense of place in remote areas. They argue that virtual experiences can indeed alter learners' sense of place. The study emphasizes the significance of a strong sense of place for positive learning outcomes in place-based education. The authors' approach, quantifying sense of place based on emotional value of words and phrases, can provide guidance for instructional design and assist educators in tailoring lessons to learners' perceptions of a place. This research holds substantial importance and is likely to be of interest to a wide range of professionals in the field.

However, while the methodological approach appears appropriate, I came across a significant issue that restricts the discussion of the results. The hypothesis regarding the deeper meaning of place resulting from virtual experiences was not explored in this study. Although the study reported data on vocabulary differences between novice and expert learners in describing Greenland as a sense of place proxy, it remains ambiguous since no virtual learning experiences were integrated into the results. I would like to clarify that this critique does not pertain to the data quality; I read the manuscript with great interest. However, the data fail to address the proposed question. It becomes challenging to assess the significance of survey data in terms of changing learners' sense of place because there is no integration with virtual learning experiences to support the argument that virtual visits to remote locations can induce behavioral change. Employing surveys both before and after virtual visits to evaluate shifts in awareness would have likely been a more effective strategy when employing this methodology. Undoubtedly, there exists a connection between vocabulary and behavior. Words serve as lenses through which we perceive the world. Language has the potential to influence opinions and behaviors, and vocabulary allows us to interpret and express ourselves. However, the authors need to provide further justification for the suitability of survey data in describing their hypothesis. Although the approach of examining differences between novice and expert use of words and phrases to describe Greenland is intriguing, it should be employed as preliminary data, as it lacks integration with virtual experiences.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Oct 26;18(10):e0293003. doi: 10.1371/journal.pone.0293003.r004

Author response to Decision Letter 1


21 Aug 2023

Response to Reviewers

Reviewer and Editor Comments:

Reviewer 2 pointed out the need for reframing the hypothesis to clearly elucidate the role of the virtual experience in the context of measuring novice-expert sense of place. This is a valid concern and addressing it will greatly enhance the overall contribution of your paper. To this end, I suggest making the following revisions:

Introduction:

a. Clearly state the objective of your study, emphasizing the investigation of how virtual experiences contribute to measuring novice-expert sense of place for a far-away location.

b. Provide a brief overview of the existing literature on the use of virtual experiences in geoscience instruction and their potential impacts on developing a sense of place.

Hypothesis:

a. Revisit your hypothesis and reframe it to explicitly incorporate (or remove the mention of) the role of the virtual experience. Consider highlighting how the virtual experience affects novice-expert sense of place formation and whether it influences participants' spatial understanding, emotional connection, or both.

b. Justify the need for investigating the impact of the virtual experience, particularly in the context of assessing sense of place for a far-away location where physical visits may be limited.

Results and Discussion:

a. Analyze and interpret the data collected in the context of the reframed hypothesis, emphasizing the relationship between the virtual experience and participants' sense of place.

b. Discuss any limitations or challenges associated with using a virtual experience as a proxy for a physical visit, and address how these limitations may impact the interpretation of the results.

How did we address the comment:

The concern that reviewer 2 raised is valid and we appreciate you laying out how to address the concern. We decided to follow your recommendation and remove the mention of virtual field trips from the hypothesis and framing of the paper and instead we mention that the study may have implications on virtual field trips. All changes are provided in a version that includes “track changes”. Specifically we changed:

Abstract – removed mention of virtual field trips in the motivation and hypothesis and focused on the research design that compares novices and experts. At the end of the abstract, we rephrased a sentence to the findings may have implications for virtual field trips in education instead of using it as a motivation.

Introduction – removed the mention of virtual field trips as part of the motivation and instead rephrased that the study may have implications for virtual field trips in education.

Results: No changes since we are not including data around virtual field trips

Discussion: We rephrased the text to suggest that future research may explore the impacts on virtual field trips and removed any connection to the motivation of the study.

Conclusion: We rephrased the text to remove mention of the virtual field trips as part of the study motivation and instead phrased it to suggest that future research may be needed to study the impact on virtual field trips in education.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Kendra Helen Oliver

4 Oct 2023

Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction

PONE-D-22-27793R2

Dear Dr. Gold,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Kendra Helen Oliver, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I have reviewed the revised manuscript and am pleased to report that the authors have diligently addressed all the previous comments and suggestions in a proper and comprehensive manner. The revisions have improved the clarity and quality of the article, and is now ready for publication.

Thank you for considering my review

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

Acceptance letter

Kendra Helen Oliver

19 Oct 2023

PONE-D-22-27793R2

Measuring novice-expert sense of place for a far-away place: Implications for geoscience instruction

Dear Dr. Gold:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Kendra Helen Oliver

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (XLSX)

    S2 File

    (DOCX)

    Attachment

    Submitted filename: ResponseToReviewer.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES