Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Nov 30;18(11):e0292865. doi: 10.1371/journal.pone.0292865

Feeling heard: Operationalizing a key concept for social relations

Carla Anne Roos 1,*, Tom Postmes 2, Namkje Koudenburg 2
Editor: Ramona Bongelli3
PMCID: PMC10688667  PMID: 38032901

Abstract

Feeling heard is considered a cornerstone of close relationships and crucial to healthy self-development, but psychologically, this sentiment of feeling heard remains understudied. The current paper therefore aims to define and measure the experience of feeling heard. Based on an integrative literature review, feeling heard is conceptualized as consisting of five components at two conceptual levels. At the interpersonal level people feel heard when they have 1) voice, and receive 2) attention, 3) empathy, 4) respect. At the collective level people should experience 5) common ground. In two population surveys (N = 194, N = 1000), we find that feeling heard is a unitary concept, and we develop and validate the feeling heard scale (FHS); a concise eight-item scale with good psychometric properties. Results show that the FHS is a distinct predictor of conversation intentions in many different contexts and relationships. In fact, the FHS is the strongest predictor of intentions for conflict behavior among a set of 15 related variables (e.g., acquaintance, intimacy). We conclude by reflecting on the potential applications of this scale: in interpersonal relations and professional contacts, the FHS enables the assessment of one crucial dimension of social interaction.

Introduction

The right of all children to be heard and taken seriously constitutes one of the fundamental values of the Convention on the Rights of the Child

- Convention on the Rights of the Child, 2009 -

If we only listened with the same passion that we feel about being heard

- Harriet Lerner, n.d.; clinical psychologist -

In the final analysis a riot is the language of the unheard. And what is it that America has failed to hear

- Martin Luther King, Jr., 1968 -

References to feeling heard are made in many domains of everyday life. As the quotes above suggest, it is often seen as a cornerstone of intimate relationships, crucial to healthy self-development, and essential to a well-functioning representative democracy. Indeed, an abundance of self-help information and training exists to help people make others feel heard, for example romantic partners, children, employees, or customers, e.g., [14]. For those who want to feel heard themselves, many countries have so-called listening centers that offer a listening ear 24/7 (see https://www.ifotes.org/en). At a more abstract level, beyond interpersonal relationships and direct interactions, various individuals and groups feel not heard by their government or other institutions. Populist parties often gain popularity among these groups by purporting to represent those who are not heard by the elite, e.g., [5]. Alternatively, people that do not feel heard can unite and engage in collective action, e.g., [6]. For example, in the US, groups across the political spectrum, from Trump supporters to Black Lives Matter activists, protest to be heard, e.g., [7, 8].

Feeling heard thus appears to be a central concept in individualized Western societies. However, possibly due to a lack of systematic research into the concept (indeed, scientific study of the concept is scarce and scattered across different fields), we currently lack a good understanding of what the concept entails, and what its precursors and consequences may be. For example, in today’s society many want to have a say and use social media platforms to express themselves to strangers on an unprecedented scale. But is all this self-expression on social media effective in making people feel heard? Recent research suggests that the opposite might be the case: a lack of instant feedback online can be misinterpreted as a signal of disinterest leading people to feel less heard compared to face-to-face conversation [9, 10]. Especially in the context of increasing political polarization and concerns about loneliness and isolation, e.g., [11], it would be important to measure the experience of feeling heard reliably.

In sum, feeling heard could be a key variable of our time and appears central to relationships, self-development, and representation. But psychologically, this sentiment of feeling heard remains understudied. This paper therefore embarks on exploring the concept, by integrating related constructs from different literatures (e.g., intimate relationships, healthcare, organizations) into a unified definition and measurement. We focus on the concrete level of feeling heard in everyday interpersonal interactions because feeling heard at an abstract level (e.g., by the government) might be different and therefore require an independent exploration.

Feeling heard in the literature

Considering the importance of feeling heard in colloquial speech and common understanding, one would expect this concept to have its own scientific literature. But in a comprehensive review, we found that feeling heard is not treated as a distinct concept yet. Instead, the literatures on contexts where feeling heard could play an important role tend to revolve around related concepts. Exploring each of these literatures might help us define feeling heard and determine whether it is distinct from other existing concepts. In this section, we will shortly describe the key findings from our review.

Intimate relationships literature: Perceived responsiveness

First, the importance of feeling heard becomes evident from the literature on intimate relationships. Rather than focusing explicitly on feeling heard, this literature examines the closely related construct of perceived responsiveness. Perceived responsiveness has been defined as the belief that close others understand and value one’s personal needs and goals and are supportive in fulfilling these [12]. It is essentially about a person’s perception that intimate others see them for who they are and accept, value, and support that [13]. While perceived responsiveness was studied most in the context of romantic couples, it plays a role in all kinds of intimate relationships, such as that between parent and child [14]. It has been found to support and strengthen not only the relationship, by increasing satisfaction, intimacy, and commitment, but also its members, by increasing subjective well-being and self-esteem, e.g., [15].

The concept of perceived responsiveness thus focuses on the target’s perception of another’s attitudes towards them. We believe this is also an important component of feeling heard in conversations. But feeling heard is more concrete than perceived responsiveness, in the sense that it is a feeling that arises from a specific interaction, rather than a general appreciation of a person’s needs and goals. Recently, [16] suggested that the concrete form of responsiveness is listening and called for the integration of both concepts in future research. The perception of listening behavior might make a speaker feel heard. Listening has been extensively studied in the healthcare literature.

Healthcare literature: Active listening

Listening is mostly considered in service of the person-centered approach that is seen as a core dimension of high-quality healthcare [17]. The person-centered therapist is essentially a responsive therapist who puts the patient center stage and aims to stimulate the patient to pursue their own needs and goals [18]. This makes the client feel known and empowered [19]. The person-centered approach gained currency in many other domains beyond healthcare, for example, it is used in education to optimize child development and in retailing to increase customer satisfaction [20, 21].

The important practice in the person-centered approach is active listening (also called empathic listening or high-quality listening; [22]). This involves paying undivided, non-directive, and non-judgmental attention with behaviors like paraphrasing and summarizing what has been said [23]. Active listeners listen to the feelings and attitudes behind the speaker’s words. The active listener tries to see the world through the speaker’s eyes and empathize with them. In this way, the listener communicates respect for the speaker.

In this literature, the central focus is on listening behaviors or, more recently, on the perception of these listening behaviors (see for reviews [24, 25]). The experience of being listened to is treated as an important and positive but not yet clearly defined outcome, e.g., [26]. We suspect that to feel heard a speaker must perceive their interaction partner as an active listener. Much like perceived responsiveness then, to feel heard not only the behavior of the listener is important, but also the perception of the speaker.

Based on the previous, three ingredients seem required for one to feel actively listened to: attention, empathy, and respect. We expect these to be the first three components of feeling heard. First, the speaker will feel heard when they perceive (undivided) attention on the side of the listener. The listener is not a passive receiver but actively engaged; the listener is all ears. Second, the speaker will feel heard when they perceive the listener as empathic. The listener tries to step into the speaker’s shoes and take their perspective. And third, the speaker must feel that the listener is respectful towards them. The listener takes the speaker seriously and does not judge them for what they say or who they are. Thus, the speaker feels heard when they perceive the listener as attentive, empathic, and respectful.

But to be listened to or heard, the speaker first needs to speak. This shifts the focus from the speaker’s interpretations of the listener’s behavior to the speaker themselves. Does the speaker feel able to express themselves?

Organizational and law literatures: Voice

The importance of being able to communicate per se is most explicitly recognized in the concept of voice, which is most relevant in contexts where there is a power difference and has therefore been examined in contexts of representation (e.g., in legal, political, and managerial settings). Voice is a central concept in the literature on procedural justice. Procedural justice is the fairness of the process by which a decision is made, and as such is contrasted with distributive justice which refers to the fairness of the decision itself [27, 28]. Subjective procedural justice involves the experience of being treated fairly, which might be related to feeling heard. Voice contributes importantly to this experience [29]. To experience voice, subordinates should feel able to let their opinions and feelings be known and taken into account by those making decisions that affect them. Importantly, this does not require (the perception of) actually influencing the decision [30]. In organizations, experiencing voice tends to increase engagement, satisfaction, and social identification with the organization [31]. In the context of law, the importance of voice has also been recognized [32]. Without voice, litigants might feel treated as a number and not taken seriously, which can make procedures appear random and raise suspicions towards legal authorities.

Although voice is mostly studied in law or organizational contexts, the essence of being able to say what one wants to say could be an important component of feeling heard, that could apply to many everyday conversations. Integrating the three literatures described so far suggests that feeling heard involves being able to speak freely to an attentive other that shows empathy and respect. This all happens on an interpersonal level. However, to feel heard, interaction partners need a certain degree of understanding between them. Such understanding requires a superordinate level of the dyad or group: the collective.

Communication literature: Common ground

In communication science, this level of “us” is considered the basis for establishing a common ground. Common ground is the knowledge and beliefs that interaction partners assume to share, which allows them to communicate effectively [33, 34]. The continuous creation and maintenance of these mutual understandings, called grounding, occurs through the dynamics of interpersonal interaction. Grounding has been presented as a three-step process that starts with the speaker presenting information, followed by the listener expressing understanding or misunderstanding, which the speaker subsequently acknowledges or corrects [35]. Interaction is thus considered an act of coordination and collaboration [36].

It logically follows that to feel heard, interaction partners need to develop a common understanding of their needs and wishes in the conversation. This component seems to be quite distinct from the other, more transactional, foundations of feeling heard, which occur at the interpersonal level (i.e., the level of “me” and “you”). The communication literature adds a new element by pointing out that feeling heard may require a joint effort of grounding in which interaction partners dynamically construct a mutual understanding at the level of “us” (see also the literature on shared reality; [37]). We refer to this level of “us” or “we” as the “collective level” to distinguish it from interpersonal experiences. At the collective level interaction partners do not think about themselves and others as individuals but as one irreducible entity (also see the literature on collective intentionality, [38]).

At this point it is good to take stock: what have we learned so far? We believe that while none of these literatures are about feeling heard as such, all of them imply that it may be an important psychological outcome of social interaction and all of them add something important to understanding what feeling heard entails. One can feel heard because of particular actions of self (e.g., voice) and other (e.g., active listening). This exchange can feed into perceptions such as responsiveness. But feeling heard may also require an ongoing dynamic by which understandings of “us” are construed and maintained. In other words, in the psychological sense of feeling heard the actions and perceptions of self, other, and us jointly seem to converge. This conclusion implies two things: that feeling heard is not a redundant concept, because it is not reducible to any one of these components, and that operationalizing it should attend to each of these components. In addition to this literature review, we conducted semi-structured interviews with four individuals who had a lot of practical experience with and knowledge about feeling heard in different fields. The summarized interviews can be found in the section 1.3 in S1 Appendix. The themes that came up in these expert interviews showed substantial overlap with the literatures outlined here.

A definition of feeling heard and an operational model

Integrating the concepts found in these diverse literatures allows us to distinguish different components of feeling heard that should be included in a definition of this concept. Voice is a first vital part of feeling heard: one needs to communicate to be, and by extension feel, heard. Voice also presupposes a wish to be heard, a desire to communicate something. Indeed, the voice literature concerns situations where communication is not self-evident (because of status differences), not required (up to people themselves), but allowed and likely desirable (giving opinions on self-relevant decisions). So, voice is not just about piping up but about one’s experience of having the opportunity to speak if one wants to speak, and to say what one wants to say.

There should also be someone receiving the communication. The literatures on intimate relations and healthcare elaborate on how receivers can put the speaker center stage. The receiver does so by paying close and undivided attention to the speaker and their communication. This is needed to accurately take the speaker’s perspective and understand their needs. Lastly, the listener should be non-judgmental and accept the speaker for who they are. Whether the speaker feels heard is dependent on their perception and interpretation of the listener’s behaviors. In sum, interpersonal perceptions of attentiveness, empathy, and respect are important components of feeling heard.

Finally, the communication literature suggests that feeling heard requires a sense that “we understand each other”. This common ground appears related to all other components of feeling heard. It is essential to voice effectively: the speaker needs to adapt their communication to their comprehension of the listener’s understanding to ensure the listener understands correctly. Common ground is also needed for attention, empathy, and respect: the listener must understand the speaker to attend to the correct details of their communication, empathize with them, and respect them for who they are.

Putting these different insights together, feeling heard has five components concerning three entities (me, you, and we). In order to feel heard, people take into account their interpersonal level experiences of my voice (1), and your attention (2), empathy (3) and respect (4). But beyond that, they may also factor in the collective level experience that we have (5) common ground. See Fig 1. This bring us to the following definition: feeling heard is the feeling that one’s communication is received with attention, empathy, respect, and in a spirit of mutual understanding. In the remainder of this paper, we report on the development and validation of an instrument to measure this concept.

Fig 1. Feeling heard in conversation.

Fig 1

A visual representation of the proposed model.

Study outlines

The paper consists of two studies aimed at scale development and scale validation. We first constructed a 16-item scale based on the conceptualization of feeling heard described above. Study 1 was a Dutch population survey in which we tested the proposed model and scale to select the items and factor structure that best represent feeling heard. Study 2 was a preregistered US survey study designed to assess the reliability, convergent and divergent validities, and the predictive validity of the resulting feeling heard scale (the FHS). We additionally conducted a preregistered lab experiment in which we manipulated feeling heard by varying communication channel (audio vs. text) and tested whether feeling heard picks up on unique variance in conversational experiences that is not measured by other related variables. Because of space limitations, the description of this study and its results can be found in the sections 3.1 and 3.2 in S1 Appendix.

Study 1

Aims and hypotheses

Study 1 had two aims: 1) test the proposed factor structure, and 2) get an impression of the natural distribution of feeling heard in everyday online conversations. This first study was not preregistered. Because this study was conducted during the lockdowns due to the COVID-19 pandemic, we focused on online interactions, which then became a central mode of communication.

Method

The studies reported in this paper and S1 Appendix were all approved by the Ethical Committee Psychology of the University of Groningen. The authors had no access to information that could identify individual participants during or after data collection. Informed consent was obtained from all participants prior to their participation. The materials, analysis code, data, and codebook for interpreting the data of all studies is publicly available on Dataverse at https://doi.org/10.34894/IHNKUN.

Sample size rationale

As a crude rule of thumb, for scale development at least 10 participants per item are required, which means 160 participants for 16 items [39]. We decided to recruit slightly over 200 participants, anticipating some attrition due to failed attention checks. With a sample of 160, correlations of r = |.19| (small effect; [40]) can still be reliably estimated with alpha = .05 (two-tailed) and power = .80.

Participants

A representative sample of the Dutch population in terms of age, gender, and educational level was recruited and paid through the online panel service PanelInzicht (N = 217). Participant recruitment and data collection took place in May and June 2020. Participants were required to be native Dutch and to have at least some experience with online conversations. Based on their descriptions of a past online conversation, we excluded 23 participants who provided nonsensical answers or indicated that they did not have the required experience (e.g., “Sorry, no example, never happened” P.198). The final sample consisted of 194 participants, 51.55% female and 48.45% male. 37.11% were between 18 and 38 years old, 43.81% were between 39 and 59, and 19.07% were 60 or older. Most participants (46.91%) had a middle education level, 29.90% were higher educated, and 23.20% were lower educated (classification based on [41]). Most participants (73.20%) had a full- or part-time job, 18.04% were either unemployed or retired, and 8.76% were studying.

Design and procedure

The survey consisted of two parts. In Part A participants were either asked to think back to an online conversation in which they felt heard (N = 108) or one in which they did not feel heard (N = 86). This division was based on random allocation and done to maximize the variance in feeling heard experiences and to test the differences between (feeling heard and feeling not heard) conditions. In Part B we examined the natural distribution of feeling heard in online conversations by asking all participants to think back to their last online conversation. All participants completed both Part A and Part B but in randomized order. Eighty-nine participants began with Part A and 105 participants began with Part B.

The study was conducted in Dutch. Participants completed an online survey via the platform Qualtrics. After providing their demographics, participants, in both Part A and B, wrote down details about the conversation situation. In Part A, participants were additionally asked to write down why they felt heard or not. We performed an exploratory thematic analysis on the answers to these open-ended questions in both Part A and B of the dataset. In both Part A and B, participants subsequently answered some general questions about the described conversation (see Conversation characteristics below), and then completed the feeling heard scale. The entire questionnaire can be found in the section 1.2 in S1 Appendix. The questionnaire contained six additional measures to assess the impact of the COVID-19 pandemic on our sample. This data is not reported here because of lacking relevance.

Materials

Conversation characteristics. We included the following variables that might affect the experience of feeling heard: 1) quality of the internet-connection, 2) number of interaction partner(s), 3) acquaintance with the interaction partner(s), and perceived 4) quality and 5) equality of the relationship with the interaction partner(s). These variables also provide a characterization of the types of conversations described, see S1 Table in S1 Appendix (Table and Figure numbers preceded by an S can be found in the S1 Appendix).

Feeling heard. Participants were first presented with the central item that formed the kernel of our scale “In this conversation, I felt heard by the other(s)” (item 1). The rest of the feeling heard scale consisted of the five components described before. For each component, we designed three items. We also included four negatively phrased items. The items were phrased according to the entity their component represented: a) voice items referred to “I”, b) attention, empathy, and respect items were about “the other(s)”, and c) common ground items assessed “we”.

All items were preceded by the phrase “In this conversation…”. Depending on the number of interaction partners in the conversation, items referring to the interaction partner(s) were phrased with “the other” or “the others”. All items were measured on 5-point Likert scales (from 1 = Completely disagree to 5 = Completely agree). See Table 1 for the operationalizations and items of the components.

Table 1. The operationalization and original items of the five components of feeling heard.

The item numbering will be used to refer to the specific items in this results section. The last column contains the item numbers that were part of the final scale.

Component Operationalization Initial items Item number Items in the final scale
Voice My experience of being able to express myself freely, that is, being able to say what I want to say. …I could say what I really wanted to say 2 2
…I could express my thoughts 3
…I felt inhibited to say what I wanted to say 4
Attention My impression that the other focused their attention on what I said (my voice). the other was more concerned with him/herself than with what I said 5 5, 6
…the other listened to what I said 6
…the other paid attention to what I said 7
Empathy My perception that the other tried to take my perspective and emotionally understand me. …the other tried to put him/herself in my shoes 8 8, 9
…the other was insensitive to my thoughts and feelings 9
…the other was empathetic 10
Respect My feeling that the other valued what I said (my voice) and me as a person. In other words, I am worth listening to. …the other showed genuine interest in me 11 13
…the other took me seriously 12
…the other treated me with respect 13
Common ground My impression that we could take each other’s perspective and understand each other’s point of view …we looked at things differently 14 15
…we understood each other 15
…we were on the same wavelength 16

Note. Reverse coded items are italicized. We show the items in singular form (i.e., “the other), some of the items were rephrased to plural form (i.e., “the others”) when participants described a conversation with more than one other person.

Results

We first describe the results of the exploratory thematic analysis on the answers to the open-ended questions in both Part A and Part B of the dataset. Then we present the results of the factor analyses performed on Part A of the data to select the items and factor structure that best fit the data and best represent the concept. Lastly, we used Part B of the data to explore the reliability of the scale and the natural prevalence of feeling heard in online conversations.

Thematic analyses

First, we analyzed the descriptions of the conversation situation by coding a) the type of relationship and b) the context of conversation (private or business). See Table 2 for the themes, their respective descriptions, and some examples. Second, we analyzed the reasons for feeling (not) heard through an inductive process, by iteratively coding and clustering answers. We allowed different themes to emerge per condition. Interestingly, these themes turned out to fall into the same four overarching categories.

Table 2. The themes used to code the conversation descriptions on relationship type and general context.
Theme Description Examples
Relationship type
Service provider(s)—one-off One-off exchanges with strangers, although another interaction might happen in the short term about the same issue. Oftentimes the participant is in a position of dependence. A helpdesk of a (web-) shop, an advertiser, the police, a bank
Service provider(s)—repeated Contacts are expected to be repeated over time and over issues. Participants feel a sense of connection with this person or the organization they represent. Oftentimes the participant is in a position of dependence. A representative of the housing association, the bank, the neighborhood police, the municipality, a regular customer
Colleague(s) Contacts are in-group members of equal or subordinate status to the participant. Colleagues, classmates, fellow organizers
Supervisor(s) Contacts are in-group members to whom the participant was subordinate. Boss, teacher
Friend(s) Contacts are in-group members with whom the participant is interdependent. Friends
Family Contacts are in-group members with whom the participant is interdependent. Children, parents, cousins, spouse
Rest Relationships that were only mentioned by a single or a few participants. Sports coach, online community, date, researcher
General context
Private A relatively “closed” or personal conversational context and/or topic. Asking a doctor for medical advice
Business A more open conversational context and/or topic than Private. Work meeting with colleagues

All descriptions were independently coded by the first author and a second (also native Dutch) coder. Themes were coded as 0 if absent and 1 when present in the description. The themes were non-exclusive, meaning that multiple themes could be present in one description, which often occurred. All Kappas were satisfactory (see Tables 3 and 4). For the analysis, we used the average of both coders, such that a description would get a score of .50 when only one of the coders coded it as present.

Table 3. The interrater reliabilities and percentages of occurrence of each relationship and context theme in each conversation description: Their last conversation, a conversation in which they felt heard, and a conversation in which they felt not heard.
Code Kappa [95%CI] Last (N = 206) Felt heard (N = 103) Felt not heard (N = 80)
Relationship type
Service provider(s)—one-off .81 [.72, .90] 6.80%a 12.62%a 12.50%a
Service provider(s)—repeated .82 [.74, .90] 13.59%a 11.65%a 17.50%a
Colleague(s) .92 [.88, .96] 32.04%a 24.27%a 31.25%a
Supervisor(s) .84 [.75, .93] 5.83%a 9.71%a, b 13.75%b
Friend(s) .87 [.79, .96] 7.77%a 10.68%a 5.00%a
Family .95 [.91, .99] 20.39%a 14.56%a 5.00%b
Rest .81 [.71, .91] 6.31%a 8.74%a 12.50%a
General context
Business .81 [.75, .87] 50.97%a 55.34%a, b 67.50%b
Private .83 [.77, .88] 41.75%a 37.86%a, b 28.75%b

Note. The uncodeable conversation descriptions were excluded. Percentages do not add up as the categories were non-exclusive. The percentages are fractions of the total number of described conversations in each category, so 206 for Last, 103 for Felt heard and 80 for Felt not heard conversations. Percentages in the same row that do not share the same superscript significantly differ at p < .05, based on a 2-sample z-test for equality of proportions.

Table 4. The interrater reliability and the percentage of occurrence of the reasons’ themes per condition.
Code Feeling heard (N = 101) Feeling not heard (N = 88)
Kappa [95%CI] % occurrence Kappa [95%CI] % occurrence
1. (Lack of) Respect .63 [.45, .80] 27.23%a .66 [.50, .82] 36.36%a
2a. (Lack of) Engagement Active .88 [.79, .97] 45.54%a .85 [.72, .99] 19.32%b
2b. (Lack of) Engagement Passive .86 [.76, .96] 50.00%a .86 [.76, .97] 48.86%a
3. (Lack of) Effort .76 [.64, .89] 48.51%a .59 [.40, .79] 23.30%b
4. (Lack of) Common ground .87 [.78, .97] 37.62%a .82 [.69, .94] 31.25%a

Note. The uncodeable reasons descriptions were excluded. Percentages do not add up as the categories were non-exclusive. Percentages in the same row that do not share the same superscript significantly differ at p < .05, based on a 2-sample z-test for equality of proportions.

Answers that both coders considered too vague or abstract to code were excluded from the coding dataset. This resulted in differing sample sizes for conversation versus reasons descriptions. Note that uncodeable cases were still valid for the quantitative analyses, as nonsensical answers had already been removed in a previous step. When only one of the coders deemed an answer uncodeable, they discussed until agreement.

Conversation situation

Table 3 shows the percentages of descriptions referring to the themes per condition. Three results stand out. First, considering these are quite rare contacts, as evidenced in their last conversation frequencies, the service provider(s)—one-off was rather frequently mentioned when people thought back to a situation in which they either felt heard or not. This suggests that interactions with strangers where one is in a dependent role, relatively easily elicit experiences related to feeling heard. A similar discrepancy is visible for the supervisor(s) where one again is in a dependent, or subordinate, position. Second, the results show that people thought relatively less of conversations with intimate others (i.e., family and friends) when asked about a conversation in which they did not feel heard, compared to what would be expected based on the last conversation frequencies. In contrast, conversations in which people did not feel heard were relatively frequently business-focused. Third, all conditions most often featured colleagues. Indeed, over half of the remembered Last conversations were with colleagues and family. Thus, presumably due to the COVID-19 lockdown, many online conversations involved work meetings with colleagues.

Reasons for feeling (not) heard

We identified four overarching reasons for feeling heard or not heard, but as the sub-themes differed slightly between these conditions, the content of the themes also differs. Below we list the four themes and shortly describe their respective sub-themes, indicating differences between conditions. We also provide some illustrative quotes. Table 4 shows the occurrence of the themes per condition. The reasons descriptions provided by participants that did not yet see our feeling heard items (first measurement) did not differ significantly from the reasons provided by participants that did (repeated measurement) and whose conception of feeling heard could have been influenced by our items.

1. (Lack of) respect. As reasons for both feeling heard and not heard, participants mentioned respectful treatment. Participants wrote about being taken seriously and receiving recognition. They also mentioned patience on the side of interaction partner(s).

I had the impression the lady on the phone thought: ‘O this is another one with a problem due to the current circumstances.’ While I believe that every person must be helped, people simply need support in this period. […]

Not feeling heard, P. 167

By arriving late and not having enough time for me, I got the impression that I am not important.”

Not feeling heard, P. 184

For feeling heard specifically, participants mentioned a more general friendly or polite treatment. Some also mentioned clear communication, as well as a sincere and honest interaction.

A sub-theme that was found almost exclusively in the not feeling heard condition was that of dominant interaction partner(s). This could either take the form of the partner(s) being too self-involved to take notice of the participant or being pushy or intrusive in trying to influence the participant.

2. (Lack of) engagement. Active engagement of interaction partner(s) was evidenced by reactions, asking follow-up questions, remembering, or summarizing what was said, and other signs of attention. Interestingly, (lack of) active engagement featured less in the reasons for not feeling heard (Table 4).

He reacted to what I said and he asked follow-up questions.

Feeling heard, P. 157

There was also a more passive form of engagement. This involved interaction partner(s) giving the participant room to speak, by listening, not interrupting, and letting them finish.

During the conversation, I could tell everything I wanted to tell. I had plenty of time for this and I didn’t have to rush my conversation. […]”.

Feeling heard, P. 27

A frequent reason for feeling not heard was the presence of too many people and no chair in online meetings, sometimes in combination with a bad internet connection. In such a conversation people talk all at once, meaning no one is heard. Relatedly, participants felt not heard when others were distracted or paid attention to something or someone else.

“Everyone talked at once, was working on something else, people who were eating. Everyone was just talking. It was not pleasant. People were busy with everything, except with what they should be doing.”

Not feeling heard, P. 197

3. (Lack of) effort. Quite often, participants described a conversation in which they wanted to get something done. As such, participants felt heard when their interaction partner(s) came to action or promised to do so.

Time and again I was sent from pillar to post and previously made agreements were not kept.

Not feeling heard, P. 91

In the feeling heard condition, participants also mentioned interaction partner(s) initiating help without request, such as comforting or giving tips.

Participants felt heard when they attained their predefined goal, or when they received a satisfactory answer for why they did not get what they wanted. Getting good quality answers could also be a goal in itself.

There was some sort of standard answer. In the sense that they could no longer reach the supplier. And so there was nothing more that could be done.

Not feeling heard, P. 173

4. (Lack of) common ground. Interaction partners could create a sense of common ground by recognizing the participant’s situation or taking the participant’s perspective. In the feeling heard context, understanding also occurred on an emotional level (i.e., empathizing).

This girlfriend asked if she could do something for me because I seemed so grumpy about the quiz team.

Feeling heard, P. 139

Some participants referred to the level of agreement between themselves and their interaction partner(s). Conversely, “closed” and stubborn others who stood firm to their own opinion would make the participant feel not heard.

I did not agree with supervisor (or supervisor not with me). I was supported by a few colleagues, but supervisor stood firm. After 2 protests I stopped trying.

Not feeling heard, P. 174

Moreover, participants in the feeling heard condition explicitly mentioned that they felt heard when their interaction partner(s) collaborated with them, for example by making decisions or appointments together or by negotiating.

To come to a decision together, the other has to listen and when you actually come to a decision together, that means that the other has heard you.

Feeling heard, P. 134

In sum, the themes and sub-themes that emerged from this content coding of the reasons’ descriptions overlap considerably with our definition (and scale) of feeling heard, except for empathy, which is not a distinct theme but more a special case of understanding. Moreover, the effort theme is not present in our scale. Central to this latter theme is the accomplishment of goals, that is, getting out of the conversation what one wanted or expected.

Scale dimensionality and item selection

Item characteristics. See S2 Table in S1 Appendix for the item means, standard deviations, skewness, kurtosis, and between-condition differences. Condition (feeling heard vs. not feeling heard) had a significant effect on all items (ranging from t(124.84) = |23.12|, p < .001 to t(165.83) = |6.17|, p < .001). This suggests that all items tapped into the experience of feeling heard as they were successful in distinguishing between feeling heard versus non-heard experiences. Both the Bartlett’s Test of Sphericity (χ2(120) = 3431.06, p < .001) and the Kaiser-Meyer-Olkin test (MSA ranged between .84 and .98) showed that there was enough overlap between the items for conducting factor analysis [42]. This is also visible in the inter-item correlations that were all significant with a mean of |.63| (see S3 Table in S1 Appendix).

Factor analysis

We conducted a confirmatory factor analysis with the Lavaan package in R (version 0.6–9; [43]). Because the scale was build upon our theoretical model for feeling heard, we used confirmatory factor analysis rather than exploratory factor analysis. To correct for the lack of multivariate normality in our data we used maximum likelihood estimation with robust standard errors and a Satorra-Bentler scaled test statistic (MLM) for the model parameters.

Alongside the chi-square test (χ2), we report the Comparative Fit Index (CFI) because this alternative fit index is less affected by the reliability paradox [44]. This is the phenomenon that more reliable measures lead to worse fit: higher standardized factor loadings provide more reliable information about a latent variable and therefore a higher power to detect small misspecifications in the model. Especially the absolute fit indices, like RMSEA, are sensitive to this paradox [45]. We will additionally inspect modification indices and residual correlation matrices to assess fit.

Hypothesized model fit

We tested the fit of the hypothesized model with a confirmatory factor analysis. Corresponding to the five feeling heard components, we specified five latent factors: Voice, Attention, Empathy, Respect, and Common ground, each with three unique items. All latent factors were additionally set to load on item 1. As can be seen in Fig 2, the fit of this hypothesized model was acceptable. However, the covariances among the five latent factors were notably high (ranging from .69 to .99), which might be indicative of unidimensionality. The modification indices and residual correlations (S4 and S5 Tables in S1 Appendix) also suggested considerable overlap between and within all latent factors.

Fig 2. The results of the confirmatory factor analysis of the hypothesized model.

Fig 2

Note. Rectangles represent observed variables and circles represent latent variables. The loadings of items 2, 6, 19, 13, and 15 were set to 1, as these were considered the defining items of their respective components. Estimation methods: Maximum likelihood with robust standard errors and a Satorra-Bentler scaled test statistic (MLM). Both latent and observed variables are standardized.

Moreover, as can be seen in Fig 2, the factor loadings of item 1 were unreliable. Because this item was set to load on all latent factors and all latent factors were very strongly related, the item’s explained variance is distributed over all latent factors. It is a zero-sum situation: the variance explained by one factor overlaps with that explained by another, but the variance can only be explained once.

One-factor model fit

Since the results above suggested item redundancy, we inspected the inter-item correlations (see S3 Table in S1 Appendix). Correlations of r ≥ |.80| (equaling a shared variance of 64%) were considered indicative of redundancy. Correlations of this magnitude that involved item 1 were not considered problematic as this is the scale’s central item. If the other highly correlated item pairs were also conceptually considered redundant, we excluded one of the items. This led to the exclusion of items 3, 7, 11, 12, and 16. There were also items with consistently low inter-item correlations of r ≤ |.40| (equaling a unique variance of 84%): items 4, 10, and 14. These were excluded too.

The number of factors to extract from the remaining eight items was based on a scree-plot and Kaiser’s criterion to remove components with eigenvalues < 1 (using the nFactors package in R, version 2.4.1, [46]). This suggested a one-component solution (see S1 Fig in S1 Appendix), which is in line with the interpretations above. The eight items were accordingly submitted to a confirmatory factor analysis with a one-factor solution. The fit of this model was satisfactory (χ2(20) = 46.72, p < .001; CFI = .98), but the modification indices and the residual correlations suggested a theoretically sensible correlation between the residuals of the two reverse coded items (see S6 and S7 Tables in S1 Appendix). Allowing this correlation resulted in a significantly better model fit (χ2(1) = 5.76, p = .02). The fit was satisfactory on all indices: χ2(19) = 34.53, p = .02; CFI = .99; all modification indices < 15; all residual correlations < |.09|, see Fig 3, and S8 and S9 Tables in S1 Appendix. The resulting feeling heard scale was highly internally consistent with an average item-total correlation of .72 (and a range of .53 to .78), and a coefficient omega of .95, 95%CI [.93, .96]. Factor loadings ranged from .64 to .93 with the highest loading for item 1 which was also conceptually the central item of the scale. This item, with an item-total correlation of .75, explained 56% of the variance in feeling heard as measured by the full scale.

Fig 3. Results of the confirmatory factor analysis of the final model.

Fig 3

Note. Rectangles represent observed variables and circles represent latent variables. Estimation methods: Maximum likelihood with robust standard errors and a Satorra-Bentler scaled test statistic (MLM). Reported are the completely standardized solutions: both latent and observed variables are standardized.

Influence of conversation characteristics

We explored the correlations between feeling heard and other characteristics of the conversation or the social relationship. Participants were slightly more likely to feel heard when they had a good internet connection (r = .15, p = .04). Feeling heard was not related to the number of interaction partners (r = -.07, p = .30), nor to whether participants knew these partners before their conversation (r = .08, p = .25). Participants felt more heard when they had a good relationship with their interaction partner(s) (r = .38, p < .001). Lastly, participants also felt more heard when they felt this relationship was equal than when they considered either their interaction partner(s) or themselves of greater authority (F(3,190) = 5.74, p < .001; Mequal = 3.70, 95%CI [3.51, 3.88] vs. Mother-authority = 3.26, 95%CI [2.96, 3.56], Cohen’s d = .44, small effect, and Mself-authority = 3.30, 95%CI [2.59, 4.01], Cohen’s d = .39, small effect). Participants that indicated “don’t know” to this question of equality felt least heard (Mdon’t-know = 2.78, 95%CI [2.33, 3.23]). The demographic variables (age, gender, education, and employment status) did not correlate with feeling heard. In sum, having a good internet connection, and a positive and equal relationship with one’s interaction partner(s), seems to make it more likely that one feels heard.

Last conversation description

We analyzed Part B of the dataset to explore the reliability of the scale and the natural prevalence of feeling heard in online conversations. Excluding the nonsense descriptions of last online conversations (3 out of 217 observations) resulted in a sample size of 214 participants for Part B. The single-factor model fitted the data well and the loadings were very similar to Part A. Part B also allowed a tentative indication of the measurement invariance of the scale or “the psychometric equivalence of a construct across groups or across time” ([47], p.1). We used the measurementinvariance function of the semTools package (version 0.5–5, [48]). Results show that the model specified on Part A of the dataset also provides a good fit to Part B. This suggests that the scale’s psychometric characteristics replicate across measures within the same sample, see S10 Table in S1 Appendix. The scale was internally reliable with an omega of .91, 95%CI [.88, .94]. The item-total correlation averaged |.62| and ranged from |.46| to |.71|. See S11 Table in S1 Appendix for the item means, standard deviations, and correlations. The distribution of feeling heard in Part B was negatively skewed (skewness = -1.10; M = 3.92, SD = 0.82) and the mean level of feeling heard was significantly higher than the scale midpoint (t(213) = 16.37, p < .001, Cohen’s d = 1.12, large effect). This suggests that people tend to feel heard in their online conversations.

Discussion

People do not seem to meaningfully distinguish between the five components—voice, attention, empathy, respect, common ground—deduced from the literature review. This is in line with recent studies showing that people experience listening holistically [49]. Feeling heard appears to be a unitary concept that can be measured with a concise eight-item scale. This scale does, however, contain elements of all five components and therefore taps into three entities (me, you, and we) at two conceptual levels (interpersonal and collective). These findings corroborate our definition of feeling heard as stated in the introduction. Providing initial evidence of the reliability of the scale, a good fit to Part B of the dataset was obtained. This is of course imperfect evidence since the same sample was involved. Study 2 therefore examines whether the scale is also reliable in another, unrelated dataset.

We additionally performed a qualitative analysis of participants’ descriptions of feeling heard. Although this combination of model testing (quantitative data) and generation (qualitative data) in a single study can be seen as a limitation, the derived themes overlapped to a great extent with our definition. One new theme came up: getting out of the conversation what one wanted or expected. In light of procedural justice being as important as distributive justice [30], we do not expect goal accomplishment to be a required component of feeling heard. That is, people can feel heard when they do not accomplish their goals (no distributive justice), and, vice versa, people can feel not heard even though they do get what they asked for (distributive justice) because of the way they are treated (procedural justice). To verify that goal accomplishment and feeling heard are not the same, we include a goal accomplishment measure as part of the convergent validity testing in Study 2.

Study 2

Aims and hypotheses

Study 2 aimed to establish the 1) reliability, 2) convergent and divergent validity, and 3) predictive validity of the feeling heard scale. Unlike Study 1, the context was not restricted to a certain medium but concerned conversation in general. The design and hypotheses of this study were preregistered prior to data collection at the Open Science Framework: https://doi.org/10.17605/OSF.IO/N4R32. We formulated three hypotheses:

  • Hypothesis 1: The eight items load on a single latent factor and the feeling heard scale has good reliability.

  • Hypothesis 2A: The feeling heard scale will moderately to strongly and positively correlate with, but not be identical to: A) perceived intimacy of interaction partner(s), B) attraction towards interaction partner(s), C) perceived responsiveness of interaction partner(s), D) experienced goal accomplishment in conversation.

  • Hypothesis 2B: The feeling heard scale will moderately to strongly and negatively correlate with, but not be identical to: E) perceived dominance of interaction partner(s), F) distrust towards interaction partner(s), G) communication apprehension.

  • Hypothesis 3: The less heard participants feel in a conversation, the stronger their intentions to negatively avoid having another conversation with the same interaction partner(s). Negative avoidance means avoidance without relational maintenance efforts, i.e., without being polite or friendly.

To establish its discriminant validity, we additionally tested to which conversational variables (e.g., number of interaction partners) feeling heard does not relate. This was an exploratory analysis and not included in the preregistration.

Method

Sample size rationale

As we wanted to sample the different types of conversations in which people felt heard and not heard, we decided to recruit a sample of 1000 respondents. This enables us to compare the most often mentioned types with a decent N in potential future analysis. With this sample size, correlations of |.08| (small effect; [40]) can be reliably estimated with alpha = .05 (two-tailed) and power = .80. Because of this high power, we interpret the effects in terms of their effect size rather than their statistical significance alone.

Participants

Participants were recruited via the online platform Prolific in December 2020. As the questionnaire was in English, the selection criteria were being fluent in English and living in the United States. We collected 50% female and 50% male participants. We excluded 28 participants that did not provide serious answers (as visible in missing conversation descriptions and/or two failed attention checks) and replaced them with new participants. The final sample therefore consisted of 1000 participants (Mage = 34.89, SDage = 12.94) of which 49.30% were female and 49.10% were male (1.60% indicated either “other” or “do not want to say”). Most participants (59.00%) were higher educated (undergraduate, graduate, or doctoral degree obtained), 21.40% were of middle educational level (college degree), and 19.60% were lower educated (no formal qualifications or secondary school completed) (classification based on [50]). About two-thirds of the sample (66.50%) was either full- or part-time employed, 21.50% was unemployed or retired, and 12.00% was studying.

Design and procedure

Participants completed an online survey via the Qualtrics platform. Participants read the following instruction: Think back to a conversation in which you wanted to share your thoughts or feelings, make a point, speak your mind, and/or get something done (regardless of whether this was successful or not). Describe this conversation in a couple of sentences below. This instruction was designed to make people think back to conversations in which feeling heard is relevant, and to exclude things like a hello-goodbye “conversation” with the cashier. With this conversation in mind participants then completed the rest of the questionnaire, described below. Lastly, participants provided their demographics and were thanked, debriefed, and paid. The entire questionnaire can be found in the section 2.2 in S1 Appendix.

Materials

Reliability. Participants were first presented with the eight-item feeling heard scale, translated to English (1 = Strongly disagree to 5 = Strongly agree). Throughout the questionnaire, items about interaction partner(s) were phrased in singular (“the other person”) or plural (“the other people”) form, depending on whether the described conversation was held with one or more than one person respectively. The example items presented here are all phrased in singular form.

Convergent and divergent validity. After careful consideration, we decided to include the following seven scales to assess convergent and divergent validity (see text 2.3 in the S1 Appendix for our inclusion criteria and reasoning). As indicator of scale reliability, we report omega (hierarchical) with bias corrected and accelerated bootstraps (1000), calculated with the ci.reliability function of the MBESS package (version 4.8.0, [51]).

First, two subscales of the relational communication scale of [52]: 1) conversational intimacy (20 items, 1 = Strongly disagree to 7 = Strongly agree), e.g., “The other person was intensely involved in our conversation” (ω = .95), and 2) dominance vs. equality (nine items), e.g.,: “The other person tried to control the interaction” (ω = .69). Second, the individualized trust scale of [53] (15 items, 7-point scales without anchors; [54]). This is a semantic differential scale asking to what extent each characteristic applies to a certain person, for example: “Trustworthy-Untrustworthy” (ω = .97). Higher scores indicate a more distrustful attitude. Third, the affective attraction scale of [55] (five items, 1 = Extremely [unpleasant] to 9 = Extremely [pleasant]), for example: “How unpleasant/pleasant do you feel about the other person?” (ω = .89). Fourth, the perceived partner responsiveness scale of [13] (18 items, 1 = Not at all true to 9 = Completely true), e.g., “The other person is responsive to my needs” (ω = .98). Fifth, a self-devised perceived goal accomplishment measure (three items, 1 = Strongly disagree to 5 = Strongly agree): “In this conversation, I accomplished the goals I had prior to this conversation”, “I was unsuccessful in achieving what I wanted in this conversation” (reverse coded), and “I got what I aimed for in this conversation” (ω = .90). Last, the dyad subscale of the communication apprehension scale by [56] (six items, 1 = Strongly disagree to 5 = Strongly agree), for example, “Ordinarily I am very tense and nervous in conversations” (ω = .93).

Predictive validity. One of the most important consequences of not feeling heard is that it may catalyze conflict. Specifically, we expect that people who feel not heard are likely to engage in interaction behaviors that may contribute to conflict. To test this, we developed items to assess behavioral intentions for a next conversation with the same partner(s).

The items were based on the classic distinction between approach and avoidance reactions. Within these reactions, we distinguished between positive approach/avoidance: behaviors that steer towards maintenance of the relationship between the participant and their interaction partner(s), and negative approach/avoidance: behaviors that do not seem conductive to relationship maintenance. For each combination of reaction (approach vs. avoidance) X relationship (positive vs. negative), we made two items: Nngative avoidance, e.g., “Next time, I would avoid having this conversation altogether” (r = .85, p < .001), positive avoidance, e.g., “Next time, I would change the topic compared to the last conversation” (r = .64, p < .001), negative approach, e.g., “Next time, when discussing the same topic, I would make my point(s) more forcefully” (r = .40, p < .001), and positive approach, e.g., “Next time, I would enter the conversation with an open mind” (r = .50, p < .001). All items were rated on 5-point Likert scales from 1 = Strongly disagree to 5 = Strongly agree. We only formulated predictions for negative avoidance intentions because this was the first time that we used these items, and we expected this behavioral intention to show the strongest effects. The other intentions were measured exploratively.

Discriminant validity. We included the following four variables deemed of importance for conversational experiences (same as Study 1) in order to establish the scale’s discriminant validity, and to include as regression covariates: 1) the number of interaction partner(s) in the conversation (1 = 1 other, 2 = 2 others, 3 = 3 others, 4 = more than 3 others), 2) to what extent participants knew the interaction partner(s) before (1 = Not at all, 2 = Barely, 3 = A bit, 4 = Quite well, 5 = Very well), 3) how positive participants felt about their relationship with the interaction partner(s) in general (1 = Very negative, 2 = Negative, 3 = Neutral, 4 = Positive, 5 = Very positive), and 4) whether participants experienced this relationship as equal or not (1 = Yes, we are equals, 2 = No, the other has more authority (e.g., other is my employer), 3 = No, I have more authority (e.g., other is my child), 4 = Don’t know).

Results

As in Study 1, participants described a variety of conversations, see S12 Table in S1 Appendix for a characterization. A one-sample t-test showed that the mean level of feeling heard was significantly higher than the scale midpoint (t(999) = 16.51, p < .001, Cohen’s d = .52, medium effect). The distribution of feeling heard was again, but less strongly than in Study 1, skewed to the left (skewness = -0.55; M = 3.51, SD = 0.98, S2 Fig in S1 Appendix). This means that most participants wrote about a conversation in which they did feel heard.

Reliability

We performed a maximum likelihood confirmatory factor analysis on the eight feeling heard items to test Hypothesis 1. As in Study 1, we used the lavaan package (version 0.6–9; [43]). The model was specified in line with Study 1: the eight items loading on a single factor with a residual correlation between the two negative items. This resulted in a good model fit: χ2(19) = 67.46, CFI = .99. The factor loadings ranged between |.67| (for the reverse coded items) and |.89| (for the central feeling heard item), see Fig 4. The omega of the scale was .93, indicating high internal consistency. The inter-item correlations averaged |.66| and ranged between r = |.45| and r = |.79|, which means they did not exceed the item exclusion cutoffs used in Study 1. See S13 Table in S1 Appendix for all inter-item correlations as well as the means and standard deviations per item. Taken together, we find strong support for Hypothesis 1: the feeling heard scale is reliable.

Fig 4. Factor loadings resulting from the confirmatory factor analysis in Study 2.

Fig 4

Note. Rectangles represent the observed variables and the circle represents the latent variable. Standardized factor loadings are displayed.

Convergent and divergent validity

To test Hypothesis 2, we calculated the correlations between the feeling heard scale and scales assessing related constructs. As can be seen in Table 5, correlations were significant and in expected directions. Two observations stand out. First, communication apprehension was very weakly related to feeling heard and the other scales. This could be because it is the only scale not tapping into evaluations of the specific conversational experience or the specific interaction partner(s), but into participants’ attitudes towards conversation in general. Second, the correlation between feeling heard and intimacy exceeded |.80|, which suggests these scales might be measuring the same thing. It is probably no coincidence that conversational intimacy is a subscale of the only scale we could find that, like feeling heard, taps into conversational experiences, albeit intimacy focusses on people’s perceptions of their interaction partner’s behaviors (“you”) while feeling heard also taps into people’s internal feelings (“me”) and their perceptions of their partner and themselves together (“us”).

Table 5. The correlations between the scales as well as their respective means and standard deviations.
Variable Mean (SD) 1 2 3 4 5 6 7
1. Feeling hearda 3.51 (0.98)
2. Intimacyb 4.86 (1.32) .84
6. Attractionc 6.54 (2.00) .63 .72
4. Responsivenessc 5.75 (2.16) .66 .76 .78
7. Goal accomplish-menta 3.37 (1.22) .75 .65 .49 .51
3. Dominanceb 3.59 (1.10) -.68 -.60 -.54 -.53 -.55
5. Distrustb 2.41 (1.31) -.72 -.78 -.80 -.76 -.55 .60
8. Communication apprehensiona 2.86 (1.04) -.13 -.17 -.12 -.15 -.12 .11 .11

Note. All the correlations reported in this table are significant at *** p < .001.

aMeasured on 5-point Likert scales.

bMeasured on 7-point Likert scales.

cMeasured on 9-point Likert scales.

To check whether feeling heard and intimacy are actually measuring the same underlying construct, we compared the fit of the model where all items of the feeling heard and intimacy scales were set to load on one single factor with the model where feeling heard and intimacy were considered two separate factors. The results show that the model fit is significantly better for the two-factor solution as compared to the one-factor model (Δχ2(1) = 804.43, p < .001), but still the two latent factors are strongly related (covariance of .89), which suggests that the constructs might be redundant [57]. Inspecting the single-factor output more closely, reveals why the correlations between constructs and latent factors are so high. The intimacy scale consists of 20 items, with standardized factor loadings ranging from quite low (|.31|) to very high (|.91|). Among the highest loading items are the items which we could also have included in the feeling heard scale, such as “the other person was willing to listen to me” (with a standardized loading of .91) and “the other person was open to my ideas” (.89). And clearly these are things that one might be experiencing in an intimate relationship. But crucially, the items that have greater face validity for intimacy load much less highly, such as “the other person did not want a deeper relationship with me” (-.55), “the other person seemed to care if I liked him/her” (.64), and “the other person was not attracted to me” (-.31). In sum, the feeling heard scale correlates highly with the items on the intimacy scale that also measure experiences very similar to “feeling heard”, but the FHS does not correlate highly with the items in the intimacy scale measuring “intimacy”. This means that the feeling heard is distinct from intimacy, but the intimacy scale confounds the two and its central dimension (at least in our dataset) is feeling heard. This observation is further supported by the differing correlation patterns of feeling heard and intimacy with other measures, see the section “Feeling heard and intimacy” below.

Predictive validity

To test Hypothesis 3, we regressed negative avoidance intentions onto the feeling heard scale; in line with the preregistration, no covariates were included at this point. Feeling heard strongly predicted negative avoidance intentions (b = -.74, 95%CI [-.80, -.68], β = -.62, R2 = .38). The less people felt heard, the more likely they were to say that they were disposed to negatively avoid a next conversation with the same person(s), for instance by withdrawing from the conversation. To explore the robustness of this effect, we performed a hierarchical linear regression. Block 1 only included the demographic variables as predictors, to which we added the covariates in block 2. In block 3, we added feeling heard, and in block 4 we included all the other scales. Does feeling heard predict intentions to negatively avoid future conversations over and above factors like being acquainted, having a good relationship, or experiencing intimacy?

As can be seen in S14 Table in S1 Appendix, feeling heard was the strongest predictor, after controlling for the influence of all demographic variables and covariates (with β = -.54 for feeling heard and β between |.01| and |.16| for the other variables). Including feeling heard in the model increased its explained variance from R2adj = .22 to R2adj = .42. Importantly, the amount of explained variance only increased by 3% after including the seven scales that measure constructs closely related to feeling heard (from R2adj = .42 to R2adj = .45). This means that the other scales do not capture variance in negative avoidance intentions that feeling heard misses. Moreover, feeling heard remained the strongest predictor of negative avoidance intentions with a β of -.24, whereas the standardized beta coefficients of the other 15 predictors ranged between |.01| and |.13|.

In additional explorative analyses, we assessed the effect of feeling heard on the other behavioral intention measures, controlling for all demographics and covariates. Although the effects were somewhat smaller, feeling heard significantly predicted positive avoidance (b = -.57, 95%CI [-.65, -.50], β = -.50, R2 = .29), negative approach (b = -.22, 95%CI [-.29, -.14], β = -.21, R2 = .11) and positive approach intentions (b = .29, 95%CI [.23, .35], β = .33, R2 = .28), see S15 Table in S1 Appendix.

The central item of the scale (i.e., “In this conversation, I felt heard by the other(s)”) also strongly predicted behavioral intentions. Controlling for the demographics and covariates, the unstandardized betas of this item ranged between |.12| (negative approach) and |.41| (negative avoidance) with explained variances from 9% to 37%. Similar to Study 1, the item-total correlation of this central item was .71, meaning that it can account for 50% of the variance measured with the full scale. This suggests that this single item might be a good short alternative for the full scale.

Thus, we find support for Hypothesis 3 and show that feeling heard is a distinct and powerful predictor of post-conversation avoidance intentions. Besides being a strong predictor, feeling heard explained variance over and above 15 related constructs. This again shows that feeling heard means something else than experiencing intimacy, dominance, distrust, liking, etc.

Feeling heard and intimacy

An important plausible cause for the high correlation between feeling heard and conversational intimacy is the fact that most of the sample described what can be considered an intimate relationship: more than 80% felt positive to very positive about the relationship with their interaction partner(s).

Whereas intimacy should be relevant and predictive of intentions among close others, feeling heard should be predictive in all subsamples. We tested this in two subsamples: 1) participants that felt not or only moderately positive about their relationship (N = 192), and 2) participants that felt positive or very positive about their relationship (N = 808).

First, in the “non-positive” subsample, when both constructs were simultaneously included in a multiple regression, feeling heard was still strongly predictive of negative avoidance intentions (β = -.49) while intimacy was not (β = .02). In contrast, in the “positive” subsample, both constructs maintained predictive value: β = -.35 for feeling heard and β = -.26 for intimacy. Thus, whereas conversational intimacy only predicted negative avoidance intentions when people felt positive about their relationship, feeling heard was also predictive in the context of less positive relationships. We can conclude that, especially in this context, feeling heard and intimacy are not the same.

Discriminant validity

Lastly, to establish discriminant validity, we explored the correlations between feeling heard and other variables relevant for conversational experiences. Feeling heard was not related to the number of interaction partner(s) in the conversation (r = -.04, p = .178) and to whether people knew these interaction partner(s) before the conversation (r = .08, p = .014). In contrast, feeling heard was strongly positively related to the perceived quality of this relationship (r = .52, p < .001). Moreover, participants felt more heard when they described a conversation with other(s) of equal status than when they considered either the other(s) or themselves of greater authority, or when participants indicated they did not know whether their relationship was equal or not (F(3,996) = 15.211, p < .001; Mequal = 3.63, 95%CI [3.56, 3.71] vs. Mother-authority = 3.24, 95%CI [3.11, 3.37], Cohen’s d = .41, small effect, Mself-authority = 3.25, 95%CI [3.09, 3.61], and Mdon’t-know = 2.82, 95%CI [2.48, 3.16], Cohen’s d = .31, small effect). The demographic variables (age, gender, education, and employment status) did not significantly relate to feeling heard. We thus replicate the results of Study 1 regarding the correlations between feeling heard and these conversational variables as well as the demographics. The finding that feeling heard is not related to being acquainted suggests that the scale has discriminant validity.

Discussion

Study 2 shows that the feeling heard scale is reliable and has high internal consistency, not only in the context of online interactions but in conversation in general. These results are important since Study 2 employed a distinct sample in a different cultural setting as compared to Study 1 and we see that the scale performed in substantially identical ways in both (Dutch and US) samples. The scale further showed convergent and divergent validity: feeling heard is related to, but different from, conversation behaviors that communicate intimacy and dominance, perceived responsiveness of interaction partner(s), attraction and distrust towards interaction partner(s), and the experience of having accomplished conversational goals. Discriminant validity was evidenced by the lack of a relation between the FHS and pre-conversation acquaintance. Lastly, we found that the scale is a distinct and strong predictor of conversational intentions related to conflict. Not feeling heard in a conversation can motivate people to avoid another conversation with the same partner(s), and, conversely, the experience of feeling heard makes it more likely that people will enter a next conversation with an open mind. The latter observation is in line with recent research showing similar effects for high quality (attentive, empathic and nonjudgmental) listening [22, 58].

General discussion

Based on a comprehensive literature review, expert interviews, and scale validation studies, we define feeling heard as a concept covering the three entities in interaction: feeling heard is about me, about you, and about us. We distinguished five components of feeling heard—voice, attention, empathy, respect, and common ground—based on the literature review. Empirically these loaded on one single factor. This suggests that feeling heard is a unitary concept, an unidimensional feeling (see [49] for a similar result concerning perceived listening). We then developed and validated a reliable and concise eight-item scale to measure it: the Feeling Heard Scale (the FHS).

Feeling heard matters across contexts

We found that feeling heard is relevant in many different contexts and relationships. When respondents were asked in an open-ended manner to describe situations in which they felt heard or not, they reported these feelings in conversations ranging from insurance negotiations, fobbing off an advertiser, or business meetings, to exchanging intimate details with friends or catching up with distant family. In both Study 1 and 2, feeling heard was unrelated to acquaintance, meaning that feeling heard (or not) is experienced in encounters with close friends as much as with strangers.

Across different contexts and relationships, we find that when people reflect on a significant social interaction they recently had, they are more likely to report that they did feel heard than did not feel heard. Although we cannot say this with certainty, this suggests that across many individuals, there might be a base rate for people to feel heard in most of their conversations. If this also holds within individuals, this may make not feeling heard a negative expectancy violation which could lead to negative arousal (see also [52]). By extension, feeling heard might play an especially central role in contexts where people more often do not feel heard. Situations in which people tend to feel less heard are also quite diagnostic and can aid our understanding of what feeling heard (and not heard) entails psychologically and socially. For example, our research suggests that these can be situations of unequal status.

Both studies showed that participants felt less heard when they were in a subordinate position and when they felt their interaction partner was dominating the conversation. A dominant other tends to hold the floor and is likely to be somewhat less concerned with others. This may mean that there is less room for the participant to express (voice) and makes it less likely that the participant feels attended to and respected. Interestingly however, people who occupied the higher status position in the conversation they reported about, did not feel more heard than those reporting about being in the subordinate position. This might be because in such an interaction, the subordinate other cannot reciprocate since they themselves do not feel heard—in this sense, it may indeed be lonely at the top. All this is in comparison to equal status interactions, where people tend to feel most heard. So, it appears that in unequal status interactions both sides lose out, and that the optimal situation is when both parties are on equal footing. This finding reinforces our impression that feeling heard could be seen as a product of a successful collaboration in conversation. Thus, these and other situations in which feeling heard tends to be most threatened (e.g., online conversations) underline the defining components of feeling heard and can provide additional insights into their workings.

The FHS is a strong predictor

We found that feeling heard is a distinct and powerful predictor of conversation intentions related to conflict. The FHS is an especially strong predictor of intentions to engage in another conversation with the same partner(s), univariate as well as when many other relevant predictors are included. In both cases the FHS explains around 30 percent of variance in conversation avoidance intentions. The FHS explains a similar amount of variance in intentions to enter a next conversation with an open mind.

This echoes research showing that perceived responsiveness and listening can lessen defensive reactions [16, 58, 59]. Note that this is not about being in agreement, but about the way people discuss about their disagreements. In fact, the item implying disagreement “we had a different perspective” did not fit the FHS well, and disagreement was barely mentioned in the open answers. This suggests that people can disagree but still feel heard. Feeling heard could therefore help bridge social divisions within society, whilst maintaining a plurality of voices. There is already evidence that feeling understood by an outgroup can have these positive effects, such as increasing trust and forgiveness, e.g., [59, 60].

Notably, feeling heard was the strongest predictor of negative avoidance intentions across a broad range of contexts and relationships, explaining variance over and above 15 related variables, such as interpersonal acquaintance. The FHS might be such a good predictor, because, in the way we operationalized it, feeling heard is not just an assessment of the relational qualities of self, other, or the relationship (as most variables in the interpersonal relations literature tend to be), but rather a variable that reflects the social interaction and is therefore about me, you, and us, all at the same time. For instance, the FHS was predictive in the subsamples of participants who reported about interactions with both people they were positive and less positive about, while the closely related conversational intimacy scale was only predictive in interactions with others who participants were initially positive about. Conversational intimacy therefore seems to be better equipped to operationalize aspects of the quality of “strong tie” relationships, whereas the FHS is a good predictor in conversations with partners who have either strong or weak ties. Of course, intentions are held in the present and do not always translate into actual behavior (i.e., the intention-behavior gap). It is therefore imperative that future studies map the behavioral consequences of feeling heard experiences over time to further establish the scale’s predictive validity.

Practical recommendations

Feeling heard can be considered a process variable. It is shaped by and shapes interaction dynamics. Whether one feels heard depends on the behaviors of one’s interaction partner(s) and one’s attributions and perceptions of these behaviors. The degree to which one feels heard then shapes one’s behaviors towards these partners who, in turn, interpret and respond to one’s behaviors. This focus on conversational experiences is also what makes the FHS unique; most related scales measure general perceptions and feelings towards either the self, partner(s), or relationship.

In many contexts, to fully understand (and predict) the consequences of certain interaction behaviors, the valid assessment of feeling heard can thus be essential. Beyond the contexts in which feeling heard is known to play a role (intimate relationships, healthcare, work), the FHS can be relevant in any context that involves direct interpersonal interaction. In therapeutic contexts, the FHS could help understand why certain treatments might be more (or less) effective; knowing whether a client feels heard by their therapist might be essential to understand the effectiveness of certain listening techniques. Call centers or helpdesks could monitor customer satisfaction by assessing the extent to which customers feel heard. In ongoing relationships, the FHS may be found suitable as an instance-by-instance measure to track patterns of relationship development and maintenance. At a different level, feeling heard might also have an important role to play in the relationship between governmental institutions and citizens: whether citizens that are affected by a certain governmental decision feel heard in their contact with governmental representatives might predict their acceptance of that decision (similar to voice, [30]).

It holds for all these settings that now we can measure feeling heard, we can test the assumptions surrounding this construct: how important is feeling heard in a specific context? What makes people feel heard in conversation? What kinds of processes are mediated by feeling heard? Instructions on how to use the Feeling Heard Scale can be found in the user manual in section 4 of the S1 Appendix. Please note however, that further research is needed to validate and standardize the FHS in clinical and other applied settings, as well as other populations, such as children and respondents with a non-western cultural background.

The FHS is a relatively compact and effective measure to use in most settings, but in research environments where space is at a premium, we recommend using the central item: “In this conversation, I felt heard by the other(s)”. Of course, there is always a loss of precision when using a single item, but on the basis of our research we can quantify its magnitude. Both studies show that the amount of variance in the full scale that is accounted for by the single-item alternative is about 50%. If one chooses to use the single item, one should be mindful of this loss of precision, and transparent about it in communicating its results. Larger sample sizes could compensate for this, but in a clinical setting or other context where N = 1, we strongly recommend the use of the full scale for a reliable and precise assessment of feeling heard.

Finally, our theoretical framework provides guidelines on how to increase interaction partners’ experiences of feeling heard. Depending on the feeling heard component(s) one decides to tackle, the commitment of one to three entities is needed: the speaker, the listener, and/or both of them together. Can the person that does not feel heard make sure they can have their say? This would depend importantly on the exact source of the silencing: maybe the speaker should speak louder or explicitly ask for attention. Does the person that wants to make another feel heard show enough attention, empathy, and respect? Here active listening techniques could be of help, e.g., paraphrasing, open-ended questions [23]. Or do both parties need to work on establishing a sense of common understanding? This could be done by common grounding techniques, e.g., checking for understanding and asking for clarification [35].

Limitations and future directions

The current studies showed that feeling heard is related to the quality (not to be confused with quantity: acquaintance) and equality of the relationship. But the direction of these relationships is not clear. It might be a bi-directional process in which “I feel positive/ equal towards the other(s) because I feel heard, and I feel heard because I feel positive/ equal towards the other(s)”. Feeling heard might affect and/or be affected by many more dispositional (e.g., rejection sensitivity, self-esteem), situational (e.g., expectations), and cultural (e.g., norms) factors. For instance, people that are low in self-esteem or especially sensitive to signals of rejection might tend to feel not heard more easily (such effects have been observed for ostracism, see [61]). As an example of cultural influences, a Turkish-Dutch scientist we interviewed mentioned that the right to be (and feel) heard needs to be earned in more collectivist cultures (see section 1.3 in S1 Appendix). This is related to the relatively limited demographical diversity in our sample (often younger adults, highly educated, likely relatively affluent and mostly white). These are all interesting directions for future research.

The current paper looked at feeling heard in conversations. However, as alluded to previously, the experience of feeling heard may also exist at a more abstract level, without direct interpersonal interaction. One prominent example that comes to mind is reflected in the quote by Dr. Martin Luther King at the start of this paper: citizens feeling not heard by government. The consequences of this experience are well-documented. For example, political discontent tends to be highest among less educated people because they feel politicians do not truly understand their lived experiences and do not respect them [62]. Moreover, qualitative research suggests that not feeling heard plays an important role in the reasons for activists to step up their actions, become more vocal, and ultimately to embrace more radical forms of collective action [6]. Future empirical investigation is required to establish the nature of feeling heard at the abstract level and its relationship to feeling heard in conversations. It might be that feeling heard in conversations with representatives of an institution or another group can spill over to feeling heard by that institute or group as a whole.

Conclusion

In many, if not all, interpersonal contexts, from work meetings and customer support to parent-child interactions and therapeutic contacts, the experience of feeling heard reflects an essential component of social interaction. By developing and validating a scale to measure feeling heard, this paper opens up the possibility to study this key process variable. The central conceptual contribution of this research is that it shows that feeling heard is not about any individual interaction partner, nor is it only about the collective, nor is it just about the appreciation of the interaction itself. Feeling heard is about all these things together, at the same time. This concept reflects the interpersonal and social dynamics of conversation, as they constitute the relational outcomes for self, other, and for “us”. We believe that in individualized societies, where the sense of self occupies an increasingly central role, this concept may become more important not just for individual self-esteem and well-being and for high quality relations, but more generally for maintaining the social fabric of societies.

Supporting information

S1 Appendix. The supporting information file containing 1) all supporting figures, tables, questionnaires and additional qualitative data of the two studies reported in the paper, 2) the report of a third (lab) study, and 3) the user manual of the feeling heard scale.

(DOCX)

Acknowledgments

The authors thank the four anonymized interviewees for sharing their knowledge about and experience with feeling heard from a practical perspective. The authors additionally thank Angela Voskuilen for performing the double-coding of the qualitative data of Study 1. Study 3 in the S1 Appendix was made possible by Kira Choinski who co-designed the experiment and collected the data. Lastly, the authors are grateful to dr. Paul Vermeulen and dr. Dominik Neumann for their advice concerning conceptualization and operationalization.

Data Availability

All the materials, data and code used in this paper is publicly available in anonymized form on dataverse.nl: https://doi.org/10.34894/IHNKUN.

Funding Statement

Part of this research (i.e., Study 2) was funded by the Behavioral and Social Sciences Internet Research Fund of the University of Groningen (project code 170240169). The grant holder was Namkje Koudenburg; Tom Postmes and Carla Roos were co-applicants. The funder's website is https://www.rug.nl/gmw/?lang=en The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. No further grant was received from any funding agency in the public, commercial, or not-for-profit sectors.

References

  • 1.Floer T. How Wireless Retailers Can Make Customers Feel Heard. 2020 Feb 6; https://www.iqmetrix.com/blog/how-wireless-retailers-can-make-customers-feel-heard
  • 2.Glaser D. How to Make Your Partner Feel Heard in a Relationship. 2020 Apr 26; https://believeberealbebold.com/2020/04/26/how-to-make-your-partner-feel-heard-in-a-relationship/
  • 3.Mohl L. Your Employees Want To Be Heard: 5 Ways to Listen & Measure Success. 2020 Jan 9; https://www.smallbizdaily.com/employees-want-heard-5-ways-listen-measure-success/
  • 4.Simperingham G. Practice: Active Listening Improves Communication in the Parent-Child Relationship. 2014 Nov 1; https://compassionjournal.stanford.edu/2014/11/practice-active-listening-improves-communication-in-the-parent-child-relationship/
  • 5.Chotiner I. Redefining Populism. 2021 Jul 9; https://www.newyorker.com/news/q-and-a/redefining-populism
  • 6.Greijdanus H, Postmes T. Sociale media en collectieve actie rondom de gasboringen in Groningen. 2018. [Google Scholar]
  • 7.Carthan EJ. Riots are the language of the unheard. What is it America is not hearing? 2020 Jun 4; https://themississippilink.com/2020/06/04/riots-are-the-language-of-the-unheard-what-is-it-america-is-not-hearing/
  • 8.Goldberg J. It’s a fallacy that Trump supporters haven’t been heard. 2021 Jan 10; https://www.adn.com/opinions/national-opinions/2021/01/10/its-a-fallacy-that-trump-supporters-havent-been-heard/
  • 9.Roos CA, Koudenburg N, Postmes T. Online Social Regulation: When Everyday Diplomatic Skills for Harmonious Disagreement Break Down. Journal of Computer-Mediated Communication [Internet]. 2020;25(6):382–401. Available from: 10.1093/jcmc/zmaa011 [DOI] [Google Scholar]
  • 10.Roos CA, Koudenburg N, Postmes T. Dealing with disagreement: The depolarizing effects of everyday diplomatic skills face-to-face and online. New Media Soc [Internet]. 2021;24(9):2153–76. Available from: 10.1177/1461444821993042 [DOI] [Google Scholar]
  • 11.Hertz N. The Lonely Century: Coming Together in a World that’s Pulling Apart. Hodder & Stoughton; 2020. [Google Scholar]
  • 12.Reis HT, Clark MS. Responsiveness. In: Simpson JA, Campbell L, editors. The Oxford handbook of close relationships. Oxford University Press; 2013. p. 400–23. [Google Scholar]
  • 13.Reis HT, Crasta D, Rogge RD, Maniaci MR, Carmichael CL. Perceived Partner Responsiveness Scale (PPRS). In: Worthington DL, Bodie GD, editors. The Sourcebook of Listening Research: Methodology and Measures. John Wiley & Sons Incl.; 2017. p. 516–21. [Google Scholar]
  • 14.Landry SH, Smith KE, Swank PR. Responsive parenting: Establishing early foundations for social, communication, and independent problem-solving skills. Dev Psychol [Internet]. 2006;42(4):627–42. Available from: doi: 10.1037/0012-1649.42.4.627 [DOI] [PubMed] [Google Scholar]
  • 15.Gable SL, Reis HT. Good News! Capitalizing on Positive Events in an Interpersonal Context. In: Zanna MP, editor. Advances in experimental social psychology. Academic Press; 2010. p. 195–257. [Google Scholar]
  • 16.Itzchakov G, Reis HT. Perceived Responsiveness Increases Tolerance of Attitude Ambivalence and Enhances Intentions to Behave in an Open-Minded Manner. Pers Soc Psychol Bull [Internet]. 2020;47(3):468–85. Available from: doi: 10.1177/0146167220929218 [DOI] [PubMed] [Google Scholar]
  • 17.Langberg EM, Dyhr L, Davidsen AS. Development of the concept of patient-centredness—A systematic review. Patient Educ Couns [Internet]. 2019;102(7):1228–36. Available from: doi: 10.1016/j.pec.2019.02.023 [DOI] [PubMed] [Google Scholar]
  • 18.Rogers CR. A client-centered/person-centered approach to therapy. In: Kirschenbaum H, Henderson VL, editors. The Carl Rogers reader. Houghton Mifflin; 1989. p. 135–52. [Google Scholar]
  • 19.Epstein RM, Street RL Jr. The values and value of patient-centered care. Ann Fam Med [Internet]. 2011;9(2):100–3. Available from: https://pubmed.ncbi.nlm.nih.gov/21403134 doi: 10.1370/afm.1239 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.de Ruyter K, Wetzels MGM. The Impact of Perceived Listening Behavior in Voice-to-Voice Service Encounters. J Serv Res [Internet]. 2000;2(3):276–84. Available from: 10.1177/109467050023005 [DOI] [Google Scholar]
  • 21.Murray J. Hearing young children’s voices. Int J Early Years Educ [Internet]. 2019;27(1):1–5. Available from: 10.1080/09669760.2018.1563352 [DOI] [Google Scholar]
  • 22.Itzchakov G, DeMarree KG, Kluger AN, Turjeman-Levi Y. The Listener Sets the Tone: High-Quality Listening Increases Attitude Clarity and Behavior-Intention Consequences. Pers Soc Psychol Bull [Internet]. 2018;44(5):762–78. Available from: doi: 10.1177/0146167217747874 [DOI] [PubMed] [Google Scholar]
  • 23.Rogers CR, Farson RE. Active Listening. Industrial Relations Center, the University of Chicago; 1957. [Google Scholar]
  • 24.Kluger AN, Itzchakov G. The Power of Listening at Work. Annual Review of Organizational Psychology and Organizational Behavior [Internet]. 2022;9(1):121–46. Available from: 10.1146/annurev-orgpsych-012420-091013 [DOI] [Google Scholar]
  • 25.Yip J, Fisher CM. Listening in Organizations: A Synthesis and Future Agenda. Academy of Management Annals [Internet]. 2022;16(2):657–79. Available from: 10.5465/annals.2020.0367 [DOI] [Google Scholar]
  • 26.Weiste E, Käpykangas S, Uusitalo LL, Stevanovic M. Being Heard, Exerting Influence, or Knowing How to Play the Game? Expectations of Client Involvement among Social and Health Care Professionals and Clients. Int J Environ Res Public Health [Internet]. 2020. Aug 5;17(16):5653. Available from: https://pubmed.ncbi.nlm.nih.gov/32764434 doi: 10.3390/ijerph17165653 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lind EA, Tyler TR. The Social Psychology of Procedural Justice. Contemporary Sociology. Plenum Press; 1988. [Google Scholar]
  • 28.Thibaut JW, Walker L. Procedural Justice: A Psychological Analysis. L. Erlbaum Associates; 1975. [Google Scholar]
  • 29.Folger R.. Distributive and procedural justice: Combined impact of voice and improvement on experienced inequity. J Pers Soc Psychol [Internet]. 1977;35(2):108–19. Available from: 10.1037/0022-3514.35.2.108 [DOI] [Google Scholar]
  • 30.Lind EA, Kanfer R, Earley PC. Voice, control, and procedural justice: Instrumental and noninstrumental concerns in fairness judgments. J Pers Soc Psychol [Internet]. 1990;59(5):952–9. Available from: 10.1037/0022-3514.59.5.952 [DOI] [Google Scholar]
  • 31.Tyler TR, Blader SL. The Group Engagement Model: Procedural Justice, Social Identity, and Cooperative Behavior. Personality and Social Psychology Review [Internet]. 2003;7(4):349–61. Available from: doi: 10.1207/S15327957PSPR0704_07 [DOI] [PubMed] [Google Scholar]
  • 32.Tyler TR, Huo YJ. Trust in the Law: Encouraging Public Cooperation with the Police and Courts [Internet]. Russel Sage Found. Russel Sage Found; 2002. Available from: 10.1353/sof.2004.0010 [DOI] [Google Scholar]
  • 33.Clark HH. Using Language. Cambridge University Press; 1996. [Google Scholar]
  • 34.Clark HH, Schaefer EF. Contributing to Discourse. Cogn Sci [Internet]. 1989;13(2):259–94. Available from: 10.1207/s15516709cog1302_7 [DOI] [Google Scholar]
  • 35.Bavelas BJ, De Jong P, Korman H, Smock Jordan S. Beyond Back-channels: A Three-step Model of Grounding in Face-to-face Dialogue. In: System Description for Demonstration at the Interdisciplinary Workshop on Feedback Behaviors in Dialog. 2012. p. 5–6.
  • 36.Bavelas JB, Coates L, Johnson T. Listeners as co-narrators. J Pers Soc Psychol [Internet]. 2000;79(6):941–52. Available from: doi: 10.1037//0022-3514.79.6.941 [DOI] [PubMed] [Google Scholar]
  • 37.Echterhoff G, Higgins ET, Levine JM. Shared Reality: Experiencing Commonality with others’ Inner States about the World. Perspectives on Psychological Science [Internet]. 2009;4(5):496–521. Available from: doi: 10.1111/j.1745-6924.2009.01161.x [DOI] [PubMed] [Google Scholar]
  • 38.Searle JR. Collective Intentions and Actions. In: Cohen P, Morgan J, Pollack ME, editors. Intentions in Communication. MIT Press; 1990. p. 401–15. [Google Scholar]
  • 39.Bentler PM, Chou CP. Practical Issues in Structural Modeling. Sociol Methods Res [Internet]. 1987;16(1):78–117. Available from: 10.1177/0049124187016001004 [DOI] [Google Scholar]
  • 40.Cohen J. Statistical Power Analysis for the Behavioral Sciences Second Edition. Routledge; 1988. [Google Scholar]
  • 41.Centraal Bureau voor de Statistiek. Standaard onderwijsindeling 2021 [Internet]. 2021. https://www.cbs.nl/-/media/cbs/onze-diensten/methoden/classificaties/documents/2021/standaard-onderwijsindeling-2021-ed-2021.pdf
  • 42.Kaiser HF. An index of factorial simplicity. Psychometrika [Internet]. 1974;39(1):31–6. Available from: 10.1007/bf02291575 [DOI] [Google Scholar]
  • 43.Rosseel Y, Jorgensen TD, Rockwood N. Latent Variable Analysis. R package version 0.6–9. [Internet]. 2021. https://cran.r-project.org/web/packages/lavaan/lavaan.pdf
  • 44.Miles J, Shevlin M. A time and a place for incremental fit indices. Pers Individ Dif [Internet]. 2007;42(5):869–74. Available from: 10.1016/j.paid.2006.09.022 [DOI] [Google Scholar]
  • 45.McNeish D, An J, Hancock GR. The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models. J Pers Assess [Internet]. 2017;100(1):43–52. Available from: doi: 10.1080/00223891.2017.1281286 [DOI] [PubMed] [Google Scholar]
  • 46.Raiche G, Magis D. nFactors: Parallel Analysis and Other Non Graphical Solutions to the Cattell Scree Test. R package version 2.4.1 [Internet]. 2020. https://CRAN.R-project.org/package=nFactors
  • 47.Putnick DL, Bornstein MH. Measurement Invariance Conventions and Reporting: The State of the Art and Future Directions for Psychological Research. Dev Rev [Internet]. 2016/06/29. 2016. Sep;41:71–90. Available from: https://pubmed.ncbi.nlm.nih.gov/27942093 doi: 10.1016/j.dr.2016.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Jorgensen TD, Pornprasertmanit S, Schoemann AM, Rosseel Y. Useful Tools for Structural Equation Modeling. R package version 0.5–5 [Internet]. 2021. https://cran.r-project.org/web/packages/semTools/semTools.pdf
  • 49.Lipetz L, Kluger AN, Bodie GD. Listening is Listening is Listening: Employees’ Perception of Listening as a Holistic Phenomenon. International Journal of Listening [Internet]. 2018;34(2):71–96. Available from: 10.1080/10904018.2018.1497489 [DOI] [Google Scholar]
  • 50.United States census bureau. Labor Force Participation by Level of Education [Internet]. 2020. https://www.census.gov/library/visualizations/2020/comm/labor-force-by-education.html
  • 51.Kelley K. MBESS: The MBESS R Package. R package version 4.8.0 [Internet]. 2020. https://CRAN.R-project.org/package=MBESS
  • 52.Burgoon JK, Hale JL. Nonverbal expectancy violations: Model elaboration and application to immediacy behaviors. Commun Monogr [Internet]. 1988;55(1):58–79. Available from: 10.1080/03637758809376158 [DOI] [Google Scholar]
  • 53.Wheeless LR, Grotz J. THE MEASUREMENT OF TRUST AND ITS RELATIONSHIP TO SELF-DISCLOSURE. Hum Commun Res [Internet]. 1977;3(3):250–7. Available from: 10.1111/j.1468-2958.1977.tb00523.x [DOI] [Google Scholar]
  • 54.Myers SA, Johnson AD. Perceived solidarity, self‐disclosure, and trust in organizational peer relationships. Communication Research Reports [Internet]. 2004;21(1):75–83. Available from: 10.1080/08824090409359969 [DOI] [Google Scholar]
  • 55.Montoya RM, Insko CA. Toward a more complete understanding of the reciprocity of liking effect. Eur J Soc Psychol [Internet]. 2008;38(3):477–98. Available from: 10.1002/ejsp.431 [DOI] [Google Scholar]
  • 56.Mccroskey JC. An Introduction to Rhetorical Communication. 4th ed. Prentice-Hall; 1982. [Google Scholar]
  • 57.Hodson G. Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs. Journal of Theoretical Social Psychology. 2021. Oct 6;5(4):576–90. [Google Scholar]
  • 58.Itzchakov G, Kluger AN, Castro DR. I Am Aware of My Inconsistencies but Can Tolerate Them: The Effect of High Quality Listening on Speakers’ Attitude Ambivalence. Pers Soc Psychol Bull [Internet]. 2016;43(1):105–20. Available from: doi: 10.1177/0146167216675339 [DOI] [PubMed] [Google Scholar]
  • 59.Bruneau EG, Saxe R. The power of being heard: The benefits of ‘perspective-giving’ in the context of intergroup conflict. J Exp Soc Psychol [Internet]. 2012;48(4):855–66. Available from: 10.1016/j.jesp.2012.02.017 [DOI] [Google Scholar]
  • 60.Livingstone AG, Fernández Rodríguez L, Rothers A. “They just don’t understand us”: The role of felt understanding in intergroup relations. J Pers Soc Psychol [Internet]. 2020;119(3):633–56. Available from: doi: 10.1037/pspi0000221 [DOI] [PubMed] [Google Scholar]
  • 61.Murray SL, Rose P, Bellavia GM, Holmes JG, Kusche AG. When rejection stings: How self-esteem constrains relationship-enhancement processes. J Pers Soc Psychol [Internet]. 2002;83(3):556–73. Available from: doi: 10.1037//0022-3514.83.3.556 [DOI] [PubMed] [Google Scholar]
  • 62.Noordzij K, de Koster W, van der Waal J. ‘They don’t know what it’s like to be at the bottom’: Exploring the role of perceived cultural distance in less-educated citizens’ discontent with politicians. Br J Sociol [Internet]. 2020/12/27. 2021. Jun;72(3):566–79. Available from: https://pubmed.ncbi.nlm.nih.gov/33368242 doi: 10.1111/1468-4446.12800 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ramona Bongelli

15 Aug 2023

PONE-D-23-13419Feeling heard: Operationalizing a key concept for social relationsPLOS ONE

Dear Dr. Roos,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 29 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ramona Bongelli, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Thank you for stating the following in the Acknowledgments Section of your manuscript:

” Part of this research (i.e., Study 2) was funded by the Behavioral and Social Sciences Internet Research Fund of the University of Groningen.”

We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

“Part of this research (i.e., Study 2) was funded by the Behavioral and Social Sciences Internet Research Fund of the University of Groningen (project code 170240169). The grant holder was Namkje Koudenburg; Tom Postmes and Carla Roos were co-applicants. The funder's website is https://www.rug.nl/gmw/?lang=en

The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

No further grant was received from any funding agency in the public, commercial, or not-for-profit sectors.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This manuscript provides a substantial review of the literature to make a compelling case for exploring and measuring “feeling heard”. It then reports two empirical studies describing the development and validation of the Feeling Heard Scale (FHS). I believe the manuscript makes a strong contribution to the extant literature, and I expect the FHS will be well-received and widely used in distinct research domains (e.g., intimate relationships, communication). However, there are some issues for consideration. Here I offer few suggestions for the authors to make their contribution stronger.

1. I understand the goal of testing the conceptual model developed in Study 1 and use the opportunity to report qualitative insights from participants. But I wished the authors would have conducted two distinct studies: the first a more qualitative study investigating how the feeling heard conceptualization made by the authors matched respondents’ own understandings and experiences; and the second study then updating the conceptualization of the theoretical model based on the first study to then guide the development of the measure. This combination of deductive-inductive-(and back to)deductive approach would have made the empirical work stronger, and potentially the final measure. I therefore recommend the authors to mention this as a potential limitation of their work.

2. I also have some recommendations regarding the theoretical model. I really liked the five identified facets (i.e., voice, attention, empathy, respect, and common ground), their clear grounding in the literature (which could have been improved by initial matching text with respondents; see above), and clear rational for the specific items in Table 1. However, aspects of the model conceptualization and presentation can be improved. First, I find the distinction between interpersonal and collective confusing. Common group (‘we’) is clearly within an interpersonal domain, and the word ‘collective’ has a much broader and group-based meaning that goes beyond ‘we’, so reading this word makes the model confusing. Third, the model description implies a hierarchical conceptualization – interpersonal (‘me’ and ‘you’) nested within ‘collective’ (‘we’) – which is not empirically explicit/tested by the model. Finally, the model conceptualization in Figure 1 does not follow recommended practices.

So, I would recommend the following: (a) I would avoid the use of ‘collective’ in the model. Perhaps ‘collective’ could be replaced with ‘dyad’, or perhaps better use ‘unipersonal’ and ‘interpersonal’ to making the distinctions between ‘me/you’ and ‘we’, respectively. (b) I would check the model description in text to avoid potential reference to a hierarchical model. This has two potential understandings: one is a multilevel model (e.g., students within classrooms within schools; or ‘me’ and ‘you’ within ‘we’) and another is a hierarchical factorial model (i.e., the five facets of voice, attention, etc nested within the higher-order construct of feeling heard) – but neither of these models were tested empirically, so I would avoid any hierarchical description in the text. And (c) I recommend the authors to use an oval for “feeling heard” in Figure 1 as this is the convention for depicting latent constructs.

3. Importantly, the correlations reported in Table 5 clearly indicates non-trivial conceptual overlaps between feeling heard and neighboring constructs. The authors provide some examination for the overlap with intimacy (correlation of .84!), but I do believe the authors must explore this further. In particular, I recommend the authors to read carefully the recent paper by Gordon Hodson titled "Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs” (https://doi.org/10.1002/jts5.120). For example, I do think the authors could provide further evidence these constructs are empirically distinct via examining the correlations of the latent factors using structural equation modelling. I understand the authors want to promote their new construct and scale, but the authors must provide convincing and (to same extent) exhaustive that this construct is justifiable non-redundant. In my view, one aspect of the Open Science movement that the authors follow (e.g., pre-registering Study 2, making material/data available) is to avoid ‘noise’ within psychological science, and promoting redundant measures is an example of such noise. This would only require the authors to reanalyze their existing data (and not to collect more data) and the work is not considerable, but the findings might go against the initial predictions (and desires) of the authors which should be accepted, and which is more aligned with the scientific enterprise (e.g., focus on the evidence and not on individual preferences).

4. There are also smaller changes, including the following:

- perhaps report one-sample t-tests when reporting mean levels of feeling heard to indicate whether it differs from the scale middle point

- in case the authors retain the additional intimacy analysis reported in p. 35, perhaps they could examine this more formally by running a moderation analysis with sample type as the moderator; this has the added benefit of avoiding splitting the sample variable.

- It is unclear to me how there were “214 participants for Part B” as reported in p. 26. Please double check this. I also found the description of the conditions and two parts in p. 13 confusing, and you might want to improve it.

- It is unclear to me the interpretation that “all items tapped into feeling heard” based on the t-test reported in p. 22

- The assertion that item 1 “loads somewhat on various factors” is misleading as Figure 1 clearly indicates it loads reliably only on two factors (respect and common group).

- I also noticed some typos/grammar issues (e.g., “participants / others that” instead of “participants / others who”; “study 1”, inconsistency in using “confirmatory factor analysis” and COVID with initial capital or not; sentence with many ‘understanding’ in line 222)

Reviewer #2: This study sought to develop a scale to measure feeling heard (FHS). Feeling heard is described as a complex construct of five components at two levels: at the interpersonal level, having voice; receiving attention, empathy, and respect; and at the communal level, experiencing common ground. These are described as involving me, you, and we.

Content

1. The abstract does not identify the two levels: interpersonal and collective. It seems this would be important to the reader, so state this in the abstract. Perhaps more problematic, the abstract currently seems to imply two sets of five elements (“five components at two levels”) and the two levels suggests higher-order factor structures while two conceptual levels are in fact intended. But there are actually three personal contexts: me, you, and us. So this may be better described as three interpersonal contexts: “individuals feel heard when 1) my voice receives 2) your attention, 3) empathy, and 4) respect in the context of 5) our common ground.

2. A key point in the discussion—lines 571 and 832—is that “feeling heard appears to be a unitary concept.” That needs to be said in the abstract as well. At present the abstract leaves the impression that feeling heard and the resulting FHS is five-dimensional.

3. Figure 1 line 234. It seems oddly inconsistent and a bit disconcerting to insert tables into the text and place figures following the references—see note #1 under Style below.

4. Implicit in Study 2 is the belief that the scale will perform in substantially identical ways in the Dutch and US samples. That it does should be explicitly stated in the discussion; that is an important finding.

5. Line 246 should conclude “can be found in the . .”

6. Informed consent could not be examined due to masking materials. It seems a better plan is needed to support review of this feature of the study. Briefly describe the consent procedures for each set of data.

7. The 2 x 2 design is not clear. What steps were taken to ensure that the same conversation was not reported in Part A and Part B?

8. Rather than state you “tried to include one negatively phrased item,” report the number of negatively-worded items in the initial and final FHS scales. The insertion of a correlation between negatively-worded items suggests there is a method effect for negatively-worded items. That might be good to include in the discussion. There is a growing body of evidence that negatively-worded items do not work similarly across some cultural settings (e.g., see Bufford & Paloutzian, 2023).

9. The section about descriptions and reasons—lines 342-344—seems redundant. Or perhaps clarification is needed.

10. Line 347 might read better as the average of both coders or the mean score of both coders.

11. Perhaps it would be worth noting in the discussion that underlying being heard are a set of shared values: respect for the person, sharing of power, a sense of justice carried out, common ground/worldview, shared being (me, you, us). And perceptions of this mutuality is essential to feeling heard.

12. It would help to carry through with the enumeration begun in line 359. What comes second and third?

13. Perhaps add here that over half of the remembered Last conversations were with colleagues and family.

14. Table 3 needs a bit more detail. For percentages, it is not clear what the underlying referent is.

15. Line 457 is not a complete sentence. Perhaps combine with the previous sentence.

16. At lines 468 to 470 absolute values of t would be clearer. As stated, a t of zero is included as significant.

17. I suggest stating that confirmatory factor analysis rather than exploratory factor analysis was carried out because of the theoretical model for feeling heard that shaped the study.

18. Given the length and complexity of the supplementary materials, at times the reader needs more help in navigating them. A table of contents at the front of the supplementary material might work. Or refer to the page(s) on which the supplemental material is presented. A header and pagination are also essential for this material.

19. Effect size data are needed for the analyses of variance at lines 545-548.

20. Limitations of Study 1 are not mentioned in the discussion. An important one is that the test for generality of the measure across samples (“invariance”) is quite weak as the same sample was employed: generality is only assessed across conversation settings within the same sample.

21. The reference to procedural and distributive justice would benefit from a brief explanation—an appositive—of these concepts (justice processes and outcomes?) and their relevance to feeling heard.

22. At line 589 place convergent and divergent validity together rather than separating them with predictive validity. Placing predictive validity last would better parallel the following hypotheses as well.

23. The divergent validity hypothesis at line 608 is problematic. First, it purports to test the null hypothesis of no relationship. Second, divergent validity is more accurately a negative relationship rather than the absence of a relationship. Discriminant validity? Hypothesis 2B seems to best fit divergent validity as I understand it. A pertinent methodological citation(s) may be helpful as these concepts seem to be defined and used in inconsistent ways.

24. The intentions for a next conversation measure is gathered as concurrent data: intentions are held in the present. Considering it a measure of predictive validity stretches the concept. 675-678

25. A period seems to be in the wrong place at line 686. Actually several; check punctuation in this entire paragraph.

26. The data at 679-689 lack needed context. What are these relationships?

27. It seems unclear how the variables following 693 fit the concept of divergent validity. Perhaps a technical citation is needed here as it appears the literature seems to conflate divergent validity and discriminant validity. See #23 above.

28. The CFA for Study 2 is much more valuable than that for Study 1 as it employs a distinct sample in a distinct cultural setting. This should be mentioned in the discussion of Study 2 or General Discussion.

29. Table 5 would be more effective if it were constructed to parallel the hypotheses 2A and 2B. The present format makes the reader work to follow the expected direction of relationships and minus signs are scattered rather than clustered together.

30. Line 735 claims that “feeling heard differs from intimacy”, but it appears this claim was not statistically tested—are these correlations significantly different? Perhaps simply report they show somewhat different patterns of correlation with other measures.

31. While the logic of regression is predictive, data were gathered at the same time and is somewhat misreported at line 745. It would be more accurate to say “The less people felt heard, the more likely they they were to say that they were disposed to negatively avoid a next conversation. . . “

32. Taken as a whole the regressions establish the FHS as a predictor of engaging/avoiding conversation and item 1 is a good short version. And yes, feeling heard is distinct from the related constructs. 778-779

33. The claim that “not feeling heard appears to be somewhat less common than feeling heard” is not tested in the study (line 845). It seems all you could claim here is that participants were more likely to report an episode of feeling heard. Might that be due to the relative rarity of feeling heard? Could is be influenced by the initial instructions?

34. At line 891-896 the supporting data are not clear. Does the conversational intimacy comment pertain to a finding I overlooked—or to another study which should be cited here?

35. Characteristics of the ample seem additional limitations—young adults, more educated, likely more affluent, likely mostly white—I did not see any ethnic/racial description of the samples.

36. The supplementary material is a bit chaotic. Adding pagination, a table of contents, and page breaks that fit the content would help to make this material (all 51 pages) accessible.

B. Format/Style

1. In APA style, tables and figures can be embedded in the text or aggregated after the reference list. Here neither of these options is employed; rather they are split in both places.

2. See line 288—in APA style numbers are spelled out to begin a sentence.

3. Embedded tables should be preceded and followed by an extra double line-space (e.g., 354-358).

4. Single-spaced tables are acceptable in APA style, but an additional line space between sections would make the material more readable (e.g., Table 2, 356ff).

5. Correlational tables are generally constructed with the data on the lower left part of the table rather than the upper right half.

6. Figures require a descriptive title and sufficient information in the notes to explain them independent of the text. The header should remain constant except for the page #. Figure titles are placed below the figures. For example, lines 531-536 should be included on the page with the figure. In this manuscript they appear to be inserted into the text without the needed extra spacing to distinguish them from the text.

7. Table S-2 would be more accessible if t and its df were placed in adjacent columns or t and df were listed sequentially like M, (SD). Several of the supplementary tables would also benefit by putting additional material in the same or an adjoining column rather than between rows.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Nov 30;18(11):e0292865. doi: 10.1371/journal.pone.0292865.r002

Author response to Decision Letter 0


14 Sep 2023

Reviewer #1: This manuscript provides a substantial review of the literature to make a compelling case for exploring and measuring “feeling heard”. It then reports two empirical studies describing the development and validation of the Feeling Heard Scale (FHS). I believe the manuscript makes a strong contribution to the extant literature, and I expect the FHS will be well-received and widely used in distinct research domains (e.g., intimate relationships, communication). However, there are some issues for consideration. Here I offer few suggestions for the authors to make their contribution stronger.

1. I understand the goal of testing the conceptual model developed in Study 1 and use the opportunity to report qualitative insights from participants. But I wished the authors would have conducted two distinct studies: the first a more qualitative study investigating how the feeling heard conceptualization made by the authors matched respondents’ own understandings and experiences; and the second study then updating the conceptualization of the theoretical model based on the first study to then guide the development of the measure. This combination of deductive-inductive-(and back to)deductive approach would have made the empirical work stronger, and potentially the final measure. I therefore recommend the authors to mention this as a potential limitation of their work.

We agree with the reviewer that two separate studies would have been better, but time and material constraints prevented us from doing so. There are two reasons why we think this approach has not been problematic for the current study: First, we see that the qualitative results show strong support for out theoretical model. Participants’ understanding of feeling heard deviated from our model only on the theme of effort or goal accomplishment. Second, Study 2 was (amongst others) designed to test whether effort/goal accomplishment is a central component of feeling heard, which appeared not to be the case; feeling heard does not necessarily involve effort or goal accomplishment. We now describe this potential limitation in the Discussion section of Study 1, lines 590-593:

“We additionally performed a qualitative analysis of participants’ descriptions of feeling heard. Although this combination of model testing (quantitative data) and generation (qualitative data) in a single study can be seen as a limitation, the derived themes overlapped to a great extent with our definition.”

2. I also have some recommendations regarding the theoretical model. I really liked the five identified facets (i.e., voice, attention, empathy, respect, and common ground), their clear grounding in the literature (which could have been improved by initial matching text with respondents; see above), and clear rational for the specific items in Table 1. However, aspects of the model conceptualization and presentation can be improved. First, I find the distinction between interpersonal and collective confusing. Common group (‘we’) is clearly within an interpersonal domain, and the word ‘collective’ has a much broader and group-based meaning that goes beyond ‘we’, so reading this word makes the model confusing. Third, the model description implies a hierarchical conceptualization – interpersonal (‘me’ and ‘you’) nested within ‘collective’ (‘we’) – which is not empirically explicit/tested by the model. Finally, the model conceptualization in Figure 1 does not follow recommended practices.

So, I would recommend the following: (A) I would avoid the use of ‘collective’ in the model. Perhaps ‘collective’ could be replaced with ‘dyad’, or perhaps better use ‘unipersonal’ and ‘interpersonal’ to making the distinctions between ‘me/you’ and ‘we’, respectively.

A. We deliberately chose the term “collective” to refer to participants’ sense of themselves and the other as one indistinguishable unit or entity. Also see the literature on collective intentionality (Searle, 1990). We thus do not understand the “we/us” in our model as interpersonal and/or dyadic. By using “collective” and “we/us”, we try to emphasize how feeling heard goes beyond the interpersonal experiences of interaction partners as individuals. We therefore decided to keep this terminology, but clarified the reasoning behind this in the manuscript, by adding a short explanation on lines 183-186:

“We refer to this level of “us” or “we” as the “collective level” to distinguish it from interpersonal experiences. At the collective level interaction partners do not think about themselves and others as individuals but as one irreducible entity (also see the literature on collective intentionality, [38]).”

Searle, J. R. (1990). Collective Intentions and Actions. In P. Cohen, J. Morgan, & M.E. Pollack (Eds.), Intentions in Communication (pp. 401-415). MIT Press.

(B) I would check the model description in text to avoid potential reference to a hierarchical model. This has two potential understandings: one is a multilevel model (e.g., students within classrooms within schools; or ‘me’ and ‘you’ within ‘we’) and another is a hierarchical factorial model (i.e., the five facets of voice, attention, etc nested within the higher-order construct of feeling heard) – but neither of these models were tested empirically, so I would avoid any hierarchical description in the text.

B. We thank the reviewer for making this important point. The comments made us realize that the interpersonal versus collective “levels” phrasing can be confusing because we indeed do not distinguish between them in our analysis. We therefore followed the suggestion, adapted our model and de-emphasize the collective-interpersonal distinction. We kept the presentation of five components that concern self, other and us. We did so because, whereas the five components that we based on theoretical grounds could also not be distinguished on empirical grounds (feeling heard being a unitary concept), we did test this model in Study 1 (and indeed this is how it was initially conceived and pre-registered).

Furthermore, as indicated in response to comment 1 by reviewer 2, we replaced the confusing description of “levels of analysis” with “conceptual levels” which is more fitting and clear, we think.

These changes concern multiple sections of the manuscript. But the most significant and important change is in the ”A definition of feeling heard and an operational model” paragraph in the Introduction where we outline our model, see lines 228-232:

“Putting these different insights together, feeling heard has five components concerning three entities (me, you, and we). In order to feel heard, people take into account their interpersonal level experiences of my voice (1), and your attention (2), empathy (3) and respect (4). But beyond that, they may also factor in the collective level experience that we have (5) common ground.”

And (C) I recommend the authors to use an oval for “feeling heard” in Figure 1 as this is the convention for depicting latent constructs.

C. We agree with the reviewer and changed Figure 1 accordingly.

3. Importantly, the correlations reported in Table 5 clearly indicates non-trivial conceptual overlaps between feeling heard and neighboring constructs. The authors provide some examination for the overlap with intimacy (correlation of .84!), but I do believe the authors must explore this further. In particular, I recommend the authors to read carefully the recent paper by Gordon Hodson titled "Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs” (https://doi.org/10.1002/jts5.120). For example, I do think the authors could provide further evidence these constructs are empirically distinct via examining the correlations of the latent factors using structural equation modelling. I understand the authors want to promote their new construct and scale, but the authors must provide convincing and (to same extent) exhaustive that this construct is justifiable non-redundant. In my view, one aspect of the Open Science movement that the authors follow (e.g., pre-registering Study 2, making material/data available) is to avoid ‘noise’ within psychological science, and promoting redundant measures is an example of such noise. This would only require the authors to reanalyze their existing data (and not to collect more data) and the work is not considerable, but the findings might go against the initial predictions (and desires) of the authors which should be accepted, and which is more aligned with the scientific enterprise (e.g., focus on the evidence and not on individual preferences).

We thank the reviewer for this point, for the reference to Hodson’s interesting paper and useful recommendations, and we concur. This correlation is indeed very high (and it fails to meet even our own criteria). So we investigated the issue again and now describe it in more detail.

We conducted a CFA comparing the single factor model with the two-factor one. Looking at the model fit, the two factor solution explains variance a lot better than the single factor model (Δχ2(1) = 804.43, p < .001). We report this in the paper. But that does not explain why the correlations between the two are so high (also in the SEM with a covariance of .89). And this is clearly a potential problem judged by Hodson’s second consideration for assessing whether a construct is really something “new” or not: “If a theoretical construct is purportedly new, independent, or distinct (theoretically), it should not correlate perfectly, or near perfectly, with another construct empirically”. But the real point is that when inspecting the model output more closely, we can see very clearly why those correlations between constructs/LV’s are so high. See the table below for the (standardized) factor loadings of the CFA where all the items of the feeling heard and intimacy scales are set to load on one single factor. The intimacy scale consists of 20 items, with factor loadings ranging from quite low (|.31|) to very high (|.91|). Among the highest loading items are the items which we could also have included in the feeling heard scale, such as “the other person was willing to listen to me” (with a loading of .91) and “the other person was open to my ideas” (.89). And clearly these are things that one might be experiencing in an intimate relationship. But crucially, the items that have greater face validity for intimacy load much less highly, such as “the other person did not want a deeper relationship with me” (-.55), “the other person seemed to care if I liked him/her” (.64) and “the other person was not attracted to me” (-.31). So what we conclude from all this is that the feeling heard scale correlates highly with the items on the intimacy scale that also measure things very similar to “feeling heard”, but the FHS does not correlate highly with the items on the intimacy scale measuring “intimacy”. Thus, feeling heard is distinct from intimacy, but the intimacy scale confounds the two and its central dimension (at least in our dataset) appears to be feeling heard. We still feel justified in concluding that this meets Hodson’s recommendations, also because of his fifth recommendation: “Statistical measurement concerns are necessary to satisfy but are not sufficient; theory must also guide decisions. [...] Construct validity is assessed by both theoretical and measurement (or statistical) means; neither is sufficient on its own, and when one is weak there is increased burden on the other to do the heavy lifting.”

We now report this in the paper as well, see lines 757-779:

“To check whether feeling heard and intimacy are actually measuring the same underlying construct, we compared the fit of the model where all items of the feeling heard and intimacy scales were set to load on one single factor with the model where feeling heard and intimacy were considered two separate factors. The results show that the model fit is significantly better for the two-factor solution as compared to the one-factor model (Δχ2(1) = 804.43, p < .001 ), but still the two latent factors are strongly related (covariance of .89), which suggests that the constructs might be redundant (Hodson, 2021). Inspecting the single-factor output more closely, reveals why the correlations between constructs and latent factors are so high. The intimacy scale consists of 20 items, with standardized factor loadings ranging from quite low (|.31|) to very high (|.91|). Among the highest loading items are the items which we could also have included in the feeling heard scale, such as “the other person was willing to listen to me” (with a standardized loading of .91) and “the other person was open to my ideas” (.89). And clearly these are things that one might be experiencing in an intimate relationship. But crucially, the items that have greater face validity for intimacy load much less highly, such as “the other person did not want a deeper relationship with me” (-.55), “the other person seemed to care if I liked him/her” (.64) and “the other person was not attracted to me” (-.31). In sum, the feeling heard scale correlates highly with the items on the intimacy scale that also measure experiences very similar to “feeling heard”, but the FHS does not correlate highly with the items on the intimacy scale measuring “intimacy”. This means that the feeling heard is distinct from intimacy, but the intimacy scale confounds the two and its central dimension (at least in our dataset) is feeling heard. This observation is further supported by the differing correlation patterns of feeling heard and intimacy with other measures, see the section “Feeling heard and intimacy” below.”

Item Factor loadings

Feeling heard scale: In this conversation, …

…I felt heard by the other 0.79

…I could say what I really wanted to say 0.65

…the other was more concerned with him/herself than with what I said -0.68

…the other listened to what I said 0.81

…the other tried to put him/herself in my shoes 0.70

…the other was insensitive to my thoughts and feelings -0.68

…the other treated me with respect 0.84

…we understood each other 0.83

Intimacy scale: The other person …

...was intensely involved in our conversation 0.61

...did not want a deeper relationship with me -0.55

...was not attracted to me -0.31

...seemed to find our conversation stimulating 0.70

...communicated coldness rather than warmth -0.80

...created a sense of distance between us -0.78

...acted bored by our conversation -0.63

...was interested in talking to me 0.85

...showed enthusiasm while talking to me 0.82

...made me feel he/she was similar to me 0.80

...tried to move the conversation to a deeper level 0.61

...acted like we were good friends 0.72

...seemed to desire further communication with me 0.81

...seemed to care if I liked him/her 0.64

...was sincere 0.83

...was interested in talking with me 0.87

...wanted me to trust him/her 0.67

...was willing to listen to me 0.91

...was open to my ideas 0.88

...was honest in communicating with me 0.80

4. There are also smaller changes, including the following:

A. perhaps report one-sample t-tests when reporting mean levels of feeling heard to indicate whether it differs from the scale middle point

We thank the reviewer for this suggestion and added these accordingly, see lines 575-577 and 722-724:

“The distribution of feeling heard in Part B was negatively skewed (skewness = -1.10; M = 3.92, SD = 0.82) and the mean level of feeling heard was significantly higher than the scale midpoint (t(213)= 16.37, p < .001, Cohen’s d = 1.12, large effect).”

“A one-sample t-test showed that the mean level of feeling heard was significantly higher than the scale midpoint (t(999) = 16.51, p < .001, Cohen’s d = .52, medium effect).”

B. in case the authors retain the additional intimacy analysis reported in p. 35, perhaps they could examine this more formally by running a moderation analysis with sample type as the moderator; this has the added benefit of avoiding splitting the sample variable.

We thank the reviewer for the suggestion. Of course those analyses could be conducted (and we did). The problem is that we then have to explain to readers all main effects, two-way interactions and the three-way interaction. The current presentation is much more elegant and direct, we feel.

C. It is unclear to me how there were “214 participants for Part B” as reported in p. 26. Please double check this. I also found the description of the conditions and two parts in p. 13 confusing, and you might want to improve it.

The 214 participants for Part B is correct. We had initially 217 participants, 3 of whom provided a clearly non-serious description of their last online conversation, which is part B. Removing these observations resulted in 214 participants for Part B. For part A, the final sample was 194 participants because there we had to exclude 23 observations – those that gave a non-serious description of a conversation in which they did (not) feel heard and those that indicated to have never experienced an online conversation in which they did (not) feel heard.

We do understand the reviewer’s confusion regarding the design description of Study 1 and clarified this on lines 286-293 (also see our response to comment 7 by Reviewer 2):

“The survey consisted of two parts. In Part A participants were either asked to think back to an online conversation in which they felt heard (N = 108) or one in which they did not feel heard (N = 86). This division was based on random allocation and done to maximize the variance in feeling heard experiences and to test the differences between (feeling heard and feeling not heard) conditions. In Part B we examined the natural distribution of feeling heard in online conversations by asking all participants to think back to their last online conversation. All participants completed both Part A and Part B but in randomized order. Eighty-nine participants began with Part A and 105 participants began with Part B.”

D. It is unclear to me the interpretation that “all items tapped into feeling heard” based on the t-test reported in p. 22

We mean that all items distinguish between feeling heard versus non-heard experiences and therefore must be measuring feeling heard. We tried to clarify this on lines 473-474:

“This suggests that all items tapped into the experience of feeling heard as they were successful in distinguishing between feeling heard versus non-heard experiences.”

E. The assertion that item 1 “loads somewhat on various factors” is misleading as Figure 1 clearly indicates it loads reliably only on two factors (respect and common group).

We agree and therefore removed this statement.

F. I also noticed some typos/grammar issues (e.g., “participants / others that” instead of “participants / others who”; “study 1”, inconsistency in using “confirmatory factor analysis” and COVID with initial capital or not; sentence with many ‘understanding’ in line 222)

We thank the reviewer for pointing this out. We resolved these typos and grammar issues.

------------------------------------------------------------------------------------------------------------------

Reviewer #2: This study sought to develop a scale to measure feeling heard (FHS). Feeling heard is described as a complex construct of five components at two levels: at the interpersonal level, having voice; receiving attention, empathy, and respect; and at the communal level, experiencing common ground. These are described as involving me, you, and we.

Content

1. The abstract does not identify the two levels: interpersonal and collective. It seems this would be important to the reader, so state this in the abstract. Perhaps more problematic, the abstract currently seems to imply two sets of five elements (“five components at two levels”) and the two levels suggests higher-order factor structures while two conceptual levels are in fact intended. But there are actually three personal contexts: me, you, and us. So this may be better described as three interpersonal contexts: “individuals feel heard when 1) my voice receives 2) your attention, 3) empathy, and 4) respect in the context of 5) our common ground.

We thank the reviewer for these suggestions. We now explicitly mention in the Abstract and Discussion that we refer to two conceptual levels, see lines 28-30 and 584-585:

“Based on an integrative literature review, feeling heard is conceptualized as consisting of five components at two conceptual levels.”

“This scale does, however, contain elements of all five components and therefore taps into three entities (me, you, and we) at two conceptual levels (interpersonal and collective).”

Further, as indicted in our reply to comment 2B of Reviewer 1, we adapted our model description in the Introduction to de-emphasize the collective-interpersonal levels distinction in favor of focusing on the five components that concern the three interpersonal contexts mentioned by the reviewer.

Lastly, and as also indicated in our reply to comment 2A of Reviewer 1, we deliberatively chose to distinguish between interpersonal, which is about interaction partners as individuals (“me and you”), and collective, which is about the interaction partners as one irreducible entity (“us or we”). As indicated in our response to comment 2A of Reviewer 1, we now explicitly state this in the manuscript as well.

2. A key point in the discussion—lines 571 and 832—is that “feeling heard appears to be a unitary concept.” That needs to be said in the abstract as well. At present the abstract leaves the impression that feeling heard and the resulting FHS is five-dimensional.

We agree and added a short phrase stating this to the abstract, see lines 32-34:

“In two population surveys (N = 194, N = 1000), we find that feeling heard is a unitary concept and develop and validate the feeling heard scale (FHS); a concise eight-item scale with good psychometric properties.”

3. Figure 1 line 234. It seems oddly inconsistent and a bit disconcerting to insert tables into the text and place figures following the references—see note #1 under Style below.

To the best of our knowledge, this is in line with the journal’s submission requirements (https://journals.plos.org/plosone/s/submission-guidelines): “- Figure captions are inserted immediately after the first paragraph in which the figure is cited. Figure files are uploaded separately. -Tables are inserted immediately after the first paragraph in which they are cited.” But we are happy to adapt this in case we misunderstood the requirements.

4. Implicit in Study 2 is the belief that the scale will perform in substantially identical ways in the Dutch and US samples. That it does should be explicitly stated in the discussion; that is an important finding.

We thank the reviewer for this suggestion. We now include a sentence about this in the Discussion of Study 2 on lines 863-866:

“These results are important since Study 2 employed a distinct sample in a different cultural setting as compared to Study 1 and we see that the scale performed in substantially identical ways in both (Dutch and US) samples.”

5. Line 246 should conclude “can be found in the . .”

Adapted accordingly.

6. Informed consent could not be examined due to masking materials. It seems a better plan is needed to support review of this feature of the study. Briefly describe the consent procedures for each set of data.

This information will be available upon publication of the manuscript and as such (also taking readability into consideration) we decided to not include it in the text. We do understand the reviewer’s request for clarification and therefore shortly describe the procedure below.

Concerning Study 1, the procedure was as follows: Participants read the study information within the online survey environment. The study information explained that they would be asked to describe their last online conversation and a conversation in which they did (not) feel heard and report on their experiences during these conversations. We additionally included information about the demographical questions they would be asked and our procedure for anonymizing their data. They were further informed about the average duration of the study, their compensation and reminded of the fact that their participation was entirely voluntary (and they could stop at all times). After this, participants gave their informed consent within the online survey environment. Upon completing the questionnaire, participants were fully debriefed as to the exact purposes of this study. For Study 2, the procedure was the same, except that the study information stated that participants would be asked to think back and describe one “conversation with another person or with multiple people”, instead of two online conversations.

7. The 2 x 2 design is not clear. What steps were taken to ensure that the same conversation was not reported in Part A and Part B?

We understand both reviewers’ confusion concerning the description of our design and therefore rephrased this on lines 286-293, as indicated in our response to comment 4C by Reviewer 1.

We did not take any explicit measures to prevent people from reporting the same conversation in Part A and Part B, so this could have happened. An examination of the qualitative data shows that around 6 participants repeated their (not) feeling heard description in their last conversation description, and 4 participants used their last conversation description also as the feeling (not) heard situation. This shows that same-conversation-reporting only happened in about 10 out of (194 valid observations for feeling (not) heard + 214 for last conversation) 408 descriptions. Nevertheless, the fact that some participants wrote down the same experience twice could threaten the accuracy of our assessments of natural occurrence of feeling heard experiences as well as the reliability of the scale (see the measurement invariance analysis). We tackle both of these issues in Study 2, however, by assessing both the natural occurrence of feeling heard experiences and the scale reliability in an independent sample. As indicated in response to comment 20, we now also explicitly acknowledge this in the manuscript as well.

8. Rather than state you “tried to include one negatively phrased item,” report the number of negatively-worded items in the initial and final FHS scales. The insertion of a correlation between negatively-worded items suggests there is a method effect for negatively-worded items. That might be good to include in the discussion. There is a growing body of evidence that negatively-worded items do not work similarly across some cultural settings (e.g., see Bufford & Paloutzian, 2023).

First, we rephrased the “tried to include one negatively phrased item” to “We also included four negatively phrased items.”, see line 316.

Second, considering the method effect of negatively-worded items, the 2 items’ distinctive negative phrasing might indeed explain their high correlation. We do not think there is a method effect, however, since these negative items still correlate very strongly with the other, positively-worded items as well and load on the same single feeling heard factor. We do concur with the reviewer in a more general sense in that the scale’s functioning across different cultural settings should be tested. We now include a statement about the limited demographical (also cultural) diversity of our sample in the General Discussion, see lines 1012-1014 (also see our response to comment 35):

“This is related to the relatively limited demographical diversity in our sample (often younger adults, highly educated, likely relatively affluent and mostly white).”

9. The section about descriptions and reasons—lines 342-344—seems redundant. Or perhaps clarification is needed.

We agree with the reviewer and removed this sentence.

10. Line 347 might read better as the average of both coders or the mean score of both coders.

Adapted accordingly, see line 354.

11. Perhaps it would be worth noting in the discussion that underlying being heard are a set of shared values: respect for the person, sharing of power, a sense of justice carried out, common ground/worldview, shared being (me, you, us). And perceptions of this mutuality is essential to feeling heard.

We value this comment and think it is interesting to pursue in future research but consider it beyond the scope of the current study, as we did not assess values, and as such decided to not include this in the paper.

12. It would help to carry through with the enumeration begun in line 359. What comes second and third?

Adapted accordingly.

13. Perhaps add here that over half of the remembered Last conversations were with colleagues and family.

Added on lines 373-374:

“Indeed, over half of the remembered Last conversations were with colleagues and family.”

14. Table 3 needs a bit more detail. For percentages, it is not clear what the underlying referent is.

The percentages are fractions of the total number of described conversations in each category, so 206 for Last, 103 for Felt heard and 80 for Felt not heard conversations. We added this to the notes under Table 3, see lines 381-383.

15. Line 457 is not a complete sentence. Perhaps combine with the previous sentence.

Adapted accordingly (see lines 463-465):

“In sum, the themes and sub-themes that emerged from this content coding of the reasons’ descriptions overlap considerably with our definition (and scale) of feeling heard, except for empathy, which is not a distinct theme but more a special case of understanding.”

16. At lines 468 to 470 absolute values of t would be clearer. As stated, a t of zero is included as significant.

We changed this (lines 472-473):

“(ranging from t(124.84) = |23.12|, p < .001 to t(165.83) = |6.17|, p < .001)”

17. I suggest stating that confirmatory factor analysis rather than exploratory factor analysis was carried out because of the theoretical model for feeling heard that shaped the study.

We added the suggested sentence on lines 481-482:

“Because the scale was build upon our theoretical model of feeling heard, we used confirmatory factor analysis rather than exploratory factor analysis.”

18. Given the length and complexity of the supplementary materials, at times the reader needs more help in navigating them. A table of contents at the front of the supplementary material might work. Or refer to the page(s) on which the supplemental material is presented. A header and pagination are also essential for this material.

We thank the reviewer for this helpful suggestion. We added page numbers and a table of contents to the supplementary material.

19. Effect size data are needed for the analyses of variance at lines 545-548.

We added the Cohen’s d for both comparisons. We also included this in the matching analysis of Study 2, see lines 554-557 and 853-856:

“(F(3,190) = 5.74, p < .001; Mequal = 3.70, 95%CI = [3.51, 3.88] vs. Mother-authority = 3.26, 95%CI = [2.96, 3.56], Cohen’s d = .44, small effect, and Mself-authority = 3.30, 95%CI = [2.59, 4.01], Cohen’s d = .39, small effect).”

“(F(3,996) = 15.211, p < .001; Mequal = 3.63, 95%CI = [3.56, 3.71] vs. Mother-authority = 3.24, 95%CI = [3.11, 3.37], Cohen’s d = .41, small effect, Mself-authority = 3.25, 95%CI = [3.09, 3.61], and Mdon’t-know = 2.82, 95%CI = [2.48, 3.16] , Cohen’s d = .31, small effect).”

20. Limitations of Study 1 are not mentioned in the discussion. An important one is that the test for generality of the measure across samples (“invariance”) is quite weak as the same sample was employed: generality is only assessed across conversation settings within the same sample.

This is a valid point and related to the reviewer’s previous point about the same discussions potentially being described. We therefore now described these analysis as being a tentative indication and suggestive evidence of the replicability of the scale (see lines 566-568 and line 571):

“The single-factor model fitted the data well and the loadings were very similar to Part A. Part B also allowed a tentative indication of the measurement invariance of the scale …”

“This suggests that the scale's psychometric characteristics replicate …”

As also indicated by the reviewer in comment 28, the confirmatory FA in Study 2 indeed provides a better assessment of the scale’s replicability and reliability, which we now explicitly acknowledge as well on lines 586-589:

“Providing initial evidence of the reliability of the scale, a good fit to Part B of the dataset was obtained. This is of course imperfect evidence since the same sample was involved. Study 2 therefore examines whether the scale is also reliable in another, unrelated dataset.”

21. The reference to procedural and distributive justice would benefit from a brief explanation—an appositive—of these concepts (justice processes and outcomes?) and their relevance to feeling heard.

We tried to clarify this in the Introduction (lines 149-152) and Discussion of Study 1 (lines 596-598):

“Procedural justice is the fairness of the process by which a decision is made, and as such is contrasted with distributive justice which refers to the fairness of the decision itself [27,28]. Subjective procedural justice involves the experience of being treated fairly, which might be related to feeling heard.”

“That is, people can feel heard when they do not accomplish their goals (no distributive justice), and, vice versa, people can feel not heard even though they do get what they asked for (distributive justice) because of the way they are treated (procedural justice).”

22. At line 589 place convergent and divergent validity together rather than separating them with predictive validity. Placing predictive validity last would better parallel the following hypotheses as well.

We adapted the text accordingly, see lines 603-604:

“Study 2 aimed to establish the 1) reliability, 2) convergent and divergent validity, and 3) predictive validity of the feeling heard scale.”

23. The divergent validity hypothesis at line 608 is problematic. First, it purports to test the null hypothesis of no relationship. Second, divergent validity is more accurately a negative relationship rather than the absence of a relationship. Discriminant validity? Hypothesis 2B seems to best fit divergent validity as I understand it. A pertinent methodological citation(s) may be helpful as these concepts seem to be defined and used in inconsistent ways.

We agree with the reviewer that this should be discriminant validity rather than divergent validity. We replaced all mentions of divergent validity with discriminant validity.

24. The intentions for a next conversation measure is gathered as concurrent data: intentions are held in the present. Considering it a measure of predictive validity stretches the concept. 675-678

Intentions are imperfect yet often used for assessing predictive validity. We chose this measure predominantly for practical reasons: it was impossible for us to assess actual behavioral consequences over time. It would be very important for future studies to assess whether and under what circumstances these intentions translate into actual behavior. We now acknowledge this in the General Discussion on lines 947-950:

“Of course, intentions are held in the present and do not always translate into actual behavior (i.e., the intention-behavior gap). It is therefore imperative that future studies map the behavioral consequences of feeling heard experiences over time to further establish the scale’s predictive validity.”

25. A period seems to be in the wrong place at line 686. Actually several; check punctuation in this entire paragraph.

Adapted accordingly.

26. The data at 679-689 lack needed context. What are these relationships?

Here relationship refers to the relationship between the participant and the interaction partner(s) in the conversation the participant remembered and described. We tried to clarify this on lines 695-697:

“Within these reactions, we distinguished between positive approach/avoidance: behaviors that steer towards maintenance of the relationship between the participant and their interaction partner(s)…”

27. It seems unclear how the variables following 693 fit the concept of divergent validity. Perhaps a technical citation is needed here as it appears the literature seems to conflate divergent validity and discriminant validity. See #23 above.

See our reply to comment 23. We adapted all references to discriminant validity.

28. The CFA for Study 2 is much more valuable than that for Study 1 as it employs a distinct sample in a distinct cultural setting. This should be mentioned in the discussion of Study 2 or General Discussion.

We agree with the reviewer and, as also indicated in response to comment 4, added a sentence stating this in the Discussion of Study 2. As indicated in our response to comment 20, we also refer to this in the Discussion of Study 1.

29. Table 5 would be more effective if it were constructed to parallel the hypotheses 2A and 2B. The present format makes the reader work to follow the expected direction of relationships and minus signs are scattered rather than clustered together.

We implemented the reviewer’s suggestion, see Table 5.

30. Line 735 claims that “feeling heard differs from intimacy”, but it appears this claim was not statistically tested—are these correlations significantly different? Perhaps simply report they show somewhat different patterns of correlation with other measures.

Adapted, see lines 777-779:

“This observation is further supported by the differing correlation patterns of feeling heard and intimacy with other measures, see the section “Feeling heard and intimacy” below.”

31. While the logic of regression is predictive, data were gathered at the same time and is somewhat misreported at line 745. It would be more accurate to say “The less people felt heard, the more likely they they were to say that they were disposed to negatively avoid a next conversation. . . “

We adopted the reviewer’s suggestion (lines 791-792):

“The less people felt heard, the more likely they were to say that they were disposed to negatively avoid a next conversation with the same person(s)…”

32. Taken as a whole the regressions establish the FHS as a predictor of engaging/avoiding conversation and item 1 is a good short version. And yes, feeling heard is distinct from the related constructs. 778-779

We agree.

33. The claim that “not feeling heard appears to be somewhat less common than feeling heard” is not tested in the study (line 845). It seems all you could claim here is that participants were more likely to report an episode of feeling heard. Might that be due to the relative rarity of feeling heard? Could is be influenced by the initial instructions?

We agree with the reviewer and adapted the phrasing on lines 894-898 accordingly:

“Across different contexts and relationships, we find that when people reflect on a significant social interaction they recently had, they are more likely to report that they did feel heard than did not feel heard. Although we can not say this with certainty, this suggests that across many individuals, there might be a base rate for people to feel heard in most of their conversations.”

34. At line 891-896 the supporting data are not clear. Does the conversational intimacy comment pertain to a finding I overlooked—or to another study which should be cited here?

This refers to the data concerning the differences between feeling heard and intimacy in predicting negative avoidance intentions within 2 different subsamples: conversations in which participants felt positive about their relationship with their interaction partner(s) and conversations in which this was not the case, see lines 833-835.

35. Characteristics of the sample seem additional limitations—young adults, more educated, likely more affluent, likely mostly white—I did not see any ethnic/racial description of the samples.

As stated in the manuscript, we recruited a sample that is representative for the Dutch population, so the limited demographic diversity mostly applies to Study 2. For ethical and data minimalization reasons, we did not assess ethnicity or race, but this might indeed be rather uniformly white. Race might indeed affect participants’ understanding of feeling heard. As indicated in our reply to comment 8, we included a remark about this in the limitations concerning demographic diversity (lines 1012-1014).

36. The supplementary material is a bit chaotic. Adding pagination, a table of contents, and page breaks that fit the content would help to make this material (all 51 pages) accessible.

As indicated under comment 18, we made these adaptations.

B. Format/Style

1. In APA style, tables and figures can be embedded in the text or aggregated after the reference list. Here neither of these options is employed; rather they are split in both places.

See our response to comment 3 above.

2. See line 288—in APA style numbers are spelled out to begin a sentence.

Adapted.

3. Embedded tables should be preceded and followed by an extra double line-space (e.g., 354-358).

We applied this to all Tables in the manuscript.

4. Single-spaced tables are acceptable in APA style, but an additional line space between sections would make the material more readable (e.g., Table 2, 356ff).

We applied this to all tables in the manuscript.

5. Correlational tables are generally constructed with the data on the lower left part of the table rather than the upper right half.

We adapted the correlation table in the manuscript (Table 5) according to the reviewer’s comment.

6. Figures require a descriptive title and sufficient information in the notes to explain them independent of the text. The header should remain constant except for the page #. Figure titles are placed below the figures. For example, lines 531-536 should be included on the page with the figure. In this manuscript they appear to be inserted into the text without the needed extra spacing to distinguish them from the text.

See our response to comment 3 above.

7. Table S-2 would be more accessible if t and its df were placed in adjacent columns or t and df were listed sequentially like M, (SD). Several of the supplementary tables would also benefit by putting additional material in the same or an adjoining column rather than between rows.

We thank the reviewer for pointing this out and adapted all Tables where space permitted.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Ramona Bongelli

2 Oct 2023

Feeling Heard: Operationalizing a key concept for social relations

PONE-D-23-13419R1

Dear Dr. Roos,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ramona Bongelli, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: It is clear the authors considered all the comments made by the reviewers and have submitted a much stronger manuscript.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

Acceptance letter

Ramona Bongelli

6 Oct 2023

PONE-D-23-13419R1

Feeling Heard: Operationalizing a key concept for social relations

Dear Dr. Roos:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Ramona Bongelli

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. The supporting information file containing 1) all supporting figures, tables, questionnaires and additional qualitative data of the two studies reported in the paper, 2) the report of a third (lab) study, and 3) the user manual of the feeling heard scale.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All the materials, data and code used in this paper is publicly available in anonymized form on dataverse.nl: https://doi.org/10.34894/IHNKUN.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES