Skip to main content
PLOS One logoLink to PLOS One
. 2022 Jan 11;17(1):e0262459. doi: 10.1371/journal.pone.0262459

Pronominal anaphora resolution in Polish: Investigating online sentence interpretation using eye-tracking

Agata Wolna 1,*, Joanna Durlik 1, Zofia Wodniecka 1
Editor: Claudia Felser2
PMCID: PMC8752000  PMID: 35015772

Abstract

The mechanism of anaphora resolution is subject to large cross-linguistic differences. The most likely reason for this is the different sensitivity of pronouns to the range of factors that determine their reference. In the current study, we explored the mechanism of anaphora resolution in Polish. First, we explored preferences in the interpretation of null and overt pronouns in ambiguous sentences. More specifically, we investigated whether Polish speakers prefer to relate overt pronouns to subject or object antecedents. Subsequently, we tested the consequences of violating this bias when tracing the online sentence-interpretation process using eye-tracking. Our results show that Polish speakers have a strong preference for interpreting null pronouns as referring to subject antecedents and interpreting overt pronouns as referring to object antecedents. However, in online sentence interpretation, only overt pronouns showed sensitivity to a violation of the speaker’s preference for a pronoun-antecedent match. This suggests that null pronoun resolution is more flexible than overt pronoun resolution. Our results indicate that it is much easier for Polish speakers to shift the reference of a null pronoun than an overt one whenever a pronoun is forced to refer to a less-preferred antecedent. These results are supported by naturalness ratings, which showed that null pronouns are considered equally natural regardless of their reference, while overt pronouns referring to subject antecedents are rated as considerably less natural than those referring to object antecedents. To explain this effect, we propose that the interpretation of null and overt pronouns is sensitive to different factors which determine their reference.

Introduction

Understanding a sentence requires appropriate identification of what each word refers to.

For example, to fully comprehend the sentence (1):

(1) When Mary crossed the street, she looked back at the monument.

the reader needs to know that “she” in the second clause refers to “Mary” in the first clause and that both words are supposed to denote one and the same person. This sentence is an example of a pronominal anaphora, which is a particularly interesting instance of reference assignment. Understanding a pronoun requires a reader or listener to identify the appropriate referent from the grammatically correct and pragmatically possible antecedents. For example, in the following sentence (2):

(2) Mom waved to Mary when she was crossing the street.

both Mom and Mary are possible antecedents for the pronoun “she” in the subordinate clause. However, as shown by the example above, the pronouns themselves often do not provide enough information to identify the intended referent: the reference assignment depends mainly on the features of the antecedent itself. As a consequence, pronouns are inherently ambiguous: their reference depends on a range of different constraints, including morpho-syntactic, semantic, and discourse-related cues [1, 2]. In this paper, we report two experiments that explored the pronominal anaphora resolution mechanism in Polish, a Slavic language whose mechanism of anaphora resolution has not yet been empirically tested. First, we tested native Polish speakers’ preference for anaphora resolution in ambiguous sentences. In the next step, we tested the robustness of this preference by testing how its violation influenced the online sentence-interpretation process.

What determines the mechanism of pronominal anaphora resolution in different languages?

The mechanism of anaphora resolution can be influenced by a range of factors or cues which affect different stages of pronoun interpretation: from syntactico-semantic processing to constructing mental representations of discourse. However, the degree to which anaphora resolution relies on different factors varies between languages; in consequence, there are substantial cross-linguistic differences between typologically distant languages [3]. For example, anaphora resolution strategies differ between discourse-oriented languages, such as Korean, Chinese, or Japanese, and sentence-oriented languages, such as English, Italian, or Spanish [3]. To establish the referent of an anaphorical expression, the latter group of languages relies on morpho-syntactic, sentence-internal cues related primarily to subject-verb agreement. For example, in some languages with subject-verb agreement (like Spanish, Italian, or Polish), information about the gender and number of the predicate’s referent is morphologically encoded into the verb form. In the following Polish sentence (3):

(3) Tata pomacha-ł Marys-i i Kas-i kiedy one przechodzi-ły przez ulicę.

Dad waived to Mary and Kate when they were crossing the street.

Dad.nom.sg waved-1sg.m.pst Mary-dat.sg and Kate-dat.sg when they-3pl.f cross-3pl.f.pst the street.acc.sg.

the verb’s suffix (“przechodzi-ły”) encodes both the grammatical gender (feminine) and the grammatical number (plural), both of which unambiguously relate the pronoun (“one” / “they”) to the antecedent (Mary and Kate) from the preceding clause. A consequence of subject-verb agreement is that whenever a pronoun in the verb phrase refers to a less-preferred, non-topical, or unexpected antecedent, the speaker needs to adjust the interpretation of the sentence and re-identify the referent of the anaphorical expression [3].

In contrast to sentence-oriented languages, discourse-oriented languages which do not have a verbal agreement system, such as Japanese, Chinese, or Korean, can rely much less (or not at all) on morpho-syntactic constraints [4]. Therefore, other reference-determining factors that are derived from discourse become much more important for the correct resolution of an anaphoric expression [3, 4].

Different sensitivity to morpho-syntactic and discourse-related factors can account for differences between discourse- and sentence-oriented languages; however, even typologically close languages, such as Spanish and Italian (both of which are sentence-oriented languages), can have different anaphora resolution preferences [5]. Several theories have been proposed to explain the mechanisms of how anaphorical expressions are interpreted. These theories provide a set of generalized rules that make it possible to formulate specific predictions for particular languages and identify potential sources of the differences between them. Below, we discuss some of the most prominent theories which explain the basis of the anaphora resolution mechanism.

Anaphora resolution mechanism theories

Most anaphora resolution theories agree that the crucial factor for reference assignment is the salience or prominence of the referent (antecedent) itself: the more salient the referent is, the more reduced an anaphorical expression can be [6, 7]. According to this proposal, the most-reduced pronominal expression (the null pronoun) is bound to the most salient of the possible antecedents. On the other hand, less-reduced expressions, like overt pronouns, refer to less-prominent antecedents (see Fig 1, adapted from Kaiser & Trueswell [1]).

Fig 1. Relationship between the prominence of an antecedent and the form of the pronominal expression that is necessary to refer to it: The more prominent the antecedent, the more reduced the pronominal form.

Fig 1

The crucial issue for theories of anaphora resolution is to identify the source of the salience of an antecedent and define the relationship between different types of anaphoric expressions and the antecedents they retrieve. Several factors have been suggested to influence the salience of antecedents. Kaiser and Trueswell [1] proposed that they can be divided into two categories: syntactico-semantic or discourse-related. The former group of constraints includes factors like subjecthood or thematic roles. Subjecthood refers to the syntactic position that an antecedent occupies in a sentence; it has been shown that syntactic subjects are considered more prominent than antecedents in other syntactic positions (e.g., [8]). Thematic roles describe the role that an antecedent plays with respect to the verb; it has been shown that agents are considered more prominent than patients of actions [9]. On the level of discourse, the salience of antecedents was argued to be driven by factors that influence the information structure, such as topicalization or focus. Topicalization predicts that discourse topics are more accessible than other possible antecedents [10, 11]. Focus predicts that entities which convey new or unexpected information are more prominent than other antecedents [1215]. It has also been shown that there is a preference for the first-mentioned antecedent in a given sentence or utterance (e.g., [16]) or that pronouns prefer referents that occupy the same grammatical role in another clause–so-called grammatical parallelism bias [17]. However, a growing number of studies suggest that an antecedent’s salience is in fact bound by multiple constraints or factors [13, 18].

To sum up, the existing literature suggests that pronoun resolution is driven by the salience of the possible antecedents; however, different theories indicate various sources of antecedents’ salience. In the following section, we discuss some of the most important theories which address this question.

Accessibility Theory

The first theoretical proposal that describes the relationship between the salience of an antecedent and the types of anaphoric expressions (i.e., null, overt, stressed pronouns, etc.) is the Accessibility Theory (henceforth: AT [6]). It proposes that the salience of an antecedent depends on the degree of its accessibility in memory. AT proposes that the accessibility of an antecedent can be derived from three universal characteristics of the referring expression: informativity, rigidity, and attenuation [6]. The informativity of a given lexical marker predicts that an anaphorical pronoun is defined by the amount of semantic information it encodes. Therefore, the emptier a lexical marker is, the more informative the antecedent to which it refers. The rigidity of a lexical item describes how uniquely referring an expression is. This criterion can be context-sensitive, but AT argues that there are markers that are inherently more rigid than others (e.g., proper names like Ernest Hemingway, vs. personal pronouns like he). According to AT, more-rigid expressions tend to refer to less-prominent lexical items. The last dimension, attenuation, is related to the phonological size of the lexical marker: more-conspicuous phonological markers tend to refer to less-accessible antecedents (e.g., stressed vs. unstressed pronouns).

Summing up, AT predicts that null pronouns will refer to more-accessible and more-prominent antecedents than overt pronouns because null pronouns are less informative, less rigid, and more attenuated than overt ones. However, differences on the three dimensions of accessibility can give rise to differences between languages that are driven by language-specific sensitivity to different constraints on pronoun resolution.

Position of the antecedent

AT describes the relationship between the characteristics of a referring expression and the salience of the antecedent; however, it focuses on the properties of the referring expression itself. As such, AT does not propose any direct criteria for defining the salience of an antecedent. This issue has been addressed by the Position of Antecedent strategy (henceforth PoA [19]). Similar to AT, PoA assumes that anaphora resolution relies on the prominence of possible antecedents: the more prominent an antecedent is, the more reduced an anaphorical expression can be. PoA proposes that the accessibility of an antecedent depends on the universal syntactic roles of anaphorical expressions in sentences. According to PoA, a null pronoun should prefer the antecedent in a specific syntactic position: Spec IP (Specifier of the Inflectional Phrase). On the other hand, an overt pronoun would be more likely to relate to an antecedent that is not in a Spec IP position. Spec IP is a syntactically defined role in a sentence: it is occupied by an argument that defines an inflectional phrase which contains all information related to the tense and agreement features of a verb [20]. The precise type of the expression in a Spec IP position is further defined by the Extended Projection Principle (EPP), according to which the Spec IP of a given clause must be occupied by a syntactic subject [20], which in the case of Polish will always be a preverbal subject. Importantly, the EPP is not specific to any particular kind of clause: it is a general grammatical property of sentences. Therefore, the predictions of EPP should be generalizable across different languages [19]. As such, PoA refers to the universal syntactic properties of sentences to describe the anaphora resolution mechanism in different languages. It predicts that equivalent expressions (i.e., pronouns) in two languages should manifest the same interpretational bias when identifying the antecedent of the pronominal anaphora. This prediction is supported by experimental evidence in the case of the most-reduced pronominal form for a given language (e.g., a null pronoun in the case of Italian or Spanish, or a non-stressed pronoun in English). It has consistently been shown that the most-reduced pronoun relates to the antecedent in the Spec IP position in different languages, such as Italian [5, 19], Spanish [5, 21] or English [22]. However, the cross-linguistic consistency of anaphora resolution decreases when less-reduced overt (or stressed) pronouns are taken into account [5]. The inconsistency of the empirical findings suggests that–contrary to the PoA’s assumption concerning the cross-linguistic universality of syntax-based rules for anaphora resolution–different languages can show varying sensitivity to syntactic cues of prominence.

The Form-Specific Multiple-Constraint Approach

One way of accounting for cross-linguistic variability that contradicts the syntax-based rules of reference assignment can be derived from a theory proposed by Kaiser and Trueswell [1]: the Form-Specific Multiple-Constraint Approach. According to this proposal, reference assignment takes context-dependent or discourse-dependent factors into account. Based on experimental evidence on anaphoric pronoun resolution in Finnish, Kaiser and Trueswell [1] showed that besides syntactic criteria such as those described by PoA, as well as mere word order, the prominence of an antecedent is also sensitive to the informational-structural factors encoded in the mental representation of a given discourse. Discourse representation includes information about the situation being described and the involved entities (such as people or objects–possible antecedents of a given clause). This information, which is inherently context-dependent, can influence the salience of antecedents and thus override syntactically encoded biases. According to Kaiser and Trueswell [1], referential expressions differ in their degree of sensitivity to the different types of cues that determine the prominence of an antecedent. What follows is that anaphoric expressions, both within and between languages, can assign different weights to the same types of cues. This approach provides a plausible explanation for the divergent pattern of overt pronoun interpretation that is observed not only between Italian and Spanish (5) but also between sentence-oriented and discourse-oriented languages, which use different types of cues to assign the reference to an anaphoric expression. For example, in the case of overt pronoun interpretation in Italian and Spanish, an increased processing cost resulting from forcing a shift of reference from the syntactic subject of a sentence (which is also the first-mentioned referent) to the syntactic object is observed for Italian but not for Spanish. Within the Form-Specific Multiple-Constraint Approach, this cross-linguistic difference can be explained by referring to the different sensitivity of pronouns to syntactico-semantic cues in both these languages. In Italian, pronoun resolution seems to rely more heavily on this type of cues than in Spanish. Similarly, differences between sentence-oriented and discourse-oriented languages can be accounted for by referring to the much higher sensitivity of pronouns to the informational structure of discourse in discourse-oriented languages than in sentence-oriented languages.

Coherence-driven and centering-driven theories. Among the anaphora resolution theories which argue that discourse-related factors are crucial in establishing the reference of a pronoun, the two most prominent proposals are the Coherence-driven approach [23, 24] and the Centering Theory (e.g., [25]). The former indicates the coherence of a discourse as a crucial notion in interpreting pronouns [23, 26]. According to Hobbs (e.g., [23]), the coherence of a discourse and the consequent pronoun interpretation is predominantly driven by semantics, causal interference, and world knowledge. Importantly, the coherence-driven accounts have long argued that constraints derived from the grammatical form or information structure are not necessary to explain the pronoun resolution mechanism. On the other hand, according to the Centering Theory [25], semantics and world knowledge do not play a role in pronoun resolution: it depends mostly on factors like grammatical roles in a sentence and information structure (e.g., word order, topic transitions, etc.). A recent proposal by Kehler and Rhode [24] attempts to reconcile these two accounts: it proposes that pronoun interpretation is determined, on the one hand, by probabilistic, coherence-driven expectations of what the following utterance will refer to; on the other hand, it is determined by constraints proposed by the Centering Theory, like grammatical role and information structure.

Anaphora resolution in pro-drop languages: Experimental evidence

One way of testing a speaker’s preference for pronominal anaphora resolution is to test the most-preferred interpretation of an ambiguous sentence in which the anaphorical pronoun might refer to at least two different antecedents [17, 19, 27]. In ambiguous sentences in languages like Spanish [28] and Italian [19], both subject and object antecedents are grammatically coherent. The preference for anaphora resolution in ambiguous sentences usually follows the predictions of PoA: the null pronoun usually relates to the antecedent that is in a Spec IP position (i.e., the subject of the main clause), while the overt pronoun refers to the antecedent in a non-Spec IP position (i.e., the object of the main clause).

The anaphora resolution mechanism can also be explored by analyzing the consequences of violating the preferred pronoun-antecedent match. This refers to situations in which a pronoun is forced to co-refer with an antecedent that does not match its resolution preference. This violation forces the reader to shift the reference and override the bias for pronoun interpretation. As previously discussed, the interpretational bias might be a syntactically based preference for interpreting verbs as referring to the subject antecedent [1, 19, 29]. Still, it can also be driven by discourse-related factors like the preference for the first-mentioned antecedent (e.g., [16, 29]), for the topic [10, 12], for the focused entity [10, 11, 14], or for the agent [9] of the sentence. Regardless of the source of the preference for pronoun interpretation, the process of reference-shifting incurs cognitive effort, which can be observed in behavioral and eye-tracking measures as an increase in reading times (self-paced reading: [5]) or fixation times (eye-tracking: [21, 30]).

In a self-paced reading experiment, Filiaci and colleagues [5] tested native Italian and Spanish speakers. Participants were asked to read unambiguous sentences which either did or did not match the preferred anaphora interpretation. While both languages showed consistent processing costs (also referred to as processing penalty) for the null pronoun that was forced to refer to the object antecedent, the pattern of results showed cross-linguistic differences for the overt pronoun. In Italian, the interpretation of an overt pronoun that was forced to refer to a subject antecedent resulted in a significant processing penalty. This was not the case for native Spanish speakers, who could accommodate the less-preferred pronoun-antecedent match effortlessly. Notably, the effects of the overt pronoun reference shift from the preferred object antecedent to the less-preferred subject antecedent were observed only in the late part of sentences: the processing penalty was observed only for wrap-up parts of sentences that followed actual anaphorical expressions [5].

The consequences of violating the offline preference for pronominal anaphora resolution have also been explored using eye-tracking [21]. In a sentence-reading experiment with Spanish speakers, no processing penalty was observed for sentences that violated the null pronouns’ referential preference. At the same time, the additional processing cost was pronounced for overt pronouns: fixation times were much longer for pronominal verb phrases (VPs) in which a pronoun referred to a subject antecedent than for pronominal verb phrases in which a pronoun referred to an object antecedent [21]. This pattern of results stands in contrast to the findings of a self-paced reading experiment carried out by Filiaci and colleagues [5], which showed the opposite effect in Italian: violation of a null pronoun’s referential preference was related to a much larger processing penalty than a violation of an overt pronoun’s referential preference. However, no differences in the sensitivity of null and overt pronouns to the violation of their preferences was observed for Spanish. Differences in whether the processing penalty is observed for sentences with null or overt pronouns referring to their less-preferred antecedents can be accounted for by design differences between the studies of Chamorro and colleagues and of Filiaci and colleagues. In particular, they can be accounted for by differences in the clause order: the stimuli in Chamorro and colleagues’ study [21] followed the Main-Subordinate order, while in Filiaci and colleagues’ study [5] the order was Subordinate-Main (for further discussion, see Discussion). Interestingly, despite the discrepancies between the results of these two experiments, the results of the experiment by Filiaci and colleagues [5] demonstrate that the resolution preference for a null pronoun is similar for Italian and Spanish, while differences emerge for overt pronouns.

To conclude, the cross-linguistic differences in anaphora resolution might stem from the divergent sensitivity of null and overt pronouns to factors determining the reference of antecedents, which can be driven by syntactico-semantic or discourse-related constraints [1, 24]. Therefore, to provide an accurate description of pronominal anaphora resolution in a given language, experimental evidence is needed to assess differences in the sensitivity of pronouns to syntactico-semantic and discourse-related factors. The current paper aims to provide an empirically based description of pronominal anaphora resolution in Polish.

Pronouns in the Polish language: Introductory remarks

Before discussing the details of our research questions, a couple of introductory remarks regarding the Polish language seem essential. Polish is a Slavic language whose dominant sentence structure is SVO (subject–verb–object); however, Polish is characterized by a relatively free word order. Polish is a morphologically rich language with two number classes, three gender markings, and a declension with seven cases reflected in the morphological form of nouns, adjectives, and some pronouns [31]. Verbs in Polish are also highly inflected and, inter alia, categories such as person, number, and gender are marked by almost every verb form. Nouns, pronouns, and verbs have to agree in person, number, and gender. Polish is also a pro-drop language that has a strong tendency to omit pre-verbal pronouns, which are redundant in most cases as the morphological form of a verb encodes the information that allows to identify the referent of a verb. In this aspect, Polish is similar to Romance languages such as Spanish or Italian, although the families of Slavic and Romance languages are generally typologically distant. To the best of our knowledge, neither the preferences for anaphora resolution in Polish speakers nor the influence of these preferences on online sentence interpretation have yet been empirically tested. The only known empirical report on Polish speakers’ preference for pronominal anaphora resolution was published by Carminati [19], but it is based on data from only two participants. Carminati asked two Polish speakers to provide their preferred interpretation of ambiguous sentences containing a null or overt pronoun; she found that the null pronoun sentence was interpreted as referring to the subject antecedent, while the overt pronoun was assigned to the object antecedent. However, given the limited participant sample, these data cannot be treated as fully informative and reliable.

The current research

The primary aim of the two experiments presented in the current paper was to empirically test the pattern of anaphora resolution in Polish. As previously discussed, the anaphora resolution pattern is bound to the notion of the prominence of an antecedent. Previous studies have shown that the grammatical role of the antecedent (especially the subjecthood) allows accurate predictions of how the pronominal anaphora will be interpreted. However, these predictions tend to be valid only for the most-reduced pronominal form allowed by a given language (which is usually a null or a non-stressed pronoun [5, 19, 22]). Less-reduced anaphorical forms (i.e., overt pronouns in pro-drop languages, stressed pronouns, or noun phrases) can be prone to the influence of other factors that determine the prominence of the antecedent. These factors can lead to vast cross-linguistic differences in anaphora resolution preference (e.g., [5]). Therefore, to provide an accurate description of the pronominal anaphora resolution preference in Polish, the predictions derived from the theoretical frameworks needed to be experimentally validated.

To this aim, we conducted two experiments. In the first one, we established the preference for anaphora resolution in native Polish speakers, who we asked to interpret ambiguous sentences and rate their naturalness. Each sentence contained either a null or an overt pronoun in the subordinate clause that might refer to either the subject or the object antecedent introduced in the preceding ambiguous main clause (for examples of the sentences used in the experiment, see Methods). To the best of our knowledge, no empirical study (besides the anecdotal evidence provided by Carminati [19]) has yet addressed the question of the pronominal anaphora resolution pattern in Polish.

In the second experiment, we examined how the offline preference for anaphora resolution in Polish influenced the online sentence-interpretation process. We used eye-tracking to follow the time course of the interpretation of sentences containing null and overt pronouns that referred to either matched or unmatched antecedents. Following the design proposed by Chamorro and colleagues [21], we manipulated the grammatical number of a subject and object antecedent so that only one interpretation of the main clause containing a singular verb would be grammatically correct (for examples, see Methods). Analysis of the online sentence-interpretation process using an eye-tracker allowed us to assess the sensitivity of Polish pronouns to a violation of the syntax-based pattern of anaphora resolution preference. Additionally, participants were asked to rate the naturalness of the sentences they read.

Experiment 1 –What is the offline pattern of anaphora resolution in native Polish speakers?

The first experiment aimed to explore the preference of native Polish speakers to interpret sentences that contain an overt or null pronoun. We tested if the presence of a pronoun influences the interpretation of a subordinate clause as referring to either the subject or the object of the main clause.

Specific predictions regarding the pronoun interpretation preference in ambiguous sentences in Polish could be formulated on the basis of the available theoretical proposals or empirical evidence from experiments on other pro-drop languages. The theoretical accounts of pronominal anaphora resolution predict that more-reduced pronouns refer to the most prominent of the possible antecedents. The syntax-based criterion of prominence proposed, e.g., by PoA, indicates that the most-salient antecedent is the subject of the main clause in the Spec IP position [19]. A similar prediction can be formulated based on the advantage of the first-mentioned antecedent [16, 29] or the fact that the first-mentioned antecedent is typically interpreted as the topic of a given sentence [32]. Therefore, we expected that the null pronoun of the subordinate clause would be interpreted as referring to the subject of the main clause. In contrast, we expected that the overt pronoun of the subordinate clause would be interpreted as referring to the object of the main clause. Further support for our prediction stems from the fact that a similar pattern of anaphora resolution in ambiguous sentences is shown in pro-drop Romance languages [5, 19, 28]. In Polish, the sentence structure is analogous to that of Italian or Spanish: the antecedent in a Spec IP position is always the preverbal subject. Moreover, following the studies of Alonso-Ovalle and colleagues [28] and Chamorro and colleagues [21], we expected to find that native Polish speakers would interpret null pronoun sentences as more natural than overt pronoun sentences. Raw data and the script necessary to reproduce the statistical analysis reported in Experiment 1 are freely available online: https://osf.io/dynwp/.

Materials and methods

Participants

Seventy native Polish speakers (8 males, age: M = 20,99; sd = 2,61) took part in the experiment. They were recruited from among students of Jagiellonian University and received course credits for their participation. Participants provided informed consent for participation in the experiment in an online form (in which there was an option to consent to participate in the study or leave the experiment) before they started the experiment. After completing the survey, they were provided with a short explanation of the aim of the study. The experiment met the requirements of the Ethics Committee of the Institute of Psychology of Jagiellonian University concerning experimental studies with human subjects.

Stimuli

To test whether the pronoun form (null vs. overt) can influence its interpretation preference, we created 48 ambiguous sentences in Polish that allowed interpretation of a subordinate clause as referring to either the subject or the object of the main clause. Each sentence consisted of a main clause containing subject and object antecedents of the same number and gender, followed by a temporal adjunct subordinate clause (henceforth referred to as a subordinate clause introduced by the conjunction kiedy–“when”). The conjugation form of the verb in the subordinate clause matched the gender and number of the subject and object antecedents of the main clause, thus allowing ambiguous interpretation of the sentences. Two versions of each sentence were created that corresponded to two different conditions: the verb of the subordinate clause was preceded by either an overt or a null pronoun (both are allowed according to the morpho-syntactic rules of Polish). Each experimental stimuli followed the same sentence structure:

subject / verb / object / time conjunction (“when”) / pronoun (null or overt) / verb / complement

By manipulating the Pronoun, two different conditions of each sentence were created (4–5):

Condition 1: null pronoun

(4) Mama    pomacha-ła    córce,    kiedy  Ø    przechodzi-ła    przez ulicę.

The mother    waved to the    daughter    when Ø (she) was crossing    the street.

Mother.nom.sg    waved-1sg.f.pst    daughter.dat.sg    when    Ø (she)    cross-1sg.f.pst    street.acc.sg.

Condition 2: overt pronoun

(5) Mama    pomachał-a    córce,    kiedy    ona    przechodzi-ła    przez ulicę.

The mother    waved to the    daughter    when she    was crossing    the street.

Mother.nom.sg    waved-1sg-f-pst    daughter.dat.sg    when    she    cross-1sg.f.pst    the street.acc.sg.

Procedure

The experiment was conducted via an online survey platform (Qualtrics: www.qualtrics.com). It was preceded by written instructions (containing comprehension questions which made it possible to confirm that participants had read the instructions carefully) and a short training session. After completing the training, participants were allowed to re-read the instructions in case they had doubts regarding the experimental procedure.

Participants were instructed to read each sentence and proceed to the next screen, which contained a disambiguation question asking for their interpretation of the sentence they just read (e.g., “Who crossed the street?”). The participants were provided with two possible answers: one always referred to the subject of the main clause, while the other always referred to the object of the main clause. Participants made their decisions by clicking the corresponding button. After progressing to the next screen, they were asked to rate the naturalness of the sentence on a scale from 0 (completely unnatural) to 5 (perfectly natural). After rating the naturalness, they proceeded to the following sentence.

Each participant read 48 experimental sentences in one of the two conditions: null or overt pronoun. There were two versions of the task, each of which contained different variants of each sentence (null or overt), which were counterbalanced between participants. Additionally, the same number of filler sentences was presented. Filler sentences were of a similar form to the experimental sentences, but they contained different conjunctions (e.g., “before”, “albeit”, “since”, etc.).

Data analysis

The preference for sentence interpretation was analyzed in R [33] using a general linear mixed-effects model (glmer) of a binominal family, as implemented in the lme4 package (version 1.1.26; [34]). We fitted a model predicting the preferred antecedent (subject or object) based on a categorical predictor Pronoun (null or overt), which was dummy coded prior to running the analysis. Random intercept and slope by participants and random intercept by items were included in the model. Naturalness ratings were analyzed using a cumulative ordinal model with flexible thresholds created in the Stan computational framework (http://mc-stan.org/) and implemented in the brms package (version 2.15.0; [35]). The model included the main effect of Pronoun (null or overt) as well as the main effect of Antecedent (subject or object), which referred to the participant’s interpretation of a given sentence. The interaction between the effects of Pronoun and Antecedent was also included in the model. Random intercept and slopes for Pronoun and Antecedent by participants and items were included in the model. It has recently been shown that Bayesian-based ordinal models are a better choice for rating scale analyses as they can model responses as discrete and not necessarily equidistant data points. As such, they provide a much better fit for the data obtained from any type of rating scales [35, 36]. The effect sizes (Cohen’s d statistic) were calculated using the lme.dscore function from the EMAtools package (version 0.1.3; [37]).

Results

Interpretation of the sentences

In this experiment we aimed to determine if the preference for interpreting ambiguous sentences in Polish was modulated by the nature of the pronoun. We found a significant difference between the two Pronoun conditions (z = -15.608, p > 0.001, d = -5.58, see Fig 2). The results revealed that the preferred interpretation of the sentences strongly depends on the pronoun type: sentences containing a null pronoun were interpreted as matching the subject antecedent (percentage of subject-match answers: M = 79.7%, SE = 4.81%), while sentences containing an overt pronoun were interpreted as matching the object antecedent (percentage of object-match answers: M = 90.8%, SE = 3.45%).

Fig 2. Preference for sentence interpretation.

Fig 2

The proportion of subject- and object-match answers for sentences containing a null or overt pronoun. Error bars represent the standard error of the model’s predictions.

The naturalness of sentences

Apart from examining Polish speakers’ preference when interpreting ambiguous sentences, we also wanted to determine whether they judge sentences as more natural depending on the use of a pronoun. Participants rated the naturalness of each sentence on a scale from 0 to 5. We found a strong effect of Pronoun (β = -0.44, 95% CrI [-0.63–0.26]), thus indicating that native Polish speakers find sentences containing a null pronoun more natural than sentences containing an overt pronoun. No main effect of Antecedent was observed (β = -0.07, 95% CrI [-0.27 0.14]); however, we found a significant interaction between Pronoun and Antecedent (β = -0.98, 95% CrI [-1.24–0.73]). Direct comparisons between the two Antecedent conditions (i.e., subject- and object-matching sentences) revealed significant effects for sentences containing a null pronoun (β = -0.42, 95% HPD [-0.62–0.20]): subject-matching sentences were rated as more natural than object-matching sentences. Significant effects were also found for sentences containing overt pronouns (β = 0.56, 95% HPD [0.29 0.81]): in these cases, subject-matching sentences were rated as less natural than object-matching sentences. The results of the analysis and the mean scores for all conditions are presented in Table 1 and Fig 3.

Table 1. Mean scores and SD for the naturalness judgment of the experimental stimuli.
Pronoun Interpretation (Antecedent) Naturalness rating
Null Subject 3.69 (1.26)
Object 3.14 (1.32)
Overt Subject 2.62 (1.52)
Object 3.31 (1.31)
Fig 3. Naturalness judgment of Experiment 1.

Fig 3

The naturalness rating of the sentences collected in Experiment 1. Error bars represent the standard error of the model’s predictions.

Experiment 1 –Summary

The results of Experiment 1 showed that native Polish speakers prefer to interpret the null pronoun of a subordinate clause as referring to the subject of the main clause; they also prefer to interpret the overt pronoun of a subordinate clause as referring to the object of the main clause. In the subsequent experiment, we investigated the online processing of pronominal anaphoric structures in Polish and assessed the extent to which it is influenced by the preference for anaphora resolution established in Experiment 1.

Experiment 2 –Eye-tracking measures of anaphora resolution in Polish

Based on experimental evidence from studies on Italian and Spanish [5, 19, 28], we expected that online pronoun resolution in Polish would be driven by the prominence of the available antecedents. As such, the interpretation of a null pronoun would refer to the most-prominent antecedent. In our experiment, it was always the first-mentioned antecedent that occupied the syntactic position of a subject. On the other hand, we expected that the interpretation of the overt pronoun would refer to the antecedent in the less-prominent syntactic position of the object, which is also the second-mentioned antecedent in a sentence and is a less likely topic of a given utterance. As discussed in the Introduction, violation of the preferred anaphora interpretation can result in a processing penalty, i.e., increased cognitive cost related to the reference shift. In eye-tracking, this cost should be reflected in longer reading times (measured by first-pass time, go-past time, and total time) in the critical region containing the VP of the subordinate clause. The eye-tracking experiment’s critical manipulation involved forcing the pronoun to refer to the mismatching antecedent (i.e., a null pronoun matched with an object antecedent or an overt pronoun matched with a subject antecedent). This manipulation should allow us to observe the reader’s reaction to a violation of the anaphora resolution preference.

Our experiment closely followed the design of the study by Chamorro and colleagues [21]. While many previous experiments used eye-tracking to assess pronoun resolution strategies, they used methodology that does not allow direct testing of how anaphora resolution preference modulates the unfolding sentence interpretation. Previous eye-tracking studies either used a visual-word paradigm (e.g., [1, 29, 3840]) or if they were based on sentence-reading paradigms, they were designed to test different research questions than ours, e.g., questions related to the resolution of intra-sentential anaphora (processing costs for using "they" as a singular pronoun in English [41]; pronoun resolution bias related to the verb’s implicit causality [42]; or the influence of cleft focus on pronoun accessibility [14]). Eye-tracking has also been used to assess the effect of immersion in a second-language environment on pronoun resolution [21, 30]. One of these studies is the experiment by Chamorro and colleagues [21], which, to the best of our knowledge, is also the only experiment that used eye-tracking to assess the sensitivity of pronominal anaphora resolution to a violation of the preference for a pronoun-antecedent match. Still, it is important to note that the main focus of the study by Chamorro and colleagues [21] concerned how long-term immersion modulates the natural pattern of anaphora resolution. Therefore, the only condition that would be informative when compared with the current experiment is the monolingual group. As such, all comparisons between our results and the study by Chamorro and colleagues [21] always refer to the monolingual condition. Chamorro and colleagues [21] observed differences in online interpretation of null and overt pronouns in three eye-tracking measures: first pass time, go-past time, and total time. In the current experiment, we analyzed the same eye-tracking measures. This allowed us to interpret the processes engaged in sentence interpretation, ranging from early (captured by the first-pass time) to cumulative (captured by total time) measures, which should be sensitive to different stages of syntactic processing.

Based on Experiment 1 and the previous literature, we expected that reading times indexed by first-pass time, go-past time, and total time would be longer for the VPs of sentences in which null pronouns are forced to refer to object antecedents and overt pronouns are forced to refer to subject antecedents as compared to the VPs of sentences in which null pronouns refer to subject antecedents and overt pronouns refer to object antecedents. However, these predictions are not entirely in line with the results of previous studies which showed that null and overt pronouns exhibit different sensitivity to a violation of their referential preferences. Based on the results of a previous eye-tracking experiment by Chamorro and colleagues [21], we expected that overt pronouns would be sensitive to a violation of their resolution preference, while null pronouns would be more flexible and would more easily accommodate the mismatching antecedent. On the other hand, based on the results of the study by Filiaci and collaborators [5], the opposite effect could be expected: in their experiment a processing penalty was observed in the case of violation of the referential preference of a null pronoun. At the same time, Filiaci and colleagues showed cross-linguistic differences in the sensitivity of an overt pronoun to a violation of its resolution preference. In contrast, no such differences were observed for a violation of null pronoun preferences.

To sum up, based on previous experiments, it seems plausible that a processing penalty will be observed when a pronoun is forced to refer to a less-preferred antecedent. However, the discrepancy between the results of previous studies suggests that, due to nuances in the experimental design or cross-linguistic differences, null and overt pronouns may exhibit different sensitivity to a violation of their preferences. As revealed by analysis of the naturalness of the sentences used in Experiment 1, Polish speakers tend to interpret sentences containing null pronouns as more natural than those containing overt pronouns. As such, if Polish pronouns differ in their sensitivity to a violation of a preferred antecedent match, it is plausible to expect that forcing a less-preferred antecedent match in the case of generally more-natural null pronouns will incur smaller processing costs for a reader than violation of the preferred antecedent match in the case of less-natural overt pronouns.

Additionally, similarly to Experiment 1, the participants were asked to rate sentence naturalness after each sentence. We expected the results of the naturalness rating to reflect the online anaphora resolution bias. Specifically, we expected that null pronoun sentences would obtain higher naturalness scores than overt pronoun sentences, and sentences following the preference for anaphora resolution (i.e., a null pronoun referring to the most-prominent antecedent and an overt pronoun referring to a less-prominent antecedent) would obtain higher scores than those violating it. The data and the script necessary to reproduce the statistical analysis for Experiment 2 are freely available online: https://osf.io/dynwp/.

Materials and methods

Participants

Thirty-six native Polish speakers took part in the experiment. Before data analysis, 3 participants were excluded because their second-language proficiency and use were higher than allowed by our criteria. The reported analysis was carried out using the data from 33 participants (31 females, 2 males, age M = 22.15, SD = 2.95). Unlike in Experiment 1, we only recruited participants who did not declare high proficiency or frequent use of a foreign language. While high proficiency or frequent use of a foreign language should not cause any problems in an experiment measuring the preference for anaphora resolution in which respondents have unlimited time to respond, it has been shown that near-native proficiency and immersion in a second language can influence online measures of the anaphora resolution mechanism [2, 21]. Therefore, only participants who reported proficiency lower than B2 and occasional use of their second language (less than 1–2 days per week) took part in the experiment. Apart from the initial pre-screening of language proficiency and use, during the experimental session we assessed participants’ proficiency in 5 language skills in the first language (L1: Polish) and the second language (L2: English) with a questionnaire (see Table 2). Participants were recruited from among students of Jagiellonian University and received course credits or monetary remuneration. All participants provided written consent for participation in the experiment and were informed that they could withdraw their consent at any point of the procedure. The experiment met the requirements of the Ethics Committee of the Institute of Psychology of Jagiellonian University concerning experimental studies with human subjects.

Table 2. Proficiency in the selected skills in L1 (Polish) and L2 (English) reported by the participants in a self-rated questionnaire.
skill understanding spoken language understanding written language fluency of speaking accent writing
L1 (Polish) 9.79 (0.56) 9.69 (0.97) 9.48 (1.45) 9.34 (1.47) 9.38 (1.37)
L2 (English) 5.79 (1.97) 6.62 (1.61) 4.79 (1.86) 4.62 (1.80) 5.45 (1.50)

Participants were asked to assess their proficiency in respect to each of the 5 language skills on a scale from 0 to 10. Values in brackets correspond to standard deviation.

Stimuli

Following Chamorro and colleagues [21], we created 32 experimental sentences in Polish. Each sentence consisted of the main clause, which contained a subject and an object antecedent of the same grammatical gender but a different grammatical number, and the subordinate clause. The subordinate clause was introduced by a temporal conjunction (kiedy–“when”), and it contained a verb conjugated in the third-person singular preceded by an overt or null pronoun. The antecedents were always common nouns depicting people (such as professions, social roles, etc.); proper names were never used. We manipulated the grammatical number of the antecedents: in half of the sentences, the subject was singular and the object was plural; in the other half, the subject was plural and the object was singular. The pronoun and verb of the subordinate clause were always singular, which allowed only one interpretation of the subordinate clause as referring either to the subject or the object of the main clause, depending on which of them was singular in a given sentence. The verbs in the subordinate clause were matched in terms of length and frequency. The length of the main clause, and the frequency of nouns corresponding to the subject and object antecedents, were also matched between sentences. Note that if a sentence included a null pronoun (which is equivalent to omitting the pronoun), no empty space or other replacements were provided in place of the pronoun in the sentence. Each sentence followed the same structure:

subject / verb1 / object / time conjunction (“when”) / pronoun (null* or overt) / verb2 / rest1 / rest2

By manipulating the Pronoun and the Antecedent match, four different versions of each sentence were created (6–9; conditions following the less-preferred pronoun-antecedent match are marked with?). Note that in Polish the nominative case is always used for a noun in the grammatical position of a subject. In our experiment, the object antecedent always uses the instrumental case; however, this is not a rule as the case of the object of a sentence depends on the verb directly preceding it.

Condition 1: ? overt pronoun / subject match:

(6) Nauczyciel    porozmawia-ł z    uczniami,    kiedy on wrócił    do szkoły    jesienią.

The teacher    talked    with the students    when he came back    to school    in the fall.

Teacher.nom.sg talk-1sg.m.pst    with students.ins.pl when    he come back.1sg.m.pst    to school.gen.sg fall-in-the.

Condition 2: overt pronoun / object match:

(7) Nauczyciele    porozmawia-li z    uczniem,    kiedy on wrócił    do szkoły    jesienią.

Teachers    talked    with the student    when he came back    to school    in the fall.

Teachers.nom.pl    talk-1pl.m.pst    with student.ins.sg    when    he came back.1sg.m.pst to school.gen.sg fall-in-the.

Condition 3: null pronoun / subject match:

(8) Nauczyciel porozmawia-ł z    uczniami,    kiedy    Ø    wrócił    do szkoły    jesienią.

The teacher    talked    with the students when he    came back    to school    in the fall.

Teacher.nom.sg talk-1sg.m.pst with students.ins.pl when Ø came back.1sg.m.pst to school.gen.sg fall-in-the.

Condition 4: ? null pronoun / object match:

(9) Nauczyciele porozmawia-li z    uczniem    kiedy    Ø    wrócił    do szkoły    jesienią.

Teachers    talked    with the student    when    Ø    came back    to school    in the fall.

Teachers.nom.pl    talk-1pl.m.pst    with student.ins.sg when    Ø    came back.1sg.m.pst    to school.gen.sg    fall-in-the.

Subsequently, four different stimuli lists of 32 sentences were created. Each list contained eight sentences corresponding to each of the four conditions (i.e., eight sentences in Condition 1, 2, 3, and 4). A complete list of experimental sentences is provided in S1 Appendix. Additionally, 64 filler sentences were created and added to the stimuli lists. They contained different grammatical structures, inanimate referents, proper names, and plural pronouns. Each of the lists contained the same 64 filler sentences. In total, each stimuli list contained 96 sentences (32 experimental + 64 filler sentences).

Procedure

The experiment was run using an Eyelink 1000 Desktop Mount eye-tracking system by SR Research. The stimuli were displayed on a 24” screen (BenQXL2411) with screen resolution set to 1920x1080. The screen was situated approximately 70 cm from participants. The sampling rate was set at 1000 Hz. Eye movements were recorded from the right eye only (except for one participant, for whom the calibration for the right eye failed, therefore the movements of the left eye were recorded instead). Before the experiment started, a calibration process was carried out until it was successful. The calibration was repeated during the main task (between trials) whenever necessary. Each trial started with a drift-correction point displayed in the center of the screen. Subsequently, a fixation point was displayed for 500ms on the left side of the screen in the place corresponding to the beginning of the sentence that appeared after it. Participants were instructed to read each sentence carefully and press a mouse button when finished. Subsequently, they were asked to rate the sentence they had just read on a 1–5 naturalness scale by clicking on the corresponding number displayed on the screen. Before the experiment proper, participants completed three training trials. The entire procedure, including calibration and training, took approximately 45 minutes.

Data analysis

Prior to the analysis of eye-tracking measures, we conducted a standard 2-step cleaning procedure using DataViewer software (SR Research). First, we merged all the fixations shorter than 80ms with the adjacent fixations if the distance between them was shorter than 0.5 angular degrees, which constituted 0.26% of the total fixation number. Subsequently, we deleted all the fixations shorter than 80ms or longer than 1200ms, as well as fixations that fell outside any of the regions of interest; this constituted a further 0.54% of the data.

We conducted the analyses on two different types of data: eye-tracking data and behavioral data (naturalness rating of each sentence). For the eye-tracking analysis, following the experiment by Chamorro and colleagues [21], we chose three measures: first-pass time (summed duration of all the fixations in a particular region from the first time the eye enters the region until it leaves the region in either left or right direction); go-past time (the sum of all of the fixations after the first entry into an area of interest, including regressions to previous regions, as well as returns to the area of interest in question until the eye enters any subsequent region); and total time (sum of all the fixations in a particular region during the whole trial). First-pass time is presumed to be sensitive to relatively early processes in sentence comprehension [42, 43]. Go-past time is a hybrid measure sensitive to both early and late processes in sentence comprehension. Therefore, these measures should be informative about the processing load related to the integration of a given word and the reader’s predictions [44], which are based on native Polish speakers’ offline preference for anaphora resolution. Total time is a measure that is sensitive to the overall difficulty of processing the relevant word; it is related not only to the automatically constructed predictions but also to conscious reflection on the naturalness and adequacy of a given syntactic structure.

For the eye-tracking data, we performed separate analyses for null and overt pronoun sentences. We found comparing the overt and null pronoun conditions in one analysis problematic due to differences in the size of the critical area of interest. Namely, the verb phrase of the subordinate clause contained only a verb in sentences with a null pronoun or a pronoun and a verb in sentences with an overt pronoun. As such, the reading times in the overt pronoun condition would always be longer than in the null pronoun condition due to the additional word. Therefore, we decided to analyze overt and null pronoun sentences separately. Even though this did not allow us to compare the differences in overt and null pronoun sentences directly, we were still able to focus on the most important and informative aspects of the present experiment: the influence of the pronoun-antecedent match on online sentence interpretation. We performed separate analyses for both null and overt pronoun conditions for two areas of interest: verb2 (or pronoun + verb in case of overt pronoun sentences) and rest1. The analyses of eye-tracking data were performed using linear mixed-effect models, as implemented in the lme4 package (version: 1.1.26; [34]). Each model was fitted using one within-participant factor, Antecedent, with two levels, subject and object. As Antecedent was a categorical predictor, it was dummy coded prior to running the analysis. The effect sizes (Cohen’s d statistic) were calculated using the lme.dscore function from the EMAtools package (version: 0.1.3; [37]). Similar to Experiment 1, naturalness data were analyzed using a cumulative ordinal model with flexible thresholds created in the Stan computational framework (http://mc-stan.org/) implemented in the brms package (version 2.15.0; [35]). The model included a main effect of Pronoun (null or overt), a main effect of Antecedent (subject or object), as well as an interaction between the main effects. Random intercept and slopes for Pronoun by participants and items were included in the model.

Results

Eye-tracking task

Overt pronoun sentences: Subject and object antecedent interpretation. The present section presents the analyses conducted for the sentences with an overt pronoun in which the area of interest contained the pronoun and the verb of the subordinate clause. We fitted a separate linear mixed-effects model for each eye-tracking measure with one within-participant factor: Antecedent. We found a significant effect of Antecedent for first-pass time (t = 2.52) and total time (t = 2.109). In both cases, the reading times were longer for sentences with a subject antecedent. We did not find a significant effect of Antecedent for go-past time (t = 1.288). The results for the three measures are presented in Fig 4A and Table 3.

Fig 4. Mean fixation times for sentences containing an overt pronoun.

Fig 4

(A) The eye-tracking measures for the critical area of interest (pronoun + verb). (B) The eye-tracking measures for the post-critical area of interest (rest1). Error bars represent standard errors of the model’s predictions.

Table 3. Linear mixed-effect models’ estimates for fixed and random effects for the first-pass, go-past, and total time analyses for the critical area of interest in sentences containing overt pronouns.
Fixed effects
First pass Go past Total time
Estimate SE t d Estimate SE t d Estimate SE t d
Intercept 466.01 25.21 18.49 538.49 27.69 19.45 893.13 59.85 14.92
Antecedent 46.54 18.43 2.53 1.21 36.73 28.51 1.29 0.47 74.08 35.12 2.11 0,19
Random effects
Variance SD Correlation Variance SD Correlation Variance SD Correlation
by subject
Intercept 17237 131.29 18022 134.20 93121 305.20
Antecedent 1603 40.03 -0.28 11178 105.70 -0.11 - - -
by item
Intercept 1561 39.51 3136 56.00 93121 305.20 -
Antecedent 1287 35.87 -0.09 - - - - - -

Furthermore, we conducted analyses in the area of interest immediately following the critical region: the post-critical region (rest1). In each sentence, this area of interest always contained two words: a preposition and a noun or adjective. For each eye-tracking measure, we fitted a separate linear mixed-effects model with one within-participant factor: Antecedent. We found no significant effects of first-pass time (t = -1.96) or go-past time (t = 0.41); however, a significant effect of Antecedent was observed for total time (t = -2.47). Interestingly, it was in the opposite direction compared to the effects observed for the critical area of interest: reading times were longer for sentences referring to an object antecedent than for those referring to a subject antecedent. The results for the three measures are presented in Fig 4B and Table 4.

Table 4. Linear mixed-effect models’ estimates for fixed and random effects for first-pass, go-past, and total time analyses for the post-critical area of interest in sentences containing overt pronouns.
Fixed effects
First pass Go past Total time
Estimate SE t d Estimate SE t d Estimate SE t d
Intercept 381.22 22.54 16.91 677.94 61.67 10.99 682.33 47.33 14.42
Antecedent -29.85 15.25 -1.96 1.12 26.20 64.59 0.41 0.31 -95.95 38.81 -2.47 0.22
Random effects
Variance SD Correlation Variance SD Correlation Variance SD Correlation
by subject
Intercept 10616.40 103.04 48883 221.10 50192 224.04
Antecedent - - - - - - 5991 77.40 0.05
by item
Intercept 4948.40 70.35 52547 229.20 18058 134.38
Antecedent 543.80 23.32 0.06 34714 34714 186.30 8917 94.43 0.11

Null pronoun sentences: Subject and object antecedent interpretation. This section presents the analyses conducted for sentences with a null pronoun in which the area of interest contained only the verb of the subordinate clause. We fitted a separate linear mixed-effects model for each eye-tracking measure with one within-participant factor: Antecedent. We did not find a significant effect of Antecedent for first-pass time (t = 1.28), go-past time (t = 0.13), or total time (t = -0.54). The results for the three measures are presented in Fig 5A and Table 5.

Fig 5. Mean fixation times for sentences containing a null pronoun.

Fig 5

(A) The eye-tracking measures for the critical area of interest (Ø + verb). (B) The eye-tracking measures for the post-critical area of interest (rest1). Error bars represent the standard errors of the model’s predictions.

Table 5. Linear mixed-effect models’ estimates for fixed and random effects for the first-pass time, go-past time, and total time analyses for the critical area of interest in sentences containing null pronouns.
Fixed effects
First pass Go past Total time
Estimate SE t d Estimate SE t d Estimate SE t d
Intercept 325.75 19.55 16.66 371.786 23.137 16.069 695.71 53.1 13.103
Antecedent 19.67 15.36 1.28 0.99 2.593 19.394 0.134 0.47 -16.82 31.26 -0.538 0.19
Random effects
Variance SD Correlation Variance SD Correlation Variance SD Correlation
by subject
Intercept 9807 99.03 12716 112.76 71817 268
Antecedent 3322 57.63 0.48 3424 58.52 0.32 - - -
by item
Intercept 1575 39.69 2526 50.25 12276 110.8
Antecedent - - - - - - - - -

We also analyzed the area of interest immediately following the critical region (rest1). For each eye-tracking measure, we fitted a separate mixed-effects model with one within-participant factor: Antecedent. Similar to the analysis of the critical region, we did not find a significant effect of Antecedent for first-pass time (t = -1.60) or go-past time (t = -1.04). However, we found a significant effect of total time (t = -2.22). Similar to the effects observed in the post-critical area of interest in sentences containing overt pronouns, reading times for total time were longer for sentences referring to the object antecedent. The results for the three measures are presented in Fig 5B and Table 6.

Table 6. Linear mixed-effect models’ estimates for fixed and random effects for the first-pass, go-past, and total time analyses for the post-critical area of interest in sentences containing null pronouns.
Fixed effects
First pass Go past Total time
Estimate SE t d Estimate SE t d Estimate SE t d
Intercept 388.54 23.46 16.56 694.22 67.22 10.33 773.68 45.88 16.86
Antecedent -24.49 15.31 -1.60 1.11 -72.18 69.52 -1.04 0.47 -71.88 32.39 -2.22 0.19
Random effects
Variance SD Correlation Variance SD Correlation Variance SD Correlation
by subject
Intercept 12364.70 111.20 108049 328.70 55203 234.95
Antecedent - - - 54657 233.80 -0.93 54657 -
by item
Intercept 4703.70 68.58 21340 146.10 9555 97.75
Antecedent 455.30 21.34 - - - - - - -

Naturalness judgment task

For the analysis of naturalness ratings, we fitted a cumulative ordinal model with two within-participant factors, Pronoun and Antecedent, and their interaction. Random intercept and slopes by participant and by item were included in the model. Unlike in the eye-tracking analysis, we were able to include both factors in one analysis as the uneven number of words in the subordinate clause in sentences containing overt and null pronouns was not problematic for the behavioral data. The means for each condition are presented in Table 7. We found a strong effect of Pronoun (β = -0.40; 95% CrI [-0.69–0.10]): participants rated sentences containing null pronouns as more natural than sentences containing overt pronouns. We also found evidence for the interaction of Pronoun and Antecedent effects (β = -1.12, 95% CrI [-1.39–0.84]). Direct comparisons between the two Antecedent conditions (i.e., subject- and object-matching sentences) revealed that there was no evidence for differences in naturalness scores in sentences containing a null pronoun (β = 0.15, 95% HPD [-0.10 0.42]). Still, there was a strong effect in sentences containing overt pronouns (β = 1.27, 95% HPD [0.99 1.52]): participants rated subject-matching sentences as less natural than object-matching sentences (see Table 7 and Fig 6).

Table 7. Mean scores and SD for the naturalness judgements of the experimental stimuli.
Condition Naturalness rating
Null pronoun–Subject antecedent 3.77 (1.13)
Null pronoun–Object antecedent 3.89 (1.06)
Overt pronoun–Subject antecedent 2.47 (1.22)
Overt pronoun–Object antecedent 3.53 (1.10)
Fig 6. Naturalness judgment.

Fig 6

The naturalness rating of the sentences used in the eye-tracking experiment. Error bars represent standard errors of the model’s predictions.

Experiment 2 –Summary

The results of Experiment 2 revealed that in Polish speakers the violation of a preferred pronoun-antecedent match did not result in increased difficulty in processing sentences containing null pronouns. However, in the case of sentences containing overt pronouns, we observed a substantial increase in the cognitive effort whenever a reader was forced to interpret the overt pronoun as referring to the subject antecedent. The naturalness rating supports the eye-tracking results. It revealed that sentences containing null pronouns were rated as equally natural regardless of the pronoun-antecedent match. In contrast, sentences containing overt pronouns which referred to the subject antecedent were rated as much less natural than those referring to the object antecedent. Our results also revealed an unexpected yet very interesting effect: in the analysis of the post-critical area of interest, the reading times were much longer for sentences referring to the object antecedent, regardless of the pronoun-antecedent match. This suggests that processing pronouns which do not refer to the most prominent subject antecedent always incurs additional cognitive effort.

General discussion

The aim of the research presented in this paper was to investigate the pattern of pronominal anaphora resolution in Polish. In the first experiment, we established the offline preference for interpreting pronominal anaphora in Polish; in the second experiment, we explored whether a violation of this established preference impedes sentence processing. The results of the first experiment reveal that native Polish speakers prefer to interpret sentences containing a null pronoun as referring to a subject antecedent. Native Polish speakers also prefer to interpret sentences containing overt pronouns as referring to an object antecedent. The second experiment extends these findings by showing how the preference for anaphora resolution influences online sentence interpretation. There are two key findings of the second experiment: First, the analysis of the critical area of interest (the pronoun + the verb of the subordinate clause) indicates that a violation of its antecedent preference does not disrupt the interpretation of a null pronoun because a null pronoun can easily be interpreted as referring to the subject and object antecedents. On the other hand, the interpretation of an overt pronoun is much more sensitive to the violation of a pronoun-antecedent match preference: whenever an overt pronoun is forced to refer to a subject antecedent, a substantial increase in processing cost is observed. The second key finding of the second experiment is revealed by the analysis of the post-critical area of interest (the complement of the subordinate clause, following the VP). This analysis shows that, regardless of the pronominal form, sentences in which a pronoun refers to the object antecedent always incur an additional processing cost compared to sentences that refer to the subject antecedent. This suggests that Polish speakers interpret sentences under the working assumption that the most-prominent referent is the first-mentioned subject and topic antecedent. The reference can be shifted towards a different antecedent during the sentence-interpretation process if additional information (like the appearance of an overt pronoun) requires it. However, shifting the predicted reference is always effortful, regardless of the pronoun-antecedent match, which is reflected by increased processing cost in sentences containing overt pronouns.

Additionally, in both Experiments we found that Polish speakers considered sentences containing null pronouns as more natural than sentences containing overt pronouns. Interestingly, our results also show that this effect is modulated by the preference for a pronoun-antecedent match. In Experiment 1, we found that null pronouns interpreted as referring to subject antecedents were rated as more natural than those interpreted as referring to object antecedents. However, no differences in the naturalness of sentences with null pronouns were observed in Experiment 2. The difference between the two Experiments may be related to differences in the task itself: while Experiment 1 allowed a reader to choose the referent of a pronoun, Experiment 2 forced the pronoun to refer to the only grammatically correct antecedent. In both experiments, we also found that overt pronouns referring to a subject antecedent were rated as much less natural than those referring to an object antecedent (i.e., preferred interpretation of an overt pronoun). This pattern is convergent with our eye-tracking results, which show a higher processing cost for overt pronouns forced to match less-preferred subject antecedents than for null pronouns forced to match less-preferred object antecedents. Based on these findings, it could be argued that sentences that are less natural are actually more difficult to interpret. Consequently, the increased processing cost related to the interpretation of sentences with an overt pronoun that is forced to match a subject antecedent might actually reflect a more general problem related to interpreting very unnatural sentences rather than to shifting the preferred reference of a pronoun. However, this interpretation is challenged by the naturalness judgment results in Experiment 1. Similarly to Experiment 2, the naturalness rating in Experiment 1 shows that Polish speakers consider sentences with overt pronouns that are interpreted as referring to the subject antecedent (i.e., contrary to the general preference) as much less natural than sentences that follow the preference for overt pronoun interpretation. However, in Experiment 1 we did not force the unnatural pronoun-antecedent match: all pronouns were ambiguous and could refer to either of the antecedents. As such, our results show that not only syntactic factors such as subjecthood or first-mention bias drive the perception of the naturalness of sentences. The speaker’s interpretation of the sentence, i.e., the pronoun-reference assignment, once it has been established, also does so.

What drives the anaphora resolution mechanism in Polish?

As revealed by the results of our first experiment, the preference for anaphora resolution in Polish is similar to that observed in other pro-drop languages. In Romance languages like Italian or Spanish, speakers usually prefer to interpret sentences containing null pronouns as referring to a subject antecedent, and they interpret sentences containing an overt pronoun as referring to an object antecedent [5, 19, 28]. Our results are also convergent with theoretical accounts according to which the use of a referring expression is determined by the prominence of its referent, which can be derived from one of the following: the referent’s grammatical role (the highest SpecIP position; [19]), a preference for the first-mentioned antecedent in a sentence [16, 29]; or the fact that the first-mentioned subjects are more likely than other antecedents to be interpreted as topics of a given utterance [12, 32]. It has been shown that while it is challenging to disentangle these effects, it is very likely that readers use a combination of different cues of prominence when interpreting pronouns (for a comparison of the first-mention account and subjecthood, see [29]). The results of both reported experiments suggest that subjecthood and information structure (i.e., order of mention but also topicality and thematic roles) are dominant constraints for pronoun resolution in Polish. This is a typical observation in sentence-oriented languages which rely on the morpho-syntactic determinants of subject-verb agreement in establishing pronouns’ reference. In Experiment 1, we showed that null and overt pronouns are usually bound by antecedents whose prominence can easily be derived from these syntactico-semantic cues. However, the interpretation of ambiguous pronouns also revealed that, in some cases, readers interpreted them contrary to the general resolution preference. Interestingly, even though participants were free to choose whichever antecedent they preferred, the naturalness scores of the less-preferred antecedent matches (i.e., an overt pronoun referring to a subject antecedent) were much lower than for conditions following a general resolution preference pattern. This result indicates that even though the syntactico-semantic bias for pronoun resolution seems to be the dominant constraint on pronoun interpretation for Polish speakers, it can be overridden by other factors whenever the mental representation of a comprehender’s discourse favors an alternative interpretation. Apart from referring to the antecedent’s prominence, the preferred pronoun-antecedent match in Polish speakers can also be explained by referring to more pragmatic factors: according to the Accessibility Theory [6], the use of a referring expression depends on the balance between its cost and function. In the case of overt pronouns, the pragmatic function of overt pronouns could be to act as cues which help to identify the appropriate antecedent that is less prominent [45, 46]. As such, whenever a speaker encounters an overt pronoun, it can be interpreted as a signal for a reference shift towards a less-prominent antecedent.

In Experiment 2, we explored the extent to which pronoun resolution preferences can be modulated by the grammatical constraints on the formation of a referential dependency. In the case of Polish, these constraints refer to the grammatical number, person, or gender agreement between the pronoun and its antecedent. Our results indicate that null pronouns can equally easily be interpreted as referring to subject and object antecedents. An important consequence of this is that since null pronouns can be easily and unambiguously interpreted as referring to the antecedent in subject and object positions, any use of an overt pronoun needs to be justified [46]. As previously discussed, the pragmatically driven function of a pronoun is to cue the identification of the appropriate antecedent. In this framework, the appearance of an overt pronoun should signal a shift of reference from the most-prominent antecedent to a less-prominent one. Otherwise, the overt pronoun would provide redundant information and, as such, it should be more difficult to interpret. Our results provide experimental confirmation of this prediction: the observed pattern of online anaphora resolution reveals that interpretation of a sentence containing an overt pronoun that refers to a subject antecedent is much more effortful than in the case of an object antecedent. A similar pattern of results was also reported by a study on online sentence interpretation in Spanish speakers [21]. However, in contrast to Polish and Spanish speakers, Italian speakers show exactly the opposite sensitivity to the violation of a preferred pronoun-antecedent match, with a much bigger processing penalty for a violation of a null pronoun preference than for a violation of an overt pronoun preference [5]. One way of accounting for the differences in the sensitivity of null and overt pronouns to the violation of their preference for interpretation is by referring to approaches which assume that pronoun resolution is driven by multiple constraints, such as the Form-Specific Multiple-Constraint approach [1]. Within these frameworks, our results can be interpreted as indicating that null pronouns are much more sensitive than overt pronouns to a wide range of factors that determine the reference. However, these factors do not necessarily drive the general pronoun resolution preference. Therefore, whenever null pronouns are forced to refer to an antecedent which does not follow the preferred antecedent match, they can easily shift their reference towards a less-preferred referent. On the other hand, overt pronouns do not exhibit similar flexibility which entails a substantial processing penalty whenever the preference for retrieving the object antecedent is violated.

Interestingly, the results of Experiment 2, while replicating the pattern observed by Chamorro and colleagues [21], are at the same time at odds with another study conducted by Filiaci and colleagues. The study by Fialiaci and colleagues showed that a violation of a preferred pronoun-antecedent match incurs a greater processing penalty for null than for overt pronouns [5]. Trying to account for the differences between these two studies, Chamorro and colleagues point out that they may actually be related to the clause order. Similarly to Chamorro and colleagues, in our experiment we used sentences following the Main-Subordinate clause order. In contrast, Filiaci and colleagues [5] followed the Subordinate-Main order. These differences can affect the information structure as they can shift a reader’s expectations, resulting in differences in discourse representations. Furthermore, they can also result in a shift in topicality or a shift of the perceived agentivity of the available antecedents. On the other hand, the discrepancies between our results and those reported by Filiaci and colleagues could be related to cross-linguistic differences in pronoun resolution mechanisms between Polish (our study), Spanish [21], and Italian [5]. Within the multiple-constraint frameworks [1, 24], it can be argued that even though the “hard” morpho-syntactic constraints in different languages are similar (or the same), their anaphora resolution mechanisms might still differ due to differences in sensitivity to the “soft” cues that define the antecedents’ prominence (such as grammatical or thematic roles, discourse coherence, etc.).

The antecedent in an object position–the source of the unexpected processing cost

So far, we have argued that subjecthood, order of mention, and automatic assignment of topicality to the subject antecedent are the dominant constraints on anaphora resolution in Polish. We also showed that in some cases these constraints can be overridden to accommodate the current representation of a discourse better. To our surprise, our data indicate that the processing of sentences referring to the antecedent in the syntactic position of an object incurs an additional processing cost, regardless of the pronoun-antecedent match. Interestingly, this effect was only revealed in the analysis of a post-critical area of interest (the spillover effect; [47]). According to the integration account [48], an increase in reading times in the post-critical area of interest reflects the cognitive load related to the sentence-level semantic integration process. This explanation is in line with the idea that pronoun resolution is a process that unfolds over time (for a discussion, see [49]): in its early stages, the initial bonding or retrieval is reflected by early fixation measures, but late processes related to integration with the discourse only affect later processing stages. Following the integration account, we propose that in our data the spillover effect reflects the cognitive load related to a shift of a default preferred reference from the most-prominent subject antecedent to a less-prominent object antecedent. As previously discussed, in our experiment the preferred reference of a given sentence can be derived not only from a preference for a syntactic subject but also from assigning the role of the topic to the first-mentioned antecedent. Under the assumption of the integration account, the effects observed in the critical area of interest reflect the ease of processing of the pronoun’s meaning (i.e., identifying the referent of a verbal phrase). In contrast, the effects in the post-critical region reflect the updating of the syntactic- or discourse-related representation of a sentence. Therefore, even though processing of a less-natural subordinate clause containing an object antecedent might not impose difficulty for lexico-semantic processing, it could generally be more demanding to process on the syntactic and discourse integration levels. Previous studies on the effect of focus in anaphora resolution reported a similar effect: an increased processing cost associated with a topic shift towards a less-prominent antecedent which has been cued by the information structure of the current discourse [10, 11, 14, 15]. In this context, our results can be interpreted as showing that Polish speakers automatically interpret the most-prominent antecedent (the first available antecedent or the subject antecedent) to be the topic of a sentence; however, as new information cues another antecedent that is coherent with the current discourse, the reference is shifted. This interpretation could be supported by similar findings from an EEG experiment performed by Schumacher and colleagues [50] which showed that co-reference with a less-prominent antecedent results in additional processing cost reflected by the N400 component, which is responsible for semantic processing and integration of words into a broader discourse. However, they also found that shifting the discourse topic from the antecedent in the initial topical position in a sentence results in an additional late processing cost that is reflected by the Late Positivity component. The authors propose that the N400 effect reflects the pronoun-specific prominence computations necessary for the appropriate resolution of the pronoun, while the Late Positivity is driven by a discourse-internal updating process. To sum up, the effects observed in the post-critical region of interest might indicate that Polish speakers automatically assign the reference (and the role of a topic) of a sentence to the first-mentioned subject antecedent, i.e., the pre-verbal subject of the main clause. While a range of different factors can modulate the interpretation of the pronoun itself, the syntactic or discourse-related representation of a sentence needs to be updated whenever the content of the sentence requires the reference to be shifted towards a different antecedent.

Conclusions

The current study provides the first experimental evidence on anaphora resolution preferences in Polish. We have shown that the general bias for anaphora resolution is consistent with theories according to which it is the prominence of an antecedent that governs anaphora resolution [1, 6, 19, 46]. Our results indicate that in Polish, syntactico-semantic cues, such as subjecthood and information structure (i.e., order of mention and thematic roles), are the dominant constraints of the prominence of an antecedent; however, they can be overridden by additional cues whenever this is justified by the coherence of discourse representation. Interestingly, the results of the eye-tracking experiment revealed that null pronouns in Polish are able to flexibly and effortlessly shift the reference towards a less-preferred antecedent, while the referential bias for overt pronouns seems to be much stronger as its violation is related to a significant increase in processing costs. Moreover, the analysis of the post-critical region revealed that, regardless of the anaphora resolution process, an additional cognitive effort occurs whenever the reference needs to be shifted towards a less-prominent non-topical antecedent. The fact that this effect is consistent across sentences that contain both null and overt pronouns suggests that it might reflect a different process than the effects observed in the critical area of interest. Altogether, our results suggest that anaphora resolution is an incremental multi-stage process; however, further research is needed to explore the mechanism responsible for the shift of reference in order to better understand the source of the extra cognitive effort it entails.

Supporting information

S1 Appendix. A list of experimental sentences used in Experiment 2.

(DOCX)

Acknowledgments

The authors would like to thank all members of our Psychology of Language and Bilingualism Laboratory, LangUsta, who contributed to the research project by discussing the task design and collecting and coding the data. We are also grateful to Michael Timberlake for proofreading and to all participants who took part in the experiments. Special thanks to Michał Remiszewski for coordinating the data collection process and to Marta Ruda as well as the three anonymous Reviewers for their helpful comments and insights.

Data Availability

All data and the scripts necessary to reproduce the presented results are available from the Open Science Framework database (https://osf.io/dynwp/).

Funding Statement

This research was possible thanks to the grant SONATA BIS grant no 2015/18/E/HS6/00428 awarded to ZW by the National Science Center Poland (https://ncn.gov.pl/). During writing the paper JD was supported by Etiuda scholarship no 2018/28/T/HS6/00277 awarded by the Polish National Science Centre (https://ncn.gov.pl/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Kaiser E, Trueswell JC. Interpreting pronouns and demonstratives in Finnish: Evidence for a form-specific approach to reference resolution. Lang Cogn Process. 2008. Aug;23(5):709–48. [Google Scholar]
  • 2.Sorace A, Filiaci F. Anaphora resolution in near-native speakers of Italian. Second Lang Res. 2006. Jul;22(3):339–68. [Google Scholar]
  • 3.Kwon N, Sturt P. Null pronominal (pro) resolution in Korean, a discourse-oriented language. Lang Cogn Process. 2013. Apr;28(3):377–87. [Google Scholar]
  • 4.Mazuka R. Processing of empty categories in Japanese. J Psycholinguist Res. 1991. May 1;20(3):215–32. [Google Scholar]
  • 5.Filiaci F, Sorace A, Carreiras M. Anaphoric biases of null and overt subjects in Italian and Spanish: a cross-linguistic comparison. Lang Cogn Neurosci. 2014. Aug 9;29(7):825–43. [Google Scholar]
  • 6.Ariel M. The function of accessibility in a theory of grammar. J Pragmat. 1991. Nov;16(5):443–63. [Google Scholar]
  • 7.Arnold JE. Reference form and discourse patterns. PhD Thesis, Stanford University; 1998. Available from: https://searchworks.stanford.edu/view/3953057.
  • 8.Hemforth B, Konieczny L, Scheepers C, Colonna S, Schimke S, Baumann P, et al. Language specific preferences in anaphor resolution: Exposure or gricean maxims? 32nd Annu Conf Cogn Sci Soc. 2010;2218–23. [Google Scholar]
  • 9.Schumacher PB, Roberts L, Järvikivi J. Agentivity drives real-time pronoun resolution: Evidence from German er and der. Lingua. 2017. Jan 1;185:25–41. [Google Scholar]
  • 10.Colonna S, Schimke S, Hemforth B. Information structure effects on anaphora resolution in German and French: A crosslinguistic study of pronoun resolution. Linguistics. 2012. Sep 13;50(5):991–1013. [Google Scholar]
  • 11.de la Fuente I, Hemforth B, Colonna S, Schimke S. The role of syntax, semantics, and pragmatics in pronoun resolution: A cross-linguistic overview. In: Empirical Perspectives on Anaphora Resolution. De Gruyter; 2016. p. 11–32. [Google Scholar]
  • 12.Cowles HW, Walenski M, Kluender R. Linguistic and cognitive prominence in anaphor resolution: topic, contrastive focus and pronouns. Topoi. 2007. Mar 1;26(1):3–18. [Google Scholar]
  • 13.Kaiser E. Focusing on pronouns: Consequences of subjecthood, pronominalisation, and contrastive focus. Lang Cogn Process. 2011. Dec 1;26(10):1625–66. [Google Scholar]
  • 14.Patterson C, Felser C. Cleft Focus and Antecedent Accessibility: The Emergence of the Anti-focus Effect. In: Information Structuring in Discourse. Brill; 2020. pp. 56–85. [Google Scholar]
  • 15.Colonna S, Schimke S, Hemforth B. Different effects of focus in intra- and inter-sentential pronoun resolution in German. Lang Cogn Neurosci. 2015. Nov 26;30(10):1306–25. [Google Scholar]
  • 16.Gernsbacher MA, Hargreaves DJ. Accessing sentence participants: The advantage of first mention. J Mem Lang. 1988. Dec 1;27(6):699–717. doi: 10.1016/0749-596X(88)90016-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Smyth R. Grammatical determinants of ambiguous pronoun resolution. J Psycholinguist Res. 1994;23(3):197–229. [Google Scholar]
  • 18.Badecker W, Straub K. The processing role of structural constraints on the interpretation of pronouns and anaphors. J Exp Psychol Learn Mem Cogn. 2002;28:748–69. doi: 10.1037//0278-7393.28.4.748 [DOI] [PubMed] [Google Scholar]
  • 19.Carminati MN. The processing of Italian subject pronouns PhD Thesis, University of Massachussetts Amherst; 2002. Available from: https://scholarworks.umass.edu/dissertations/AAI3039345/.
  • 20.Chomsky N. Some Concepts and Consequences of the Theory of Government and Binding. MIT press; 1982. [Google Scholar]
  • 21.Chamorro G, Sorace A, Sturt P. What is the source of L1 attrition? The effect of recent L1 re-exposure on Spanish speakers under L1 attrition. Biling Lang Cogn. 2016. May;19(3):520–32. [Google Scholar]
  • 22.Matthews A, Chodorow MS. Pronoun resolution in two-clause sentences: Effects of ambiguity, antecedent location, and depth of embedding. J Mem Lang. 1988. Jun 1;27(3):245–60. [Google Scholar]
  • 23.Hobbs JR. Coherence and Coreference. Cogn Sci. 1979;3(1):67–90. [Google Scholar]
  • 24.Kehler A, Rohde H. A probabilistic reconciliation of coherence-driven and centering-driven theories of pronoun interpretation. Theor Linguist. 2013. Sep 12;39(1–2):1–37. [Google Scholar]
  • 25.Grosz B, Joshi A, Weinstein S. Centering: A Framework for Modelling the Local Coherence of Discourse. Comput Linguist. 1995. Jan 1;21(2):203–25. [Google Scholar]
  • 26.Kehler A, Kertz L, Rohde H, Elman JL. Coherence and coreference revisited. J Semant. 2008;25(1): 1–44. doi: 10.1093/jos/ffm018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Crawley RA, Stevenson RJ, Kleinman D. The use of heuristic strategies in the interpretation of pronouns. J Psycholinguist Res. 1990. Jul 1;19(4):245–64. doi: 10.1007/BF01077259 [DOI] [PubMed] [Google Scholar]
  • 28.Null vs. overt pronouns and the Topic-Focus articulation in Spanish. Riv Linguist. 2002;14(2):151–69. [Google Scholar]
  • 29.Järvikivi J, van Gompel RPG, Hyönä J, Bertram R. Ambiguous Pronoun Resolution: Contrasting the First-Mention and Subject-Preference Accounts. Psychol Sci. 2005. Apr 1;16(4):260–4. doi: 10.1111/j.0956-7976.2005.01525.x [DOI] [PubMed] [Google Scholar]
  • 30.Roberts L, Gullberg M, Indefrey P. Online Pronoun Resolution in L2 discourse: L1 Influence and General Learner Effects. Stud Second Lang Acquis. 2008. Sep;30(3):333–57. [Google Scholar]
  • 31.Reinders-Machowska E. Binding in Polish. In: Koster J, editor. Long Distance Anaphora. Cambridge: Cambridge University Press; 1991. pp. 137–50. [Google Scholar]
  • 32.Hung Y-C, Schumacher PB. Topicality matters: Position-specific demands on Chinese discourse processing. Neurosci Lett. 2012. Mar 9;511(2):59–64. doi: 10.1016/j.neulet.2012.01.013 [DOI] [PubMed] [Google Scholar]
  • 33.R Core Team. R: A language and environment for statistical computing. Version 4.0. 2 (Taking Off Again). 2020.
  • 34.Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. J Stat Softw. 2015. Oct 7;67(1):1–48. [Google Scholar]
  • 35.Bürkner P-C. Advanced Bayesian Multilevel Modeling with the R Package brms. R J. 2018;10(1):395–411. [Google Scholar]
  • 36.Veríssimo J. Analysis of rating scales: A pervasive problem in bilingualism research and a solution with Bayesian ordinal models. Bilingualism: Language and Cognition. Cambridge University Press; 2021;1–7. [Google Scholar]
  • 37.Kleiman E. EMAtools: Data Management Tools for Real-Time Monitoring/Ecological Momentary Assessment Data. R package version 0.1.3. https://CRAN.R-project.org/package=EMAtools. 2017.
  • 38.Patterson C, Felser C. Delayed Application of Binding Condition C During Cataphoric Pronoun Resolution. J Psycholinguist Res. 2019. Apr 1;48(2):453–75. doi: 10.1007/s10936-018-9613-4 [DOI] [PubMed] [Google Scholar]
  • 39.Venditti JJ, Stone M, Nanda P, Tepper P. Toward an account of accented pronoun interpretation in discourse context: Evidence from eye-tracking. Rutgers Cent Cogn Sci Tech Rep RuCCSTR-68. 2001;1–48. [Google Scholar]
  • 40.Fernandes EG, Luegi P, Correa Soares E, de la Fuente I, Hemforth B. Adaptation in pronoun resolution: Evidence from Brazilian and European Portuguese. J Exp Psychol Learn Mem Cogn. 2018. Dec;44(12):1986–2008. doi: 10.1037/xlm0000569 [DOI] [PubMed] [Google Scholar]
  • 41.Sanford AJ, Filik R. “They” as a gender-unspecified singular pronoun: Eye tracking reveals a processing cost. Q J Exp Psychol. 2007. Feb 1;60(2):171–8. [DOI] [PubMed] [Google Scholar]
  • 42.Koornneef AW, Van Berkum JJA. On the use of verb-based implicit causality in sentence comprehension: Evidence from self-paced reading and eye tracking. J Mem Lang. 2006;54(4):445–65. [Google Scholar]
  • 43.Clifton C, Staub A, Rayner K. Eye movements in reading words and sentences. In: Van Gompel RPG, Fischer MH, Murray WS, Hill RL, editors. Eye Movements: A window on mind and brain. Oxford: Elsevier; 2007. p. 341–71. [Google Scholar]
  • 44.Featherstone CR, Sturt P. Because there was a cause for concern: An investigation into a word-specific prediction account of the implicit-causality effect. Q J Exp Psychol. 2010. Jan 1;63(1):3–15. doi: 10.1080/17470210903134344 [DOI] [PubMed] [Google Scholar]
  • 45.Almor A. Noun Phrase Anaphora and Focus: The Informational Load Hypothesis. Psychol Rev. 1999;106(4):748–65. doi: 10.1037/0033-295x.106.4.748 [DOI] [PubMed] [Google Scholar]
  • 46.Almor A. Constraints and Mechanisms in Theories of Anaphor Processing. In: Crocker MW, Pickering M, Clifton C, editors. Architectures and Mechanisms for Language Processing [Internet]. Cambridge: Cambridge University Press; 2000. p. 341–54. doi: 10.3758/bf03209354 [DOI] [Google Scholar]
  • 47.Conklin K, Pellicer-Sánchez A, Carrol G. Eye-Tracking. Cambridge University Press; 2018. 247 p. [Google Scholar]
  • 48.Rayner K, Duffy SA. Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Mem Cognit. 1986. May 1;14(3):191–201. doi: 10.3758/bf03197692 [DOI] [PubMed] [Google Scholar]
  • 49.Kehler A. Rethinking the SMASH Approach to Pronoun Interpretation. In: Gundel JK, Hedberg N, editors. Reference: Interdisciplinary Perspectives. Oxford University Press; 2008. [Google Scholar]
  • 50.Schumacher PB, Backhaus J, Dangl M. Backward- and Forward-Looking Potential of Anaphors. Front Psychol. 2015. Jul 20;6: 1746. doi: 10.3389/fpsyg.2015.01746 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Claudia Felser

3 Jun 2021

PONE-D-21-12740

Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.

PLOS ONE

Dear Dr. Wolna,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 18 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Claudia Felser, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. While the reviewers find your study interesting and note several positive aspects of it, they also raise a number of non-trivial concerns which I am asking you to address in a revised version of your manuscript. Major comments relate to the statistical methods used (which are out-dated and deemed inapppropriate by two reviewers), the coverage and depth of the literature review and discussion, the distinction made between syntax and pragmatics/discourse, and the consideration of alternative models or explanations for the results. Please also respond to the reviewers' more minor comments.

3. Thank you for including your ethics statement:  "The experiment received a written approval of the Ethics Committee of the Institute of Psychology of Jagiellonian University concerning experimental studies with human subjects.".   

Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

4. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 4 in your text; if accepted, production will need this reference to link the reader to the Table.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This paper reports an offline and an online experiment on the interpretation of anaphoric pronouns in Polish. The authors are argued that the results show that interpretation of a null pronoun would be more sensitive to discourse-level cues than syntactic cues, while resolution of overt pronouns would rely strongly on syntax-based cues. While potentially interesting, the paper presents several weaknesses that would require some important improvements before it can be considered for publication in PLOS One.

Detailed comments:

- I do not understand the term “natural preference” (or “natural pattern”) for anaphora resolution used by the authors throughout the manuscript. In most cases, the adjective “natural” can be simply removed. In some other cases it can be replaced by “offline preference” or “baseline preference”.

- p. 8-9, l186-192 and throughout the manuscript, the authors present the null pronoun preference for subject antecedents and the overt pronoun preference for object antecedents as syntactic preferences. This is the hypothesis of the Position of Antecedent Strategy (PAS) but it is not the only one interpretation of the division of labour between null and overt pronouns observed in null-subject languages. In sentences such as those used in the study (e.g., The mother waved to the daughter when Ø (she) was crossing the street.), the preference of the null pronoun for the more salient antecedent (here, the mother) can be interpreted as a preference for the subject but also as a preference for the first mentioned referent, for the topic, for the agent or all at once. The division of labour between null and overt subject pronouns does not demonstrate that only syntactic cues are in play, it may also be driven by semantic or discourse-level cues. The authors should discuss the alternative hypotheses to the PAS and take them into account when interpreting their results.

- p. 8, l165-168, “This approach provides a plausible explanation of the divergent pattern of overt pronoun interpretation that is observed not only between Italian and Spanish (5) but also between sentence-oriented and discourse-oriented languages, which use different types of cues to assign the reference to an anaphoric expressions (for discussion, see: (3))”. Referring to the discussion of Kwon and Sturt is not enough here. The authors should clearly explain how the Form-Specific Multiple-Constraint Approach can account for the cross-linguistic differences in overt pronoun interpretation.

- Results. For both experiments, the authors performed separate F1 and F2 ANOVA analyses. This is not the most appropriate for psycholinguistic experimental data with two random variables (participant and item). The authors should analysed their data with mixed-effects models which allow for simultaneously modelling crossed participant and item effects in a single analysis (see Baayen & al., 2008; Barr, & al., 2013).

- p. 17, l390. For another experiment which used eye-tracking during reading to explore the online pronoun resolution process, see Roberts et al. (2008).

- The authors rely on the PAS to predict the offline preferences: the null pronoun should be preferentially interpreted as referring to the subject whereas the overt pronoun should be preferentially interpreted as referring to the object, which the offline results confirmed. However, they predict (and observe) different online preferences. Their online predictions are based on previous eye-tracking during reading results (see p. 17, l406-412). The discrepancy between online and offline results should be more discussed both in predictions and results.

- Naturalness judgments. An effect of the pronoun form was observed in the naturalness judgments in Study 1 (p. 15-16, l362-366). Was the factor Antecedent (subject vs object) taken into account in this analysis? If I understand correctly, even if the pronoun is ambiguous, the naturalness judgment was asked after the participants had chosen an antecedent for the pronoun. It would be interesting to compare the naturalness judgements observed in Study 1 with those observed in Study 2. In the paper, there is very little discussion of the results of the naturalness judgement results.

- Interpretation of the results of study 2. “Exploring the online interpretation of unambiguous sentences whose only possible interpretation either was or was not in line with the preference for interpretation of anaphorical sentences allowed us to determine whether these preferences are strictly bound to syntax-based rules or whether they can be modulated by the context of a given sentence.” (p. 28, l667-671). Based on the assumption that a syntax-based preference is more costly to change than a discourse-based preference, the authors conclude “we have shown that overt pronouns are much more sensitive than null pronouns to syntax-based determinants of the prominence of an antecedent. In contrast, null pronouns are more sensitive to discourse-related information as they are able to flexibly and effortlessly shift the reference, even against syntax-based cues.” (p. 31, l746-749). However, this assumption was not directly tested in the study (discourse-level factors were not manipulated and disentangle from syntactic cues). The authors’ rationale needs to be more documented and motivated by experimental and/or theoretical arguments. And the authors should consider other possible interpretations of the findings.

Minor points:

- p. 5, l103. The following order seems more logical: “(i.e. null, overt pronouns, stressed, etc.)”

- The authors are missing for the reference (14).

References

Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390‑412. https://doi.org/10.1016/j.jml.2007.12.005

Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing : Keep it maximal. Journal of Memory and Language, 68(3), 255‑278.

Roberts, L., Gullberg, M., & Indefrey, P. (2008). On-line pronoun resolution in L2 discourse: L1 influence and general learner effects. Studies in Second Language Acquisition, 30, 333–357. https://doi.org/10.1017/S0272263108080480

Reviewer #2: In this paper the authors report two experiments testing the resolution preferences for null and overt pronouns in Polish. Adopting the Position of Antecedent hypothesis, and based on previous studies of anaphora resolution for null and overt pronouns in Italian and Spanish, the authors predict that null pronouns should refer to the subject of the previous (main) clause, and that overt pronouns should refer to the object of the previous (main) clause. In a pronoun interpretation experiment, these predictions were borne out. Naturalness ratings indicated that sentences containing null pronouns were perceived as more natural than sentences containing overt pronouns. In an eye-tracking experiment, violations of these resolution preferences caused longer first-pass and total times in the verb region for the overt pronouns, but had no discernible effect on the null pronouns. The authors conclude that the resolution preferences are in line with the Position of Antecedent hypothesis, and that null pronouns are more flexible in their interpretation than overt pronouns.

I found this a well organised and well written paper with a clear structure. The experiments appear to have been carried out soundly, although some improvements could be made to the analysis (see below). Although brief, coverage of the previous literature was adequate, but the authors should add discussion of a more recent model for pronoun resolution (see below). The findings are quite modest and are reflected fairly in the discussion, it is good that the authors address a gap in the literature by testing pronoun resolution in Polish.

The major points that should be addressed relate to (i) literature coverage; (ii) data analysis; (iii) the interpretation relating to claims about syntax and/or use of terms relating to syntax.

(i) literature coverage

For a short paper, you covered most of the important theoretical background. But you should also include more recent work on pronoun resolution by Kehler and colleagues (e.g. Kehler et al 2008; Kehler and Rohde 2013) as this represents an important development in models of pronoun resolution.

(ii) data analysis

ANOVA: results (especially from Experiment 1) are very clear and I don’t doubt them, but ANOVA has been replaced by linear mixed-effects models as the standard way to analyse psycholinguistic data of this type. This is because mixed models take better account of the random structure of the data, rather than averaging over items and participants. I think your analyses using ANOVA in experiments 1 and 2 should be replaced in order to conform to current standards (I don’t think that your interpretation will change much). If you are not familiar with this type of analysis, a good place to start is Cunnings (2012): An overview of mixed-effects statistical models for second-language researchers. https://journals.sagepub.com/doi/pdf/10.1177/0267658312443651

Power analysis and effect sizes: please report effect sizes. Also, did you do a power analysis? It is good practice to do this in advance of an experiment. If you did, please report it. If not, please consider it for your next experiments; some journals are requesting this as standard.

Analysis of naturalness data: this type of data should not be analysed using raw scores. Z-scores are more appropriate (see Schütze and Sprouse 2014, Judgment Data, DOI: 10.1017/CBO9781139013734.004). Even better would be some kind of ordinal model analysis (see this recent paper: Veríssimo, Analysis of rating scales: A pervasive problem in bilingualism research and a solution with Bayesian ordinal models, on psyarxiv.com)

Reporting main effects: please state which direction the effects go in

(iii) syntax

I think this may just be a terminology issue, but I was confused by your claims about syntax and syntactic cues versus discourse/pragmatics. For instance, in lines 184-192, I really don’t understand the claim you are making here. Why should violation of syntactic cues lead to processing costs, but discourse violations not induce such costs? Is there any prior evidence to that effect? I would expect that a violation of a discourse-based expectation could induce processing costs just as much as a syntactic violation. But further, I don’t understand the distinction you are making between syntax and discourse/pragmatics. As I see it, pronouns are subject to certain syntactic rules in certain configurations, such as Condition B. But this is not what you test in the current study. You seem to equate syntax with a strong preference for a certain grammatical category. Could you clarify what you want to claim here? This issue recurs throughout the paper. For example, in lines 246-251: Previous studies have shown that… Are you making the claim that null pronouns are syntactically resolved and overt pronouns are influenced by non-syntactic factors? How can this be distinguished from discourse-based prominence? I’m not sure that there is such a strict distinction as you are trying to make. Similarly, lines 387-388: syntax-based determinants. Not sure what this is based on. And lines 698-700: overall I agree with the line of argumentation in the discussion, but I don’t agree that the preferences for the resolution of overt pronouns is necessarily best characterised as syntax-based. You can have more rigid interpretation preferences (see work on German demonstratives as an example) without invoking syntactic rules. In my view, not referring to the most prominent antecedent is not necessarily a rule of syntax. Even if you want to say something like “influenced by syntactic factors”, I don’t think you have the evidence here that this is just about grammatical role.

Line 723 onwards: adjustment of syntactically based assignment: again same issue as above

Other comments

The naturalness data in Exp 1 are interesting. They should be discussed/reflected on in more detail.

Summary of Exp 1 (lines 368-373): it looks like preferences for overt pronoun are actually stronger than for null pronouns. Would be good to test this statistically, and reflect on what this could mean. Also, what you refer to as natural here actually contradicts the naturalness data

Processing slowdown for referring to the object: at least in the example in lines 464-475, the object conditions have a less natural scenario with respect to number: several teachers and one student. A prototypical scenario is one teacher and multiple students. Could this be behind the processing slowdown here, and the lower ratings? Are the other items like this too?

Shifting reference expectations/updating discourse expectations has shown to have effects in ERP (Schumacher et al 2015, Backward and Forward Looking Potential of Anaphors), similar to the object processing cost you discuss at the end of the paper.

Minor issues

Page 3 line 39: denominate —> denote

Lines 64-65: it is not the information about the referent of a pronoun that is morphologically encoded in the verb. It is the gender and number of the predicate’s subject. Similarly, in line 71, it is not clear what you mean here by mismatch between a pronoun and a verb.

Example lines 66-67 needs a gloss

Line 232: referent of a verb —> subject of a verb

Fig 2: labels object-match and subject match are odd because they don’t relate to the experimental set up. Simply subject and object?

Lines 389-390: there are a lot of studies that have used eye-tracking to look at pronoun resolution, should refer to these.

Line 382: higher fixation times: this is a prediction relating to a specific measure (fixation times), but you actually tested first-pass, go-past and total times which are more than simply fixation times.

Line 404: total time is a cumulative, not a late measure (captures both early and late processes).

Around line 415: I think I get what you mean in the predictions for the naturalness ratings, but you need to spell it out more clearly (what you mean by natural here).

Condition examples (lines 464-475): need a gloss

Line 565, figure 4A caption is incorrect - not pronoun + verb (no pronoun because null)

Line 635: syntactic position of an object —> syntactic position of a subject

Reviewer #3: In my opinion, the present study presents several strong points: First, it is a close replication of a previous study (both in terms of tasks and materials); second, it adds a (Slavic) language to the repertoire of languages that have been studied in the pronoun resolution literature; third, the reported results confirm a well-known bias previously attested in other languages.

My concern regarding this article, as I explain just below, has to do with the fact that the literature review and parts of the discussion section are rather superficial (in particular when it comes to the discussion of the factors that play a role in pronoun resolution).

See attached file for further comments.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Wolna et al_review.pdf

PLoS One. 2022 Jan 11;17(1):e0262459. doi: 10.1371/journal.pone.0262459.r002

Author response to Decision Letter 0


12 Aug 2021

Response to the Editor’s comments:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

We made sure that our manuscript meets PLOS ONE’s style requirements and that the uploaded files are named according to the provided guidelines.

2. While the reviewers find your study interesting and note several positive aspects of it, they also raise a number of non-trivial concerns which I am asking you to address in a revised version of your manuscript. Major comments relate to the statistical methods used (which are out-dated and deemed inapppropriate by two reviewers), the coverage and depth of the literature review and discussion, the distinction made between syntax and pragmatics/discourse, and the consideration of alternative models or explanations for the results. Please also respond to the reviewers' more minor comments.

We have carefully considered the Reviewers’ comments and we introduced the changes to our manuscript according to their suggestions.

(1) First, we reanalyzed our data using the linear mixed-effects models and, in the case of naturalness ratings, the Bayesian ordinal models.

(2) Second, we extended the literature review by including a discussion of an additional model an by focusing on frameworks alternative to the syntax-based Position of Antecedent strategy. Those changes are reflected in the Introduction as well as in the Discussion of our results.

(3) Third, we reformulated the problematic distinction between syntax and pragmatics/discourse by centering our narration around two alternative, literature-based distinctions of factors that influence the pronoun resolution. The first distinction, proposed by Kaiser and Trueswell (2008) distinguishes between syntactico-semantic and discourse-related factors. The second distinction, proposed by Kehler and Rhode (2013) distinguishes between “hard” and “soft” constraints on pronoun resolution. Both distinctions are introduced and described in detail in the Introduction; they are also referred to in the discussion of the results of the current study

(4) Finally, we addressed all minor concerns of the Reviewers (see the item-by-item responses to all comments below).

3. Thank you for including your ethics statement: "The experiment received a written approval of the Ethics Committee of the Institute of Psychology of Jagiellonian University concerning experimental studies with human subjects.".

Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

The ethics statement has been updated in the manuscript and it now provides additional information of the form of consent obtained from participants of both reported Studies. The ethics statement has also been updated in the submission system.

4. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 4 in your text; if accepted, production will need this reference to link the reader to the Table.

We made sure that all Tables are properly referred to in the text. Following the suggestion of the Reviewers to reanalyse our data with linear mixed-effects models, we included additional Tables that summarize the results of the statistical analyses, therefore the numeration of Tables was updated.

Response to reviewers

Reviewer #1:

This paper reports an offline and an online experiment on the interpretation of anaphoric pronouns in Polish. The authors are argued that the results show that interpretation of a null pronoun would be more sensitive to discourse-level cues than syntactic cues, while resolution of overt pronouns would rely strongly on syntax-based cues. While potentially interesting, the paper presents several weaknesses that would require some important improvements before it can be considered for publication in PLOS One.

Detailed comments:

- I do not understand the term “natural preference” (or “natural pattern”) for anaphora resolution used by the authors throughout the manuscript. In most cases, the adjective “natural” can be simply removed. In some other cases it can be replaced by “offline preference” or “baseline preference”.

Response 1.1: According to your suggestion, we have changed the term “natural preference” throughout the manuscript by removing the adjective or replacing it with “offline” whenever we wanted to highlight the contrast between the preferences established in Study 1 and the preferences reflected in the online sentence interpretation in Study 2.

- p. 8-9, l186-192 and throughout the manuscript, the authors present the null pronoun preference for subject antecedents and the overt pronoun preference for object antecedents as syntactic preferences. This is the hypothesis of the Position of Antecedent Strategy (PAS) but it is not the only one interpretation of the division of labour between null and overt pronouns observed in null-subject languages. In sentences such as those used in the study (e.g., The mother waved to the daughter when Ø (she) was crossing the street.), the preference of the null pronoun for the more salient antecedent (here, the mother) can be interpreted as a preference for the subject but also as a preference for the first mentioned referent, for the topic, for the agent or all at once. The division of labour between null and overt subject pronouns does not demonstrate that only syntactic cues are in play, it may also be driven by semantic or discourse-level cues. The authors should discuss the alternative hypotheses to the PAS and take them into account when interpreting their results.

Response 1.2: Thank you for your comment. It is indeed the case that in the previous version of the manuscript the predictions and results were discussed in detail only in reference to the PAS framework (and, generally, in reference to theories that propose syntactic preferences as a dominant constraint on pronominal anaphora resolution). Following the Reviewer’s suggestion, to the Introduction (p. 6 lines 111–126) we have added a paragraph describing the different factors that have been shown to influence anaphora resolution (such as grammatical roles, order of mention, agentivity, topicality, focus, information structure and discourse coherence). We have also included this information when discussing previous experimental evidence on anaphora resolution (p. 11, lines 248-252). We now discuss how the alternative accounts to PoA would translate to predictions for Study 1 (p. 16 lines 370-374) and we consider them when discussing the results of Study 1 (p. 39 lines 915–931) and Study 2 (pp. 41-42, lines 972-999). Moreover, following the suggestions of Reviewer #2 regarding the review of previous literature, we discussed a recent theory of pronominal anaphora resolution which was proposed by Kehel and Rhode (2013) as a reconciliation of coherence-driven and centering-driven approaches (pp. 9-10 lines 211-234) and which differentiates between “hard” morpho-syntactic constraints of pronoun reference (such as gender, number, person etc.) and “soft” constraints (such as grammatical or thematic roles, syntactic function, coherence etc.). The revised discussion of our result also reflects this proposal.

- p. 8, l165-168, “This approach provides a plausible explanation of the divergent pattern of overt pronoun interpretation that is observed not only between Italian and Spanish (5) but also between sentence-oriented and discourse-oriented languages, which use different types of cues to assign the reference to an anaphoric expressions (for discussion, see: (3))”. Referring to the discussion of Kwon and Sturt is not enough here. The authors should clearly explain how the Form-Specific Multiple-Constraint Approach can account for the cross-linguistic differences in overt pronoun interpretation.

Response 1.3: A more elaborate explanation of how the Form-Specific Multiple-Constraint Approach could account for the cross-linguistic differences mentioned in the text has been added to the end of the paragraph describing the theory (p. 9 lines 201-210).

- Results. For both experiments, the authors performed separate F1 and F2 ANOVA analyses. This is not the most appropriate for psycholinguistic experimental data with two random variables (participant and item). The authors should analyze their data with mixed-effects models which allow for simultaneously modelling crossed participant and item effects in a single analysis (see Baayen & al., 2008; Barr, & al., 2013).

Response 1.4: Following the Reviewer’s suggestions, we reanalyzed the data using linear mixed-effects models for both experiments and updated the corresponding Results sections. In terms of the significance of the effects we tested, the analyses using LMMs yield the same pattern of results than the previously used ANOVAs. We have added Tables that summarize the results of the LMMs that we used to analyze the data from Experiment 2 to provide a comprehensive overview of the results [Tables 3–6]. The results of the LMMs analyses did not change significantly with respect to the previously reported results of ANOVAs. Following the suggestion of Reviewer #2, who pointed out that this approach provides a much better fit for data based on ordinal scales, we now use Bayesian ordinal models for the analysis of the naturalness of sentences in both Experiments (we provide a short justification for the use of ordinal models on p.19, lines 445-448).

- p. 17, l390. For another experiment which used eye-tracking during reading to explore the online pronoun resolution process, see Roberts et al. (2008).

Response 1.5: Thank you for this suggestion. The reference to this text has now been added on p. 11 line 255 and p. 22 line 528 (reference n.30).

- The authors rely on the PAS to predict the offline preferences: the null pronoun should be preferentially interpreted as referring to the subject whereas the overt pronoun should be preferentially interpreted as referring to the object, which the offline results confirmed. However, they predict (and observe) different online preferences. Their online predictions are based on previous eye-tracking during reading results (see p. 17, l406-412). The discrepancy between online and offline results should be more discussed both in predictions and results.

Response 1.6: Thank you very much for raising this important point. Indeed, the predictions referring to online preferences were based on the previous experiments without making a clear reference to our offline experiment. Following your suggestion and a similar comment by Reviewer #3 (R3.26), we modified the predictions for Study 2 to better explain our reasoning behind them. First, we adopt the assumption that a violation of the preference for pronoun resolution in Polish that we established in Study 1 would incur additional processing cost. Second, we explain how previous studies that tested pronouns’ sensitivity to a violation of a preferred antecedent match provide contradictory results and suggest that there are cross-linguistic differences in pronouns' sensitivity to violation of referential preferences. Finally, based on what we show in Study 1, we explain that sentences containing null pronouns are interpreted as more natural than overt pronoun sentences, regardless of the antecedent they refer to. As such, we propose that when Polish pronouns indeed exhibit differences in how strong their preferences for resolution are, it can be expected that the processing penalty will be smaller for null pronouns (which are generally more natural) than for overt pronouns. The necessary changes have been introduced to the text (pp. 23–24, lines 546-571).

- Naturalness judgments. An effect of the pronoun form was observed in the naturalness judgments in Study 1 (p. 15-16, l362-366). Was the factor Antecedent (subject vs object) taken into account in this analysis? If I understand correctly, even if the pronoun is ambiguous, the naturalness judgment was asked after the participants had chosen an antecedent for the pronoun.

Response 1.7: Thank you very much for this suggestion. We have updated our analysis of naturalness in Study 1 so that it shows how naturalness is influenced by the Pronoun and the preferred Antecedent. This analysis revealed a similar pattern to the naturalness analysis in Study 2: we found a main effect of pronoun, which shows that sentences containing a null pronoun are interpreted as more natural than sentences containing an overt pronoun (similarly to Study 2). We also found a significant interaction between Pronoun and Antecedent factor: similarly to Study 2, sentences with overt pronouns were rated as more natural when they were interpreted as matching the object than when they were interpreted as matching the subject antecedent. However, unlike in Study 2, we also observed a significant difference between sentences with null pronouns that were interpreted as matching the subject and sentences with null pronouns that were interpreted as matching the object: the former were rated as more natural. Another difference in respect to Study 2 is that in the naturalness analysis in Study 1 we did not observe a significant main effect of Antecedent. However, it is the interaction between the Pronoun and Antecedent that is crucial and most informative.

The updated analysis of naturalness scores is now included in the Results of Study 1 (p. 20 lines 473–485).

It would be interesting to compare the naturalness judgements observed in Study 1 with those observed in Study 2. In the paper, there is very little discussion of the results of the naturalness judgement results.

Response 1.8: Following the Reviewer’s suggestion, to the Discussion (p. 37–38, l. 865–891) we added a paragraph discussing the naturalness scores of both Studies (as mentioned in the previous comment) and their relation to the eye-tracking results. Additional mentions of naturalness were also included in further parts of the Discussion, where we consider the mechanisms that drive anaphora resolution in Polish (p. 41 lines 965-969).

- Interpretation of the results of study 2. “Exploring the online interpretation of unambiguous sentences whose only possible interpretation either was or was not in line with the preference for interpretation of anaphorical sentences allowed us to determine whether these preferences are strictly bound to syntax-based rules or whether they can be modulated by the context of a given sentence.” (p. 28, l667-671). Based on the assumption that a syntax-based preference is more costly to change than a discourse-based preference, the authors conclude “we have shown that overt pronouns are much more sensitive than null pronouns to syntax-based determinants of the prominence of an antecedent. In contrast, null pronouns are more sensitive to discourse-related information as they are able to flexibly and effortlessly shift the reference, even against syntax-based cues.” (p. 31, l746-749). However, this assumption was not directly tested in the study (discourse-level factors were not manipulated and disentangled from syntactic cues). The authors’ rationale needs to be more documented and motivated by experimental and/or theoretical arguments. And the authors should consider other possible interpretations of the findings.

Response 1.9: Thank you for pointing out this problem to us. First of all, we fully agree that our design does not make it possible to test which factors (syntax-based or discourse-related) affect the interpretation of null and overt pronouns. To avoid possible confusion, we reformulated the discussion so it is centered around (1) the preferences for anaphora resolution in Polish, and (2) whether these preferences can be easily overridden whenever the morpho-syntactic structure of a sentence requires so. In other words, we now discuss our results on a more general level. At the same time, to avoid potential confusion, we decided to drop the distinction between syntax-based and discourse-related factors. Instead, we refer to two distinctions proposed in previous literature: (1) “hard” morpho-syntactic constraints (e.g. number, gender, person etc.) vs. “soft” constraints or heuristics (such as grammatical or thematic roles, syntactic function, coherence etc.), which were introduced and discussed by Kehler and Rhode (2013) (p. 10 lines 226-234); and (2) syntactico-semantic factors (subjecthood and grammatical roles, thematic roles, agentivity) vs. discourse-related factors (topicalization, focus, order of mention), which were introduced by Kaiser and Trueswell (2008) (p. 6 lines 111–126). This new approach to the discussion made it possible to discuss our results within the existing frameworks, extend our predictions and findings beyond the syntax-based constraint of subjecthood, as well as better define the “discourse-related” factors. All mentions of syntax-based cues throughout the text have been deleted or rephrased to be more specific:

In the case of the examples brought up in your comment, we made the following changes:

The fragment: “Exploring the online interpretation of unambiguous sentences whose only possible interpretation either was or was not in line with the preference for interpretation of anaphorical sentences allowed us to determine whether these preferences are strictly bound to syntax-based rules or whether they can be modulated by the context of a given sentence.”

was changed to: “Exploring the online interpretation of unambiguous pronouns whose only possible interpretation either was or was not in line with the preference for interpretation of anaphorical sentences allowed us to determine whether these preferences can be modulated by the context of a given sentence” (p. 40 lines 947-950).

The fragment: “we have shown that overt pronouns are much more sensitive than null pronouns to syntax-based determinants of the prominence of an antecedent. In contrast, null pronouns are more sensitive to discourse-related information as they are able to flexibly and effortlessly shift the reference, even against syntax-based cues.” was replaced by: “Our results indicate that in Polish syntactico-semantic cues such as subjecthood and information structure (i.e., order of mention but also a typical topicality) are the dominant constraints of the prominence of an antecedent; however, they can be overridden by additional cues whenever this is justified by the coherence of discourse representation.” (p. 45 lines 1083-1086).

Minor points:

- p. 5, l103. The following order seems more logical: “(i.e. null, overt pronouns, stressed, etc.)”

Response 1.10: Thank you. The text has been updated according to your suggestions.

- The authors are missing for the reference (14).

Response 1.11: Thank you for spotting this. It has been fixed (in the current version it’s the reference number 28).

References

Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390 412. https://doi.org/10.1016/j.jml.2007.12.005

Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing : Keep it maximal. Journal of Memory and Language, 68(3), 255 278.

Roberts, L., Gullberg, M., & Indefrey, P. (2008). On-line pronoun resolution in L2 discourse: L1 influence and general learner effects. Studies in Second Language Acquisition, 30, 333–357. https://doi.org/10.1017/S0272263108080480

###################

Reviewer #2: In this paper the authors report two experiments testing the resolution preferences for null and overt pronouns in Polish. Adopting the Position of Antecedent hypothesis, and based on previous studies of anaphora resolution for null and overt pronouns in Italian and Spanish, the authors predict that null pronouns should refer to the subject of the previous (main) clause, and that overt pronouns should refer to the object of the previous (main) clause. In a pronoun interpretation experiment, these predictions were borne out. Naturalness ratings indicated that sentences containing null pronouns were perceived as more natural than sentences containing overt pronouns. In an eye-tracking experiment, violations of these resolution preferences caused longer first-pass and total times in the verb region for the overt pronouns, but had no discernible effect on the null pronouns. The authors conclude that the resolution preferences are in line with the Position of Antecedent hypothesis, and that null pronouns are more flexible in their interpretation than overt pronouns.

I found this a well organised and well written paper with a clear structure. The experiments appear to have been carried out soundly, although some improvements could be made to the analysis (see below). Although brief, coverage of the previous literature was adequate, but the authors should add discussion of a more recent model for pronoun resolution (see below). The findings are quite modest and are reflected fairly in the discussion, it is good that the authors address a gap in the literature by testing pronoun resolution in Polish.

The major points that should be addressed relate to (i) literature coverage; (ii) data analysis; (iii) the interpretation relating to claims about syntax and/or use of terms relating to syntax.

(i) literature coverage

For a short paper, you covered most of the important theoretical background. But you should also include more recent work on pronoun resolution by Kehler and colleagues (e.g. Kehler et al 2008; Kehler and Rohde 2013) as this represents an important development in models of pronoun resolution.

Response 2.1: Thank you for drawing this work to our attention. A sub-section describing the coherence-driven approach in pronoun resolution proposed by Kehler et al. (2008) and Kehler and Rhode (2013) has been added to the Introduction (pp. 9-10, lines 211-234).

(ii) data analysis

ANOVA: results (especially from Experiment 1) are very clear and I don’t doubt them, but ANOVA has been replaced by linear mixed-effects models as the standard way to analyse psycholinguistic data of this type. This is because mixed models take better account of the random structure of the data, rather than averaging over items and participants. I think your analyses using ANOVA in experiments 1 and 2 should be replaced in order to conform to current standards (I don’t think that your interpretation will change much). If you are not familiar with this type of analysis, a good place to start is Cunnings (2012): An overview of mixed-effects statistical models for second-language researchers. https://journals.sagepub.com/doi/pdf/10.1177/0267658312443651

Response 2.2: We agree that this is a better approach to data analysis; thank you for motivating us to reanalyze our results using LMMs. We have reanalyzed our data using a linear mixed-effects model (in the case of Experiment 1, we used a generalized linear mixed-effect model because our dependent variable was binomial). The Results sections have been updated and additional tables providing summaries of the models have been added to provide a comprehensive overview of the results [Tables 3–6]. The analyses using LMMs yield the same pattern of results than the previously used ANOVAs in terms of the significance of the effects we tested.

Power analysis and effect sizes: please report effect sizes. Also, did you do a power analysis? It is good practice to do this in advance of an experiment. If you did, please report it. If not, please consider it for your next experiments; some journals are requesting this as standard.

Response 2.3: Unfortunately, we did not run a power analysis prior to our experiments. However, our sample size is already bigger than that of the study by Chamorro and colleagues (2016), which our study was based on (our study, n=36; Chamorro et al. (2016), n = 24).

As for the effect sizes, we calculated Cohen's d for each of the effects included in the mixed models (for Experiments 1 and 2). In the case of the naturalness rating analyses, since (following another comment by the Reviewer) we reanalyzed the data using the Bayesian approach, the coefficients of the Bayesian ordinal models that we now report in the text are equivalent to the effect size estimates. As such, we believe no additional estimates are needed.

Analysis of naturalness data: this type of data should not be analysed using raw scores. Z-scores are more appropriate (see Schütze and Sprouse 2014, Judgment Data, DOI: 10.1017/CBO9781139013734.004). Even better would be some kind of ordinal model analysis (see this recent paper: Veríssimo, Analysis of rating scales: A pervasive problem in bilingualism research and a solution with Bayesian ordinal models, on psyarxiv.com)

Response 2.4: We thank the Reviewer for bringing this issue to our attention. Following this comment, we decided to reanalyze the naturalness data for Experiments 1 and 2 using Bayesian ordinal models, similarly to the approach described in the suggested paper. Thank you for providing this great resource. The Results sub-sections that refer to the naturalness judgement analysis (p. 20, lines 469-485 and p. 34, lines 780-797) as well as the figures corresponding to the naturalness analysis of Experiment 1 (Fig 3) Experiment 2 (Fig 7) have been updated according to the new analysis. In the Methods section for Experiment 1, we have also included a Data Analysis subsection (pp.18-19, lines 433-449) to explain the details of our analytical approach; we have updated the Data Analysis section for Experiment 2 (p. 29, lines 699-709).

Reporting main effects: please state which direction the effects go in

Response 2.5: We added information to the text about the directions of all the main effects described in the Results sections.

(iii) syntax

I think this may just be a terminology issue, but I was confused by your claims about syntax and syntactic cues versus discourse/pragmatics. For instance, in lines 184-192, I really don’t understand the claim you are making here. Why should violation of syntactic cues lead to processing costs, but discourse violations not induce such costs? Is there any prior evidence to that effect? I would expect that a violation of a discourse-based expectation could induce processing costs just as much as a syntactic violation. But further, I don’t understand the distinction you are making between syntax and discourse/pragmatics. As I see it, pronouns are subject to certain syntactic rules in certain configurations, such as Condition B. But this is not what you test in the current study. You seem to equate syntax with a strong preference for a certain grammatical category. Could you clarify what you want to claim here? This issue recurs throughout the paper. For example, in lines 246-251: Previous studies have shown that… Are you making the claim that null pronouns are syntactically resolved and overt pronouns are influenced by non-syntactic factors? How can this be distinguished from discourse-based prominence? I’m not sure that there is such a strict distinction as you are trying to make. Similarly, lines 387-388: syntax-based determinants. Not sure what this is based on. And lines 698-700: overall I agree with the line of argumentation in the discussion, but I don’t agree that the preferences for the resolution of overt pronouns is necessarily best characterised as syntax-based. You can have more rigid interpretation preferences (see work on German demonstratives as an example) without invoking syntactic rules. In my view, not referring to the most prominent antecedent is not necessarily a rule of syntax. Even if you want to say something like “influenced by syntactic factors”, I don’t think you have the evidence here that this is just about grammatical role.

Response 2.6: Thank you for directing our attention to this problem. We agree that the distinction between syntax-based or discourse-related factors in pronoun resolution might have been confusing (and, in some cases, probably ungrounded). As this issue was also brought up by other Reviewers, we decided to omit this distinction. We have introduced two important changes in the text to better explain our interpretation of the factors that influence pronoun resolution in Polish:

1. Throughout the text we refer to two distinctions proposed in previous literature which describe factors influencing pronominal anaphora resolution: (1) “hard” morpho-syntactic constraints (e.g. number, gender, person etc.) vs. “soft” constraints or heuristics (such as grammatical or thematic roles, syntactic function, coherence etc.), which were introduced and discussed by Kehler and Rhode (2013) (p. 10 lines 227-234); (2) syntactico-semantic (subjecthood and grammatical roles, thematic roles, agentivity) vs. discourse-related (topicalization, focus, order of mention), which were introduced by Kaiser and Trueswell (2008) (p. 6 lines 111-126). We have also provided a short summary of previous findings which show that pronoun resolution can be modulated by a number of different factors (p. 6 lines 111–126). This allowed us to discuss our results within the existing frameworks, extend our predictions and findings beyond the syntax-based constraint of subjecthood, and better define the “discourse-related” factors. All mentions of syntax-based cues have been deleted or replaced by more specific formulations throughout the text.

2. We reformulated some claims so they are centered around (1) the preferences for anaphora resolution in Polish, and (2) whether these preferences can be easily overridden whenever the morpho-syntactic structure of a sentence requires so. In other words, we discuss our results on a more general level without making specific claims about the nature of the constraints on pronominal anaphora resolution. We attempt to discuss our results while taking into account various alternative explanations which have been proposed to influence the pronoun resolution process (p. 38 lines 900-906; p. 39 lines 908-913; p.41 lines 973-984, p. 42, lines 992-1000).

Line 723 onwards: adjustment of syntactically based assignment: again same issue as above

Response 2.7: We believe that the steps described in the response to your previous comments should have resolved this issue.

Other comments

The naturalness data in Exp 1 are interesting. They should be discussed/reflected on in more detail.

Response 2.8: We extended the analysis of naturalness by including the Antecedent factor (the preferred interpretation of an ambiguous sentence provided by a given subject) and its interaction with Pronoun (null vs. overt), as suggested by Reviewer #1. As such, we were able to compare the naturalness results for both Studies. To the Discussion section of our paper (pp. 37-38 lines 865-891), we have added a paragraph with a more in-depth summary, comparison and discussion of the naturalness scores from both Studies.

Summary of Exp 1 (lines 368-373): it looks like preferences for overt pronoun are actually stronger than for null pronouns. Would be good to test this statistically, and reflect on what this could mean.

Response 2.9: Our understanding is that this comment was driven by the difference between the preference for null and overt pronouns to refer to subject or object antecedents (Fig. 2). However, this Figure presents only the raw means but not the results of the statistical model. As the participants’ preference for sentence interpretation (i.e. subject or object) was a dependent variable in our analysis, we can only estimate the main effect of pronoun (i.e. null or overt). As such, our analysis allows us to determine whether Polish speakers interpret sentences with null and overt pronouns as systematically referring to different antecedents, but we cannot compare the strength of these preferences directly.

Also, what you refer to as natural here actually contradicts the naturalness data

Response 2.10: Following a suggestion from Reviewer #1, we decided not to refer to the preferences established in Study 1 as “natural”. We have adjusted the text so that now we discuss “preferences” and not “natural preferences”. We assume this comment was actually caused by imprecise terminology. We acknowledge that there are important differences between the preference for pronoun resolution and the naturalness analysis; in the revised version of our text, we discuss these discrepancies in more detail in the Discussion (pp. 33–39 lines 918-925) and in the context of the predictions for Study 2, which were based on the results of Study 1 (pp. 23–24 lines 566–571).

Processing slowdown for referring to the object: at least in the example in lines 464-475, the object conditions have a less natural scenario with respect to number: several teachers and one student. A prototypical scenario is one teacher and multiple students. Could this be behind the processing slowdown here, and the lower ratings? Are the other items like this too?

Response 2.11 Thank you for pointing out this important issue; it is indeed a very interesting question. Unfortunately, we did not control for the prototypicality of our stimuli; as data collection is now completed, there is nothing that could be changed to account for this issue at the level of the experimental design. However, to assess the possible scope of the problem, we attempted to classify our sentences as prototypical or not post hoc: we found that 7 out of 32 stimuli might be considered as describing a (more or less) prototypical situation. In 4 of these stimuli, there should prototypically be one subject antecedent; in 3 stimuli, there should prototypically be one object antecedent. While we agree that prototypicality could influence naturalness ratings and sentence processing itself, as there are only a few prototypical sentences in our dataset it is impossible to statistically test this and get meaningful results. For the same reason, we think it is reasonable to assume that prototypicality did not confound the results of our experiment to a degree which would impede our inference related to the pronoun-antecedent manipulation. As such, even though we did not (and at this point we are not able to) control for the prototypicality of our stimuli, we believe they still contribute valuable results to the existing literature. A complete list of experimental stimuli can be found in Appendix A (also posted on osf).

Shifting reference expectations/updating discourse expectations has shown to have effects in ERP (Schumacher et al 2015, Backward and Forward Looking Potential of Anaphors), similar to the object processing cost you discuss at the end of the paper.

Response 2.12: Thank you for providing this very useful reference! We added a discussion of the findings of this study to our text (pp. 44-45 lines 1056-1071).

Minor issues

Page 3 line 39: denominate —> denote

Response 2.13: This has been updated in the text.

Lines 64-65: it is not the information about the referent of a pronoun that is morphologically encoded in the verb. It is the gender and number of the predicate’s subject. Similarly, in line 71, it is not clear what you mean here by mismatch between a pronoun and a verb.

Response 2.14: We have provided an additional explanation to account for these problems. In the first case mentioned in your comment, the previous formulation (“[...] information about the referent of a pronoun is morphologically encoded into the verb form”) has been changed to: “[...] information about the gender and number of the predicate’s referent of a pronoun is morphologically encoded into the verb form” (p. 4, lines 71-73). In the second case, we provided an additional explanation of what a mismatch between a pronoun and a verb refers to: “that whenever a mismatch between a pronoun and a verb occurs (i.e. the pronoun refers to a less-preferred, non-topical or unexpected antecedent), the speaker needs to adjust the interpretation of the sentence and reidentify the referent of the anaphorical expression” (p. 4 line 80-82).

Example lines 66-67 needs a gloss

Response 2.15: A gloss has been added to all examples in Polish (including the examples of experimental sentences for Study 1 and examples from the Introduction).

Line 232: referent of a verb —> subject of a verb

Response 2.16: We respectfully disagree with this suggestion because in this particular case we do not assume that the referent of a verb would always be in the syntactic position of a subject. As we use the term “subject” to refer to the syntactic position within a sentence, we would not like to confuse the reader.

Fig 2: labels object-match and subject match are odd because they don’t relate to the experimental set up. Simply subject and object?

Response 2.17: The labels of Fig 2 were changed following your suggestion.

Lines 389-390: there are a lot of studies that have used eye-tracking to look at pronoun resolution, should refer to these.

Response 2.18: Thank you for pointing this out. A short review of the previous eye-tracking studies has been added to the text (p. 22, lines 522-528).

Line 382: higher fixation times: this is a prediction relating to a specific measure (fixation times), but you actually tested first-pass, go-past and total times which are more than simply fixation times.

Response 2.19: The prior formulation (“ [...] this cost should be reflected in higher fixation times in the critical region [...]”) was changed according to your suggestion (“[...] this cost should be reflected in longer reading times (measured by first-pass time, go-past and total-time) in the critical region [...]”, p. 21, line 512).

Line 404: total time is a cumulative, not a late measure (captures both early and late processes).

Response 2.20: The prior formulation (“This allowed us to interpret the processes engaged in sentence interpretation, which range from early (captured by the first-pass time) to late(captured by total time) measures [...]”) has been changed according to your suggestion (“This allowed us to interpret the processes engaged in sentence interpretation, which range from early (captured by the first-pass time) to cumulative (captured by total time) measures [...]”, p.23, lines 542-543).

Around line 415: I think I get what you mean in the predictions for the naturalness ratings, but you need to spell it out more clearly (what you mean by natural here).

Response 2.21: A more detailed explanation of the predictions has been added to the text. We modified the paragraph so that it would be clear that any assertions regarding the naturalness of a particular kind of sentence refers to our empirical data (i.e. natural = what was rated as most natural by the participants of Experiment 1):

“We expected the results of the naturalness rating to reflect the online anaphora resolution bias. Specifically, we expected that null pronoun sentences would obtain higher naturalness scores than overt pronoun sentences, and sentences following the preference for anaphora resolution (i.e., a null pronoun referring to the most-prominent antecedent and an overt pronoun referring to a less-prominent antecedent) would obtain higher scores than those violating it.” (p. 24, lines 577-582)

Condition examples (lines 464-475): need a gloss

Response 2.22: A gloss has been added to all examples in Polish (including the experimental sentence examples for Study 1 and an example from the Introduction).

Line 565, figure 4A caption is incorrect - not pronoun + verb (no pronoun because null)

Response 2.23: Indeed, the caption was incorrect. Thank you for spotting the mistake. We changed the previous formulation (pronoun + verb) to (Ø + verb). “Ø” is already used to refer to a null pronoun when examples of the sentences in the four experimental conditions of Study 1 and Study 2 are introduced (p. 17 lines 409-410, pp. 26-27 lines 634-643).

Line 635: syntactic position of an object —> syntactic position of a subject

Response 2.24: This has been corrected in the text.

##################

Reviewer #3:

In my opinion, the present study presents several strong points: First, it is a close replication of a previous study (both in terms of tasks and materials); second, it adds a (Slavic) language to the repertoire of languages that have been studied in the pronoun resolution literature; third, the reported results confirm a well-known bias previously attested in other languages.

My concern regarding this article, as I explain just below, has to do with the fact that the literature review and parts of the discussion section are rather superficial (in particular when it comes to the discussion of the factors that play a role in pronoun resolution).

The present study replicates a previous study on the pronoun resolution preferences in Spanish (Chamorro et al., 2015). The authors of the present study set out to investigate the interpretation strategies for null and overt subject pronouns in another null-subject language, namely Polish. In order to do so, they make use of two experimental tasks, an offline sentence-interpretation task, where participants had to decide on the referent of an ambiguous pronoun and subsequently rate the naturalness of the sentence, and an online eye-tracking during reading task where participants read sentences, which they also had to rate for their naturalness afterwards. The main findings of the study are the following:

• Offline experiment: Polish speakers prefer to interpret the null pronoun as co-referential with the subject antecedent, and the overt pronoun as co-referential with the object antecedent.

• Online experiment:

Finding #1: the interpretation of a null pronoun is not disrupted by a violation of its natural preference (for the subject antecedent); however, the interpretation of the overt pronoun is disrupted when it is forced to co-refer with the subject antecedent.

Finding #2: the sentences where the (null/overt) pronoun refers to the antecedent in the object position incur an additional processing cost as compared with the sentences where the pronoun refers to the subject antecedent.

In my opinion, the present study presents several strong points: First, it is a close replication of a previous study (both in terms of tasks and materials); second, it adds a (Slavic) language to the repertoire of languages that have been studied in the pronoun resolution literature; third, the reported results confirm a well-known bias previously attested in other languages.

My concern regarding this article, as I explain just below, has to do with the fact that the literature review and parts of the discussion section are rather superficial (in particular when it comes to the discussion of the factors that play a role in pronoun resolution).

My recommendation is that the article is accepted after some revisions have been made.

These revisions have mainly to do with the discussion of the linguistic factors that play a role in pronoun resolution in the literature review and in the discussion/conclusion sections. The authors discuss in certain detail the issue of antecedent prominence as being crucial in pronoun resolution and, in relation to this, they discuss the syntactic function/position of the subject as being an important contributor of this prominence (this is reinforced by the discussion of Carminati’s Position of Antecedent Hypothesis and the related psycholinguistic findings on languages such as Italian and Spanish). However, the discussion stops there. No mention of other potential crucial factors (e.g. topicality, thematic role, order of mention, etc.) is to be found. The authors do evoke multiple times discourse-pragmatic factors (see the non-exhaustive list below of the sections where this comes up) but they never give examples of any of these factors nor do they discuss any previous studies that investigated them.

Response 3.1: Thank you for your comment. Indeed, we fully acknowledge that our discussion of results was limited to the PAS framework (and generally to theories that propose syntactic preferences, especially subjecthood, as a dominant constraint on pronominal anaphora resolution). We agree that omission of other accounts and factors was a serious shortcoming of our argumentation, so we undertook several steps to fix this problem:

1. We added a paragraph to the Introduction (p. 6 lines 111-126) describing different factors that have been shown to influence anaphora resolution (such as grammatical roles, order of mention, agentivity, topicality, focus, information structure and discourse coherence). We also included this information when discussing previous experimental evidence on anaphora resolution (p. 11, lines 248-255). We discussed how alternative accounts to PAS would translate into predictions for Study 1 (p. 16 lines 370-377) and we considered them when discussing the results of Study 1 and Study 2 (pp. 38-39 lines 900-915).

2. Moreover, following the suggestions of Reviewer #2 regarding the review of the previous literature, we discuss Kehler and Rhode’s recent theory of pronominal anaphora resolution. This was proposed as a reconciliation of coherence-driven and centering-driven approaches (2013) (pp. 9-10 lines 211-234) and it differentiates between “hard” morpho-syntactic constraints of pronoun reference (such as gender, number, person etc.) and “soft” constraints (such as grammatical or thematic roles, syntactic function, coherence etc.). The discussion of our result also reflects this proposal (p.41, lines 976-980; p. 43 lines 1012-1016).

3. To better explain what discourse-related factors refer to, we made several adjustments throughout the text. We now refer to two distinctions proposed in previous literature which describe factors that influence pronominal anaphora resolution: (1) “hard” morpho-syntactic constraints (e.g. number, gender, person etc.) vs. “soft” constraints or heuristics (such as grammatical or thematic roles, syntactic function, coherence etc.), which were introduced and discussed by Kehler and Rhode (2013) (pp. 9–10 lines 211–234); (2) syntactico-semantic factors (subjecthood and grammatical roles, thematic roles, agentivity) vs. discourse-related factors (topicalization, focus, order of mention), which were introduced by Kaiser and Trueswell (2008) (p. 6 lines 111-126). This allowed us to discuss our results within the existing frameworks, extend our predictions and findings beyond the syntax-based constraint of subjecthood, as well as better define the “discourse-related” factors. All mentions of syntax-based cues have been changed accordingly throughout the text

The discussion of these additional factors is paramount in order to be able to better account for the present findings. This seems to be the case regarding the finding that the sentences where a (null/overt) pronoun refers to the antecedent in the object position incur an additional processing cost compared with the sentences where the pronoun refers to the subject antecedent, which the authors account in the following terms: “This suggests that Polish speakers interpret sentences under the working assumption that they refer to the most prominent subject antecedent” (p. 27, line 640-645). What we see in this case (i.e. in the object conditions) is a shift in the sentence topic from the main clause to the subordinate clause. This dispreference for a topic-shift intra-sententially has also been attested in other languages, such as French, German, and Spanish (see Colonna et al., 2012, 2015; de la Fuente, 2016; Patterson & Felser, 2020). The notion of (sentence) topic and these previous findings need to be discussed in the paper.

Response 3.2: Thank you very much for pointing out these very valuable references. We added a fragment to the General Discussion in which we discuss our results in the light of anti-focus effects (pp. 44-45 lines 1056-1063). Additionally, a mention of the early and late stages of the pronoun resolution process that was discussed by Patterson & Felser (2020) has been included in our Discussion (p. 44, lines 1041-1044). Following other comments from all the Reviewers, to the Introduction (p. 6, l. 119–121) we added a more in-depth discussion of factors which can influence the anaphora resolution process, including topicality and focus. Mentions of topicality as an important cue of antecedents’ prominence appear throughout the entire text.

To account for the information presented in the discussion of anti-focus results in the context of our study, the sentence quoted in the current comment was rephrased to the following (no additional explanation has been added as a discussion of the anti-focus effect appears later in the same paragraph):

“This suggests that Polish speakers interpret sentences under the working assumption that the topic of a sentence is the most-prominent, first-mentioned, subject antecedent” (p. 37 lines 858-860).

My second (more general) remark concerns the choice of manipulation regarding the disambiguating part of the experimental sentences in the online experiment, namely the agreement between the subject of the main clause and the verb of the subordinate clause (a manipulation also used by Chamorro et al. 2015 in their experiment in Spanish). The pronoun resolution strategies commonly observed in the literature (null pronoun refers to a subject antecedent, overt pronoun refers to an object antecedent) remain preferences which can be easily overridden by other factors (this could indeed explain why there is certain variability in the literature regarding the resolution preference for Spanish null and overt pronouns, for example). Morpho-syntactic cues such as gender and number agreement between pronoun and antecedent and subject-verb agreement are examples of such strong cues which can override the role of other factors in pronoun resolution (like the position of the antecedent). That is why the differences between conditions 1 and 2, on the one hand, and conditions 3 and 4, on the other hand, are not always robust.

Response 3.3: We fully acknowledge the Reviewer's concern and agree with the remark regarding some problematic aspects of the used manipulation. Since our aim was to replicate as closely as possible the initial study by Charomorro, we used methodology that was as similar as possible. Since data collection is already completed, there is nothing that can be changed in the design at this point. In future research, we will certainly take this remark into account when exploring new avenues of research on pronoun resolution in Polish. Still, despite the fact that our study is certainly not free of limitations, we believe it contributes to the body of knowledge on pronoun resolution mechanisms in different languages.

We hope that the concerns raised by the Reviewer can – as much as is possible at this stage – be addressed by including an additional explanation of the role of “hard” morpho-syntactic cues (i.e. subject-verb agreement) and the “soft” cues that can override the syntactically-based preferences in pronoun resolution. These additional explanations are mainly related to a discussion of the additional theoretical account by Kehler and Rhode (2013), which was suggested by Reviewer #2 (R2.1) (pp. 9–10 lines 211-234).

In relation to this, I was not very surprised to read that the interpretation of a null pronoun is not disrupted by a violation of its natural preference (for the subject antecedent); however, the interpretation of the overt pronoun is disrupted when it is forced to co-refer with the subject antecedent (contrary to what was previously found in the literature). For me, there is a difference in terms of acceptability between the two “less-natural” conditions 1 and 4: Condition 1 (overt pronoun/subject match) seems a lot less natural than condition 4 (null pronoun/object match). This has to do, on the one hand, with what I described in the paragraph above regarding subject-verb agreement and, on the other hand, with the fact that the overt pronoun is a lot more (pragmatically) marked and not always pragmatically felicitous in short decontextualized sentences.

Mention of syntax vs. pragmatic/discourse factors:

(p. 2) “Overall, in the Polish language, interpretation of a null pronoun seems to be more sensitive to pragmatic cues of reference than syntactic cues of reference, while resolution of overt pronouns relies strongly on syntax-based cues.”

Response 3.4: Following the reformulation of the text such that it would not be based on syntax-based vs. pragmatic factors, this sentence has been deleted from the abstract.

(p. 3) “their reference relies not only on the rigid rules of the syntax of a given language but is also sensitive to pragmatic and contextual factors”

Response 3.5: This fragment has been replaced with the following more general statement: “As a consequence, pronouns are inherently ambiguous: their reference depends on a range of different constraints, including morpho-syntactic, semantic and discourse-related cues”

(p. 3) “the mechanisms of anaphora resolution can be sensitive to syntactic and also pragmatic or contextual factors”

Response 3.6: This fragment has been replaced by the following: “The mechanism of anaphora resolution can be influenced by a range of factors which affect different stages of pronoun interpretation: from syntactico-semantic processing to constructing mental representations of discourse.”

(p. 4) (discourse-oriented language) “other sources of information such as discourse and context become much more important for the correct resolution of an anaphoric expression”

Response 3.7: In this case, the reference to discourse as a source of cues that drive the anaphora-resolution process is a reference to the paper by Kwon and Sturt (2013), to which we refer when introducing sentence-oriented and discourse-oriented languages: “in so-called discourse-oriented languages without such a verbal agreement system, like Japanese, Korean, and Chinese, discourse may play a stronger role.” (Kwon & Sturt 2013, p. 379). As such, we would like to retain the original terminology; however, following your comment, we have attempted to propose a rewording of the fragment in question. As we previously mentioned, we have also included a more extensive explanation of what discourse-related cues of reference are in a further part of the text (p. 6, lines 119-126).

The fragment in question and the sentence directly preceding it have been replaced with the following: “In contrast to sentence-oriented languages, discourse-oriented languages which do not have a verbal agreement system, such as Japanese, Chinese or Korean, rely much less (or not at all) on morpho-syntactic constraints (4). Therefore, other cues of reference that are derived from discourse become much more important for the correct resolution of an anaphoric expression (3,4).” (pp. 4–5, l. 83–87).

(p. 6) “differences between languages that are driven by language-specific, syntax-based, pragmatic constraints”

Response 3.8: This fragment has been replaced with the following: “differences between languages that are driven by language-specific sensitivity to different constraints on pronoun resolution”

(p. 10, line 216) “stem from divergent sensitivity of null and overt pronouns to syntactic and discourse-related or context-related determinants of the prominence of an antecedent”

R3.9 Response: This fragment has been replaced by the following: “[...] stem from the divergent sensitivity of null and overt pronouns to cues of prominence of antecedents which can be driven by syntactico-semantic or discourse-related constraints”.

Even though our reformulation does not dispose of the problematic distinction but replaces it with another (i.e. syntactico-semantic vs. discourse-related constraints), we believe that after providing a more elaborate explanation of what factors have been shown to affect the anaphora-resolution process (e.g. subjecthood, topicality, agentivity etc.) and explaining the distinction between syntactico-semantic and discourse-related factors (p. 6 lines 111-126), it should be clear to the reader what we refer to here.

(p. 11, line 251) “can be prone to the influence of other non-syntactic factors. These factors…”

Response 3.10: This fragment has been replaced with: “[...] can be prone to the influence of other cues of prominence of the antecedent. These factors [...]”

(p. 16, line 387-388) “we should be able to assess the sensitivity of null and overt pronouns to the syntax-based determinants of the prominence of an antecedent”

Response 3.11: As a consequence of modifications introduced to address another Reviewer’s comment, this fragment was deleted.

(p. 17, line 398-399) “can provide information on the sensitivity of pronouns to different types of prominence cues”

Response 3.12: This fragment was deleted following the suggestions of the Reviewers who pointed out that our design did not make it possible to test the sensitivity of pronouns to different cues of prominence. As we fully agree with this point, we have changed the narration to avoid any misleading claims which might suggest that we tested the sensitivity of pronouns to different types of prominence cues.

(p. 29, line 708-710) “relies on both syntactic and contextual factors”[…] “can be modulated by pragmatic and contextual cues”

R3.13 Response: This fragment has been replaced (following a broader change to our narration) with the following: “So far, we have argued that subjecthood, order of mention and automatic assignment of topicality to the subject-antecedent are the dominant constraints on anaphora resolution in Polish, which in some cases can be overridden to better accommodate a current representation of discourse.”

(p. 8-9) “Whenever a violation of a preferred pronoun-antecedent match incurs additional processing cost, this indicates that the speaker is using a syntactic cue (i.e. the antecedent’s syntactic position within a sentence) to identify the referent of an anaphorical pronoun. On the other hand, if violating the speaker’s preference does not lead to additional processing cost, a speaker likely uses non-syntactic cues to define the prominence of an antecedent (i.e. context-related or discourse-related information) to interpret the anaphorical pronoun.”

R3.14 Response: This fragment was deleted following comments from all the Reviewers, who pointed out that, based on our design and the existing literature, we do not have a basis for this claim. We agree with this, so we decided to remove this paragraph from the predictions and instead elaborate more on possible factors driving the anaphora resolution mechanism in Polish in the Discussion (see pp. 38–39 lines 900-915).

• What context-related or discourse-related information? It seems that “discourse” and “contextual” are used as synonymous terms in certain sections of the paper, and as two different things in other (e.g. on page 28, the use of the term “context-dependent information” seems to refer to the information on subject-verb agreement).

Response 3.15: This is true. We agree that we were not very clear about what discourse-related information is and how it relates to context (and we have in fact used these two terms as synonyms in several instances). We have added an explanation of what discourse-related factors mean (p. 6 lines 119–126), and we avoid mentions of “context-dependent information” throughout the text to avoid confusion. As for the example that you mention (p. 28), we deleted the sentence mentioning “context-dependent information” as, after introducing other changes suggested by all the Reviewers, this fragment was unnecessary and unclear.

• Are there previous findings that show this clear-cut tendency? Is this related to the findings for Italian and Spanish by Filiaci and colleagues? Because there is crosslinguistic variation there and even variation within the same language (Spanish) if we take into account the results by Chamorro and colleagues.

Response 3.16: As mentioned in the response to the general comment, we acknowledge we have no grounds for making these kinds of claims, therefore we have deleted the problematic fragment and we discuss the possible factors that might influence pronoun resolution without making such strong categorical distinctions.

• (p. 10, line 213) “the available empirical evidence demonstrates that the preference for anaphora resolution seems to be more universal for null pronouns” > taken into account the two languages under discussion in the literature review, this is not so clear cut, right? It seems to be the case for Italian, for not so much for Spanish.

Response 3.17: Thank you for bringing this part to our attention. In the context of the paragraph it was located in, it might have been easy to misinterpret as this particular claim actually refers to only one of the discussed experiments, namely that of Filiaci et al. (2014). What we meant to say was that, despite the differences between the two experiments testing pronouns’ sensitivity to violation of their preferences (that might be due, e.g., to the experimental stimuli used), the differences in pronoun resolution strategies between the two languages only emerge for overt pronouns, not null pronouns.

We have rephrased the preceding paragraph as well as the conclusion (from which the statement you brought up in your comment was taken) to clarify what we mean (p.12 lines 287-302):

“However, no differences in the sensitivity of null and overt pronouns to the violation of their preferences was observed for Spanish. Differences in whether the processing penalty is observed for sentences with null or overt pronouns referring to their less-preferred antecedents can be accounted for by differences in the design between the studies by Chamorro and colleagues and Filiaci and colleagues (in particular, by the clause order: the stimuli in Chamorro and colleagues’ study (21) followed the Main-Subordinate order, while in Filiaci and colleagues’ study (5) the order was Subordinate-Main. For further discussion, see Discussion). Interestingly, despite the discrepancies between the results of these two experiments, the results of the experiment by Filiaci and colleagues (5) demonstrate that a preference for null pronoun resolution is similar for Italian and Spanish, while differences emerge for overt pronouns.

To conclude, the cross-linguistic differences in anaphora resolution might stem from the divergent sensitivity of null and overt pronouns to cues of prominence of antecedents, which can be driven by syntactico-semantic or discourse-related constraints (1,24)”

Other comments

(p. 4) sentence-oriented languages (e.g. Italian, Polish, Spanish) rely on morpho-syntactic cues (subject-verb agreement) to establish the referent of an anaphorical expression. > Nothing about sentence vs. discourse oriented languages in the discussion (does Polish behave like a hybrid (sentence-oriented for null pronouns) but discourse-oriented for overt pronouns)?

Response 3.18: The distinction between sentence-oriented and discourse-related subjects is mainly based on the morphological characteristics of a language, namely whether it has a subject-verb agreement or not (i.e., whether a pronoun can be resolved based on the morphological characteristics of a verb). As such, Polish is an inherently sentence-oriented language. We introduced the distinction between sentence-oriented and discourse-oriented languages at the beginning of the discussion to draw attention to the variety of different cues that different languages use to establish the reference of a pronoun. However, we acknowledge that introducing this distinction needs addressing in further parts of the text, so we have added the following information:

Introduction of the coherence-driven approach to pronoun resolution:

“Their theory differentiates between “hard” constraints of reference, which in the case of sentence-oriented languages relate to the morpho-syntactic features that determine the subject-verb agreement (such as gender, number, person etc.) […]” (p.10, lines 227-230)

Discussion:

“The results of both reported studies suggest that subjecthood and information structure (i.e., order of mention but also topicality and thematic roles) are dominant constraints for pronoun resolution in Polish” (p. 39 lines 911-913).

(p. 3) The assertion that the pronoun she and the noun Mary in When Mary crossed the street, she looked back at the monument “denominate one and the same person” is misleading. Strictly speaking, she can also refer to somebody else other than Mary here.

Response 3.19: Yes, we agree that “she” could also refer to somebody else, but for the sake of the example we present we’d like to keep it simple and not include additional explanations of other referential possibilities in the text. However, we have rephrased this fragment so that it does not make such a strong claim:

“the reader needs to know that “she” in the second clause refers to “Mary” in the first clause and both words are supposed to denote one and the same person”

(p. 4, 14, 20) Given the rich morphology of the language, the examples in Polish should also include a gloss in English.

Response 3.20: A gloss has been added to all examples in Polish.

(p. 5, line 90) “on the other hand, less-reduced expression, like those containing an overt pronoun” > “on the other hand, less-reduced expression, like an overt pronoun”

Response 3.21: Thank you. The suggested change has been introduced in the text.

(p. 14, line 338-340) Did the filler items also feature null and overt pronouns? If so, I’m not sure I’m very comfortable with the fact that the filler items also included the critical (null vs. overt pronoun) manipulation.

Response 3.22: Filler items did not include the critical manipulation, even though they included null and overt pronouns. The filler sentences are similar to the experimental sentences only in terms of length and the fact that they are composed of Main and Subordinate clauses (but not necessarily in the Main-Subordinate order, as in the case of the experimental sentences). As Polish is a pro-drop language, null pronouns appeared in most of the sentences (as pronouns are usually skipped before verbs). In some sentences, we also used overt pronouns, but they were either non-anaphoric (e.g., “On zgodził się, że powieści Sienkiewicza nie są ciekawą lekturą dla nastolatków.” – He (overt pronoun) agreed that the novels by Sienkiewicz are not an interesting read for teenagers) or they were unambiguous. Crucially, there were no sentences in which null or overt pronouns were forced to refer to a less-preferred antecedent.

If this was the case, I was also wondering whether the filler items also contained the same proportions of null and overt pronouns. This is an important point, as it was been previously shown that the varying proportions of the type of pronoun present in the experiment has a direct impact on the participants’ resolution preference (cf. Fernandes et al. 2018).

Response 3.23: Thank you for pointing out this important work that shows adaptation effects. We did not take it into account when designing our experiment and the filler items; as the data collection is already concluded, there is not much we can do about the stimuli choice; however, we believe that adaptation effects might not be very problematic in the case of our study. As we pointed out in the previous comment, due to the characteristics of Polish, overt pronouns are much less common than null pronouns. As such, overt pronouns appear in the filler sentences less often than null pronouns; however, they were never used in an ambiguous way, they were not anaphoric pronouns, and they were never forced to refer to less-preferred antecedents. Moreover, the structure of the filler sentences was different from that of the experimental sentences (see the examples below). We believe that this might be an important point as the effect of adaptation in pronoun resolution that was shown in the study by Fernandes et al. (2018) was reported based on an experiment which used a set of sentences of identical structure (subject – verb – object – conjunction “when” – pronoun (null or overt) – verbs – complement). As such, it might be possible that it is driven at least to some extent by syntactic priming, similarly to grammatical parallelism bias (Smyth, 1994). As such, using filler sentences with different grammatical structures might actually reduce the adaptation effect.

A couple of examples of filler items that we used in our study (overt pronouns are marked with *):

1. Ona lubi malować wieczorami, podczas gdy on gra na gitarze i śpiewa.

She* likes to paint in the evenings while he* plays the guitar and sings.

2. Oni muszą skończyć remont, zanim wyprowadzą się z tego mieszkania do nowego domu.

They* need to finish the renovation before they move from this flat to a new house.

3. Podczas gdy oni podróżowali po Afryce, ich kuzynka urodziła śliczne bliźnięta.

While they* were travelling in Africa, their* cousin had lovely twins.

4. Pingwiny często gromadzą się blisko siebie, żeby było im cieplej.

Penguins often gather close together so that they are warmer.

I’m also little concerned about the use of the different conjunctions for the filler sentences. We know from previous literature (the works by Kehler and Rhode, de la Fuente et al. 2016), that the kinds of coherence relations that these types of conjunctions establish between main and subordinate clause, have an impact on pronoun resolution. I wonder to what extent the filler items also influenced the resolution preference of the experimental items here.

Response 3.24: This is a very interesting question, especially in light of the adaptation account discussed in the previous comment. However, due to the variability in the conjunctions and the structure of the filler sentences, we are not able to statistically estimate this effect based on our data. In the case of our experimental stimuli, the decision to use a range of different conjunctions and grammatical structures in the filler sentences was driven by the fact that we based our design on the study by Chamorro et al (2016); as such, we attempted to closely follow their solutions. However, as pointed out in the previous comment, our filler sentences did not exactly follow the same grammatical structure as the experimental stimuli; as such, the biases in pronoun interpretation induced by the use of different conjunctions should not have primed the pronoun resolution preferences in the experimental sentences (or, at least, there should not have been a simple syntactic priming between the filler and experimental sentences).

(p. 15, line 344) “was modulated by the use of a pronoun” > “was modulated by the nature of the pronoun”

Response 3.25: Thank you. The suggested change has been introduced in the text.

(p. 15, line 364-365) “which indicates that native Polish speakers find null pronoun sentences more natural than overt pronoun sentences” > This sounds a little too general. A better formulation would be “which indicates that native Polish speakers find the null pronoun condition more natural than the overt pronoun conditions” or “which indicates that native Polish speakers find the sentences containing a null pronoun more natural than those containing an overt pronoun”

Response 3.26: Thank you. The suggested change (the second reformulation that was proposed in your comment) has been introduced in the text.

(p. 17, line 406-412) Why would this be your prediction? As you said previously, the preference of the null pronoun for a subject antecedent seems to be more robust according to previous findings. The findings of Chamorro et al. are rather exceptional in that respect. Shouldn’t you then expect the opposite (i.e. that null pronouns are more sensitive to violations of the syntax-based bias)?

Response 3.27: Thank you for raising this issue. A similar comment was also made by Reviewer #1 (R1.6). We agree that the reason why we would make this prediction is not straightforward. We provided a more in-depth explanation in the text that refers to the results of the naturalness judgement task from Study 1 (pp. 23-24, lines 546-571). In the General Discussion (pp. 41-42, lines 1000-1016), we also address this issue with respect to experiments that show a contradictory pattern of results.

(p. 20, line 476-480) It is not clear to me whether there were 8 experimental items (in the 4 experimental conditions = 32 experimental sentences in total = 4 lists each with 8 experimental items and 64 filler items) or 32 experimental items (in the four experimental conditions = 128 experimental sentences in total = 4 lists each with 32 experimental items and 64 filler items).

Response 3.28: Thank you for drawing our attention to this ambiguity. We have updated the description of the experimental lists in the text in the following way to make it clearer:

“[...] four different experimental lists of 32 sentences were created. Each list contained eight sentences corresponding to each of the four conditions (i.e., 8 sentences in Condition 1, 2, 3 and 4). Additionally, 64 filler sentences were created and added to the experimental lists. They contained different grammatical structures, inanimate referents, proper names and plural pronouns. Each of the lists contained the same 64 filler sentences. In total, each experimental list contained 96 sentences (32 experimental + 64 filler sentences).” (p. 27, lines 643-650)

(p. 21, line 509) Strictly speaking, the go-past measure is more of a “hybrid” measure that reflects both early and late processes.

Response 3.29: Thank you for pointing this out. We have changed the text according to your suggestions by replacing the previous formulation: “The first two measures are presumed to be sensitive to processes that occur relatively early in sentence comprehension” to the following: “First-pass time is presumed to be sensitive to processes that occur relatively early in sentence comprehension” (p. 28 lines 737–738) and adding a sentence explaining the go-past measure: “Go-past time is a hybrid measure that is sensitive to both early and late processes in sentence comprehension” (p. 28, lines 743–745).

(p. 26, summary and general discussion sections) The authors use multiple times formulations such as “processing sentences which do not refer to the most prominent antecedent” or “sentences referring to an antecedent in the object position always incur…” This sounds a little weird. Strictly speaking, it is the pronoun that refers to one or another antecedent not the sentence. A better formulation can be “sentences in which the (null/overt) pronoun refers to…”.

Response 3.30: Thank you for spotting this problem and suggesting a solution. We have corrected all occurrences of the problematic formulation in the Summary and General Discussion.

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 1

Claudia Felser

22 Sep 2021

PONE-D-21-12740R1Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.PLOS ONE

Dear Dr. Wolna,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Your revised manuscript was sent to two of the original reviewers for re-evaluation. Although both are happy with the way you have addressed their initial concerns, they both list a number of minor points which should be addressed in the final version of your manuscript.

Please submit your revised manuscript by Nov 06 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Claudia Felser, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Please also reword any unclear, misleading, or stylistically convoluted passages in your manuscript. Examples of these can already be found in your abstract:

"cues of reference" - odd wording

"an ambiguous sentence interpretation task" - this phrase is itself ambiguous

"First, in an ambiguous sentence interpretation task, we explored the natural biases that occur during the interpretation of null or overt pronouns." - What is meant by "natural" here (are there also unnatural biases)? Also, if this was an offline task, how can it possibly explore biases *during* interpretation?

"antecedents which are in the syntactic position of a subject or an object" - Why not simply say "subject or object antecedents"?

Please carefully check the remainder of your manuscript for further such instances and amend these. Reviewer #1 makes several helpful suggestions in this regard.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I was reviewer 1 on a previous draft of this manuscript. My previous major concerns have been addressed satisfactorily, and I do not have any large objections, though I do have some comments on this revised version and some additional minor suggestions.

Comments:

- p. 9, l. 191-197: “For example, in the case of overt pronoun interpretation in Italian and Spanish, the increased processing cost resulting from forcing a shift of reference from the syntactic subject of a sentence (which is also the first-mentioned referent) to the syntactic object is observed for Italian but not for Spanish. Within the Form-Specific Multiple-Constraint Approach, this cross-linguistic difference can be explained by referring to the different sensitivity of pronouns to syntactico-semantic cues in both these languages: in Italian, pronoun resolution seems to rely more heavily on this type of cue than in Spanish.” But why are Italian overt pronouns more sensitive to syntactico-semantic cues than Spanish overt pronouns? “differences in pronouns’ reference resolution do not necessarily need to be associated with typological differences between languages” (l.186-187): this seems to be the case instead if the cross-linguistic difference in overt pronouns interpretation depends of the different sensitivity of overt pronouns in Italian and in Spanish. “differences between sentence-oriented and discourse-oriented languages can be accounted for by referring to the much higher sensitivity of pronouns to the informational structure of discourse in discourse-oriented languages than in sentence-oriented languages.”(l. 198-200): Here again, typological differences between languages are seen to be responsible for cross-linguistics differences in pronoun interpretation.

- Thematic roles are defined as the semantic roles (agent, patient,…) (see p. 6, l. 109-111). However, further on in the text, I do not understand the formulations: “the role of the thematic topic” (p. 40, l. 945) “and the thematic role of a topic” (p.41, l. 967). I would change to “the role of topic”. Furthermore, the authors propose to distinguish the syntacto-semantic cues from discourse-related cues but in the conclusion, they seem to include topicality in the syntacto-semantic cues (p. 41, l. 977) when I understood that they were talking about the discourse topic throughout the paper. This should be clarified.

- In the discussion (p. 37-38), the authors discuss the role of the context of a sentence but again, the context was not manipulated in the current study. So, contrary to what the authors claim, I do not think that the online results allow them “to determine whether these preferences can be modulated by the context of a given sentence” (p. 37, l. 858). Just as I do not think that they can conclude that null pronouns “easily shift their reference towards a more contextually appropriate referent” (p. 38, l. 888) since null pronouns, whether disambiguated in favour of the object or the subject, were presented in the same contexts.

- In further discussion (p. 41-42), the argument about the anti-focus effect needs clarification. To the best of my knowledge, contrary to what the authors claim (p. 40, l. 952-953), an increased processing cost associated with an anti-focus effect was not observed. The anti-focus effect is the fact that the pronoun refers preferentially to the topic of the current discourse unit (which is not the focused by cleft antecedent of the discourse unit in which it appears since the clefting function is to signal a topic shift for the subsequent discourse unit). The authors should clarify what they want to argue here.

Smaller suggestions:

- p. 2, l. 19: in the abstract, change “we explored the natural biases that occur during the interpretation of null or overt pronouns” to “we explored the interpretation preferences of null and overt pronouns”

- p. 9, l. 196, change “pronoun resolution seem” to “pronoun resolution seems”

- p. 10, l. 235, change “the natural pronoun-antecedent match” to “the preferred pronoun-antecedent match”

- p. 11, l. 247, change “the natural anaphora resolution preference” to “the preferred anaphora interpretation”

- p. 11, l. 255, why is “followed” in italics?

- p. 11, l. 256, change “a violation of the natural preference” to “a violation of the offline preference”

- p. 13, l. 294, change “neither the preference” to “neither the preferences”

- p. 14, 332, in the title, change “What is the natural pattern of anaphora resolution in Native Polish speakers?” to “What is the offline pattern of anaphora resolution in Native Polish speakers?”

- p. 16, l. 366-367, change “In order to test whether a pronoun can influence the natural tendency to interpret the antecedent of a sentence” to “In order to test whether the pronoun form (null vs overt) can influence its interpretation preference”

- p. 20, l. 477, change “violation of the natural preference for anaphora resolution” to “violation of the preferred anaphora interpretation”

- p. 27, l. 635, change “on native Polish speakers’ natural preference” to on native Polish speakers’ offline preference”

- p. 33, l. 758, change “the natural pattern of pronominal anaphora resolution in Polish” to “the pattern of pronominal anaphora resolution in Polish”

- p. 33, l. 759, change “we established a preference” to “we established the offline preference"

- p. 33, l. 768, change “the interpretation of a null pronoun is not disrupted by a violation of its preference” to “the interpretation of a null pronoun is not disrupted by a violation of its subject-preference”

- p. 34, l. 777-779, change “Polish speakers interpret sentences under the working assumption that the topic of a sentence is the most-prominent, first-mentioned, subject antecedent” to “Polish speakers interpret sentences under the working assumption that the most-prominent referent is the first-mentioned, subject and topic antecedent”

- I did not find Appendix A

Reviewer #2: I think that this paper has improved substantially since the previous version, I appreciate the efforts to which the authors have gone to address all comments in the last round. My remaining comments are quite minor. The area that now requires a bit of refinement is the discussion, as you will see from my final few comments.

Page 4 line 69: this example needs a number and a translation

Page 4 line 74: I wouldn’t describe this as a mismatch between a pronoun and a verb. It is a bit confusing to describe it this way, although I know what you are getting at. Rephrase. I think this issue is made more confusing by the fact that, up to this point in the manuscript, you haven’t indicated exactly what information the pronoun carries in Polish (also this is not clear from the example gloss). This should be clarified.

Page 10, lines 217: note that the SMASH algorithm is what Kehler and colleagues are arguing **against**

See also page 38 line 880.

Page 15, line 343: I think there is some kind of paste/text error here

Page 15, line 352-354. Without knowing the contents of the Alonso-Ovalle or Chamorro studies, it is very unclear why sentences with null pronouns should be overall more natural than those containing overt pronouns. Explain.

Page 16, examples: number the examples, and give a translation as well (it is normal to present both a gloss and a translation)

Page 19, statistical reporting: check if the term “b coefficient” is the correct one for this type of statistical analysis. I think what you normally get from a Bayesian ordinal model is an effect size and a credible interval. Check that you are reporting this correctly.

Page 19, line 446-447: “subject-matching sentences were rated as more natural than object-matching sentences for sentences containing overt pronouns. But in Table 1, the mean rating for subjects is much lower than for objects.

Page 20, study 1 summary: add some nuance to this paragraph. It sounds here as though you are describing categorical patterns (null pronoun only interpreted as subject and overt only as object), which is not the case.

Page 25: provide a translation for the example materials

Page 32, line 724: “sentences referring to object antecedent were rated on average as more natural than sentences referring to the subject antecedent”. You can ignore this main effect of antecedent here, as it interacts with pronoun - so the main effect of antecedent is driven entirely by the difference in the object pronouns. (In general, if main effects are qualified by a significant interaction they should not be interpreted on their own)

Discussion section: I suggest condensing this, it is quite long and in some places repeats the same point in several ways.

Pages 39-40: spillover effect and lexical access. It is difficult to see how this relates directly to the current study. The studies you cite are talking about why effects show up at the spillover region at all (as opposed to a region containing a particular stimulus). But the question you need to answer is why your spillover effect goes in a particular direction. I think this is an entirely different question, so I suggest cutting out this short part of the discussion and references 49-51.

Page 40: you should not make it sound as though Patterson & Felser were the first to propose that pronoun processing occurs in stages over time, this idea has been around in the literature for a very long time

Pages 40-41: I think you have misunderstood the anti-focus effect: it does not represent a cost associated with a “less prominent, non-focused antecedent”

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Jan 11;17(1):e0262459. doi: 10.1371/journal.pone.0262459.r004

Author response to Decision Letter 1


26 Sep 2021

We would like to thank the Editor and the Reviewers for their detailed comments and suggestions. We hope that the revisions in the manuscript and our accompanying responses successfully address the concerns of the Editor and the Reviewers and that after revision you will find our work suitable for publication in PLOS One.

Whenever in our responses we refer to specific pages and lines corresponding to the changes that we have introduced to the manuscript, the page and lines numbers refer to the marked-up version of the manuscript.

Yours sincerely,

Agata Wolna, Joanna Durlik, Zofia Wodniecka

Response to the Editor’s comments:

Please reword any unclear, misleading, or stylistically convoluted passages in your manuscript. Examples of these can already be found in your abstract:

"cues of reference" - odd wording

"an ambiguous sentence interpretation task" - this phrase is itself ambiguous

"First, in an ambiguous sentence interpretation task, we explored the natural biases that occur during the interpretation of null or overt pronouns." - What is meant by "natural" here (are there also unnatural biases)? Also, if this was an offline task, how can it possibly explore biases *during* interpretation?

"antecedents which are in the syntactic position of a subject or an object" - Why not simply say "subject or object antecedents"?

Please carefully check the remainder of your manuscript for further such instances and amend these. Reviewer #1 makes several helpful suggestions in this regard.

Response:

We have reviewed the manuscript and fixed all the unclear, misleading and (statistically) convoluted passages that we could identify. In the case of the examples that you mentioned in your comment:

• We reworded the formulation “cues of reference” wherever it appeared in this form to “factors determining the reference/prominence”; however the term “cues” (e.g. “discourse prominence cues”) is commonly used in the pronominal anaphora resolution literature so we decided to keep the word “cues” did not correct it in other instances

• We fixed the ambiguous phrase (“an ambiguous sentence interpretation task”) in the abstract. In the current version of the text it is as follows:

“we explored the interpretation preferences of null and overt pronouns in an ambiguous sentence interpretation task”

• We have replaced the more precise terms “antecedents in the syntactic position of subject/object” with the shorter version that you propose: “subject/object antecedent”. In a couple of instances we did not change the wording which stresses the syntactic position of an antecedent, but only if it was justified by the narrative(e.g. on p. 40 l. 953-954, where we believe that it is crucial to stress that the subjecthood/objecthood refers to a syntactic feature of an antecedent, because we build an argument that the unexpected processing cost observed in the post-critical AOI is actually related to the syntactic processing)

• We have incorporated in the text all other stylistic suggestions of Reviewer #1

Response to the Reviewers’ comments

Reviewer #1

I was reviewer 1 on a previous draft of this manuscript. My previous major concerns have been addressed satisfactorily, and I do not have any large objections, though I do have some comments on this revised version and some additional minor suggestions.

Comments:

- p. 9, l. 191-197: “For example, in the case of overt pronoun interpretation in Italian and Spanish, the increased processing cost resulting from forcing a shift of reference from the syntactic subject of a sentence (which is also the first-mentioned referent) to the syntactic object is observed for Italian but not for Spanish. Within the Form-Specific Multiple-Constraint Approach, this cross-linguistic difference can be explained by referring to the different sensitivity of pronouns to syntactico-semantic cues in both these languages: in Italian, pronoun resolution seems to rely more heavily on this type of cue than in Spanish.” But why are Italian overt pronouns more sensitive to syntactico-semantic cues than Spanish overt pronouns? “differences in pronouns’ reference resolution do not necessarily need to be associated with typological differences between languages” (l.186-187): this seems to be the case instead if the cross-linguistic difference in overt pronouns interpretation depends of the different sensitivity of overt pronouns in Italian and in Spanish. “differences between sentence-oriented and discourse-oriented languages can be accounted for by referring to the much higher sensitivity of pronouns to the informational structure of discourse in discourse-oriented languages than in sentence-oriented languages.”(l. 198-200): Here again, typological differences between languages are seen to be responsible for cross-linguistics differences in pronoun interpretation.

Response 1.1: Thank you very much for spotting this problem. In the fragment that the Reviewer found unclear, what we wanted to argue was that sensitivity to the syntactico-semantic cues may account for differences in pronoun resolution preference even between languages that are not typologically distant (i.e.: Spanish vs. Italian, in contrast to e.g. Spanish vs. Chinese). However, we agree with the Reviewer that different sensitivity to some types of cues can actually be considered to be a typological difference between the languages and as such our argument was somewhat circular.

As the considerations of typological distance between Spanish and Italian are not the central notion for the argument we want to make, from the beginning of the paragraph, we removed the sentence which claimed that “differences in pronouns’ reference resolution do not necessarily need to be associated with typological differences between languages”. In the current form, the paragraph (p.9 l. 189-206) does not differentiate between typological differences between the languages and the differences in sensitivity to syntactico-semantic cues. We believe that it solves the problem of circularity of the argument.

- Thematic roles are defined as the semantic roles (agent, patient,…) (see p. 6, l. 109-111). However, further on in the text, I do not understand the formulations: “the role of the thematic topic” (p. 40, l. 945) “and the thematic role of a topic” (p.41, l. 967). I would change to “the role of topic”. Furthermore, the authors propose to distinguish the syntacto-semantic cues from discourse-related cues but in the conclusion, they seem to include topicality in the syntacto-semantic cues (p. 41, l. 977) when I understood that they were talking about the discourse topic throughout the paper. This should be clarified.

Response 1.2: Thank you for spotting these inconsistencies.

We have corrected the formulations related to the role of topic on p. 42 l. 1000 and on p. 42 l. 1010. In both instances, “the thematic topic” / “thematic role of a topic” have been replaced with “the role of topic”, following your suggestion.

We have also reworded the conclusions so that they no longer claim that topicality is an instance of a syntactico-semantic cue (which was a mistake on our part). In the current formulation the fragment in question was changed to the following form:

“Our results indicate that in Polish, syntactico-semantic cues - such as subjecthood and information structure (i.e., order of mention and thematic roles) - are the dominant constraints of the prominence of an antecedent”

- In the discussion (p. 37-38), the authors discuss the role of the context of a sentence but again, the context was not manipulated in the current study. So, contrary to what the authors claim, I do not think that the online results allow them “to determine whether these preferences can be modulated by the context of a given sentence” (p. 37, l. 858). Just as I do not think that they can conclude that null pronouns “easily shift their reference towards a more contextually appropriate referent” (p. 38, l. 888) since null pronouns, whether disambiguated in favour of the object or the subject, were presented in the same contexts.

Response 1.3: Thank you for bringing up this unfortunate use of the term “context” . We agree with the Reviewer that as context was not manipulated in our study we cannot draw any conclusions related to how it influences the pronoun resolution. Whenever we used the term “context” we actually referred to the grammatical constraints of a sentence, which were manipulated in Study 2. We replaced all the mentions of “context” in the discussion with “grammatical constraints”.

The problematic formulations were changed in the text to the following:

“[...] to determine whether these preferences can be modulated by the grammatical constraints of a given sentence”

“[...] null pronouns are forced to refer to an antecedent which does not follow the preferred antecedent match, they can easily shift their reference towards a less-preferred, but grammatically correct referent”

- In further discussion (p. 41-42), the argument about the anti-focus effect needs clarification. To the best of my knowledge, contrary to what the authors claim (p. 40, l. 952-953), an increased processing cost associated with an anti-focus effect was not observed. The anti-focus effect is the fact that the pronoun refers preferentially to the topic of the current discourse unit (which is not the focused by cleft antecedent of the discourse unit in which it appears since the clefting function is to signal a topic shift for the subsequent discourse unit). The authors should clarify what they want to argue here.

Response 1.4: Thank you for spotting this inconsistency. It has been corrected: the section that mentioned it is supposed to refer, in a broader sense, to experiments that explored the focus effect in pronoun resolution. We do not aim to explain the anti-focus effect as it is not central to our argumentation so we have removed the mention of it. The corrected version of the paragraph is the following:

“Previous studies on focus effect in anaphora resolution reported a similar effect: an increased processing cost associated with a topic shift towards a less-prominent antecedent which has been cued by the information structure of the current discourse (10,11,14,15). In this context, our results can be interpreted as showing that Polish speakers automatically interpret the most-prominent antecedent (the first available antecedent or the subject antecedent) to be the topic of a sentence, but as new information cues another antecedent which is coherent with the current discourse, the reference is shifted.”

Smaller suggestions:

- p. 2, l. 19: in the abstract, change “we explored the natural biases that occur during the interpretation of null or overt pronouns” to “we explored the interpretation preferences of null and overt pronouns”

Response 1.5: This fragment has been changed according to the Reviewer’s suggestion.

- p. 9, l. 196, change “pronoun resolution seem” to “pronoun resolution seems”

Response 1.6: Thank you for spotting this mistake. It has been corrected in the text.

- p. 10, l. 235, change “the natural pronoun-antecedent match” to “the preferred pronoun-antecedent match”

Response 1.7: We changed this formulation according to the Reviewer’s suggestion.

- p. 11, l. 247, change “the natural anaphora resolution preference” to “the preferred anaphora interpretation”

Response 1.8: We changed this formulation according to the Reviewer’s suggestion.

- p. 11, l. 255, why is “followed” in italics?

Response 1.9: The format has been changed to a regular text.

- p. 11, l. 256, change “a violation of the natural preference” to “a violation of the offline preference”

Response 1.10: We changed this formulation according to the Reviewer’s suggestion.

- p. 13, l. 294, change “neither the preference” to “neither the preferences”

Response 1.11: Thank you for spotting this issue. It has been corrected in the text.

- p. 14, 332, in the title, change “What is the natural pattern of anaphora resolution in Native Polish speakers?” to “What is the offline pattern of anaphora resolution in Native Polish speakers?”

Response 1.12: We changed this formulation according to the Reviewer’s suggestion.

- p. 16, l. 366-367, change “In order to test whether a pronoun can influence the natural tendency to interpret the antecedent of a sentence” to “In order to test whether the pronoun form (null vs overt) can influence its interpretation preference”

Response 1.13: This fragment has been changed according to the Reviewer’s suggestion.

- p. 20, l. 477, change “violation of the natural preference for anaphora resolution” to “violation of the preferred anaphora interpretation”

Response 1.14: We changed this formulation according to the Reviewer’s suggestion.

- p. 27, l. 635, change “on native Polish speakers’ natural preference” to on native Polish speakers’ offline preference”

Response 1.15: We changed this formulation according to the Reviewer’s suggestion.

- p. 33, l. 758, change “the natural pattern of pronominal anaphora resolution in Polish” to “the pattern of pronominal anaphora resolution in Polish”

Response 1.16: We changed this formulation according to the Reviewer’s suggestion.

- p. 33, l. 759, change “we established a preference” to “we established the offline preference"

Response 1.17: We changed this formulation according to the Reviewer’s suggestion.

- p. 33, l. 768, change “the interpretation of a null pronoun is not disrupted by a violation of its preference” to “the interpretation of a null pronoun is not disrupted by a violation of its subject-preference”

Response 1.18: We changed this formulation according to the Reviewer’s suggestion.

- p. 34, l. 777-779, change “Polish speakers interpret sentences under the working assumption that the topic of a sentence is the most-prominent, first-mentioned, subject antecedent” to “Polish speakers interpret sentences under the working assumption that the most-prominent referent is the first-mentioned, subject and topic antecedent”

Response 1.19: This fragment has been changed according to the Reviewer’s suggestion.

- I did not find Appendix A

Response 1.20: We have previously added the Appendix to the submission as a separate file - we were not aware that the Reviewers will not be able to access them. It has been fixed and the Appendix is not added at the end of the manuscript.

Reviewer #2

I think that this paper has improved substantially since the previous version, I appreciate the efforts to which the authors have gone to address all comments in the last round. My remaining comments are quite minor. The area that now requires a bit of refinement is the discussion, as you will see from my final few comments.

Page 4 line 69: this example needs a number and a translation

Response 2.1: The number has been added to the example. Translation is provided in the gloss in the line following the example sentence.

Page 4 line 74: I wouldn’t describe this as a mismatch between a pronoun and a verb. It is a bit confusing to describe it this way, although I know what you are getting at. Rephrase. I think this issue is made more confusing by the fact that, up to this point in the manuscript, you haven’t indicated exactly what information the pronoun carries in Polish (also this is not clear from the example gloss). This should be clarified.

Response 2.2: Thank you for pointing out this issue. The problematic formulation has been replaced with the following one:

“A consequence of subject-verb agreement is that whenever a pronoun of the verb phrase refers to a less-preferred, non-topical or unexpected antecedent, a speaker needs to adjust the interpretation of the sentence and re-identify the referent of the anaphorical expression.”

We hope that in this corrected, more descriptive form this fragment is not confusing anymore.

Also, we have updated the gloss of the example sentence (1) so that it explains what information is carried by the pronoun.

Page 10, lines 217: note that the SMASH algorithm is what Kehler and colleagues are arguing **against**

See also page 38 line 880.

Response 2.3: Thank you for spotting this, it was indeed our misinterpretation of Kehler and colleagues’ claims. As the discussion of the SMASH algorithm is not central to explaining the ideas proposed by Kehler and Rhode, we decided that the mention of SMASH can be omitted altogether in the text without substantially affecting the argumentation. It was also not discussed in detail in the Discussion, where it was only mentioned as an example of a certain type of pronoun reference theories (the mentioned p. 38 line 880). As such, we believe that both mentions of the SMASH algorithm of pronoun resolution can be dropped from the text without causing substantial changes to the narration.

Page 15, line 343: I think there is some kind of paste/text error here

Response 2.4: Thank you for spotting this, it has been fixed.

Page 15, line 352-354. Without knowing the contents of the Alonso-Ovalle or Chamorro studies, it is very unclear why sentences with null pronouns should be overall more natural than those containing overt pronouns. Explain.

Response 2.5: We clarified what the previous studies found and how those findings affect our predictions. In the current version of the text the relevant fragment is the following:

“Moreover, following the studies of Alonso-Ovalle and colleagues (28) and Chamorro and colleagues (21) who found null pronoun sentences are interpreted as more natural than overt pronoun sentences. Following their results, we expected to observe a similar pattern of results in our data.”

Page 16, examples: number the examples, and give a translation as well (it is normal to present both a gloss and a translation)

Response 2.6: Numbers and translations have been added to the text.

Page 19, statistical reporting: check if the term “b coefficient” is the correct one for this type of statistical analysis. I think what you normally get from a Bayesian ordinal model is an effect size and a credible interval. Check that you are reporting this correctly.

Response 2.7: We would like to thank the Reviewer #2 for this comment. We have reviewed once again the way of reporting the results of the bayesian ordinal models.

The “b coefficient” that we reported in the previous version of the text corresponds to the “Estimate” column from the brms model summary which represents the posterior means (or medians, in the case of the post-hoc tests) of the parameters of the reported bayesian regression mode (“Ordinal Regression Models in Psychology: A Tutorial” by Bürkner and Vuorre, 2018). The β coefficients are usually reported in experiments which use bayesian ordinal models, e.g.:

• Zimmerman et al. (2021): https://www.frontiersin.org/articles/10.3389/fpsyg.2021.675633/full#h4

• Skovgaard-Olsen et al. (2019): https://www.sciencedirect.com/science/article/abs/pii/S0010028518301749

• Robin et al (2021): https://doi.org/10.1080/09658211.2021.1895221

However, the convention is usually to refer to the reported estimates using the “β” notation instead of “b coefficient” so we have adjusted the text by replacing the “b coefficient” with “β”. We have also replaced the reference to credible intervals “CI” with “CrI”, which is less ambiguous (as in frequentist statistics “CI” refers to the confidence intervals).

Page 19, line 446-447: “subject-matching sentences were rated as more natural than object-matching sentences for sentences containing overt pronouns. But in Table 1, the mean rating for subjects is much lower than for objects.

Response 2.8: Thank you for spotting this inconsistency. We have corrected the description of the results which is now the following:

“Direct comparisons between the two Antecedent conditions (i.e., subject- and object-matching sentences) revealed significant effects for sentences containing a null pronoun (b coefficient = -0.42, 95% HPD [-0.62 -0.20]): subject-matching sentences were rated as more natural than object-matching sentences. Significant effects were also found for sentences containing overt pronouns (b coefficient = 0.56, 95% HPD [0.29 0.81]); in the case of which, subject-matching sentences were rated as less natural than object-matching sentences. “

Page 20, study 1 summary: add some nuance to this paragraph. It sounds here as though you are describing categorical patterns (null pronoun only interpreted as subject and overt only as object), which is not the case.

Response 2.9: Thank you for bringing this issue to our attention. We rephrased the summarizing sentence to stress that it is not a categorical pattern but rather a preference. In the current form it is as follows:

“The results of Study 1 showed that Polish native speakers prefer to interpret the null pronoun of a subordinate clause as referring to the subject of the main clause and the overt pronoun of a subordinate clause as referring to the object of the main clause.”

Page 25: provide a translation for the example materials

Response 2.10: Similarly as in the case of previous example sentences, numbers and translations have been added to the text.

Page 32, line 724: “sentences referring to object antecedent were rated on average as more natural than sentences referring to the subject antecedent”. You can ignore this main effect of antecedent here, as it interacts with pronoun - so the main effect of antecedent is driven entirely by the difference in the object pronouns. (In general, if main effects are qualified by a significant interaction they should not be interpreted on their own)

Response 2.11: Thank you for this comment. We agree that the main effect itself is not informative in this case so we have removed the sentence referring to the main effect of Antecedent from the text. Instead, we only talk about the effect of Antecedent in the context of its interaction with the effect of Pronoun so the current version of the description of the results of the naturalness rating in Study 2 is the following:

“We found a strong effect of Pronoun (β = -0.40; 95% CrI [-0.69 -0.10]): sentences containing null pronouns were rated as more natural than sentences containing overt pronouns. We also found evidence for the interaction of Pronoun and Antecedent effects (β = -1.12, 95% CrI [-1.39 -0.84]). Direct comparisons between the two Antecedent conditions (i.e. subject- and object-matching sentences) revealed that there was no evidence for differences in naturalness score in sentences containing a null pronoun (β = 0.15, 95% HPD [-0.10 0.42]) but there was a strong effect in sentences containing overt pronouns (β = 1.27, 95% HPD [0.99 1.52]): subject-matching sentences were rated as less natural than object-matching sentences.”

Discussion section: I suggest condensing this, it is quite long and in some places repeats the same point in several ways.

Response 2.12: We have shortened the discussion by removing a couple of fragments which repeated the same information and presented similar points. We have also removed the fragment related to the discussion of the spillover effect and lexical access, as suggested by the Reviewer in the following comment. We hope that it is now more condensed and to the point.

Pages 39-40: spillover effect and lexical access. It is difficult to see how this relates directly to the current study. The studies you cite are talking about why effects show up at the spillover region at all (as opposed to a region containing a particular stimulus). But the question you need to answer is why your spillover effect goes in a particular direction. I think this is an entirely different question, so I suggest cutting out this short part of the discussion and references 49-51.

Response 2.13: Thank you for this comment. Following your suggestion we have deleted the fragment discussing the spillover effect in the context of lexical access and the corresponding references.

Page 40: you should not make it sound as though Patterson & Felser were the first to propose that pronoun processing occurs in stages over time, this idea has been around in the literature for a very long time

Response 2.14: Thank you for bringing our attention to this issue. We have reworded the sentence in which we previously referred to the work of Patterson & Felser to make it clear that we would like to refer to a broader idea. Instead of referring to Patterson & Felser we added a reference to Kehler (2007) who summarizes and critically analyzes the idea of incremental pronoun resolution:

“This explanation is in line with the idea that pronoun resolution is a process that unfolds over time (for a discussion see: Kehler, 2007): in its early stages, the initial bonding or retrieval are reflected by early fixation measures, but late processes related to the integration with discourse only affect later processing stages.”

Pages 40-41: I think you have misunderstood the anti-focus effect: it does not represent a cost associated with a “less prominent, non-focused antecedent”

Response 2.15: Thank you for spotting this mistake. We decided to remove the mention of the anti-focus effect as the section that mentioned it is supposed to refer, in a broader sense, to experiments that explored the focus effects in pronoun resolution. The corrected version of the paragraph is the following:

“Previous studies on focus effect in anaphora resolution reported a similar effect: an increased processing cost associated with a topic shift towards a less-prominent antecedent which has been cued by the information structure of the current discourse (10,11,14,15). In this context, our results can be interpreted as showing that Polish speakers automatically interpret the most-prominent antecedent (the first available antecedent or the subject antecedent) to be the topic of a sentence; however, as new information cues another antecedent which is coherent with the current discourse, the reference is shifted.”

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 2

Claudia Felser

22 Nov 2021

PONE-D-21-12740R2Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.PLOS ONE

Dear Dr. Wolna,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================While I think the reviewer comments have been adequately addressed, your manuscript still contains some minor errors, omissions and unclear wordings (see below for details). Please attend to these issues before submitting a final revised version of your manuscript.

==============================

Please submit your revised manuscript by Jan 06 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Claudia Felser, Ph.D

Academic Editor

PLOS ONE 

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. 

Additional Editor Comments:

General points

1. The manuscript still contains several grammatical errors and should be carefully proofread before final submission. Examples found on the first few pages include:

Abstract: "sensitivity to violation" > "sensitivity to a violation"

80: "the reference" > "reference"

2. In-text references should be in angular rather than round brackets, following the usual convention and to avoid literature references being confused with references to linguistic examples.

Specific points

Abstract: I'm sorry for being picky, but the phrase "ambiguous sentence interpretation task" is still ambiguous as I pointed out before, in that the adjective "ambiguous" can be understood as modifying either "sentence" or "task". Why not simply omit this adjective?

68: Examples are only numbered from here, and the first two examples on p. 3 are not numbered. Please use example numbering consistently.

158: The EPP is not direction-specific and thus does not require the subject to be preverbal. Remove "preverbal" or refer explicitly to Polish, as appropriate.

307 (and elsewhere): Your use of the term "study" is confusing. You report two experiments here which both form part of the same study. Please replace "study" by "experiment" thoughout the manuscript when referring to your experiments.

350: More information about the participants is needed - minimally, their age should be provided.

380: "Qualtrics"? Please provide the URL to this platform or other reference.

p.24: Consider using a symbol other than an asterisk to indicate dispreference as asterisks normally indicate ungrammaticality.

533: Again, more participant bio-information is needed.

571f.: If this is a footnote or endnote, please format and position it as such.

p.25: How long did the experiment take?

775 (and elsewhere): Why does the word "Studies" start with a capital letter?

833ff. "In the second study of the current paper we explored to what extent the pronoun resolution preferences can be modulated by the grammatical constraints of a given sentence. Our results indicate that sentences containing a null pronoun equally easily accommodate verb phrases referring to subject and object antecedents." - It is not clear what is meant by "grammatical constraints" here (a term which replaces the previously used but misleading term "context"). Do you mean a sentence's grammatical properties, its structure, or something else? Secondly, how can verb phrases possibly refer to subject or object antecedents? Please rephrase.

Fig.1: Why does "Noun Phrase" start with capitals?

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Jan 11;17(1):e0262459. doi: 10.1371/journal.pone.0262459.r006

Author response to Decision Letter 2


8 Dec 2021

We would like to thank the Editor for her comments and suggestions. We have addressed them all and we have had the manuscript proofread by a native English speaker to make sure that there are no grammatical errors left. We hope that the revisions in the manuscript and our accompanying responses successfully address the concerns of the Editor and that after revision you will find our work suitable for publication in PLOS One.

Yours sincerely,

Agata Wolna, Joanna Durlik, Zofia Wodniecka

Response to the Editor’s comments:

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response: The reference list had not changed since the last round of reviews and we previously checked that it was complete and that the status of the cited work was correct.

General points

1. The manuscript still contains several grammatical errors and should be carefully proofread before final submission. Examples found on the first few pages include:

Abstract: "sensitivity to violation" > "sensitivity to a violation"

80: "the reference" > "reference"

Response E.1. The specific examples you gave have been changed according to your suggestions. Moreover, the entire text has been proofread by a professional proofreader who is a native English speaker to make sure all other errors were corrected.

2. In-text references should be in angular rather than round brackets, following the usual convention and to avoid literature references being confused with references to linguistic examples.

Response E.2. We have updated the literature references in the manuscript and they are now all between angular brackets.

Specific points

Abstract: I'm sorry for being picky, but the phrase "ambiguous sentence interpretation task" is still ambiguous as I pointed out before, in that the adjective "ambiguous" can be understood as modifying either "sentence" or "task". Why not simply omit this adjective?

Response E.3. Thank you for pointing out this inconsistency. We would rather keep the adjective as it refers to one of the most crucial differences between stimuli used in experiments 1 and 2; however, we have reformulated the problematic sentence and we hope it is clear now. In the corrected version, this fragment is now as follows:

“First, we explored preferences in interpretation of null and overt pronouns in ambiguous sentences.”

68: Examples are only numbered from here, and the first two examples on p. 3 are not numbered. Please use example numbering consistently.

Response E.4. Thank you for spotting this inconsistency. Numbers have now been added for the first two examples, and the numeration of subsequent examples throughout the text has been updated accordingly.

158: The EPP is not direction-specific and thus does not require the subject to be preverbal. Remove "preverbal" or refer explicitly to Polish, as appropriate.

Response E.5. Thank you for pointing this out. The sentence has been changed according to your suggestion and it now reads as follows:

“The precise type of the expression in a Spec IP position is further defined by the Extended Projection Principle (EPP), according to which the Spec IP of a given clause must be occupied by a subject [20], which in the case of Polish will always be a preverbal subject” (p. 8 lines 161-163).

307 (and elsewhere): Your use of the term "study" is confusing. You report two experiments here which both form part of the same study. Please replace "study" by "experiment" thoughout the manuscript when referring to your experiments.

Response E.6. The terminology used in the manuscript has been updated following your suggestion: whenever we refer to one of our experiments, we now use the term “experiment”. The term “study” is used only in reference to previous studies (conducted by someone else).

350: More information about the participants is needed - minimally, their age should be provided.

Response E.9. We added the information on participants’ age to the manuscript (p. 15 line 358). In this study we only collected the information on participants’ gender, age and native language, so we do not have any more precise information describing the group in this case.

380: “Qualtrics”? Please provide the URL to this platform or other reference.

Response E.8. We now provide the URL to the platform in the manuscript: “The experiment was conducted via an online survey platform (Qualtrics: www.qualtrics.com).”

p.24: Consider using a symbol other than an asterisk to indicate dispreference as asterisks normally indicate ungrammaticality.

Response E.9. Thank you for bringing this to our attention. We replaced asterisks with “?” to mark dispreference in sentence interpretation in the text.

533: Again, more participant bio-information is needed.

Response E.10. In the case of Experiment 2, more information on the participants’ group was provided but only after explaining the exclusion criteria. However, we agree that it was not the best way of providing information. We moved the fragment with the information on the final sample size along with the demographic information to the beginning of the paragraph (p. 23, lines 545-548), and we only discuss the exclusion criteria after giving this information. In the case of Experiment 2, in addition to the information on gender and age, we also provide information on participants’ language background in Table 2 (p. 24 line 569). We only collected precise language background information on participants of Experiment 2 and not Experiment 1 because in the case of Experiment 2 we wanted to be sure that our participants would not be functional and very proficient bilinguals. The reason for restricting the participants’ sample to functional monolinguals was driven by previous findings which show that language experience (immersion in L2 or high proficiency levels) can affect online sentence interpretation and pronoun resolution measured with eye-tracking.

571f.: If this is a footnote or endnote, please format and position it as such.

Response E.11. As PLOS one does not allow us to add footnotes to the manuscript, we have moved this information to the main text (p. 24 lines 584-586), directly preceding the example of a sentence’s structure. The fragment explaining the structure of experimental sentences is now as follows:

“The length of the main clause, as well as the frequency of nouns corresponding to the subject and object antecedents, were also matched between sentences. Note that if a sentence included a null pronoun (which is equivalent to omitting the pronoun), no empty space or other replacement were provided in place of the pronoun in the sentence. Each sentence followed the same structure:

subject / verb1 / object / time conjunction (“when”) / pronoun (null* or overt) / verb2 / rest1 / rest2”

p.25: How long did the experiment take?

Response E.12. The experiment took approximately 45 minutes. We have included this information in the text (p. 26, lines 633-634).

775 (and elsewhere): Why does the word "Studies" start with a capital letter?

Response E.13. First, following one of your previous comments, we replaced all occurrences of “study” with “experiment”. Second, when talking about experiments, we use capital letters in some cases to specifically refer to our experiments (i.e., “Experiment 1” / “Experiment 2”). As such, these expressions are used as if they were proper nouns, in contrast to “experiment(s)”, which is used as a common noun. Therefore, we would rather not change the words starting with capital letters to lowercase so as to keep this distinction in the text. However, if you have a strong preference for this change, we will be happy to adopt it.

833ff. "In the second study of the current paper we explored to what extent the pronoun resolution preferences can be modulated by the grammatical constraints of a given sentence. Our results indicate that sentences containing a null pronoun equally easily accommodate verb phrases referring to subject and object antecedents." - It is not clear what is meant by "grammatical constraints" here (a term which replaces the previously used but misleading term "context"). Do you mean a sentence's grammatical properties, its structure, or something else? Secondly, how can verb phrases possibly refer to subject or object antecedents? Please rephrase.

Response E.14. We have rephrased this fragment to make it more specific. We have added a sentence to explain what we mean by “grammatical constraints'' and we have replaced the term “verb phrase” with “verb”. After corrections, this fragment reads as follows:

“In Experiment 2, we explored the extent to which pronoun resolution preferences can be modulated by the grammatical constraints of a given sentence. In the case of Polish, grammatical constraints refer to grammatical number, person or gender agreement between the verb and its antecedent. Our results indicate that sentences containing a null pronoun accommodate verbs referring to subject and object antecedents equally easily.” (p. 36, lines 858-863)

Fig.1: Why does "Noun Phrase" start with capitals?

Response E.15. There was no real reason for that. We have corrected the text in the figure and it no longer starts with capital letters.

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 3

Claudia Felser

13 Dec 2021

PONE-D-21-12740R3Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.PLOS ONE

Dear Dr. Wolna,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 27 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Claudia Felser, Ph.D

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

You have addressed most of my previous comments well enough, but please check your manuscript again carefully for grammatical and linguistic accuracy. Reading through your current manuscript I spotted the following two points, but there may be more.

214: on one hand > on the one hand

840ff.: “In Experiment 2, we explored the extent to which pronoun resolution preferences can be modulated by the grammatical constraints of a given sentence. In the case of Polish, grammatical constraints refer to grammatical number, person or gender agreement between the verb and its antecedent. Our results indicate that sentences containing a null pronoun accommodate verbs referring to subject and object antecedents equally easily.” - The reworded passage makes no sense. Verbs cannot refer to subject or object antecedents any more than verb phrases can! It is pronouns that require antecedents. The constraints you mention are not constraints of sentences - I am guessing that what you mean are constraints on referential dependency formation. Please reword as appropriate.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Jan 11;17(1):e0262459. doi: 10.1371/journal.pone.0262459.r008

Author response to Decision Letter 3


21 Dec 2021

We have carefully read through the manuscript and fixed a number of grammatical and linguistic inaccuracies and mistakes. We have also had the manuscript proofread by a native English speaker to make sure that there are no grammatical errors left. We hope that the revisions in the manuscript successfully address the concerns of the Editor and that after revision you will find our work suitable for publication in PLOS One.

Yours sincerely,

Agata Wolna, Joanna Durlik and Zofia Wodniecka

Response to the Editor’s comments:

You have addressed most of my previous comments well enough, but please check your manuscript again carefully for grammatical and linguistic accuracy. Reading through your current manuscript I spotted the following two points, but there may be more.

Thank you for pointing out to this problem. We have carefully read through the manuscript and fixed a number of grammatical and linguistic inaccuracies. We have also asked a professional proofreader (a native English speaker) to read the manuscript again and we have introduced the corrections he has suggested.

214: on one hand > on the one hand

This mistake has been corrected following the Editor’s suggestion.

840ff.: “In Experiment 2, we explored the extent to which pronoun resolution preferences can be modulated by the grammatical constraints of a given sentence. In the case of Polish, grammatical constraints refer to grammatical number, person or gender agreement between the verb and its antecedent. Our results indicate that sentences containing a null pronoun accommodate verbs referring to subject and object antecedents equally easily.” - The reworded passage makes no sense. Verbs cannot refer to subject or object antecedents any more than verb phrases can! It is pronouns that require antecedents. The constraints you mention are not constraints of sentences - I am guessing that what you mean are constraints on referential dependency formation. Please reword as appropriate.

We reformulated this fragment following the Editor’s suggestion. It is now as follows:

“In Experiment 2, we explored the extent to which pronoun resolution preferences can be modulated by the grammatical constraints on the formation of a referential dependency. In the case of Polish, these constraints refer to the grammatical number, person, or gender agreement between the pronoun and its antecedent. Our results indicate that null pronouns can equally easily be interpreted as referring to subject and object antecedents.” (p.36, lines 843 - 847)

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 4

Claudia Felser

24 Dec 2021

Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.

PONE-D-21-12740R4

Dear Dr. Wolna,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Claudia Felser, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Claudia Felser

3 Jan 2022

PONE-D-21-12740R4

Pronominal anaphora resolution in Polish: investigating online sentence interpretation using eye-tracking.

Dear Dr. Wolna:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Claudia Felser

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. A list of experimental sentences used in Experiment 2.

    (DOCX)

    Attachment

    Submitted filename: Wolna et al_review.pdf

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    All data and the scripts necessary to reproduce the presented results are available from the Open Science Framework database (https://osf.io/dynwp/).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES