Skip to main content
PLOS One logoLink to PLOS One
. 2021 Jul 14;16(7):e0254489. doi: 10.1371/journal.pone.0254489

Dutch tenants at risk of eviction: Identifying predictors of eviction orders

Marieke H Edwards 1,¤, Linda van den Dries 1, Manfred te Grotenhuis 2, Sten-Åke Stenberg 3, Judith R L M Wolf 1,*
Editor: Shihe Fu4
PMCID: PMC8279371  PMID: 34260642

Abstract

In order to prevent evictions, it is important to gain more insight into factors predicting whether or not tenants receive an eviction order. In this study, ten potential risk factors for evictions were tested. Tenants who were at risk of eviction due to rent arrears in five Dutch cities were interviewed using a structured questionnaire, and six months later their housing associations were asked to provide information about the tenants’ current situation. Multiple logistic regression analyses with data on 344 tenants revealed that the amount of rent arrears was a strong predictor for receiving an eviction order. Furthermore, single tenants and tenants who had already been summoned to appear in court were more likely to receive an eviction order. These results can contribute to identifying households at risk of eviction at an early stage, and to develop targeted interventions to prevent evictions.

Introduction

Losing one’s home due to an eviction, and also the mere prospect of being evicted, can have a severe impact on the lives of those involved [1]. It causes major stress and feelings of panic and shame [2], and may even lead to suicide [3]. Although the consequences of evictions are severe, data on the impact of and reasons behind evictions are scarce [46]. It is therefore important to gain more insight into the factors that increase the risk of eviction. In this study we explore which factors cause eviction orders among Dutch tenants who are at risk of eviction due to rent arrears.

Preventing evictions is not only important from a social and health point of view, but also from a financial perspective [5]. Akkermans and Räkers [7] estimated the cost of an eviction in the Netherlands to be between 5,000 and 9,000 euro. These costs include bailiff and litigation costs, costs for the eviction itself, unrecovered rent, costs for repairing damages to the property, and costs for removing the personal belongings of the tenants from the accommodation. When tenants are not able to pay these costs, they have to be covered by the housing associations. There are also costs for society, for example, due to the use of the social relief system, and costs related to rehousing [8], debt counseling [9] and the utilization of shelters facilities.

There are approximately 350 social housing associations in the Netherlands, owning about a third of the total housing stock; they house around four million tenants in 2.4 million homes [10]. Tenants with arrears of roughly two months’ rent receive a letter from their social housing association requesting them to pay the rent arrears or make payment arrangements. When the terms of the housing association are not met within approximately three months, the debt is handed over to a bailiff who then tries to collect the rent or make payment arrangements. If this fails, the bailiff requests the court to serve the tenant with an eviction order, which the housing association can use to terminate the tenancy agreement [5]. In the Netherlands, receiving an eviction order does not necessarily mean that a tenant will be evicted. In almost 75% of the cases in which tenants receive an eviction order, the social housing association and the tenant come to agreements which prevent the eviction, for example repayment in installments [11]. In 2018, an estimated 12,000 eviction orders were issued in the Dutch social housing sector, of which 3,000 orders were actually effectuated, and 1,500 tenants left the residence after receiving the eviction order, before an eviction could take place. Of the 3,000 evictions, the majority, 80%, was due to rent arrears [12].

The negative social, health and financial consequences of evictions underscore the importance of gaining insight into the predictors of eviction in order to prevent evictions and the accompanying negative effects. In a recent large study in Milwaukee [13], individual, neighborhood, and social network determinants of eviction were identified. This study showed that a higher number of children in the household, recent job loss, high neighborhood crime and eviction rates, and network disadvantage (strong ties with people who had experienced or were experiencing poverty and disadvantage) increased the likelihood of eviction. Furthermore, a survey among tenants appearing in the Milwaukee eviction court indicated that tenants with children were significantly more likely to receive an eviction order than tenants without children [14]. However, several Dutch housing associations claim to be more lenient towards households with children, because it is agreed that, if possible, eviction of children should be prevented [15]. Risk factors for eviction identified by Stenberg, Kareholt, and Carroll [16], are a low income, a criminal record, being refused help from the welfare authorities and being an immigrant. In a longitudinal study on home owners and renters in Britain from 1991 to 1997, Böheim and Taylor [17] concluded that households that were evicted tended to have younger heads, a lower household income, and more often had experienced a financial setback than households that were not evicted. Van Laere, De Wit, and Klazinga [18] studied a group of tenants with rent arrears in Amsterdam, and compared characteristics of those that were and were not evicted. Being native Dutch and having a drug-related problem were identified as risk factors for eviction. Furthermore, debt counseling can be helpful in preventing evictions [2,19]. Thus, a lack of help from debt counseling services may be a potential risk factor for eviction. Additionally, data from Dutch housing associations show that the majority of evicted tenants are single [12]. In addition to the abovementioned risk factors for evictions, it is plausible that the height of the rent arrears and the phase in the eviction process are also important predictors for evictions due to rent arrears, because higher rent arrears are more difficult to repay. The higher the rent arrears get, and the further tenants are in the eviction process, the less possibilities there are for recovery [7]. Furthermore, policies to prevent evictions differ significantly across Dutch cities [7,15], and therefore the city in which the tenant lives may affect their chance of recovering from their rent arrears and averting eviction. In most Dutch municipalities there are agreements between housing associations, social work agencies, debt counseling services, and in most cases the municipality, to prevent evictions. However, these agreements differ significantly across municipalities; some agreements have clear guidelines, measurable goals, and clear descriptions of tasks of the different parties involved, while other agreements are more general and lack these details [7].

For the present study, we approached tenants who had received a second notification from a bailiff due to non-payment of rent. This is the last phase in the eviction process before the bailiff starts the court proceeding in order to obtain an eviction order. The aim of this study was to gain insight into the role of the abovementioned risk factors in predicting whether or not Dutch tenants at risk of eviction due to rent arrears eventually receive an eviction order. This knowledge will help housing associations and social workers to identify vulnerable households and develop early, targeted interventions to prevent evictions.

Method

Procedure and participants

For this study, we conducted logistic regression analyses with a sample of 344 Dutch households at risk of eviction due to rent arrears. Tenants were included in the study when they were at least 18 years old, lived in independent housing from social housing associations, and had received at least a second notification from a bailiff because of rent arrears for the housing they were currently living in. We have complied with APA ethical principles in our treatment of individuals participating in our research, and our study complies with the criteria for studies that have to be approved by an accredited Medical Research Ethics Committee. Upon consultation, the Arnhem/Nijmegen Ethics Committee stated that the study was exempt from formal approval (registration number 2011/110) as the participants were not subjected to any treatment other than the interview.

Tenants were contacted through sixteen social housing associations in five different municipalities in the Netherlands (Amsterdam, Leiden, Nijmegen, Rotterdam, and Utrecht). The social housing associations, or bailiffs working for them, screened all tenants with rent arrears to identify tenants who met the study’s inclusion criteria. All identified tenants received an information letter about the study. Two types of letters were sent: opt-out and opt-in letters. With the opt-out method, tenants were informed that they would be contacted by telephone to ask them if they were willing to participate in the study, unless they sent in the opt-out card. With the opt-in method, tenants were asked to contact the researchers when they were willing to participate. The opt-in method was only used when the social housing association was unwilling or unable to use the opt-out method due to organizational or privacy reasons. In addition, seven local projects working with people at risk of eviction and six debt counseling agencies were provided with flyers explaining the research, which they distributed among clients that met our inclusion criteria. All these institutions and agencies chose the opt-in method, so their clients were asked to contact the researchers if they were willing to participate.

In total, 495 tenants were included in the study at T0 (Fig 1). All tenants were interviewed between November 2011 and February 2013, using a structured questionnaire with standardized instruments. Informed consent was obtained before the start of the interview. After participation, tenants received 20 euro. Six tenants could not be interviewed in Dutch. These interviews were conducted using an English translation of the questionnaire (n = 3), or with on the spot translation to French (n = 2) or Turkish (n = 1) by bilingual interviewers.

Fig 1. Response and non-response at T0 and T1, using the opt-in and opt-out methods.

Fig 1

*Since not all housing associations, municipal institutions and debt counseling agencies kept track of the number of letters they sent, it is unclear exactly how many tenants received opt-in letters or flyers.

All interviewed tenants gave written permission to the researchers to obtain information about their situation from their housing association. This T1 data collection took place six months after each T0 interview. At T1, the respective housing association was asked whether or not an eviction order had been served to the tenant. This information was collected through an online questionnaire for most housing associations, while two housing associations preferred to send this information by e-mail. T1 data collection took place between May 2012 and December 2013. While all participating housing associations had agreed to provide us with the T1 data, collecting this information at T1 proved to be difficult. Several housing associations were reorganizing during the course of this study, so contact persons that had agreed to provide us with the required information were no longer working at the housing association when we eventually asked for a tenant’s information and their colleagues were not willing to participate. One housing association had changed their data system and was unable to find information about specific tenants. Furthermore, since several housing associations transferred rent arrear cases to debt collection agencies which then worked on these cases independently, these housing associations were unaware of the status of court proceedings. The debt collection agencies were unwilling to participate in this study, and therefore these housing associations were not able to provide information about eviction orders. We were able to obtain T1 information about eviction orders for 71% (353) of the interviewed tenants. Nine tenants had already received an eviction order at T0; these tenants were excluded from the analyses. Thus, 344 respondents were included in the analyses.

A possible bias might be caused by tenants’ high levels of stress, anxiety, shame, or fear of being evicted. Consequently, we made every effort to explain that participation in the study was very important. Researchers were also very accommodating with rescheduling interview appointments when needed. We conducted several preliminary analyses to determine whether the imminent eviction was indeed perceived as an emotional burden by the tenants included in the study. We found that tenants participating in the study reported that, as a result of their rent arrears and risk of eviction, they experienced stress (87%), had trouble sleeping (66%), were sad (72%), felt powerless (77%) and felt ashamed (57%). This suggests that tenants with a high self-assessment of eviction risk also entered the study.

Measures

We included one outcome variable in our analyses, and ten potential predictors, derived from our review of the literature.

Outcome variable: Eviction order

Six months after each interview, the respective housing associations were asked whether or not the tenant had received an eviction order.

Predictors

Based on the literature, we included ten predictors, divided into three clusters: socio-economic variables, housing and finances, and eviction circumstances.

Socio-economic variables. Four socio-economic variables were included as potential predictors. The first was the respondent’s age at the time of interview. Second, a foreign background variable classified tenants into three categories, based on the classification by Statistics Netherlands [20]: native Dutch (both parents were born in the Netherlands, even if the respondent was not born in the Netherlands), first generation immigrants (the respondent and at least one of the parents were not born in the Netherlands), and second generation immigrants (the respondent was born in the Netherlands and at least one of the parents was not born in the Netherlands). The household composition variable indicates whether respondents lived in one-person households or multi-person households, and the fourth variable indicates whether there were children living in the household (yes/no).

Housing and finances. Four variables related to housing and finances were included. Respondents estimated their total household income in the last month in Euros, and the total amount of their current rent arrears in Euros. For presentational reasons, we transformed the income and rent arrears variables by dividing them by 1,000. Furthermore, respondents were asked whether they had been fired from a job in the past three years (yes/no), and whether they had received any help from a debt counseling agency in the six months prior to the interview (yes/no).

Eviction circumstances. Two variables were included to account for the heterogeneity of our sample of households: the city in which the tenant lived (Amsterdam, Leiden, Nijmegen, Rotterdam or Utrecht), and the phase in the eviction process at the time of interview (before being summoned to appear in court, between summoning and the court hearing, after the court hearing but without an eviction order). The phase in the eviction process was determined by asking several questions, to be answered by yes or no (i.e. “Were you summoned to appear in court because of your rent arrears?”).

Data analysis

Table 1 shows descriptive statistics and missing values for our sample. Since data was missing for more than 5% of the respondents for income and level of rent arrears, we searched for differences between the respondents with and without values for these two variables for the outcome measure. A significant difference was found only for respondents with and without missing values for the level of rent arrears: respondents with missing values for the level of rent arrears more often received an eviction order (41%, compared to 22% of tenants with a value for level of rent arrears; χ2(1, N = 344) = 5.37, p = .02).

Table 1. Descriptive statistics of predictor variables for available responses.

Variable name N % Missing Mean Range SE
Age 338 6 (1.7%) 43.4 19–80 12.3
Foreign background 343 1 (0.3%)
        Native Dutch 169 49.3
        First generation immigrant 140 40.8
        Second generation immigrant 34 9.9
Household composition 341 3 (0.9%)
        One-person household 180 52.8
        Multi-person household 161 47.2
Children living in the household 341 3 (0.9%)
        No 210 61.6
        Yes 131 38.4
Total household income (Euro) 321 23 (6.7%) 1405.7 0.0–4,500.0 723.5
Total rent arrears (Euro) 315 29 (8.4%) 855.3 0.0–5,000.0 941.6
Fired from job in past 3 years 335 9 (2.6%)
        No 227 67.8
        Yes 108 32.2
Received help from debt counseling in past 6 months 335 9 (2.6%)
        No 253 75.5
        Yes 82 24.5
City 344 -
        Amsterdam 40 11.6
        Leiden 15 4.4
        Nijmegen 52 15.1
        Rotterdam 62 18.0
        Utrecht 175 50.9
Phase in the eviction process 334 10 (2.9%)
        Before summoning 248 74.3
        Between summoning and court hearing 42 12.6
        After hearing, no eviction order (yet) 44 13.2

We used logistic regression analysis to determine which variables significantly predicted whether tenants had received an eviction order at T1. In all analyses, p-values of ≤ .10 were considered statistically significant. A backward stepwise logistic regression analysis was conducted, starting with a model that included all ten predictors and, in each step, deleting the predictor with the lowest significance, leading to a sparse model with only significant predictors. Since only respondents with values for all predictors could be included in the backward stepwise logistic regression, the accumulation of missing values reduced our sample significantly (to N = 275); therefore, we followed up by adding each predictor to the sparse model individually (with the N that was available for this smaller model) to determine whether adding the predictor improved the model. Using the final model, the predicted probability and marginal effects were calculated.

Results

Of the 344 tenants that could be included in the analyses to predict eviction orders, 24% (82) had received an eviction order at T1. The initial logistic regression analysis with all predictors only shows total rent arrears at T0, living in Utrecht, and being between a summons and a court hearing as significant predictors (Table 2).

Table 2. Initial multiple logistic regression model predicting receiving an eviction order (N = 275).

Variable B SE OR 95% CI for OR
Age 0.01 0.01 1.01 [0.98, 1.03]
Foreign background (Ref: Native Dutch)
First generation immigrant 0.16 0.38 1.18 [0.56, 2.47]
Second generation immigrant 0.07 0.64 1.07 [0.30, 3.77]
Household composition: One-person household 0.92 0.65 2.51 [0.70, 8.97]
Children living in the household: yes 0.04 0.67 1.04 [0.28, 3.88]
Total household income/1,000 0.01 0.27 1.01 [0.60, 1.71]
Total rent arrears at T0/1,000 0.94*** 0.18 2.55 [1.78, 3.64]
Fired from job in past 3 years: yes 0.44 0.36 1.56 [0.78, 3.12]
Received help from debt counseling in past 6 months: yes 0.44 0.39 1.55 [0.72, 3.34]
City (Ref: Rotterdam)
Amsterdam 0.69 0.63 1.99 [0.58, 6.83]
Leiden 1.65* 0.77 5.23 [1.16, 23.56]
Nijmegen 0.87 0.61 2.39 [0.73, 7.86]
Utrecht 0.42 0.54 1.52 [0.53, 4.39]
Phase in eviction process (Ref: before summoning)
        Between summoning and court hearing 0.91* 0.49 2.48 [0.95, 6.46]
        After hearing, no eviction order (yet) 0.14 0.50 1.15 [0.43, 3.07]
Constant -4.09

Notes. Reference categories are given in parentheses for categorical variables. R2 = .16 (Cox & Snell) .25 (Nagelkerke).

*p < .10.

**p < .001.

***p < .001.

Backward stepwise logistic regression analysis resulted in a model with household composition, the level of rent arrears and phase in the eviction process as predictors. We then added each of the excluded predictors to this sparse model to determine if they improved the model, but we did not identify other significant predictors. Thus, our final model to predict eviction orders includes being a single tenant, total rent arrears at T0, and phase in the eviction process (Table 3).

Table 3. Final multiple logistic regression model predicting receiving an eviction order (N = 304).

Variable B SE OR 95% CI for OR
Household composition (Ref: multi-person household)
One-person household 0.79* 0.33 2.20 [1.16, 4.16]
Total rent arrears at T0/1,000 0.91*** 0.17 2.48 [1.79, 3.44]
Phase in eviction process (Ref: before summoning)
        Between summoning and court hearing 1.17** 0.43 3.22 [1.40, 7.40]
        After hearing, no eviction order (yet) 0.55 0.42 1.74 [0.76, 3.98]
Constant -2.93

Notes. Reference categories are given in parentheses for categorical variables. R2 = .17 (Cox & Snell) .25 (Nagelkerke).

*p < .10.

**p < .01.

***p < .001.

The level of rent arrears at T0 proved to be a strong predictor for eviction orders: the odds of receiving an eviction order were more than two times greater when rent arrears were increased by € 1,000 (OR = 2.48; 95% CI = 1.79, 3.44). Furthermore, the odds of receiving an eviction order were more than two times greater for single tenants compared to households of more than one person (OR = 2.20; 95% CI = 1.16, 4.16). Marginal effects indicated that, controlled for rent arrears and phase in the eviction process, single tenants had a probability of .32 (95% CI = .23, .43) of receiving an eviction order, while the probability for multi-person households was .18 (95% CI = .11, .27). Additionally, the odds of receiving an eviction order were more than three times greater for tenants who had been summoned to appear in court but had not had a court hearing yet, compared to tenants who had not been summoned to appear in court (OR = 3.22; 95% CI = 1.40, 7.40). Controlled for household composition and rent arrears, the probability of receiving an eviction order for tenants who had not been summoned was .15 (95% CI = .11, .21), while it was .37 (95% CI = .22, .55) for tenants who had been summoned but had not had a hearing yet, and the probability was .24 (95% CI = .13, .40) for tenants who had had a hearing.

This logistic regression model was used to calculate the probability of receiving an eviction order as a result of the level of rent arrears at T0. Figs 2 and 3 show how the probability of receiving an eviction order differs for different categories of household composition and phases in the eviction process at T0. In each of these figures, the other predictor was at average level.

Fig 2. Probability of receiving an eviction order as a result of level of rent arrears at T0 for different household compositions, while phase in the eviction process is at average level (N = 304).

Fig 2

Fig 3. Probability of receiving an eviction order as a result of level of rent arrears at T0 for different phases in the eviction process, while household composition is at average level (N = 304).

Fig 3

In general, the probability of receiving an eviction order is relatively low for low levels of rent arrears. However, the probability of receiving an eviction order significantly increase for higher levels of rent arrears, with a higher probability for single tenants. As expected, tenants who had not yet been summoned to appear in court at T0 had the lowest probability to receive an eviction order; this probability increased with higher rent arrears. However, while tenants who had been summoned and were waiting for the court hearing had the highest probability to receive an eviction order, this probability was lower (and not significantly different from the tenants who had not yet been summoned) for the tenants who had already appeared in court but had not received an eviction order (yet).

In order to further explore the data, we repeated the logistic regression analyses for single tenants and for multi-person households. Tables 4 and 5 present the final models for these groups.

Table 4. Final multiple logistic regression model predicting receiving an eviction order for single tenants (N = 149).

Variable B SE OR 95% CI for OR
Total rent arrears at T0/1,000 1.10*** 0.29 2.99 [1.69, 5.30]
Fired from job in past 3 years: yes 0.82* 0.45 2.28 [0.95, 5.47]
Phase in eviction process (Ref: before summoning)
    Between summoning and court hearing 2.00** 0.68 7.40 [1.96, 27.89]
    After hearing, no eviction order (yet) 0.46 0.60 1.58 [0.48, 5.16]
Constant -2.66

Notes. Reference categories are given in parentheses for categorical variables. R2 = .22 (Cox & Snell) .32 (Nagelkerke).

*p < .10.

**p < .01.

***p < .001.

Table 5. Final multiple logistic regression model predicting receiving an eviction order for multi-person households (N = 151).

Variable B SE OR 95% CI for OR
Total rent arrears at T0/1,000 0.97*** 0.24 2.65 [1.66, 4.21]
City (Ref: Rotterdam)
Amsterdam 2.09* 1.00 8.08 [1.14, 57.11]
Leiden 2.16* 1.17 8.71 [0.88, 86.57]
Nijmegen 2.18* 1.01 8.81 [1.22, 63.42]
Utrecht 1.12 0.92 3.07 [0.50, 18.81]
Constant -4.04

Notes. Reference categories are given in parentheses for categorical variables. R2 = .18 (Cox & Snell) .30 (Nagelkerke).

*p < .10.

**p < .01.

***p < .001.

For both single tenants and multi-person households, the level of rent arrears at T0 was a strong predictor of receiving an eviction order, but differences between these groups were found for other predictors.

For single tenants, the odds of receiving an eviction order were three times greater when rent arrears were increased by € 1,000 (OR = 2.99; 95% CI = 1.69, 5.30). Furthermore, the odds of receiving an eviction order were more than two times greater for single tenants who had been fired from a job in the past three years compared to single tenants who had not experienced a recent job loss (OR = 2.28; 95% CI = 0.95, 5.47). Additionally, the odds of receiving an eviction order were more than seven times greater for single tenants who had received a summons from a bailiff compared to single tenants who had not received a summons. Marginal effects indicated that, controlled for rent arrears and phase in the eviction process, single tenants who had recently been fired from a job had a probability of .45 (95% CI = .28, .64) of receiving an eviction order, while the probability for single tenants who had not recently lost a job was .27 (95% CI = .16, .41). Controlled for rent arrears and recent job loss, single tenants had a probability of 0.19 (95% CI = .13, .29) to receive an eviction order if they had not been summoned yet, a probability of .64 (95% CI = .34, .86) if they had received a summons but had not had a court hearing yet, and a probability of .28 (95% CI = .12, .53) if they had had a court hearing.

For multi-person households, only the level of rent arrears and the city were found to be significant predictors of receiving an eviction order. For these households, the odds of receiving an eviction order were almost three times greater when rent arrears were increased by € 1,000 (OR = 2.65; 95% CI = 1.66, 4.21). Furthermore, city was a significant predictor among multi-person households: compared to multi-person households in Rotterdam, the odds of receiving an eviction order were eight times greater for multi-person households in Amsterdam (OR = 8.08; 95% CI = 1.14, 57.11), and almost nine times greater for multi-person households in Leiden (OR = 8.71; 95% CI = 0.88, 86.57) and Nijmegen (OR = 8.81; 95% CI = 1.22, 63.42). Controlled for rent arrears, the probability for multi-person households to receive an eviction order was 0.27 (95% CI = .10, .53) in Amsterdam, .28 (95% CI = .07, .67) in Leiden, .28 (95% CI = .13, .51) in Nijmegen, .04 (95% CI = .01, .20) in Rotterdam, and .12 (95% CI = .06, .22) in Utrecht.

Discussion

The aim of this study was to gain more insight into risk factors for receiving an eviction order. Our results indicate that the level of rent arrears is a strong predictor; higher rent arrears significantly increase the risk of receiving an eviction order. Additionally, single tenants were more likely to receive an eviction order, and tenants who had been summoned to appear in court and were waiting for their court hearing were more likely to receive an eviction order, compared to tenants who had not been summoned yet. Furthermore, different predictors were found for single tenants and for multi-person households. While rent arrears was found to be a significant predictor in both groups, among single tenants recent job loss and phase in the eviction process were significant predictors, while among multi-person households city was a significant predictor.

Our results confirm that the level of rent arrears is an important predictor for receiving an eviction order. Increasing rent arrears decrease tenants’ possibilities for recovery. Furthermore, the phase in the eviction process at the time of interview was found to be a significant predictor for eviction orders. Tenants who were between summoning and the court hearing had a higher chance to receive an eviction order than tenants who had not been summoned yet. This seems to comfirm the notion that the further tenants are in the eviction process, the smaller their chances are for recovery [7]. However, the group of tenants that was the furthest in the eviction process (the group that had already had a court hearing), did not have a significantly higher chance to receive an eviction order than tenants who had not been summoned yet. This may be explained by the fact that a court hearing can be a traumatic event for a tenant. The threat of an imminent eviction, when the housing association has the legal right to terminate the rental contract, may also serve as a strong motivator for tenants to take action towards repaying their rent arrears. Another explanation of this result is a certain selection bias: a court hearing is a very stressful event for tenants, so most tenants in that phase may not have wanted to participate in an interview. The tenants who did agree to be interviewed may have been the ones who were in less stressful circumstances, because they may have been given a second chance to repay their arrears in court, and therefore their chances of eventually receiving an eviction order were lower than for other tenants who had had a court hearing.

Furthermore, this study demonstrates that single tenants are at a significantly higher risk of receiving an eviction order. This is in line with the observations of Dutch housing associations that the majority of evicted households are single tenants [12]. A previous study [21] also demonstrated that single tenants, especially men, are at an increased risk of eviction, and a study in Sweden [22] showed that 70% of the evicted households were single tenants. The lack of support from a partner or other household members may make it more difficult for these tenants to find a solution for their rent arrears and to avert receiving an eviction order.

Further investigation of differences between single tenants and multi-person households showed significant differences between these groups. Among single tenants, besides rent arrears and phase in the eviction process, recent job loss was a significant predictor of receiving an eviction order. Single tenants generally do not have multiple income sources, so losing an income has a bigger impact than it has on families with multiple sources of income.

Interestingly, among multi-person households the city is a significant predictor of receiving an eviction order. Households in Rotterdam and Utrecht were less likely to receive an eviction order than households in Amsterdam, Leiden and Nijmegen. This indicates that different local policies and housing association procedures affect households’ chances to receive an eviction order.

The results of our study have several implications for policies regarding the prevention of evictions, and provide insights that can contribute to developing targeted interventions to prevent evictions. First, since the level of rent arrears and the phase in the eviction process are strong predictors, early interventions are necessary; if at-risk households can be identified at an early stage, the rent arrears are more manageable and evictions can be prevented. Since many households with rent arrears have other debts as well, and the rent often is not the first unpaid bill, early identification of households with a variety of arrears cannot be done by housing associations alone. In Amsterdam, for example, the Vroeg Eropaf (“go for it”) policy, which helps to identify households with financial difficulties at an early stage, in order to find solutions before a court process starts, indeed includes a large insurance company and utility providers, besides all social housing associations and social care institutions in the city [23].

Additionally, as single tenants are at a significantly higher risk of receiving an eviction order, special attention is needed for this group. Single tenants may need extra support and professional help in order to avert eviction. Single tenants who have recently experienced a job loss have a particularly higher chance of receiving an eviction order. This knowledge may be helpful to housing associations as they develop early interventions.

It should be noted that the population of tenants at risk of eviction due to rent arrears may differ across countries, resulting from different local circumstances and policies. As this study indicated, risk factors even differ across Dutch cities; multi-person households in Rotterdam and Utrecht were less likely to receive an eviction order compared to multi-person households in Amsterdam, Leiden and Nijmegen. Each Dutch city has their own policies and projects regarding evictions. In Rotterdam, for example, intensive support is provided to families with severe problems, where families risk losing social assistance benefits or an eviction if they refuse the support that is offered [24]. While policies differ among cities, housing associations also have differing policies and procedures when families have accumulating rent arrears. Therefore, when developing interventions, it is important to study the local context and identify vulnerable households in that specific context. This study has provided insights into risk factors for eviction, and how these risk factors differ across groups. Similar studies in other countries are needed to determine if these risk factors are relevant in those contexts as well.

One of the strengths of this study is its large scale. We included 344 tenants from five municipalities of different sizes, in order to make our sample more representative of the total Dutch population of tenants at risk of eviction due to rent arrears. To our knowledge, this is the first study that specifically focused on tenants facing eviction because of rent arrears, thus providing important clues to improve policy and practice to prevent evictions of these households. This vulnerable population was difficult to contact, because many tenants did not open their mail or answer their telephone, or indicated that the anxiety and stress made it impossible for them to participate in an interview. This may have caused a selection bias at T0: tenants who were experiencing high levels of stress, anxiety and/or shame may have been less inclined to participate in an interview. However, tenants participating in the study reported high levels of stress, sadness, powerlessness, trouble sleeping, and shame; this indicates that for many tenants, these emotions did not prevent them from participating.

Another challenge related to data collection was the T1 data collection. T1 data was collected by contacting the participating housing associations and asking whether or not an eviction order was issued for the tenant (after receiving written permission from the tenant at T0 to do so). Not all housing associations were able and/or willing to provide us with the complete information six months after each interview, despite our efforts to ensure that this information would be provided. All this led to a rather high non-response for both our interview data and data from housing associations. However, due to the large scale of this study, there was still ample data to build our conclusions on. Our analyses of the missing data indicated that tenants who had a missing value for the level of rent arrears at the time of interview received an eviction order more often than tenants with a value for the level of rent arrears. It is possible that the tenants who did not answer the question about their rent arrears had lost control over and insight into their financial situation, or were unwilling to mention the level of rent arrears out of shame for the height of their debt. Therefore, our results may have underestimated the true effect of the level of rent arrears as a predictor. Another limitation of this study is that it was impossible to predict actual evictions. Because the process from rent arrears to eviction can be very long, it was not feasible to determine which tenants were eventually evicted, as this usually takes longer than six months. Eviction orders are often used by housing associations to pressure tenants into accepting help from debt counseling. The threat of an imminent eviction, when the housing association has the legal right to terminate the rental contract, may also serve as a strong motivator for tenants to take action towards repaying their rent arrears. Therefore, there may be a long process after an eviction order, and if this process eventually leads to an eviction, it often does not take place within a few months after the eviction order.

While this study has provided some important insights into the risk factors for eviction orders, there is a great need for future research, to gain more insight into this vulnerable population and to develop targeted interventions. First, similar research should be conducted in other countries, in order to determine whether risk factors are similar across countries. Second, longer-term studies are needed to determine which risk factors are associated with actual evictions. Furthermore, it is important to examine why single tenants are at a higher risk of receiving an eviction order. More insight into all of the above will help to develop targeted, effective interventions to prevent evictions.

To summarize, this study aimed to identify risk factors for tenants at risk of eviction due to rent arrears. Our results call for early identification of households with financial difficulties, because higher rent arrears and being later in the eviction process make recovery more difficult. Single tenants are at a higher risk to receive an eviction order. Therefore, targeted interventions should be developed to take these risks into account.

Supporting information

S1 File. Vragenlijst predictiestudie DEF maart 2012.

(PDF)

Acknowledgments

We would like to thank all the tenants who took the time to participate in this study, all the interviewers, and all the housing associations who helped us to contact tenants. Manfred te Grotenhuis passed away before the submission of the final version of this manuscript. Judith Wolf accepts responsibility for the integrity and validity of the data collected and analyzed.

Data Availability

The SPSS data and syntax files are available from the ICPSR database (https://doi.org/10.3886/E120762V1).

Funding Statement

This study was funded by ZonMw, the Netherlands Organization for Health Research and Development, grant number 204002002. The award was received by Judith R.L.M. Wolf. The ZonMw website is: https://www.zonmw.nl/en/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Desmond M. Disposable ties and the urban poor. Am J Sociol. 2012;117(5): 1295–335. [Google Scholar]
  • 2.Wewerinke D, De Graaf W, Van Doorn L, Wolf J LM. Huurders over een dreigende huisuitzetting. Ervaringen, oplossingen en toekomstperspectief [Tenants about the risk of eviction. Experiences, solutions and prospects]. Nijmegen: Impuls; 2014. [Google Scholar]
  • 3.Rojas Y, Stenberg S. Evictions and suicide: A follow-up study of almost 22 000 Swedish households in the wake of the global financial crisis. J Epidemiol Community Health. 2016;70: 409–413. doi: 10.1136/jech-2015-206419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Gerull S. Evictions due to rent arrears: A comparative analysis of evictions in fourteen countries. Eur J Homelessness. 2014;8(2):137–55. [Google Scholar]
  • 5.Stenberg S, Van Doorn L, Gerull S. Locked out in Europe: A comparative analysis of evictions due to rent arrears in Germany, the Netherlands and Sweden. Eur J Homelessness. 2011;5(2):39–61. [Google Scholar]
  • 6.Hartman C. Evictions: the hidden housing problem. Hous Policy Debate. 2003;14:461–501. [Google Scholar]
  • 7.Akkermans C, Räkers M. Handreiking voorkomen huisuitzettingen [Guide for preventing evictions]. Amsterdam: Stichting Eropaf; 2013. [Google Scholar]
  • 8.Van Summeren F, Bogman R. Is preventieve woonbegeleiding effectief en kostenefficiënt?—Huisuitzetting voorkomen [Is preventive supported housing effective and cost efficient?—Preventing eviction]. Soc Bestek. 2011;73(4):29–32. [Google Scholar]
  • 9.Aarts L, Douma K, Friperson R, Schrijvershof C, Schut M. Op weg naar effectieve schuldhulp. Kosten en baten van schuldhulpverlening [Towards effective debt counseling. Costs and benefits of debt counseling]. The Hague: Ape Public Economics; 2011. [Google Scholar]
  • 10.Aedes. Facts & Figures 2017. Reporting year 2015. Available from: https://dkvwg750av2j6.cloudfront.net/m/6a82b6001e710f31/original/Facts-and-figures_2017.pdf.
  • 11.Boerebach N. Prevention of evictions by social housing organisations in the Netherlands. Homeless Eur. 2013;(Winter 2013):12–13. [Google Scholar]
  • 12.Aedes. Corporatiemonitor Voorkomen Huisuitzettingen [Social housing monitor preventing evictions]. The Hague: Aedes; 2019. Available from: https://dkvwg750av2j6.cloudfront.net/m/1f616e0a34b2f262/original/Corporatiemonitor-huisuitzettingen-2019-oktober-2019.pdf. [Google Scholar]
  • 13.Desmond M, Gershenson C. Who gets evicted? Assessing individual, neighborhood, and network factors. Soc Sci Res. 2016: 1–16. [DOI] [PubMed] [Google Scholar]
  • 14.Desmond M, An W, Winkler R, Ferriss T. Evicting children. Soc Forces. 2013;92(1); 303–327. [Google Scholar]
  • 15.Wewerinke D, Van den Dries L, Wolf JRLM. De aanpak van schulden bij dreigende huisuitzetting. Een verkenning in Rotterdam en Amsterdam [Handling debts in case of an eviction threat. An exploration in Rotterdam and Amsterdam]. Nijmegen: Impuls; 2015. [Google Scholar]
  • 16.Stenberg S, Kareholt I, Carroll E. The precariously housed and the risk of homelessness: A longitudinal study of evictions in Sweden in the 1980s. Acta Sociol. 1995;38(2):151–65. [Google Scholar]
  • 17.Böheim R, Taylor MP. My home was my castle: Evictions and repossessions in Britain. J Hous Econ. 2000;9(4):287–319. [Google Scholar]
  • 18.van Laere I, de Wit M, Klazinga N. Preventing evictions as a potential public health intervention: Characteristics and social medical risk factors of households at risk in Amsterdam. Scand J Public Health. 2009;37(7):697–705. doi: 10.1177/1403494809343479 [DOI] [PubMed] [Google Scholar]
  • 19.Evans G, McAteer M. Does debt advice pay? A business case for social landlords. London: The Financial Inclusion Centre; 2011. [Google Scholar]
  • 20.Keij I. Hoe doet het CBS dat nou? Standaarddefinitie allochtonen [How does Statistics Netherlands do it? Standard definition immigrants]. Cent Bur voor Stat Index. 2000;(10):24–5. [Google Scholar]
  • 21.van Laere I, de Wit M. Dakloos na huisuitzetting [Homeless after eviction]. Amsterdam: GG&GD; 2005. Available from: http://www.gezond.amsterdam.nl/GetDocument.ashx?DocumentID=2370&name=Dakloos-na-huisuitzetting&rnd=634146117102309238.
  • 22.Von Otter C, Bäckman O, Stenberg S, Qvarfordt Eisenstein C. Dynamics of eviction: Results from a Swedish database. Eur J Homelessness. 2017;11(1): 1–23. [Google Scholar]
  • 23.Van Ommeren CM, De Ruig LS, Coenen L. Amsterdam: Vroeg Eropaf. Businesscase vroegsignalering en preventie van schulden [Amsterdam: Go for it. Business case early detection and prevention of debts]. Zoetermeer: Panteia; 2014. [Google Scholar]
  • 24.Schaafsma K, Dieters M, Verweij S. Voorkomen is beter dan uit huis zetten. Handleiding voor de aanpak voor multiprobleemgezinnen en woonproblematiek [Prevention is better than eviction. Manual for the approach for multi-problem families and housing problems]. Amsterdam; 2013. Available from: https://www.dsp-groep.nl/wp-content/uploads/15ksmpgwo2_handleiding-voorkomen-is-beter-dan-uit-huis-zetten.pdf. [Google Scholar]

Decision Letter 0

Shihe Fu

25 Nov 2020

PONE-D-20-27239

Dutch tenants at risk of eviction: Identifying predictors of eviction orders

PLOS ONE

Dear Dr. Edwards,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Both qualified reviewers liked your research but raised valid concerns. Please try to address their concerns as much as you can. Particularly, you have not explored enough your data. Although it is difficult to establish a rigorous causality test, it should be feasible to estimate more models with different predictors to see how your current findings change, as reviewer 2 suggested. Also a p value of 0.1 is often considered significant too and you certainly can include those variables whose coefficients are statistically significant at the 10% level or better.  

Please submit your revised manuscript by Jan 09 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Shihe Fu, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please ensure you have provide a copy of all questionnaires used in your study as supporting information files.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This paper utilizes a sample of 344 tenants who were at risk of eviction due to rent arrears in five Dutch cities interviewed using a structured questionnaire to test ten potential risk factors for evictions. Multiple logistic regression analyses are applied on the tenants’ personal information and the tenants’ situation at the notice of eviction risk and six months after the notice. The authors conclude that the amount of rent arrears was a strong predictor for receiving an eviction order, and single tenants, tenants who had already been summoned to appear in court were more likely to receive an eviction order. The authors believe that these results can contribute to identifying households at risk of eviction at an early stage, and help to develop targeted interventions to prevent evictions.

Overall, this is an interesting research work and carries immediate real-life application potentials. However, there are several major weaknesses in the current version of this paper.

First, the survey design. The sample size is not big, but this is not a very big issue. The more important issue is the representativeness of the samples. The authors need to provide more justifications on the interview was scientifically designed, and the interviewees were not chosen with systematic bias. For example, since the interviewees enrolled in the survey on voluntary basis rather than by force, there is high possibility that only those tenants with low self-assessment of eviction risks would choose to join the research. Thus, the analysis on such groups of interviewees may produce biased findings.

Second, the empirical design. What so far observed and discussed by the authors is just correlation but not causality. Correlation helps little in delivering policy recommendation. Since the data is one-shot cross-section data, it may suffer high risks of self-selection and endogeneity when attempting to discover causality relationship. These problems are hard to address but not incurable. There are several econometric tools to address them. The authors may carefully consider them.

Third, the model. Too few controls are included in the regression models. I suppose several variables such as ethnic backgrounds, immigrant or not and years of immigration, the ratio of rent in household monthly income, and regional dummies should enter in the model. The work also needs several robustness checks, i.e., checking the consistency of the findings in different model setup and alternative use of key variables.

Fourth, the generality. PLOS ONE is an international journal, the authors should put more justifications on why a case study of Dutch may be interested to international audiences, or what international readers can learn from this work.

Finally, contributions and innovations. The authors should make more attempts on highlighting what new insights this paper could offer to readers. The findings such as “the amount of rent arrears was a strong predictor for receiving an eviction order”, is well predicted and not surprised at all. The readers need to know something that they could not imagine themselves but need to be informed from researchers.

Reviewer #2: The authors have a fine idea to explore some potential risk factors predicting whether or not tenants receive an eviction order. In particular, they use the logistic regression model to determine which factor (variable) significantly affects the probability of tenants receive an eviction order. The authors conclude that the amount of rent arrears, whether tenants are single, and phase in eviction process are strong predictors for eviction orders. While the topic is of interest, I do have some concerns that should be addressed and discussed in the paper.

1. While 495 tenants were included in the study at T0, only 71% (353) of tenants were tracked at T1, which may cause a selection bias issue. For example, as you mentioned in line 294-296 (Page 13), tenants who have had a court hearing may not want to continue to participate in an interview. Therefore, I suggest that you can use the Probit or Logit model to investigate which factors affect the response rates for follow-up interview at T1. In addition, you can also test whether significant differences exist between the respondents with and without information about eviction for the ten predictors.

2. You conducted a backward stepwise logistic regression analysis to discard the statistically insignificant variables, one by one. However, I am afraid that the results based on the model you used may be misleading. Smith (2018) uses a Monte Carlo simulation model to demonstrate that some predictors that have causal effects on the dependent variable may happen be statistically insignificant and therefore are discarded, while nuisance predictors may be coincidentally significant. Plus, the larger the number of potential predictors, the stepwise regression analysis is less effective.

From the perspective of econometrics, variables should be included in a model based on theoretical grounds rather than the size of their t-values. If variables that truly belong in the model are omitted, the estimated coefficients of the existing explanatory variables would be biased. (Wooldridge 2006)

Based on the reasons mentioned above, I suggest that you can choose variables from a priori knowledge, then use the logistic regression model to determine which variables are significant and which are not.

3. When you try to explain the results shown in Table 2, you mainly show that how the odds ratios (OR) of receiving an eviction order change when predictors (such as household composition) change. I think that you can also show the marginal effects of receiving an eviction order at the means for all available predictors, because a marginal effect of a predictor shows how do predicted probabilities change as the predictor changes 1-unit, which would be easier to understand for audience.

4. You can try to use other functional forms when you run the logistic regression. For example, I suggest that you can transform some variables such as the total household income in the last month and the total amount of respondents’ current rent arrears using the natural logarithm transformation.

5. You can try to do subsample regression to explore heterogeneity among different groups. For example, you can divide the whole sample into group of one-person household and group of multi-person household.

Some more detailed comments while reading the paper:

-Figure 1: You’d better use a vector image (such as SVG, eps, wmf,emf), because vector images can be enlarged to any size without appearing pixelated.

-Page 10: The last sentence (line 226-228) on Page 10 is unclear to me. “The final model was used to calculate the risk of 227 receiving an eviction order as a result of combinations of two predictors, controlling for the 228 other predictors in the models.” Could you explicitly point out the names of the two predictors you mentioned?

-Figure 2 and 3: Please show the confidence interval of variables in Figure 2 and 3.

References:

Smith, Gary. "Step away from stepwise." Journal of Big Data 5.1 (2018): 32.

Wooldridge JW. Introductory econometrics: a modern approach. 3rd ed. Mason: Thompson; 2006. p. 94–7.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jul 14;16(7):e0254489. doi: 10.1371/journal.pone.0254489.r002

Author response to Decision Letter 0


17 May 2021

Thank you for providing us an opportunity to revise our manuscript “Dutch Tenants at Risk of Eviction: Identifying Predictors of Eviction Orders”. In this letter, we respond to each point raised. Please note: page and line numbers in our responses refer to the document titled “Revised Manuscript with Track Changes”.

Response to the Editor:

The Editor indicated the we had not explored our data enough, and that more models with different predictors should be estimated. The Editor also suggested using a p value of 0.1 instead of 0.05.

We repeated the backward stepwise logistic regression analysis using a p value of 0.1; this resulted in the same model. We also estimated models with the other predictors (see our response to reviewer #2 below).

Response to Reviewer #1:

Reviewer #1 raised five issues, related to the survey design, the empirical design, the model, the generality, and contributions and innovations.

Reviewer #1: First, the survey design. The sample size is not big, but this is not a very big issue. The more important issue is the representativeness of the samples. The authors need to provide more justifications on the interview was scientifically designed, and the interviewees were not chosen with systematic bias. For example, since the interviewees enrolled in the survey on voluntary basis rather than by force, there is high possibility that only those tenants with low self-assessment of eviction risks would choose to join the research. Thus, the analysis on such groups of interviewees may produce biased findings.

Due to moral and ethical constraints the medical ethical committee of the region Arnhem-Nijmegen allowed for inclusion of tenants on a voluntary basis. We cannot force tenants to participate in our study. This indeed means there is a risk of an inclusion bias with a higher chance of tenants with a lower self-assessment of eviction risks joining the study. The results of our study, however, show that tenants participating in the study experienced high levels of stress, shame, sadness, powerlessness, and trouble sleeping, related to the rent arrears. This suggests that tenants with a high self-assessment of eviction risk also entered the study. We added sections about this in the Methods and Discussion (page 8, lines 173-181; page 20, lines 438-442).

Reviewer #1: Second, the empirical design. What so far observed and discussed by the authors is just correlation but not causality. Correlation helps little in delivering policy recommendation. Since the data is one-shot cross-section data, it may suffer high risks of self-selection and endogeneity when attempting to discover causality relationship. These problems are hard to address but not incurable. There are several econometric tools to address them. The authors may carefully consider them.

Thank you for this feedback. However, our data is not only “one-shot cross-section data”; we collected data on predictors among tenants at risk of eviction, and six months later we collected the outcome data. So, besides correlation, there is also a temporal priority of the independent variables. The T1 data collection is described on page 7, lines 153-159. We edited this paragraph to improve clarity.

Reviewer #1: Third, the model. Too few controls are included in the regression models. I suppose several variables such as ethnic backgrounds, immigrant or not and years of immigration, the ratio of rent in household monthly income, and regional dummies should enter in the model. The work also needs several robustness checks, i.e., checking the consistency of the findings in different model setup and alternative use of key variables.

As suggested, we added the regression model with all predictors (page 12, lines 241-250), presenting an overview of the controls that we tested in the model. These predictors were all derived from our review of the literature on risk factors for eviction. The backward stepwise logistic regression analysis was followed by forward stepwise logistic regression analysis, adding one predictor to the sparse model at a time to determine if that improved the model.

We also conducted the logistic regression with the natural logarithm transformations for household income and rent arrears; however, this did not change the results. Therefore, we chose not to report on the results using these transformations. Additionally, we repeated the analyses for single tenants versus multi-person households, which led to two different models (pages 14- 16, lines 305-352).

Reviewer #1: Fourth, the generality. PLOS ONE is an international journal, the authors should put more justifications on why a case study of Dutch may be interested to international audiences, or what international readers can learn from this work.

We elaborated more on the generalizability of the study (page 19, lines 417-430). We also hope that the addition of the comparison between single tenants and multi-person households (page 18, lines 390-400) will be more interesting to international audiences. We do realize that local laws, policies and regulations around rent arrears and evictions vary greatly, and we therefore highly recommend further research in other locations to determine whether the relations we found are present across various localities (page 21, lines 468-469).

Reviewer #1: Finally, contributions and innovations. The authors should make more attempts on highlighting what new insights this paper could offer to readers. The findings such as “the amount of rent arrears was a strong predictor for receiving an eviction order”, is well predicted and not surprised at all. The readers need to know something that they could not imagine themselves but need to be informed from researchers.

As suggested by Reviewer #2, we conducted further analyses and compared single tenants and multi-person households. These analyses resulted in more insights (the role of job loss and differences between cities; page 18, lines 390-400). We hope that this addition resolves this issue.

Response to Reviewer #2:

Reviewer #2 raised five issues. We will respond to each issue below.

Reviewer #2: While 495 tenants were included in the study at T0, only 71% (353) of tenants were tracked at T1, which may cause a selection bias issue. For example, as you mentioned in line 294-296 (Page 13), tenants who have had a court hearing may not want to continue to participate in an interview. Therefore, I suggest that you can use the Probit or Logit model to investigate which factors affect the response rates for follow-up interview at T1. In addition, you can also test whether significant differences exist between the respondents with and without information about eviction for the ten predictors.

The T1 data was not collected through interviews with tenants, but by asking housing associations to provide the needed information about each tenant. Because the issues preventing us from collecting complete T1 data were at the housing association level (organizational restructuring, changes in IT systems and difficulties working with debt collectors) and not at the individual tenant level, we believe this has not caused a selection bias at T1. The issues around the T1 data collection are described under “Procedure and Participants” (pages 7-8, lines 159-172). We added the discussion of the T1 data collection in the Discussion (page 20, lines 443-448) to be clearer.

Reviewer #2: You conducted a backward stepwise logistic regression analysis to discard the statistically insignificant variables, one by one. However, I am afraid that the results based on the model you used may be misleading. Smith (2018) uses a Monte Carlo simulation model to demonstrate that some predictors that have causal effects on the dependent variable may happen be statistically insignificant and therefore are discarded, while nuisance predictors may be coincidentally significant. Plus, the larger the number of potential predictors, the stepwise regression analysis is less effective.

From the perspective of econometrics, variables should be included in a model based on theoretical grounds rather than the size of their t-values. If variables that truly belong in the model are omitted, the estimated coefficients of the existing explanatory variables would be biased. (Wooldridge 2006)

Based on the reasons mentioned above, I suggest that you can choose variables from a priori knowledge, then use the logistic regression model to determine which variables are significant and which are not.

We understand the concerns about the risk of omitting variables that should be in the model. Therefore, we added a section in the results (page 12, lines 241-250) that presents the model that includes all variables that we expected to have an effect on receiving an eviction order. These variables were all derived from the literature presented in the introduction. This is stated in the Method section (page 8, line 184). Additionally, after determining the sparse model with only significant variables, we added each excluded variable to this sparse model again, to determine if adding the variable would improve the model. We clarified this in the Results in more detail (page 12, lines 253-255)

Reviewer #2: When you try to explain the results shown in Table 2, you mainly show that how the odds ratios (OR) of receiving an eviction order change when predictors (such as household composition) change. I think that you can also show the marginal effects of receiving an eviction order at the means for all available predictors, because a marginal effect of a predictor shows how do predicted probabilities change as the predictor changes 1-unit, which would be easier to understand for audience.

Thank you for this feedback. We added the marginal effects (page 13, lines 270-273 and lines 276-280).

Reviewer #2: You can try to use other functional forms when you run the logistic regression. For example, I suggest that you can transform some variables such as the total household income in the last month and the total amount of respondents’ current rent arrears using the natural logarithm transformation.

Thank you for this suggestion. We ran the logistic regression with the natural logarithm transformations for household income and rent arrears; however, this did not change the results. Therefore, we chose not to report on the results using these transformations.

Reviewer #2: You can try to do subsample regression to explore heterogeneity among different groups. For example, you can divide the whole sample into group of one-person household and group of multi-person household.

This is a great suggestion, thank you. We conducted the logistic regression analysis among single tenants and multi-person households and found interesting differences between these groups (pages 14-16, lines 305-352). We explored options to compare other groups, but because in most cases the groups were too small to be able to conduct the analyses, we chose to only report on the difference between single tenants and multi-person households.

Reviewer #2: Figure 1: You’d better use a vector image (such as SVG, eps, wmf,emf), because vector images can be enlarged to any size without appearing pixelated.

Thank you for this suggestion. We uploaded Figure 1 as an EPS file instead.

Reviewer #2: Page 10: The last sentence (line 226-228) on Page 10 is unclear to me. “The final model was used to calculate the risk of receiving an eviction order as a result of combinations of two predictors, controlling for the other predictors in the models.” Could you explicitly point out the names of the two predictors you mentioned?

We changed the language of this section (pages 11-12, lines 237-238). In the Results section (page 14, lines 281-285) we explain exactly which predictors were included in these risk calculations.

Reviewer #2: Figure 2 and 3: Please show the confidence interval of variables in Figure 2 and 3.

Because Figures 2 and 3 were created by computing the probability of receiving an eviction order based on the final logistic regression model, and the graphs were not based on the data but on the parameters in the model, we cannot include confidence intervals.

In addition to the changes requested by the Reviewers and Editor, we also edited the acknowledgement section, based on communication with your editorial office regarding one author who passed away before completion of the manuscript. Additionally, we uploaded the questionnaire as supplemental material.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Shihe Fu

29 Jun 2021

Dutch tenants at risk of eviction: Identifying predictors of eviction orders

PONE-D-20-27239R1

Dear Dr. Edwards,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Shihe Fu, Ph.D.

Academic Editor

PLOS ONE

P.S. I am very sorry for your loss of your coauthor Professor Manfred te Grotenhuis.  Please accept my deepest condolences.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: My concerns have been addressed and I have no further comments. But I would like to receive information on how other reviewers judge the revision.

Reviewer #2: The authors have addressed all the issues I raised. Therefore I accept this paper without further comments. Congratulations.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: ZHEJIN ZHAO

Acceptance letter

Shihe Fu

2 Jul 2021

PONE-D-20-27239R1

Dutch tenants at risk of eviction: Identifying predictors of eviction orders

Dear Dr. Edwards:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Shihe Fu

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Vragenlijst predictiestudie DEF maart 2012.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    The SPSS data and syntax files are available from the ICPSR database (https://doi.org/10.3886/E120762V1).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES