Skip to main content
SSM - Population Health logoLink to SSM - Population Health
. 2020 Nov 18;12:100695. doi: 10.1016/j.ssmph.2020.100695

Impact of Brazil's More Doctors Program on hospitalizations for primary care sensitive cardiovascular conditions

Ece A Özçelik a,, Adriano Massuda a,b, Margaret McConnell a, Marcia C Castro a
PMCID: PMC7725939  PMID: 33319027

Abstract

Globally, cardiovascular diseases are the leading cause of disease burden and death. Timely and appropriate provision of primary care may lead to sizeable reductions in hospitalizations for a range of chronic and acute health conditions. In this paper, we study the impact of Brazil's More Doctors Program (MDP) on hospitalizations due to cerebrovascular disease and hypertension. We exploit the geographic variation in the uptake of the MPD and combine coarsened exact matching and difference-in-difference methods to construct valid counterfactual estimates. We use data from the Hospital Information System in Unified Health System, the MDP administrative records, the Brazilian Regulatory Agency, the Ministry of Health, and the Brazilian Institute of Geography and Statistics, covering the years from 2009 to 2017. Our analysis resulted in estimated coefficients of −1.47 (95%CI: −4.04,1.10) for hospitalizations for cerebrovascular disease and −1.20 (95%CI: −5.50,3.11) for hypertension, suggesting an inverse relationship between the MDP and hospitalizations. For cerebrovascular disease, the estimated MDP coefficient was −0.50 (95%CI: −2.94,1.95) in the year of program introduction, −5.21 (95%CI: −9.43,-0.99) and −8.21 (95%CI: −13.68,-2.75) in its third and fourth year of implementation, respectively. Our results further suggest that the beneficial impact of MDP on hospitalizations due to cerebrovascular disease became discernable in urban municipalities starting from the fourth year of implementation. We found no evidence that the MDP led to reductions in hospitalizations due to hypertension. Our results highlight that increased investment in resources devoted to primary care led to improvements in hospitalizations for selected cardiovascular conditions. However, it took time for the beneficial effects of the MDP to become discernable and the Program did not guarantee declines in hospitalizations for all cardiovascular conditions, suggesting that further improvements may be needed to enhance the beneficial impact of the MDP on the level and distribution of population health in Brazil.

Keywords: Brazil, Primary healthcare, More doctors program, Physician recruitment, Family health strategy

Highlights

  • Globally, cardiovascular diseases are the leading cause of disease burden and death.

  • We study the impact of the More Doctors Program (MDP) on hospitalizations due to cerebrovascular disease and hypertension.

  • We combine coarsened exact matching and difference-in-difference methods to construct valid counterfactual estimates.

  • We find an inverse association between MDP and hospitalizations due to cerebrovascular disease and hypertension.

  • We show that the beneficial effects of MDP on cerebrovascular disease increased over time.

Introduction

Globally, cardiovascular diseases are the leading cause of disease burden and death (Naghavi et al. 2017). The worldwide number of deaths attributable to cardiovascular diseases is estimated to have increased from approximately 11.9 to 17.1 million deaths between 1990 and 2015 (IHME, 2018). Low- and middle-income countries bear a considerable share of the disease burden, with more than 80% of global deaths due to cardiovascular diseases now occurring in these settings (Murray et al. 2012; Naghavi et al. 2017; Yusuf et al. 2014).

The Global Conference on Primary Health Care in 2018 renewed global commitment to strengthening primary care provision. Previous studies demonstrate a positive relationship between primary care strengthening and better health outcomes, as well as improvements in the quality and efficiency of health care delivery and patient satisfaction (Shi et al. 2002; Macinko et al. 2003, 2009; Starfield et al. 2005; Kringos et al. 2010, 2013; Kruk et al., 2010; Shi, 2012; Starfield, 2012; Doubova et al. 2016; Macinko 2019; Button et al. 2019).

An extensive literature shows that timely and appropriate provision of primary care may lead to sizeable reductions in hospitalizations for a range of chronic and acute health conditions (Ansari, 2007; Billings et al. 1993). Previous studies indicate that high rates of primary care sensitive hospitalizations may signal challenges in access to and quality of primary care, inadequate distribution of resources for health, or a mismatch between the availability of services and the needs of the population (AHRQ 2001; Ansari, 2007; Caminal et al. 2004; Laditka et al. 2003; Rosano et al. 2012). Yet, available evidence on the relationship between increased investment in primary care and the use of hospital services is mixed (Gibson et al. 2013; Rosano et al. 2012). Several studies found that there was an inverse relationship (Arrieta & García-Prado, 2015; Laditka et al. 2005; Rizza et al. 2007), whereas others showed a positive or no associations (Ricketts et al. 2001; Schreiber & Zielinski, 1997). Moreover, most empirical evidence comes from high-income settings, including the United States, Canada, Australia, and European health systems (Cloutier-Fisher et al. 2006; Friedberg et al. 2010; Glied & Smith, 2011; Kringos et al. 2010; Lopez et al. 2017; Magán et al. 2011; Purdy et al. 2009; Rosano et al. 2012; Weissman et al. 1992; Whittaker et al. 2016).

In this study, we address the gap in the literature by assessing the impact of Brazil's More Doctors Program (MDP) on hospitalizations for cardiovascular conditions. Brazil's main platform for primary care provision, known as the Family Health Strategy (FHS), plays an integral role in the country's strategy for the prevention of NCDs (Macinko et al. 2010; Schmidt et al. 2011). Since its launch in 1994, the FHS has become the world's largest community-based primary care program, reaching more than 122 million people (Andrade, Coelho, Xavier, & et al, 2018; Macinko & Harris, 2015). Over the last two decades, the FHS was scaled up rapidly. However, there were considerable disparities in the proportion of the population covered across geographic regions (Massuda et al. 2018). Imbalances in the distribution of physicians, rather than a shortage, has been highlighted as one of the most difficult challenges undermining efforts for equitable expansion of the FHS (Andrade, Coelho, Xavier, & et al, 2018).

Established in 2013, the MDP was one of the world's largest health programs that aimed to strengthen primary care provision in traditionally underserved communities (Ministério da Saúde, 2019). The MDP had three main components. The first involved new funding for the construction of new primary health care clinics or refurbishing of existing ones to support health care provision on the ground. The second was the establishment of new medical school in underserved areas with a particular emphasis on primary care training. Finally, the third component entailed the recruitment of a cadre of domestic and foreign physicians to serve in municipalities where previous attempts to attract Brazilian physicians proved difficult. A unique feature of the program was that MDP physicians were required to work exclusively in primary care settings. This feature provides a valuable opportunity to study the relationship between primary care physician availability and hospitalizations due to primary care sensitive conditions for selected cardiovascular conditions.

We identified the effect of the MDP by exploiting the geographic variation in the uptake of the program. As our main primary outcomes, we selected hospitalizations due to cerebrovascular disease and hypertension. Together, these two conditions represent close to half of all hospitalizations due to cardiovascular diseases between 2009 and 2017 in Brazil. To the best of our knowledge, this study provides the first causal evidence of the impact of the MDP on hospitalizations for these selected cardiovascular conditions.

More Doctors Program

In Brazil, NCDs—specifically, cardiovascular diseases—represent the leading cause of death. In 2015, NCDs accounted for approximately 74% of all deaths, with cardiovascular diseases representing about one-third of these deaths (IHME, 2018; Victora et al. 2011). The burden of cardiovascular deaths is more pronounced in poorer regions of the country (Schmidt et al. 2011).

The FHS is the main platform for primary care provision, and services are delivered by multi-professional FHS teams comprised of physicians, nurses and community health workers, that serve up to 1000 households residing in non-overlapping catchment areas. During their monthly visits, the FHS teams screen patients for major risk factors related to cardiovascular diseases in accordance with the national guidelines and protocols. Based on these patient assessments, the FHS teams then make recommendations, including smoking cessation, changes in dietary habits and increasing physical activity that can help reduce the burden of cardiovascular diseases. For high-risk patients, the FHS teams can prescribe medication and monitor whether their patients are taking their medications as prescribed and assess whether prescription refills are needed. All Brazilians are eligible to utilize FHS services free of charge.

Earlier studies demonstrate that the expansion of FHS led to improvements in health system performance (Aquino et al. 2009; Bastos et al. 2017; Elias et al. 2008; Hone et al. 2017; Macinko et al. 2007; Nery et al. 2014; Rasella et al. 2010) with substantial reductions in hospitalizations for conditions sensitive to primary care (Cavalcante et al. 2018; Macinko et al. 2010, 2011) and deaths due to cerebrovascular and cardiovascular diseases among adults (Rasella et al. 2014).

With the aim of reducing imbalances in the distribution of physicians working in FHS teams, the MDP was launched in 2013 by the Ministry of Health (MOH). The MOH was the main government agency responsible for overseeing the implementation of the MDP; it recruited more than 16 thousand domestic and foreign physicians, developed strategies to determine the allocation of physicians to participating municipalities in accordance with their needs, and paid the wages of MDP physicians (Santos et al. 2018). The MDP relied particularly on foreign physicians who were recruited from more than 85 countries (Nogueira et al. 2016); more than half of about 16 thousand MDP physicians all MDP physicians (52%) were from Cuba (Santos et al. 2018).

The municipal governments were mainly responsible for covering the cost of lodging and food expenses. Service contracts were renewed every three years. Unlike other physicians working in FHS, it was required that the MDP physicians recruited from other countries had prior experience in family medicine. Upon acceptance into the program, they enrolled in a mandatory three-week course. MDP physicians were also required to attend regular, brief training courses organized by Brazilian health authorities at regular intervals, and they could enroll in online medical education classes. MDP physicians were supervised by Brazilian health professionals who provided guidance on their medical inquiries. Once placed in local communities, MDP physicians were required to practice medicine only within the organization of the FHS.

As shown in Fig. 1, the geographic coverage of the MDP expanded rapidly, with the proportion of municipalities that enrolled in the program increasing from almost 20% in 2013 to about 63% in 2017. To distribute MDP physicians across communities, the MOH ranked municipalities by priority based on a set of criteria including the proportion of the population living in poverty, geographic location and population size (Özçelik et al. 2020). All municipalities were eligible to join the MDP; though they were required to submit an application to the MOH to receive MDP physicians. Once a municipality submitted their application, the MOH determined whether the municipality was among the priority communities and calculated the number of MDP physicians that would be allocated to the community (Özçelik et al. 2020).

Fig. 1.

Fig. 1

The More Doctors Program implementation, 2013, 2015 and 2017.

Orange and white denotes municipalities enrolled and unenrolled in the program each year of implementation, respectively. Black lines indicate the state boundaries in Brazil.

Methods

Our main unit of analysis in the post-CEM sample is 5564 out of Brazil's 5570 municipalities in the period between 2009-2017. We obtained de-identified administrative data on the number of MDP physicians working in municipalities between 2013-2017 from the MOH. We measured socioeconomic development using the municipal gross domestic product (GDP) per capita (in log scale) for the years 2009–2017 using data from the Brazilian Institute of Geography and Statistics (IBGE). We used administrative records from the MOH to construct an indicator of the number of hospital beds per 1000 inhabitants, excluding psychiatric beds. For data available on a monthly basis, we used July as a temporal reference, as was done in previous studies (Andrade et al. 2018a, 2018b). Using data from the Brazilian Regulatory Agency, we controlled for the proportion of the population with private health plans to account for the public-private provider mix in each municipality. We also included controls for the proportion of population of population between 0-19 years of age, between 20 and 49 years of age, and 50 years and older provided by the IBGE. Population estimates by age groups were available for only the period from 2009 to 2015. We used the 2015 age distribution of municipalities in our calculations of age distributions in municipalities for 2016 and 2017. We opted for this approach, because we observed no substantial changes in the municipality age structure during the study period. We built a categorical variable to capture the size of the municipal population using data from the IBGE. Population size was coded in five categories: <5000 inhabitants, 5000–9999 inhabitants, 10,000–19,999 inhabitants, 20,000–49,999 inhabitants, and 50,000 or more inhabitants (A more detailed overview of covariates used in analysis is provided in the Appendix).

To classify location type of each municipality, we obtained the list of municipalities with populations living in rural settlements (Damasceno et al. 2017) based on classifications developed in November 2013 by the Board for Land Acquisition and Settlements Implementation in the Ministry of Agrarian Development. Similar to IBGE, we classified municipalities with no rural settlements as urban areas (IBGE, 2017). We opted for these classifications, because the MOH explicitly highlighted municipalities with rural settlements as among priority communities while distributing MDP resources (Ministério da Saúde, 2014; Özçelik et al. 2020). In this way, our analysis aims for consistency with the implementation of the MDP. Moreover, subgroup analyses provide evidence on the impact of the MDP on communities that were explicitly targeted.

Our primary outcome is the number of hospitalizations by municipality of residence for cardiovascular conditions sensitive to primary care per 100,000 inhabitants. In particular, we focused on cerebrovascular disease and hypertension, which combined represent almost half of hospitalizations due to cardiovascular diseases in our study period. We selected these outcomes on the basis of the list of primary care sensitive conditions published by the MOH in 2008, as well as findings from earlier studies (Cavalcante et al. 2018; Dantas et al. 2018; Macinko et al. 2009; Ministério da Saúde, 2008). We scaled our outcome variables by population size, because the distribution of the number of hospitalizations was skewed. To construct these outcomes, we merged data from two publicly available data sets. First, we obtained patient hospital discharge records from the Hospital Information System (HIS). The HIS is a national database of patient records that contains information for all hospitalizations financed by the national health system, including public hospitals, private and non-profit facilities. We extracted data using the International Classification of Diseases, Tenth Revision (ICD-10) groupings for the period 2009–2017. We accessed data on the number of residents living in each municipality from publicly available population counts reported by the IBGE.

A central challenge in assessing the impact of the MDP on hospitalizations is the non-random roll-out of the program across municipalities. Difference-in-difference methods rely on the assumption that after controlling for municipal-level observable characteristics and trends, changes in our primary outcomes are independent of the enrollment status in the MDP. When this assumption fails, the difference-in-difference estimates are biased, because the method is unable to distinguish between changes in the outcomes that are attributable to the program and those that are not (Lindner & Mcconnell, 2018).

In our study, we aim to construct valid estimates of counterfactual municipalities to ascertain how hospitalizations due to cerebrovascular disease and hypertension would have changed in the MDP municipalities in the absence of the program. A growing literature suggests the combination of the difference-in-difference method with coarsened exact matching (CEM) in order to reduce bias in causal inference where program roll-out is not random (Ho et al. 2007; Ku et al. 2019; Lindner & Mcconnell, 2018; Ryan et al. 2015, 2019; Stuart, 2010; Winship & Morgan, 2014; Yong et al. 2018). CEM enables us to reduce imbalances in the empirical distribution of observable characteristics between treatment and control municipalities by temporarily pruning data, while simultaneously retaining a representative sample. In our study, CEM is appealing, because it permits us to leverage the information we have on the criteria used by the MOH for the prioritization of municipalities to allocate MDP physicians for matching treatment and control municipalities (King & Nielsen, 2016; Stuart et al. 2014). Other advantages of CEM are explained in detail elsewhere (Blackwell et al. 2009; Chabé-Ferret, 2015; Iacus et al. 2012; King et al. 2011; O’ neill et al., 2016; King & Nielsen, 2016; O'Neill et al. 2016; Stuart et al. 2014).

We performed CEM in the following steps. First, we defined treatment municipalities as those that received at least one MDP physician deployed in the community and the control municipalities were those that did not receive an MDP physician during the study period. Next, we temporarily coarsened municipality-level controls, including geographic region, population size, hospital beds per 1000 inhabitants and a binary indicator for whether the proportion of the population that lives in extreme poverty exceeded 20% of the population. We selected these controls for CEM, because the MOH used these indicators to allocate MDP physicians to municipalities and previous studies showed that these municipal-level factors were associated with the uptake and expansion of primary care programs in Brazil (Andrade et al. 2018a, 2018b). We also included the proportion of population 20 years and above (Macinko et al. 2011) to account for demographic characteristics in each municipality (A more detailed description of CEM variables is provided in the Appendix). Next, we performed exact matching on the coarsened data. In this step, observations were sorted into a set of strata with unique cut-off points assigned for each control we used for the coarsening. Any stratum that did not have at least one treatment and one control municipality were pruned. We then used the uncoarsened observations, minus those pruned, in subsequent regressions. We used weights generated by CEM in the rest of the difference-in-difference analyses. In our subgroup analysis, we applied the same CEM weighs from our main analysis that used location type as one of the matching variables, as was done by the MOH to identify high priority municipalities for the purposes of the MDP. In our analysis, treated municipalities were matched with untreated ones depending on whether depending on their classification as an urban/rural community.

To evaluate the impact of MDP on hospitalizations, we exploited the geographic variation in program enrollment across municipalities for an intention-to-treat analysis. Using the MOH administrative records on the number of MDP physicians, we constructed MDPmt , the binary indicator that takes value one starting from the year of MDP enrollment for municipality m in time t, and zero otherwise. The value of the MDPmt indicator remains one even if municipality m is unenrolled in the MDP in a subsequent year. We adopted this approach because it was plausible that the MDP had unintended effects on the medical practices of health workers in host communities. With time, the MDP physicians and health workers may have had more opportunities to interact with each other, which provided an opportunity for mutual learning. Alternatively, health behaviors among patients may have changed if they were exposed to health education and promotion activities (de Melo Ghisi et al., 2014). Given this unique feature of the program, the potential educational effects of the MDP may have endured even after MDP physicians left their posts. We estimated a linear model to examine the impact of the program, as shown in Equation (1):

Ymt=γMDPmt+δXmt+φm+ρst+εmj (1)

where Ymt denotes the key hospitalization variables in municipality m in year t. Xmt is the vector of time-varying municipality controls that may be correlate with the outcome variables, including municipal GDP per capita, the number of hospital beds per 1000 inhabitants, the proportion of the population with private health plans, the proportion of the population aged 20 years and above, and population size. φm represents municipality fixed effects unobserved time-invariant municipality characteristics to account for permanent differences between municipalities that may correlate with key hospitalization outcomes. The term ρst denotes a series of state-by-year fixed effects. We included state-by-year fixed effects because Brazilian states had considerable discretion in terms of health and non-health initiatives during the study period. Finally, the term εmj is the residual. The main parameter of interest in Equation (1) is the term γ, which captures the average change in hospitalization outcomes between the treatment and control municipalities.

Equation (1) yields the average changes in hospitalization outcomes attributable to MDP. However, this approach masks information on the temporal dynamic nature of the program implementation. For instance, some of the effects of stronger primary care may not be immediately evident, as shown by previous studies (Cesur et al. 2017; Fontes et al. 2018). Moreover, we hypothesize that the effects of the MDP may not be immediately observable. For instance, once in the municipality, the local government needed to decide whether the MDP physician would fill gaps in existing FHS teams or contribute to the formation of new teams. New FHS teams had to become operational, which entailed allocating personnel to the new teams, identifying and registering new patients, and starting home-visits to designated patients. Moreover, it might also have taken time for the MDP physicians to learn the medical needs and disease profiles of their new patients and align their own medical practice with FHS clinical guidelines for the management of chronic diseases. Even though the MDP physicians were required to attend training courses while practicing medicine in Brazil, these learning opportunities may not have been sufficient to fully prepare them for their new work contexts right away. Finally, the presence of MDP may also have influenced the behaviors of citizens, because it may take time for physicians and patients to build relationships, a crucial factor in the continuity of care in primary care settings (Starfield, 1998). To capture the temporal aspect of the program, we estimated a linear model as shown in Equation (2):

Ymt=β0+β1Xmt+β2MDPmt0+k=1+4βkMDPmt+φm+ρst+εmj (2)

Equation (2) includes a separate dummy variable for the year of MDP enrollment and subsequent year of program implementation. In this model, the impact of the MDP is represented by the estimated coefficient of MDPmt0, and the effects in subsequent years is captured by the estimated coefficients on βkMDPmt. Our approach implies that the impact of the MDP in the year that the municipality enrolled in the program may differ from the effects of the MDP in subsequent years. In all models, we clustered standard errors at the municipality level to account for heteroskedasticity and serial correlation within municipalities across time. To examine whether the MDP affected hospitalizations due to cerebrovascular disease and hypertension differently across municipalities, we further stratified our analytical sample by location type (i.e. urban versus rural).

We performed several robustness checks. A key difference-in-difference assumption is that enrollment in the MDP is not correlated with pre-existing trends in key hospitalization outcomes after we control for the time-varying municipality controls, time-invariant area effects, state-time controls, and common trends. To test the plausibility of this assumption, we conducted an event study analysis. We replaced the treatment variable in Equation (1) with a continuous measure that tracks the number of years since MDP enrollment. Next, we performed joint F-tests to ascertain whether the estimated coefficients in the period prior to the MDP enrollment were statistically different from one another (Goodman-Bacon, 2018). Additional analyses are detailed in the Appendix.

Results

Table 1 presents descriptive statistics on hospitalization outcomes and control variables. Columns 2 and 3 show that MDP and non-MDP municipalities vary substantially in the pre-matched sample. MDP municipalities had fewer hospitalizations for both outcomes, fewer hospital beds per 1000 inhabitants, and smaller populations, compared to non-MDP municipalities. All control variables, except the proportion of the population with private health plans, were statistically different between MDP and non-MDP municipalities. We observed statistically significant differences in the empirical distribution of control variables for the municipal GDP per capita, hospital beds per 1000 inhabitants and the proportion of the population in different age categories. However, these differences were considerably smaller in the matched sample, as shown in Table 1. We proceeded with the matched sample in the subsequent analyses and controlled for these variables in order to adjust for the remaining imbalances in the matched data (Blackwell et al. 2009).

Table 1.

Descriptive statistics of Brazilian municipalities before and after CEM, 2009–2017.

Full sample Before CEM
After CEM
MDP Non-MDP p-values Non-MDP p-values
Panel A. Hospitalizations per 100 000 inhabitants
Cerebrovascular disease 107.43 106.10 108.13 0.01 103.17 p < 0.001
(80.40) (76.27) (82.50) (78.90)
Hypertension 60.78 50.62 66.15 p < 0.001 67.72 p < 0.001
(117.20) (113.68) (118.67) (119.23)
Panel B. Municipality characteristics
Per capita municipal GDP (log scale) 9.43 9.59 9.35 p < 0.001 9.31 p < 0.001
(0.74) (0.69) (0.75) (0.76)
Hospital beds per 1000 inhabitants 1.35 1.31 1.37 p < 0.001 1.43 p < 0.001
(1.60) (1.46) (1.67) (1.52)
Proportion of the population with private health insurance coverage 0.08 0.08 0.08 0.27 0.08 0.13
(0.11) (0.11) (0.11) (0.11)
Proportion of population between 0-19 years of age 0.34 0.33 0.35 p < 0.001 0.36 p < 0.001
(0.07) (0.06) (0.07) (0.07)
Proportion of population between 20-49 years of age 0.44 0.44 0.44 p < 0.001 0.44 p < 0.001
(0.04) (0.03) (0.04) (0.04)
Proportion of population 50 years of age and above 0.22 0.23 0.22 p < 0.001 0.21 p < 0.001
(0.06) (0.06) (0.06) (0.06)
Population size
Less than 5000 (%) 0.23 0.16 0.26 p < 0.001 0.16 0.02
(0.42) (0.36) (0.44) (0.37)
5000–9999 (%) 0.22 0.20 0.23 p < 0.001 0.20 0.34
(0.41) (0.40) (0.42) (0.40)
10 000–19 999 (%) 0.25 0.26 0.24 p < 0.001 0.26 0.13
(0.43) (0.44) (0.43) (0.44)
20 000–49 999 (%) 0.19 0.23 0.17 p < 0.001 0.22 0.02
(0.39) (0.42) (0.38) (0.41)
50 000 (%) 0.11 0.15 0.09 p < 0.001 0.14 0.03
(0.32) (0.36) (0.29) (0.35)
Number of observations 50130 17341 32789 32735

Table 2 presents the estimated impact of MDP on hospitalizations per 100,000 inhabitants. In Panel A, we find that the estimated MDP coefficients for hospitalizations for due to cerebrovascular disease and hypertension were −1.47 (95%CI: −4.04,1.10) and −1.20 (95%CI: −5.50,3.11) respectively, suggesting that neither estimate reached statistical significance (Results from different model specifications are presented in the Appendix). In Panel B, we replaced the binary MDP treatment variable with a set of dummy variables that tracked the number of years since initial enrollment in the program. For cerebrovascular disease, the estimated MDP coefficient was −0.50 (95%CI: −2.94,1.95) in the year of program introduction, −5.21 (95%CI: −9.43,-0.99) in its third year and it stood at −8.21 (95%CI: −13.68,-2.75) in the fourth year. This pattern suggests that, for cerebrovascular disease, the estimated coefficient on MDP became statistically different from zero starting from the third year, and the magnitude of the estimated coefficient increased in the next year. For hypertension, the estimated MDP coefficient was 0.27 (95%CI: −3.88, 4.42) in the year of program introduction. In subsequent years, we observed an inverse relationship between the MDP and hospitalizations, with the estimated coefficient shifting from −2.41 (95%CI: −7.43, 2.62) in the first year of implementation to −4.26 (95%CI: −73.96, 65.44) by the fourth year. However, none of these estimated MDP coefficients were statistically different from zero, suggesting that the MDP did not lead to any measurable declines in hospitalizations for this condition over time.

Table 2.

Impact of the MDP on hospitalizations in the matched sample.

(1)
(2)
Cerebrovascular Disease Hypertension
Panel A. Controls for time-varying municipality controls, municipality fixed effects, state-by-year fixed effects
MDP implementation −1.47 −1.20
[−4.04,1.10] [−5.50,3.11]
Constant 105.02 −4.03
[39.20,170.84] [−73.77,65.72]
N 50076 50076
R2 0.65 0.65
Panel B. Controls for time-varying municipality controls, municipality fixed effects, state-by-year fixed effects
MDP (Year 0) −0.50 0.27
[−2.94,1.95] [−3.88,4.42]
MDP (Year 1) −0.43 −2.41
[−3.45,2.58] [−7.43,2.62]
MDP (Year 2) −1.93 −2.97
[−5.53,1.68] [−9.20,3.25]
MDP (Year 3) −5.21 −1.97
[−9.43,-0.99] [−9.58,5.64]
MDP (Year 4) −8.21 −1.28
[−13.68,-2.75] [−11.84,9.28]
Constant 105.36 −4.26
[39.75,170.96] [−73.96,65.44]
N 50076 50076
R2 0.65 0.65

All regressions are performed with CEM weights. Outcome variables are hospitalizations per 100,000 inhabitants. Data on hospitalization outcomes are based on the patient discharge records by the place of residence from the Hospital Information System of the public hospitals. Time-varying municipality characteristics include the municipal GDP per capita (in log scale), hospital beds per 1000 inhabitants, proportion of the population with private insurance plans, population size, proportion of population between 0-19 years of age, between 20 and 49 years of age, and 50 years and older. 95%CIs are in brackets. All standard errors are clustered at the municipality-level.

Table 3 presents results by location type. Panel A shows the MDP average treatment effects. In rural municipalities the estimated MDP coefficients for cerebrovascular disease and hypertension were −1.47 (95%CI: −5.44, 2.51) and −7.69 (95%CI: −15.30, 0.12), respectively. Whereas in urban municipalities, the estimated MDP coefficients were −1.23 (95%CI: −4.56, 2.11) for cerebrovascular disease and 2.09 (95%CI: −3.01,7.18) for hypertension. However, none of the estimated MDP coefficients were statistically different from zero. Panel B evaluates dynamic effects of the MDP on hospitalizations. In rural municipalities, the estimated MDP coefficients remained statistically insignificant for cerebrovascular disease and hypertension throughout the study period. In urban municipalities the MDP led to measurable reductions in hospitalizations due to cerebrovascular disease starting from the fourth year of implementation, with the estimated MDP of −8.58 (95%CI: −15.91, −1.26). For hypertension, none of the estimated MDP coefficients were statistically different from zero in municipalities classified as urban.

Table 3.

Impact of the MDP on hospitalizations by type of residence.

Rural
Urban
(1)
(2)
(3)
(4)
CD HP CD HP
Panel A
MDP −1.47 −7.59 −1.23 2.09
[−5.44,2.51] [−15.30,0.12] [−4.56,2.11] [−3.01,7.18]
Constant −19.91 −58.14 163.88 23.34
[−72.48,32.65] [−175.72,59.44] [87.31,240.46] [−61.46,108.15]
N 18243 18243 31833 31833
R2 0.67 0.67 0.63 0.64



MDP (Year 0) −0.78 −2.86 0.07 1.77
[−4.35,2.78] [−11.07,5.35] [−3.20,3.35] [−2.49,6.04]
MDP (Year 1) 0.12 −9.29 −0.54 1.20
[−4.62,4.86] [−18.60,0.01] [−4.44,3.36] [−4.60,7.00]
MDP (Year 2) −2.39 −14.61 −1.56 2.80
[−8.20,3.43] [-26.76,-2.45] [−6.15,3.03] [−4.35,9.96]
MDP (Year 3) −5.42 −15.40 −5.09 3.12
[−12.05,1.20] [-31.16,0.37] [−10.53,0.36] [−5.04,11.28]
MDP (Year 4) −7.49 −19.41 −8.58 6.17
[−15.94,0.96] [-39.19,0.37] [−15.91,−1.26] [−5.15,17.49]
Constant −19.88 −58.61 164.66 23.04
[−72.44,32.68] [−176.24,59.01] [88.24,241.08] [−61.74,107.82]
N 18243 18243 31833 31833
R2 0.67 0.67 0.63 0.64

All regressions are performed with CEM weights. Outcome variables are hospitalizations per 100,000 inhabitants. Data on hospitalization outcomes are based on the patient discharge records by the place of residence from the Hospital Information System of the public hospitals. Time-varying municipality characteristics include the municipal GDP per capita (in log scale), hospital beds per 1000 inhabitants, proportion of the population with private insurance plans, population size, proportion of population between 0-19 years of age, between 20 and 49 years of age, and 50 years and older. 95%CIs are in brackets. All standard errors are clustered at the municipality-level.

Fig. 2 plots the estimated coefficients from our event study analyses. For hospitalizations due to cerebrovascular disease and hypertension, none of the estimated coefficients in the pre-MDP period were statistically different from zero. (Event study point estimates are provided in the Appendix). The joint F-tests further showed that there were no statistically detectable differences between the estimated coefficients in the pre-MDP period for our hospitalization outcomes, suggesting that observed declining trends in hospitalization rates were not statistically different from zero.

Fig. 2.

Fig. 2

Event study for hospitalization outcomes in the matched sample.

The estimated coefficients are relative to the year prior to the MDP implementation. The vertical dashed line indicates the start of MDP enrollment. Vertical bars around point estimates represent 95% confidence intervals. Estimated coefficients for periods −4 to 4 should be interpreted as the coefficient on 4 or more years prior to and 4 years since the MDP implementation, respectively. All regressions are performed with CEM weights. Outcome variables are hospitalizations per 100,000 inhabitants. Data on hospitalization outcomes are based on the patient discharge records by the place of residence from the Hospital Information System of the public hospitals. Time-varying municipality characteristics include the municipal GDP per capita (in log scale), hospital beds per 1000 inhabitants, proportion of the population with private insurance plans, population size, proportion of population between 0-19 years of age, between 20 and 49 years of age, and 50 years and older. 95%CIs are in brackets. All standard errors are clustered at the municipality-level.

Discussion

In this study, we evaluated the impact of Brazil's More Doctors Program on hospitalizations for cerebrovascular disease and hypertension using municipal-level data covering the period 2009–2017. We showed that the MDP was correlated with fewer hospitalizations due to cerebrovascular disease starting from the third year of program implementation. In urban municipalities, the beneficial impact of MDP on hospitalizations due to cerebrovascular disease became discernable in the fourth year. We found no evidence that the MDP was associated with statistically significant declines in hospitalizations due to hypertension.

Our study has several strengths. First, our study makes several methodological contributions to the literature on the MDP. We use several publicly available datasets to build a unique municipal-aggregated dataset for 5570 municipalities covering a period of 9 years. Second, we used coarsened exact matching to minimize potential bias in our estimates. Many studies evaluating the impact of MDP rely on propensity score matching to account for potential bias (Fontes et al., 2018; Mattos & Mazetto, 2019). However, an emerging body of evidence suggests that CEM offers important advantages over other matching methods (Blackwell et al. 2009; King & Nielsen, 2016). In our analysis, CEM enabled us to leverage our contextual information on the unique design and implementation features of the MDP while selecting variables used in matching. The matched sample was highly representative of the population, which was an important limitation of many earlier studies (Gonçalves et al., 2016; Fontes et al., 2018).

Second, to our knowledge, this is the first study that provides an analysis of the impact of MDP on hospitalizations for cerebrovascular disease and hypertension. We selected these conditions, because they represent close to half of all hospitalizations due to cardiovascular conditions in Brazil during the study period. Moreover, earlier works suggested that the expansion of the FHS in the past was associated with improvements in hospitalizations due to cardiovascular conditions, including cerebrovascular disease and hypertension (Cavalcante et al., 2018; Macinko et al. 2010, 2011). To date, Fontes et al. (2018) provided causal evidence on the effect of the MDP on hospitalizations due to all conditions considered to be sensitive to primary health care; however, the authors did not provide disease-specific estimates (e.g. cardiovascular conditions). Maffioli and colleagues recently corroborated the results generated by Fontes et al., 2018, though they did not provide evidence on cardiovascular conditions (Maffioli et al., 2019). More recently, Mattos and Mazetto (2019) using a sample of 2940 municipalities with populations of less than 500,000 inhabitants and showed that the MDP led to reductions in general hospitalizations between 2010 and 2015. However, the authors did not report on the extent to which the observed reductions in hospitalizations were due to ambulatory care sensitive conditions. Like earlier studies, we sought to provide causal evidence, and performed an in-depth analysis of the relationship between the MDP and hospitalizations for cerebrovascular diseases and hypertension. Our findings are in line with most studies that demonstrate that the scale-up of MDP led to reductions in hospitalizations, thought it did not guarantee declines in hospitalizations for all health conditions and it took time for the beneficial effects to become observable.

Third, we provide new causal evidence on the differential impact of MDP between rural and urban communities. Earlier studies shed light on the heterogenous treatment effects of the MDP. For instance, Gonçalves and colleagues (2016) found that the observed reductions in hospitalizations attributable to the MDP were particularly prevalent in the Northeast region (e.g., diarrhea and gastroenteritis), where a large proportion of MDP physicians were deployed (Gonçalves et al., 2016). However, no study to date has looked whether the impact of the MDP differed across municipalities classified by the level of urbanization. Our study fills this gap by using classifications developed by the Ministry of Agrarian Development, as was done by the MOH to rank municipalities in accordance of their needs for the purposes of the MDP. We find that the MDP was associated with declines in hospitalizations due to cerebrovascular disease in urban municipalities in the fourth year of implementation.

We found no evidence that the MDP reduced hospitalizations for hypertension. This finding may be attributable to several factors. It is possible that the relatively short study period may not be sufficient enough time to start observing declines in hospitalization for this condition. Earlier studies with much longer study periods demonstrated an inverse relationship between the FHS expansion and hospitalizations due to cardiovascular conditions. For instance, Macinko et al. (2010) used municipal-aggregated data for the period from 1999 to 2007 to show that there was an inverse relationship between the FHS expansion and hospitalizations due to stroke, hypertension, and other cardiovascular conditions. More recently, Da Silva and Powell-Jackson (2017) concluded that the FHS expansion between 2000 and 2014 led to reductions in hospitalizations due to selected cardiovascular conditions, including cerebrovascular diseases, heart failure, and hypertension. We also observed declines in hypertension in the years prior to the introduction of the MDP, suggesting that the recent efforts in the management of NCDs, such as the Strategic Action Plan to Confront Noncommunicable Diseases in Brazil in 2011 may have contributed to fewer hospitalizations even before the MDP was introduced (More information on recent efforts addressing cardiovascular disease burden in Brazil is discussed in Ribeiro et al. 2016).

Our study contributes to the strand of literature that explores the links between strengthening primary care and the burden of NCDs. Approximately 85% of premature mortality attributable to NCDs occur in low- and middle-income countries (Beaglehole et al., 2008). Yet, most evidence on the effectiveness of interventions to tackle the NCD burden comes from high-income settings. For instance, a recent analysis of reviews extracted from the Cochrane database found that only 13 out of 633 publications that examined the effectiveness of different approaches to address key NCD risk factors were from low-income settings, corresponding to less than 1% of study participants globally (Heneghan et al. 2013). In a more recent systematic review, Varghese et al. (2019) similarly alluded to the limit availability of evidence from these settings, despite the growing policy interest in primary care as a strategy to address the rising NCD burden (Kruk et al. 2015).

In recent years, a relatively rich body of literature focusing on the relationship between FHS and hospitalizations due to conditions sensitive to primary health care has emerged. Most evidence suggests that the expansion of the FHS was associated with improvements in population health (Bastos et al. 2017), while reductions in access to PHC services can lead to increases in the burden of mortality due to health conditions sensitive to timely and adequate access to primary care (Francesconi et al. 2020), as well as mortality from infectious diseases and nutritional deficiencies (Rasella et al. 2019). Our findings are aligned with this strand of literature, which demonstrated that the expansion of FHS services does not always lead to reductions in hospitalizations for conditions considered sensitive to primary care and it may take time before protective effects of the FHS become discernable (Cavalcante et al. 2018; Macinko et al. 2010, 2011).

Our study has some limitations. First, our estimation strategy relies on a binary measure that tracks the presence of MDP physicians in a municipality over time. While our approach allowed us to exploit the variation in uptake of the Program from 2013 to 2017, it may have limited our ability to adequately capture the main mechanisms through which the MDP impacted hospitalizations. For instance, it is plausible that in municipalities that received a greater number of MDP physicians, the number of primary care consultations attended by physicians may have increased greater than those that received fewer MDP physicians.

Our study was unable to distinguish between the control municipalities that did not have any MDP physicians because they did not apply to join the Program or those whose applications to receive MPD physicians were denied by the MOH. While Oliveira et al. (2016) indicated that only a small proportion of municipalities had their applications denied, we were unable to rule out any potential bias in our estimates if these two types of municipalities were systematically different from one another.

Our study focused on cause-specific hospitalizations. However, we did not have identification codes for each patient. Therefore, we were unable to verify diagnoses and control for comorbidities, case severity or whether the hospitalization was a new case or a readmission. Moreover, the precision of our estimates may be impacted by potential errors in the coding of disease-specific ICD-10 groupings listed in the HIS. We do not expect this to be a major concern, because the HIS has consistently been shown as a reliable source of information (Bittencourt et al. 2006, 2008; Mathias et al. 1998; Sgambatti et al. 2015).

While CEM successfully improved the distribution of selected observables, we observed that there were statistically significant differences in the empirical distribution of the municipal GDP per capita, hospital beds per 1000 inhabitants and the proportion of the population above the age of 20 between the MDP and non-MDP municipalities. While we included these covariates in the regression analyses in the matched sample as suggested by Blackwell et al. (2009), we are unable to ascertain the remaining level of bias in our estimates in the absence of formal tests. One potential source of bias in our estimates stem from the MDP application process that required municipalities to apply to the MDP. If application process was burdensome, it may have led some municipalities to opt not to submit an application to join the program. The CEM aims to reduce potential bias due to the prioritization of municipalities by the MOH to inform decisions over the distribution of MDP physicians across communities, but this method does not address any remaining bias stemming from the decision of municipalities to apply to the Program.

Our study was unable to explore the potential mechanisms by which the MDP impacted hospitalizations for cardiovascular conditions due to the dearth of publicly available data. One plausible explanation for our finding that the MDP was associated with declines in hospitalizations for selected cardiovascular conditions may be due to increased interactions with the FHS workers. For instance, Mattos and Mazetto (2019) found that the MDP was associated with increases in the number of FHS consultations. However, the dearth of data precluded the authors from concluding that there were statistically significant increases in the number of primary care consultations that included health care services targeting cardiovascular health. Yet, recent evidence suggests that bottlenecks may exists in care provision for cardiovascular conditions. For instance, in a recent study focusing on hypertension care continuum in Brazil, Macinko et al. (2018) point out that substantial challenges in hypertension control persist. Medication adherence is low (Bastos-Barbosa et al., 2012), even though antihypertensive medications are accessible free of charge (Harris, 2012). Future studies are needed to explore the main challenges that hinder the provision of primary care services targeting cardiovascular conditions.

Our estimation strategy is unable to disentangle the complex interactions between the different design features of the MDP. Evaluating the impact of MDP is complicated by the complexity of its design, which entailed many changes in the delivery of primary health care provision that were introduced at the same time. For instance, one important design feature of the MDP was that its recruits were composed of physicians with prior training in primary care who were required attend training courses while they worked in their posts. While it is plausible that the explicit emphasis on physician education on primary care contributed to enhancing the impact of the MDP, our estimation strategy is unable to shed light on the importance of this factor relative to other changes implemented at the same time. This concern is not unique to the MDP; however, recent studies suggest that there is substantial variation across countries in terms of the design and implementation of programs to increase access to primary care vary substantially across settings (Bitton et al., 2019). As the evidence base on primary care continues to expand, future studies can document the design primary care programs to ascertain the extent to which different design aspects can change the impact of these programs.

We performed several robustness checks. First, we visually inspected and confirmed that there were similar trends in hospitalizations due to cerebrovascular diseases and hypertension between municipalities when grouped by the year of MDP enrollment and location type (i.e., urban and rural municipalities). We supplemented our visual inspection with several additional statistical analyses. First, we performed an event study as typically done in the literature (Borusyak & Jaravel, 2017; Goodman-Bacon, 2018; Roth, 2019). In this analysis, we tested whether the estimated coefficients in years prior to the MDP implementation reached statistical significance in the study sample, as well as separately for the rural and urban samples. The event study analyses suggested that the none of the estimated coefficients in the pre-MDP period for the selected outcomes did not reach statistical significance. Next, we performed joint significance tests further indicated that the estimated MDP coefficients prior to the implementation of the program were not statistically different from one another (We provide results from additional sensitivity checks in the Appendix). Taken together, these results lessen potential endogeneity concerns in our DID estimates.

Conclusion

Cardiovascular diseases pose a threat to population health in many countries across all income levels. With timely and appropriate provision of primary care, countries may achieve sizable reductions in hospitalizations for a range of chronic health conditions. Our results suggested that sizable infusion of resources in primary care provision led to gains in population health. However, our findings also demonstrated that it took time for the MDP's beneficial effects to become discernable and that the Program fell short of yielding reductions in hospitalizations for all of the cardiovascular conditions we studied. Taken together, our findings suggest that further efforts may be needed to enhance the beneficial effects of the MDP on the level and distribution of population health in Brazil.

CRediT authorship contribution statement

Ece A. Özçelik: Conceptualization, Data curation, Methodology, Formal analysis, Writing - original draft. Adriano Massuda: Data curation, Writing - review & editing. Margaret McConnell: Conceptualization, Methodology, Writing - review & editing. Marcia C. Castro: Conceptualization, Methodology, Writing - review & editing, Supervision.

Declaration of competing interest

None.

Footnotes

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.ssmph.2020.100695.

Appendix A. Supplementary data

The following is the Supplementary data to this article:

Multimedia component 1
mmc1.docx (187.4KB, docx)

References

  1. AGRQ . 2001. AHRQ quality indicators - guide to prevention quality indicators: Hospital admission for ambulatory care sensitive conditions. Rockville, MD. [Google Scholar]
  2. Andrade M.V., Coelho A.Q., Neto M.X. Transition to universal primary health care coverage in Brazil: Analysis of uptake and expansion patterns of Brazil's family health strategy (1998-2012) PloS One. 2018;13:E0201723. doi: 10.1371/journal.pone.0201723. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Andrade M.V., Coelho A.Q., Xavier N. Brazil's family health strategy: Factors associated with programme uptake and coverage expansion over 15 years (1998–2012) Health Policy and Planning. 2018;33:368–380. doi: 10.1093/heapol/czx189. [DOI] [PubMed] [Google Scholar]
  4. Ansari Z. The concept and usefulness of ambulatory care sensitive conditions as indicators of quality and access to primary health care. Australian Journal of Primary Health. 2007;13:91–110. [Google Scholar]
  5. Aquino R., De Oliveira N.F., Barreto M.L. Impact of the family health program on infant mortality in Brazilian municipalities. American Journal of Public Health. 2009;99:87–93. doi: 10.2105/AJPH.2007.127480. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Arrieta A., García-Prado A. Cost sharing and hospitalizations for ambulatory care sensitive conditions. Social Science & Medicine. 2015;124:115–120. doi: 10.1016/j.socscimed.2014.11.026. [DOI] [PubMed] [Google Scholar]
  7. Bastos-Barbosa R.G., Ferriolli E., Moriguti J.C. Treatment adherence and blood pressure control in older individuals with hypertension. Arquivos Brasileiros de Cardiologia. 2012;99:636–641. doi: 10.1590/s0066-782x2012005000054. [DOI] [PubMed] [Google Scholar]
  8. Bastos M.L., Menzies D., Hone T. The impact of the Brazilian family health on selected primary care sensitive conditions: A systematic review. PloS One. 2017;12 doi: 10.1371/journal.pone.0189557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Beaglehole R., Epping-Jordan J., Patel V. Improving the prevention and management of chronic disease in low-income and middle-income countries: A priority for primary health care. The Lancet. 2008;372:940–949. doi: 10.1016/S0140-6736(08)61404-X. [DOI] [PubMed] [Google Scholar]
  10. Billings J., Zeitel L., Lukomnik J.C. Impact of socioeconomic status on hospital use in New York City. Health Affairs. 1993;12:162–173. doi: 10.1377/hlthaff.12.1.162. [DOI] [PubMed] [Google Scholar]
  11. Bittencourt S.A., Camacho L.A., Leal C.M. Hospital information systems and their application in public health. Cadernos de Saúde Pública. 2006;22:19–30. doi: 10.1590/s0102-311x2006000100003. [DOI] [PubMed] [Google Scholar]
  12. Bittencourt S.A., Camacho L.A.B., Leal M.D.C. A qualidade da informação sobre o parto no Sistema de Informações Hospitalares no Município do Rio de Janeiro, Brasil, 1999 a 2001. Cadernos de Saúde Pública. 2008;24:1344–1354. doi: 10.1590/s0102-311x2008000600015. [DOI] [PubMed] [Google Scholar]
  13. Bitton A., Fifield J., Ratcliffe H. Primary healthcare system performance in low-income and middle-income countries: A scoping review of the evidence from 2010 to 2017. BMJ Global Health. 2019;4(Suppl 8) doi: 10.1136/bmjgh-2019-001551. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Blackwell M., Iacus S., King G. CEM: Coarsened exact matching in Stata. STATA Journal. 2009 http://gking.harvard.edu/files/cem-stata.pdf accessed October 2019. [Google Scholar]
  15. Borusyak K., Jaravel X. Revisiting event study designs, with an application to the estimation of the marginal propensity to consume. 2017. https://scholar.harvard.edu/files/borusyak/files/event_studies_may8_website.pdf accessed November 2019.
  16. Caminal J., Starfield B., Sánchez E.C. The role of primary care in preventing ambulatory care sensitive conditions. The European Journal of Public Health. 2004;14:246–251. doi: 10.1093/eurpub/14.3.246. [DOI] [PubMed] [Google Scholar]
  17. Cavalcante D.F.B., Brizon V.S.C., Probst L.F. Did the family health strategy have an impact on indicators of hospitalizations for stroke and heart failure? Longitudinal study in Brazil: 1998-2013. PloS One. 2018;13:E0198428. doi: 10.1371/journal.pone.0198428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Cesur R., Güneş P.M., Tekin E. The value of socialized medicine: The impact of universal primary healthcare provision on mortality rates in Turkey. Journal of Public Economics. 2017;150:75–93. [Google Scholar]
  19. Chabé-Ferret S. Analysis of the bias of Matching and Difference-in-Difference under alternative earnings and selection processes. Journal of Econometrics. 2015;185:110–123. [Google Scholar]
  20. Cloutier-Fisher D., Penning M.J., Zheng C. The devil is in the details: Trends in avoidable hospitalization rates by geography in British Columbia, 1990–2000. BMC Health Services Research. 2006;6:104. doi: 10.1186/1472-6963-6-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Da Silva E.M., Powell-Jackson T. Does expanding primary healthcare improve hospital efficiency? Evidence from a panel analysis of avoidable hospitalisations in 5506 municipalities in Brazil, 2000–2014. BMJ Global Health. 2017;2:E000242. doi: 10.1136/bmjgh-2016-000242. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Damasceno R., Chiavari J., Lopes C.L. Evolution of Land rights in rural Brazil frameworks for understanding, pathways for improvement. Climate Policy Initiative. 2017 https://climatepolicyinitiative.org/wp-content/uploads/2017/06/Evolution_of_Land_Rights_In_Rural_Brazil_CPI_FinalEN.pdf accessed September 2018. [Google Scholar]
  23. Dantas R.C.D.O., Silva J.P.T.D., Dantas D.C.D.O. Vol. 16. 2018. Factors Associated with Hospital Admissions due to Hypertension. Einstein (Sao Paulo) p. 3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Doubova S.V., Guanais F.C., Pérez-Cuevas, Canning R. Attributes of patient-centered primary care associated with the public perception of good healthcare quality in Brazil, Colombia, Mexico and El Salvador. Health Policy and Planning. 2016;31:834–843. doi: 10.1093/heapol/czv139. [DOI] [PubMed] [Google Scholar]
  25. Elias E., Magajewski F. A Atenção primária à Saúde no sul de Santa Catarina: uma análise das internações por condições sensíveis à atenção ambulatorial, no período de 1999 a 2004. Revista Brasileira de Epidemiologia. 2008;11:633–647. [Google Scholar]
  26. Fontes L.F.C., Conceição O.C., Jacinto P.D.A. Evaluating the impact of physicians' provision on primary healthcare: Evidence from Brazil's More Doctors Program. Health Economics. 2018;27:1284–1299. doi: 10.1002/hec.3775. [DOI] [PubMed] [Google Scholar]
  27. Francesconi G.V., Tasca R., Basu S. Mortality associated with alternative policy options for primary care and the Mais médicos (more doctors) program in Brazil: Forecasting future scenarios. Revista Panamericana de Salud Públic. 2020;44:e31. doi: 10.26633/RPSP.2020.31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Friedberg M.W., Hussey P.S., Schneider E.C. Primary care: A critical review of the evidence on quality and costs of health care. Health Affairs. 2010;29:766–772. doi: 10.1377/hlthaff.2010.0025. [DOI] [PubMed] [Google Scholar]
  29. Gibson O.R., Segal L., McDermott R.A. A systematic review of evidence on the association between hospitalisation for chronic disease related ambulatory care sensitive conditions and primary health care resourcing. BMC Health Services Research. 2013;13:336. doi: 10.1186/1472-6963-13-336. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Glied S., Smith P.C. Oxford University Press; 2011. The Oxford handbook of health economics. [Google Scholar]
  31. Gonçalves R.F., Sousa I.M.C.D., Tanaka O.Y. The Mais Médicos (More Doctors) Program in Northeast: evaluation of hospitalizations for Primary Healthcare-sensitive conditions. Ciencia & Saude Coletiva. 2016;21:2815–2824. doi: 10.1590/1413-81232015219.15392016. [DOI] [PubMed] [Google Scholar]
  32. Goodman-Bacon A. National Bureau of Economic Research; 2018. Difference-in-differences with variation in treatment timing (working paper No: 25018) [Google Scholar]
  33. Harris M. Integrating primary care and public health: Learning from the Brazilian way. London Journal of Primary Care. 2012;4:126–132. doi: 10.1080/17571472.2012.11493350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Heneghan C., Blacklock C., Perera R. Evidence for non-communicable diseases: Analysis of Cochrane reviews and randomised trials by world bank classification. BMJ Open. 2013;7 doi: 10.1136/bmjopen-2013-003298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Ho D.E., Imai K., King G. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Analysis. 2007;15:199–236. [Google Scholar]
  36. Hone T., Rasella D., Barreto M.L., Majeed A. Association between expansion of primary healthcare and racial inequalities in mortality amenable to primary care in Brazil: A national longitudinal analysis. PLoS Medicine. 2017;14:E1002306. doi: 10.1371/journal.pmed.1002306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Iacus S.M., King G., Porro G. Causal inference without balance checking: Coarsened exact matching. Political Analysis. 2012;20:1–24. [Google Scholar]
  38. IBGE Classificação e caracterização dos espaços rurais e urbanos do Brasil. 2017. https://biblioteca.ibge.gov.br/visualizacao/livros/liv100643.pdf accessed from. accessed September 2018.
  39. IHME . IHME. Seattle; WA: 2018. Findings from the global burden of disease study 2017. [Google Scholar]
  40. King G., Nielsen R. Why propensity scores should not be used for matching. 2016. http://gkind.harvard.edu/files/gking/files/pan1900011_rev.pdf accessed October 2018.
  41. King G., Nielsen R., Coberley C. Comparative effectiveness of matching methods for causal inference. 2011. https://gking.harvard.edu/files/psparadox.pdf accessed October 2018.
  42. Kringos D.S., Boerma W.G., Hutchinson A. The breadth of primary care: A systematic literature review of its core dimensions. BMC Health Services Research. 2010;10:65. doi: 10.1186/1472-6963-10-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Kringos D.S., Boerma W., Van Der Zee J. Europe's strong primary care systems are linked to better population health but also to higher health spending. Health Affairs. 2013;32:686–694. doi: 10.1377/hlthaff.2012.1242. [DOI] [PubMed] [Google Scholar]
  44. Kruk M.E., Porignon D., Rockers P.C. The contribution of primary care to health and health systems in low-and middle-income countries: A critical review of major primary care initiatives. Social Science & Medicine. 2010;70:904–911. doi: 10.1016/j.socscimed.2009.11.025. [DOI] [PubMed] [Google Scholar]
  45. Kruk M.E., Nigenda G., Knaul F.M. Redesigning primary care to tackle the global epidemic of noncommunicable disease. American Journal of Public Health. 2015;3:431–437. doi: 10.2105/AJPH.2014.302392. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Ku Y.C., Chou Y.J., Lee M.C. Effects of national health insurance on household out-of-pocket expenditure structure. Social Science & Medicine. 2019;222:1–10. doi: 10.1016/j.socscimed.2018.12.010. [DOI] [PubMed] [Google Scholar]
  47. Laditka J.N., Laditka S.B., Mastanduno M.P. Hospital utilization for ambulatory care sensitive conditions: Health outcome disparities associated with race and ethnicity. Social Science & Medicine. 2003;57:1429–1441. doi: 10.1016/s0277-9536(02)00539-7. [DOI] [PubMed] [Google Scholar]
  48. Laditka J., Laditka S.B., Probst J. More may be better: Evidence that a greater supply of primary care physicians reduces hospitalization for ambulatory care sensitive conditions. Health Services Research. 2005;40:1148–1166. doi: 10.1111/j.1475-6773.2005.00403.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Lindner S., Mcconnell K.J. Difference-in-differences and matching on outcomes: A tale of two unobservables. Health Services & Outcomes Research Methodology. 2018;19:127–144. [Google Scholar]
  50. Lopez B.J.A., Lu C.Y., Gasparrini A., Cummins S., Wharham J.F., Soumerai S.B. Association between the 2012 health and social care act and specialist visits and hospitalisations in England: A controlled interrupted time series analysis. PLoS Medicine. 2017;14(11) doi: 10.1371/journal.pmed.1002427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Macinko J., Andrade F.C., Nunes B.P. Primary care and multimorbidity in six Latin American and Caribbean countries. Revista Panamericana de Salud Públic. 2019;43:e8. doi: 10.26633/RPSP.2019.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Macinko J., De Oliveira, VB Turci The influence of primary care and hospital supply on ambulatory care–sensitive hospitalizations among adults in Brazil, 1999–2007. American Journal of Public Health. 2011;101:1963–1970. doi: 10.2105/AJPH.2010.198887. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Macinko J., De Souza, Guanais M.D.F.M. Going to scale with community-based primary care: An analysis of the family health program and infant mortality in Brazil, 1999–2004. Social Science & Medicine. 2007;65:2070–2080. doi: 10.1016/j.socscimed.2007.06.028. [DOI] [PubMed] [Google Scholar]
  54. Macinko J., Dourado I., Aquino R. Major expansion of primary care in Brazil linked to decline in unnecessary hospitalization. Health Affairs. 2010;29:2149–2160. doi: 10.1377/hlthaff.2010.0251. [DOI] [PubMed] [Google Scholar]
  55. Macinko J., Harris M.J. Brazil's family health strategy—delivering community-based primary care in a universal health system. New England Journal of Medicine. 2015;372:2177–2181. doi: 10.1056/NEJMp1501140. [DOI] [PubMed] [Google Scholar]
  56. Macinko J., Leventhal D.G., Lima-Costa M.F. Primary care and the hypertension care continuum in Brazil. The Journal of Ambulatory Care Management. 2018;41:34–46. doi: 10.1097/JAC.0000000000000222. [DOI] [PubMed] [Google Scholar]
  57. Macinko J., Starfield B., Erinosho T. The impact of primary healthcare on population health in low-and middle-income countries. The Journal of Ambulatory Care Management. 2009;32:150–171. doi: 10.1097/JAC.0b013e3181994221. [DOI] [PubMed] [Google Scholar]
  58. Macinko J., Starfield B., Shi L. The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Services Research. 2003;38:831–865. doi: 10.1111/1475-6773.00149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Maffioli E.M., Rocha T.A.H., Vivas G. Addressing inequalities in medical workforce distribution: Evidence from a quasi-experimental study in Brazil. BMJ Global Health. 2019;4 doi: 10.1136/bmjgh-2019-001827. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Magán P., Alberquilla Á., Otero Á. Hospitalizations for ambulatory care sensitive conditions and quality of primary care: Their relation with socioeconomic and health care variables in the Madrid regional health service (Spain) Medical Care. 2011:17–23. doi: 10.1097/MLR.0b013e3181ef9d13. [DOI] [PubMed] [Google Scholar]
  61. Massuda A., Hone T., Leles F.A.G. The Brazilian health system at crossroads: Progress, crisis and resilience. BMJ Global Health. 2018;3 doi: 10.1136/bmjgh-2018-000829. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Mathias T.A.D.F., Soboll M.L.D. Confiabilidade de diagnósticos nos formulários de autorização de internação hospitalar. Revista de Saúde Pública. 1998;32:526–532. doi: 10.1590/s0034-89101998000600005. [DOI] [PubMed] [Google Scholar]
  63. Mattos E., Mazetto D. Assessing the impact of more doctors' program on healthcare indicators in Brazil. World Development. 2019;123:104617. [Google Scholar]
  64. de Melo Ghisi G.L., Abdallah F., Grace S.L. A systematic review of patient education in cardiac patients: Do they increase knowledge and promote health behavior change? Patient Education and Counseling. 2014;95:160–174. doi: 10.1016/j.pec.2014.01.012. [DOI] [PubMed] [Google Scholar]
  65. Ministério da Saúde Portaria Nº 221, de 17 de Abril de 2008. 2008. http://bvsms.saude.gov.br/bvs/saudelegis/sas/2008/prt0221_17_04_2008.html accessed October 2018.
  66. Ministério da Saúde Edital No 22, de 31 de Março de 2014. 2014. https://portalarquivos2.saude.gov.br/images/pdf/2014/abril/01/Edital-22-MM-municipios-31-03-2014.pdf accessed March 20.
  67. Ministério da Saúde Médicos pelo Brasil é aprovado pelo Congresso Nacional. 2019. http://saude.gov.br/noticias/agencia-saude/46092-medicos-pelo-brasil-e-aprovado-pelo-congresso-nacional accessed December 2019.
  68. Murray C.J., Vos T., Lozano R.N. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: A systematic analysis for the global burden of disease study 2010. The Lancet. 2012;380:2197–2223. doi: 10.1016/S0140-6736(12)61689-4. [DOI] [PubMed] [Google Scholar]
  69. Naghavi M., Abajobir A.A., Abbafati C. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: A systematic analysis for the global burden of disease study 2016. The Lancet. 2017;390:1151–1210. doi: 10.1016/S0140-6736(17)32152-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Nery J.S., Pereira S.M., Rasella D.P. Effect of the Brazilian conditional cash transfer and primary health care programs on the new case detection rate of leprosy. PLoS Neglected Tropical Diseases. 2014;8:E3357. doi: 10.1371/journal.pntd.0003357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Nogueira P.T.A., Bezerra A.F.B., Leite A.F.B. Characteristics of the distribution of doctors in the Mais médicos (more doctors) program in the states of Brazil's Northeast. Ciência & Saúde Coletiva. 2016;21:2889–2898. doi: 10.1590/1413-81232015219.17022016. [DOI] [PubMed] [Google Scholar]
  72. Oliveira J.P.A., Sanchez M.N., Santos L.M.P. O programa Mais Médicos: Provimento de médicos em municípios brasileiros prioritários entre 2013 e 2014. Ciência & Saúde Coletiva. 2016;21:2719–2727. doi: 10.1590/1413-81232015219.17702016. [DOI] [PubMed] [Google Scholar]
  73. Özçelik E., Massuda A., McConnell M. Assessing the performance of beneficiary targeting in Brazil's More Doctors Programme. Health Policy and Planning. 2020 doi: 10.1093/heapol/czaa137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. O’neill S., Kreif N., Grieve R.S. Estimating causal effects: Considering three alternatives to difference-in-differences estimation. Health Services & Outcomes Research Methodology. 2016;16:1–21. doi: 10.1007/s10742-016-0146-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Purdy S., Griffin T., Salisbury C. Ambulatory care sensitive conditions: Terminology and disease coding need to be more specific to aid policy makers and clinicians. Public Health. 2009;123:169–173. doi: 10.1016/j.puhe.2008.11.001. [DOI] [PubMed] [Google Scholar]
  76. Rasella D., Aquino R., Barreto M.L. Impact of the family health program on the quality of vital information and reduction of child unattended deaths in Brazil: An ecological longitudinal study. BMC Public Health. 2010;10:380. doi: 10.1186/1471-2458-10-380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Rasella D., Harhay M.O., Pamponet M.L. Impact of primary health care on mortality from heart and cerebrovascular diseases in Brazil: A nationwide analysis of longitudinal data. BMJ. 2014;349:Gg4014. doi: 10.1136/bmj.g4014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Rasella D., Hone T., de Souza L.E. Mortality associated with alternative primary healthcare policies: A nationwide microsimulation modelling study in Brazil. BMC Medicine. 2019;17:82. doi: 10.1186/s12916-019-1316-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Ribeiro A.L.P., Duncan B.B., Brant L.C. Cardiovascular health in Brazil: Trends and perspectives. Circulation. 2016;133:422–433. doi: 10.1161/CIRCULATIONAHA.114.008727. [DOI] [PubMed] [Google Scholar]
  80. Ricketts T.C., Randolph R., Howard H.A. Hospitalization rates as indicators of access to primary care. Health & Place. 2001;7:27–38. doi: 10.1016/s1353-8292(00)00035-6. [DOI] [PubMed] [Google Scholar]
  81. Rizza P., Bianco A., Pavia M. Preventable hospitalization and access to primary health care in an area of Southern Italy. BMC Health Services Research. 2007;7:134. doi: 10.1186/1472-6963-7-134. [DOI] [PMC free article] [PubMed] [Google Scholar]
  82. Rosano A., Loha C.A., Falvo R. The relationship between avoidable hospitalization and accessibility to primary care: A systematic review. The European Journal of Public Health. 2012;23:356–360. doi: 10.1093/eurpub/cks053. [DOI] [PubMed] [Google Scholar]
  83. Roth J. Pre-test with caution: Event-study estimates after testing for parallel trends. 2019. https://oconnell.fas.harvard.edu/files/jroth/files/roth_pretrends_20190730.pdf Working Paper. accessed November 2019.
  84. Ryan A.M., Burgess J.F., Jr., Dimick J.B. Why we should not be indifferent to specification choices for difference-in-differences. Health Services Research. 2015;50:1211–1235. doi: 10.1111/1475-6773.12270. [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Ryan A.M., Kontopantelis E., Linden A. Now trending: Coping with non-parallel trends in difference-in-differences analysis. Statistical Methods in Medical Research. 2019;28:3697–3711. doi: 10.1177/0962280218814570. [DOI] [PubMed] [Google Scholar]
  86. Santos L.M.P., Millett C., Rasella D. The end of Brazil's More Doctors programme? BMJ Clinical Research. 2018;363:k5247. doi: 10.1136/bmj.k5247. [DOI] [PubMed] [Google Scholar]
  87. Schmidt M.I., Duncan B.B., Silva E., Menezes G.A. Chronic non-communicable diseases in Brazil: Burden and current challenges. The Lancet. 2011;377:1949–1961. doi: 10.1016/S0140-6736(11)60135-9. [DOI] [PubMed] [Google Scholar]
  88. Schreiber S., Zielinski T. The meaning of ambulatory care sensitive admissions: Urban and rural perspectives. The Journal of Rural Health. 1997;13 doi: 10.1111/j.1748-0361.1997.tb00970.x. 276-276. [DOI] [PubMed] [Google Scholar]
  89. Sgambatti S., Minamisava R., Afonso E.T. Appropriateness of administrative data for vaccine impact evaluation: The case of pneumonia hospitalizations and pneumococcal vaccine in Brazil. Epidemiology and Infection. 2015;143:334–342. doi: 10.1017/S0950268814000922. [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Shi L. The impact of primary care: A focused review. Scientific. 2012;2012:432892. doi: 10.6064/2012/432892. [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Shi L., Starfield B., Politzer R., Regan J. Primary care, self-rated health, and reductions in social disparities in health. Health Services Research. 2002;37:529–550. doi: 10.1111/1475-6773.t01-1-00036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Starfield B. Oxford University Press; USA: 1998. Primary care: Balancing health needs, services, and technology. [Google Scholar]
  93. Starfield B. Primary care: An increasingly important contributor to effectiveness, equity, and efficiency of health services. Gaceta Sanitaria. 2012;26:20–26. doi: 10.1016/j.gaceta.2011.10.009. SESPAS Report 2012. [DOI] [PubMed] [Google Scholar]
  94. Starfield B., Shi L., Macinko J. Contribution of primary care to health systems and health. The Milbank Quarterly. 2005;83:457–502. doi: 10.1111/j.1468-0009.2005.00409.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. Stuart E.A. Matching methods for causal inference: A review and a look forward. Statistical Science: A Review Journal of the Institute of Mathematical Statistics. 2010;25:1. doi: 10.1214/09-STS313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Stuart E.A., Huskamp H.A., Duckworth K. Using propensity scores in difference-in-differences models to estimate the effects of a policy change. Health Services & Outcomes Research Methodology. 2014;14:166–182. doi: 10.1007/s10742-014-0123-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Varghese C., Nongkynrih B., Onakpoya I. Better health and wellbeing for billion more people: Integrating non-communicable diseases in primary care. BMJ. 2019;364 doi: 10.1136/bmj.l327. [DOI] [PMC free article] [PubMed] [Google Scholar]
  98. Victora C.G., Barreto M.L., Do Carmo Leal M. Health conditions and health-policy innovations in Brazil: The way forward. The Lancet. 2011;377:2042–2053. doi: 10.1016/S0140-6736(11)60055-X. [DOI] [PubMed] [Google Scholar]
  99. Weissman J.S., Gatsonis C., Epstein A.M. Rates of avoidable hospitalization by insurance status in Massachusetts and Maryland. Journal of the American Medical Association. 1992;268:2388–2394. [PubMed] [Google Scholar]
  100. Whittaker W., Anselmi L., Kristensen S.R., Lau Y.S., Bailey S., Bower P., Checkland K., Elvey R., Rothwell K., Stokes J., Hodgson D. Associations between extending access to primary care and emergency department visits: A difference-in-differences analysis. PLoS Medicine. 2016;13(9) doi: 10.1371/journal.pmed.1002113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  101. Winship C., Morgan S. 2nd ed. 2014. Counterfactuals and causal inference: Methods and principles for social research. [Google Scholar]
  102. Yong J., Scott A., Gravelle H. Do rural incentives payments affect entries and exits of general practitioners? Social Science & Medicine. 2018;214:197–205. doi: 10.1016/j.socscimed.2018.08.014. [DOI] [PubMed] [Google Scholar]
  103. Yusuf S., Rangarajan S., Teo K. Cardiovascular risk and events in 17 low-, middle-, and high-income countries. New England Journal of Medicine. 2014;371:818–827. doi: 10.1056/NEJMoa1311890. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia component 1
mmc1.docx (187.4KB, docx)

Articles from SSM - Population Health are provided here courtesy of Elsevier

RESOURCES