Abstract
This cross-sectional study evaluated the management and organisation of primary dental care in Brazil. For this purpose, data from the National Program for Improving Access and Quality of Primary Care (PMAQ-AB) were used. Dentists from 18,114 Oral Health Teams (OHTs) answered a structured questionnaire in 2014. The data were analyzed descriptively and by cluster analysis. Half the Brazilian OHTs (51.0%) undertake planning and programming of activities. The majority of OHTs (66.4%) conducted monitoring and analysis of indicators and oral health information. The majority of OHTs had performed some self-evaluation process in the last 6 months (67.5%) and utilised self-evaluation results for planning and programming actions (71.4%). The OHTs grouped in Cluster 1 demonstrated better management organisation, followed by the teams grouped in Cluster 2. In the Brazilian macro-regions, the more OHTs were grouped in Cluster 1 in the Southeast (87.5%), Northeast (85.4%) and South (82.7%) regions. The majority of OHTs have satisfactory management and organisation. However, some need improvement, mainly in planning and programming actions based on health indicators and self-evaluation. All Brazilian OHTs need to participate in PMAQ-AB and it is important to continue evaluating the data to improve oral health care.
Introduction
The Brazilian healthcare system, known as the Unified Health System (UHS) (Sistema Único de Saúde–SUS, in Portuguese) was implemented through the 1988 Federative Constitution of Brazil. In accordance with Primary Health Care (PHC) and based on the proposals made at the Alma Ata Conference in 1978, the main objective of the UHS is the promotion and universalisation of public health care to the whole population, the realisation of preventive actions and coordination of care based on social context [1,2,3].
To achieve the goals proposed by the UHS, the Family Health Program (FHP), later called the Family Health Strategy (FHS), was introduced in 1994, with the aim of restructuring the PHC, with a focus on comprehensive health care of the population and epidemiological needs of the country, offering the services of health promotion and prevention [4]. The Oral Health Teams (OHTs) were only included in the FHS teams in 2000, restructuring the PHC model. In 2004, the National Oral Health Policy guidelines, called the “Smiling Brazil” Program (Programa Brasil Sorridente in Portuguese) was created with actions to reorganise basic health care and the expansion and qualification of specialised care, to improve the oral health problems that had been uncovered in the epidemiological survey SB Brasil 2003 [5, 6]. After a decade of the “Smiling Brazil” Program, advances in oral health work were observed focusing on educational and permanent education actions; welcoming, bonding and accountability. The main challenges were related to comprehensive health care; extension and improvement of care, teamwork; planning, monitoring, and evaluation of actions, and working conditions. [7].
Critical evaluations of health policies are pertinent to improve the quality of installed health actions and services [8]. It is important to develop research aimed at strengthening primary health care and improving the healthcare system [9]. To strengthen services, it is essential to measure the health system by availability, access, quality and efficiency, and population health by health status, responsiveness, user satisfaction and financial risk protection, through monitoring and evaluating the performance of public healthcare services [10].
In Brazil, the Brazilian Ministry of Health established the National Program for Improving Access to and Quality of Primary Care (Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica–PMAQ-AB, in Portuguese) in 2011. The PMAQ-AB is based on the classic organisation of care and quality proposed by Donabedian, where quality is evaluated using structure, process and results parameters [11]. The PMAQ-AB aims to improve services, both qualitatively and quantitatively, in order to create a quality standard that is comparable at national, regional and local levels [12,13]. The main challenge of the PMAQ-AB is to establish a culture of evaluation among PHC professionals and managers who monitor and evaluate processes and results. OHTs participating in the PMAQ-AB receive financial incentives conditional on performance evaluation of their structure, health indicators, external self-evaluation results and interviews with managers, professionals and users [14].
Monitoring and evaluating actions related the Oral Health Policies is essential to know how the access and quality of services provided, to implement corrective measures and/or improve the actions and services offered in the scope of PHC [14]. So, the aim of this study was to analyse data for the management and organisation of primary oral health care.
Materials and methods
The study was submitted to and approved by the Human Research Ethics Committee of the Universidade Federal de Minas Gerais, Brazil (protocol number 02396512.8.0000.5149).
This cross-sectional descriptive study used data from the second cycle of PMAQ-AB, conducted by the Brazilian Ministry of Health between 2013 and 2014, and included the entire national territory, covering the macro-regions of Brazil (North, Northeast, Midwest, Southeast and South). This study used secondary data obtained in the external evaluation phase of PMAQ which involved an interview with Brazilian dentists working in OHTs, about the management and organisation of the work process of the OHTs and verification of documents in the PHC units. During the years 2013 and 2014 there were 23,251 OHTs implanted in Brazilian territory. A total of 19,946 OHTs (85.79%) participated in the entire process for certification of the second cycle of PMAQ. At the end of this cycle 1,832 OHTs (9.18%) were disqualified or were unsatisfactory in the program, being excluded of database by the Brazilian Ministry of Health.
A questionnaire used for the interview was created through a Brazilian Ministry of Health partnership with education and research institutions in Brazil. The interviewers were health professionals selected and were trainined to administer the survey across the country. They received a 40-hour training program including survey methods, PHC content and PMAQ questionnaires. After this, all interviewers were submitted to an evaluation to assess their abilities. Each interviewer had one supervisor. An app for mobile devices, which had the questions in electronic format that allowed data collection, was developed by Brazilian Ministry of Health. Data were sent online to the database of the Brazilian Ministry of Health that was responsible for the consistency analysis and certification of OHTs. The interviews with the professionals of the OHTs were voluntary, documents were verified and information previously acquired was inserted into the electronic questionnaires. The questionnaire consisted of mainly dichotomous questions.
The questions were developed according to the principles from primary care [15] that should be incorporated into the OHTs, and included, among other items, questions about the management and organisation processes of dental services in primary care. The questions that were considered are presented at Tables 1 and 2.
Table 1. Descriptive analysis of management and organisation of OHTs, according to PMAQ-AB Data, Brazil, 2014.
| Variable | Frequency (%) |
|---|---|
| Does the OHT perform monthly planning and scheduling activities with a document to prove it? (Yes) | 9,238 (51.0) |
| Does the OHT conduct monitoring and analysis of indicators and oral health information? (Yes) | 12,031 (66.4) |
| Does the OHT receive support for the programming and organisation work process? (Yes) | 14,303 (79.0) |
| Was some self-evaluation process performed by the OHT in the last 6 months? (Yes) | 12,218 (67.5) |
| Does the OHT receive permanent support from a team or person from the municipal health department? (Yes, always or since the accession of PMAQ) | 14,925 (82.4) |
| Does the OHT program your activities considering: the construction of a weekly, biweekly or monthly work schedule? (Yes) | 16,737 (92.4) |
| Does the OHT program your activities considering: the goals for primary care according to the municipality? (Yes) | 15,541 (85.8) |
| Does the OHT program your activities considering: data from the primary care information system? (Yes) | 14,454 (79.8) |
| Does the OHT program your activities considering: local information (demand study, epidemiological scenario and others)? (Yes) | 14,518 (80.1) |
| Does the OHT program your activities considering: questions related to biological risks and individual, family and social vulnerabilities (violence, drugs and others)? (Yes) | 14,195 (78.4) |
| Does the OHT program your activities considering: the environmental issues of the territory (including access to land)? (Yes) | 11,712 (64.7) |
| Does the OHT program your activities considering: the challenges mentioned in self-evaluation? (Yes) | 12,940 (71.4) |
| Is the OHT schedule shared with family health team (FHT) professionals? (Yes) | 12,007 (66.3) |
| Is the OHT schedule organised to offer oral health education activities in the territory? (Yes) | 16,407 (90.6) |
| Does the OHT guarantee the schedule of appointments to continue users’ treatment? (Yes) | 16,639 (91.9) |
Table 2. Management organisation of OHTs by cluster, according to PMAQ-AB Data, Brazil, 2014.
| Variable | Frequency (%) | ||
|---|---|---|---|
| Cluster 1 | Cluster 2 | Cluster 3 | |
| Does the OHT perform monthly planning and scheduling activities with a document to prove it? (Yes) | 8,599 (56.4) | 423 (34.8) | 216 (13.1) |
| Does the OHT conduct monitoring and analysis of indicators and oral health information? (Yes) | 11,574 (75.9) | 208 (17.1) | 249 (15.1) |
| Does the OHT receive support for the programming and organisation work process? (Yes) | 13,416 (88.0) | 559 (46.0) | 328 (19.8) |
| Was some self-evaluation process performed by the OHT in the last 6 months? (Yes) | 10,879 (71.4) | 915 (75.4) | 424 (25.6) |
| Does the OHT receive permanent support from a team or person from the municipal health department? (Yes, always or since the accession of PMAQ) | 13,359 (87.6) | 872 (71.8) | 694 (42.0) |
| Does the OHT program your activities considering: the construction of a weekly, biweekly or monthly work schedule? (Yes) | 14,627 (95.9) | 1,099 (90.5) | 1,011 (61.1) |
| Does the OHT program your activities considering: the goals for primary care according to the municipality? (Yes) | 14,113 (92.6) | 864 (71.2) | 564 (34.1) |
| Does the OHT program your activities considering: data from the primary care information system? (Yes) | 13,565 (89.0) | 556 (45.8) | 333 (20.1) |
| Does the OHT program your activities considering: local information (demand study, epidemiological scenario and others)? (Yes) | 13,444 (88.2) | 830 (68.4) | 244 (14.8) |
| Does the OHT program your activities considering: questions related to biological risks and individual, family and social vulnerabilities (violence, drugs and others)? (Yes) | 12,958 (85.0) | 866 (71.3) | 371 (22.4) |
| Does the OHT program your activities considering: the environmental issues of the territory (including access to land)? (Yes) | 10,615 (69.6) | 847 (69.8) | 250 (15.1) |
| Does the OHT program your activities considering: the challenges mentioned in self-evaluation? (Yes) | 11,760 (77.1) | 943 (77.7) | 237 (14.3) |
| Is the OHT schedule shared with family health team (FHT) professionals? (Yes) | 10,685 (70.1) | 810 (66.7) | 512 (31.0) |
| Is the OHT schedule organised to offer oral health education activities in the territory? (Yes) | 14,280 (93.7) | 1,164 (95.9) | 963 (58.2) |
| Does the OHT guarantee the schedule of appointments to continue users’ treatment? (Yes) | 14,316 (93.9) | 1,105 (91.0) | 1,218 (73.6) |
Descriptive statistics were analysed and cluster analysis was performed using the IBM Statistical Package for Social Sciences (SPSS) version 22.0 (IBM SPSS Statistics for Windows, Armonk, NY, USA). Confidence intervals were not calculated because this was a census study. Multivariate agglomerative hierarchy based on the farthest neighbour is an exploratory analysis tool used to organise the data observed in groups (clusters). In this case, analysis of OHTs was based on a combination of independent variables, maximising the similarity of cases within each group (clusters) and maximising the differences between groups [16]. Three types of cluster (including two to four clusters) were formed from the OHTs in Brazil. The three-cluster option was chosen as the best way to interpret the data. After that, the three clusters formed were compared for the Brazilian macro-regions: North, Northeast, Midwest, Southeast and South.
Results
The final sample was composed by 18,114 OHTs (77.9%).
Table 1 shows the management and organisation of the OHTs associated with planning of evaluation and service to users in the Basic Health Units (BHUs).
Table 2 displays the management organisation of OHTs according to the clusters formed. Overall, the OHTs grouped in Cluster 1 demonstrated the best management organisation, followed by the teams grouped in Cluster 2.
Table 3 shows the distribution of the OHTs in the Brazilian macro regions. The Southeast, Northeast and South regions had more OHTs grouped in Cluster 1.
Table 3. Distribution of OHTs in the Brazilian Macro-regions by cluster, according to PMAQ-AB data, Brazil, 2014.
| Macro-region | Frequency (%) | |||
|---|---|---|---|---|
| Cluster 1 | Cluster 2 | Cluster 3 | Total | |
| North | 930 (73.6) | 112 (8.9) | 221 (17.5) | 1,263 (100.0) |
| Northeast | 6,572 (85.4) | 572 (7.4) | 556 (7.2) | 7,700 (100.0) |
| Midwest | 1,232 (78.4) | 108 (6.9) | 232 (14.8) | 1,572 (100.0) |
| Southeast | 4,401 (87.5) | 266 (5.3) | 360 (7.2) | 5,027 (100.0) |
| South | 2,111 (82.7) | 156 (6.1) | 285 (11.2) | 2,552 (100.0) |
| Total | 15,246 (84.2) | 1,214 (6.7) | 1,654 (9.1) | 18,114 (100.0) |
Discussion
This study shows the organisation of the work processes of Brazilian OHTs that participated in PMAQ-AB between 2013 and 2014. The majority of the teams organise work processes by planning and programming actions according to community contexts, self-evaluations and team agendas. The majority of OHTs showed good work process performances; however, others must be improved in order to develop an appropriate intervention program.
Half of the Brazilian OHTs in this study reported that they frequently plan and program their activities, and the majority reported that they received permanent support to plan and organise their actions. Almost all of the OHTs declared that they plan their activities based on a work schedule and guarantee that the appointment schedule is maintained to provide continued treatment for users. Planning, implementation and evaluation of actions are important mechanisms to analyse activities in public health. When planning does not occur, activities continue to be part of a curative system. Based on the PHC principle, which represents much more than offer a cure for diseases, the system must be based on both the prevention of disease and the promotion of health, offering the possibility of continued treatment in order to establish full health care [15,17,18].
PHC services must offer health care according to the social-epidemiological profile of the population [19,20,21]. The majority of OHTs reported that they plan their activities considering PHC goals, especially according to data from the primary care information system and local information in the region. Healthcare services must be organised and managed according to a health surveillance system so as to improve local and individual health conditions and to achieve collective results [8,22–24]. The best planning and programming actions are evidence-based, and this evidence comes from epidemiological research, which makes it possible to formulate indicators and parameters to assess the real situation in the community [8,23,24].
The majority of OHTs reported the monitoring and analysis of oral health indicators and information. This monitoring is essential in order to evaluate the performance of healthcare policies and actions, as well as to formulate the criteria necessary to improve health care. Indicators integrated within a continuous process of monitoring and evaluation make it possible to identify emergency situations and implement changes [11,25–28]. Although there have been advances in oral health care since the “Smiling Brazil” Program was introduced, the planning, monitoring and evaluation of actions are far from the everyday routines of the OHT. This remains a challenge that requires mobilisation, engagement and decision-making by both managers and professionals, especially since dental care professionals tend to reproduce the predominant biomedical models. Therefore, further efforts are required in the fields of management, training and permanent education [7].
Another way to improve action planning is to analyse the results of self-evaluations. More than half of the OHTs from the present study reported that they had carried out self-evaluations in the last 6 months and had planned their activities considering the challenges observed in these assessments. Self-evaluation is a crucial element in determining a population’s health needs, identifying target groups and developing new intervention strategies to offer improved oral health services. Thus, self-evaluation should be integrated within the monitoring process [29,30,31].
A little more than half of the OHTs share their schedule with the FHS teams. These results are probably due to the late introduction of the OHTs at FHS, making the integration between the theses teams difficult, since the individual work processes of dentists isolate them inside their offices [7]. It is important that dental professionals in the field of public health work together and offer an integrated healthcare network with greater comprehensive care. The absence of communication between the FHS with the OHTs can compromise the quality and quantity of care [32].
Almost all of the OHTs offer oral health education activities, which focused on how behaviour and changes in lifestyle can impact a population’s overall health, thus leading to the possible best results, according the principles of PHC [15,33].
In the present study, the OHTs in Cluster 1 demonstrated better results than did the OHTs in Cluster 2 and 3 in the management and organisation of primary dental care. Differences in the OHTs’ patterns of distribution in the Brazilian macro-regions were observed, with the Southeastern, Northeastern and Southern regions presenting more OHTs grouped in Cluster 1. Brazil is a developing country and has an extensive territory with high levels of socioeconomic inequality, which explains the different types of management organisation within the Brazilian macro-regions. The Brazilian economy is concentrated in the Southeastern and Southern regions of the country, which provide better incentives for public health. Since the implementation of the “Smiling Brazil” program, the Northeastern region is where the majority of OHTs can be found. These OHTs also receives high incentives from the UHS, which could explain the results of this study [34]. Previous studies, using PMAQ-AB data, also found differences between Brazilian macro-regions when evaluating the relationship between primary and secondary care in public health services [35] and procedures of primary dental health care performed by the OHTs [36]. Both studies observed the best results for OHTs in the Southern and Southeastern regions, reinforcing the great social disparities between the Brazilian regions, even though the UHS does offer actions and services to promote, prevent, treat and improve the health of all Brazilians in all regions [37].
This study showed that the majority of the OHTs have satisfactory management and organisation. However, some need improvements, mainly in the planning and programming of actions, such as the improvement of the population’s health. A limitation of this study is that pay-per-performance models may be biased. The PMAQ-AB invests in the OHTs according to the results obtained by the healthcare teams. Pay-for-performance models can be ineffective, since encouraging well-performing teams will not change their behaviour and the cost of improvement may well prevent poorly performing teams from participating in the programs. However, performance pay systems should be used to drive quality improvement and not merely to reward those who already offer high-performance healthcare services [17,38,39]. Another limitation is that the self-evaluations used dichotomous variables and no specific instructions were provided to the respondents about how to operationalise these questions. Hence, the observations represent a self-perception of whether or not the clinics actually engage in these practices at all. Nonetheless, the sample consisted of dentists working in the OHTs of the UHS, which provides public health care to the entire Brazilian population. It is important to mention that the use of Brazilian public services is associated with a lower family income, a greater number of household residents and more teeth requiring treatment [40]. Therefore, the assessment among PHC professionals and managers who monitor and evaluate processes and results is essential to the production of measures that assist in decision-making and improvements in services. This study is important and innovative, because it shows how management and organisation in primary dental care is working in Brazil and how new polices can be traced in order to improve the quality of services and, consequently, oral health care.
Supporting information
BancoTatiana_Plos One.
(SAV)
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
This work was supported by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior to TPS, Conselho Nacional de Desenvolvimento Científico e Tecnológico, Fundação de Amparo à Pesquisa do Estado de Minas Gerais, and Pró-Reitoria de Pesquisa, Universidade Federal de Minas Gerais. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Paim J, Travassos C, Almeida C, Bahia L, Macinko J. The Brazilian health system: history, advances, and challenges. The Lancet. 2011;377: 1778–97. [DOI] [PubMed] [Google Scholar]
- 2.Rohde J, Cousens S, Chopra M, Tangcharoensathien V, Black R, Bhutta A, et al. 30 years after Alma-Ata: has primary health care worked in countries? The Lancet. 2008;372: 950–61. [DOI] [PubMed] [Google Scholar]
- 3.Rivero DAT. What a primary health care is: Some considerations after almost thirty five years of Alma-Ata. Rev Peru Med Exp Salud Publica. 2013;30(2): 283–7. [PubMed] [Google Scholar]
- 4.Silva SA, Baitelo TC, Fracolli LA. Primary Health Care Evaluation: the view of clientes and professionals about the Family Health Strategy. Rev. Latino-Am. Enfermagem. 2015;23(5): 979–87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Aquilante AG, Aciole GG. Building a “Smiling Brazil”? Implementation of the Brazilian National Oral Health Policy in a health region in the State of São Paulo. Cad. Saúde Pública. 2015. January;31(1): 82–96. Available from: http://www.scielo.br/pdf/csp/v31n1/0102-311X-csp-31-01-00082.pdf. [DOI] [PubMed] [Google Scholar]
- 6.Junqueira SR, Pannuti CM, Rode SM. Oral health in Brazil–Part I: public oral health policies. Braz Oral Res. 2008;22(Spec Iss 1): 8–17. [DOI] [PubMed] [Google Scholar]
- 7.Scherer CI, Scherer MDA. Advances and challenges in oral health after a decade of the “Smiling Brazil” Program. Rev Saúde Pública. 2015; 49:98 Available from: http:// http://www.scielo.br/pdf/rsp/v49/0034-8910-rsp-S0034-89102015049005961.pdf. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Moysés SJ, Pucca Junior GA, Paludetto Junior M, Moura L. Progresses and challenges to the Oral Health Surveillance Policy in Brazil. Rev Saúde Pública. 2013;47(Supl 3): 161–7. [DOI] [PubMed] [Google Scholar]
- 9.Bourgeois DM, Phantumvanit P, Llodra JC, Horn V, Carlile M, Eiselé JL. Rationale for the prevention of oral diseases in primary health care: an international collaborative study in oral health education. International Dental Journal. 2014;64(Suppl. 2): 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.World Health Organization (WHO). Monitoring and evaluation of health systems strengthening. An operational framework. 2009 Nov. [cited 2017 Sep 15]. Available from: http://www.who.int/healthinfo/HSS_MandE_framework_Nov_2009.pdf.
- 11.Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005;83(4): 691–729. 10.1111/j.1468-0009.2005.00397.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Matta-Machado ATG, Santos AFS, Abreu DMX, Jorge AO, Reis CMR, Lima AMLD, et al. Health care, quality certification and institutional support: a focus on primary health care in Brazil. Salud Publica Mex. 2016;58: 358–65. [PubMed] [Google Scholar]
- 13.Neves M, Giordani JMA, Ferla AA, Hugo FN. Primary Care Dentistry in Brazil from prevention to comprehensive care. J Ambulatory Care Manage. 2017;40(Supp 2): S35:48. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Macinko J, Harris MJ, Rocha MG. Brazil´s National Program for Improving Primary Care Access and Quality (PMAQ). J Ambulatory Care Manage. 2017;40(Supp 2): 4–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Starfield B. Primary Care: balancing health needs, services, and technology 1st ed New York: Oxford University Press; 1998. [Google Scholar]
- 16.Johnson RA, Wichem DW. Applied multivariate statistical analysis. 6th ed Pearson Prentice Hall: Upper Saddle River, NJ; 2007. [Google Scholar]
- 17.Reis CMR, Matta-Machado ATG, Amaral JHL, Werneck MAF, Abreu MHNG. Describing the primary care actions of oral health teams in Brazil. Int J Environ Res Public Health. 2015;12(1): 667–78. 10.3390/ijerph120100667 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Aires LCP, Santos EKA, Bruggemann OM, Backes MTS, Costa R. Reference and counter-reference health care system of infant discharged from neonatal unit: perceptions of primary care health professionals. Esc Anna Nery. 2007;21(2): e20170028. [Google Scholar]
- 19.Haggerty J, Burge F, Lévesque JF, Gass D, Pineault R, Beaulieu MD, et al. Operational definitions of attributes of Primary Health Care: Consensus among Canadian experts. Annals of Family Medicine. 2007. Jul-Aug;5(4). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Miller WL, Crabtree BF, Nutting PA, Stange KC, Jaén CR. Primary Care Practice Development: A Relationship-Centered Approach. Annals of Family Medicine. 2010;8(1): 68–79. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nascimento AC, Moysés ST, Werneck RI, Moysés SJ. Oral health in the context of primary care in Brazil. International Dental Journal. 2013;63: 237–43. 10.1111/idj.12039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Chaves LA, Jorge AO, Cherchiglia ML, Reis IA, Santos MAC, Santos AF, et al. Integration of primary care in the healthcare network: analysis of the components in the external evaluation of the PMAQ-AB. Cad. Saúde Pública. 2018;34(2): e00201515 10.1590/0102-311X00201515 [DOI] [PubMed] [Google Scholar]
- 23.Barros SG, Chaves SCL. Use of the outpatient information system (SIA-SUS) to assess oral health activitie. Epidemiologia e Serviços de Saúde. 2003. Jan-Mar;12(1): 41–51. [Google Scholar]
- 24.Arrizón AV, Andersson N, Ledogar RJ. Micro-regional planning: evidence-based community buy-in for health development in five of Mexico´s poorest rural districts. BMC Health Services Research. 2011;11(Suppl 2): S2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Contandriopoulos AP. Evaluating the institutionalization of evaluation. Ciência & Saúde Coletiva. 2006;11(3): 705–11. [Google Scholar]
- 26.Braun JP, Mende H, Bause H, Bloos F, Geldner G, Kastrup M, et al. Quality indicators in intensive care medicine: why? Use or burden for the intensivist. GMS German Medical Science. 2010;8(Issn 1612–3174): 1–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Santos AF, Sobrinho DF, Araujo LL, Procópio CSD, Lopes EAS, Lima AMLD, et al. Incorporation of information and communication technologies and quality of primary healthcare in Brazil. Cad. Saúde Pública. 2017. Jun 5;33(5): e00172815 10.1590/0102-311X00172815 Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2017000505003&lng=en&nrm=iso&tlng=en. [DOI] [PubMed] [Google Scholar]
- 28.Goes PSA, Figueiredo N, Neves JC, Silveira FMM, Costa JFR, Pucca Júnior GA, Rosales MS. Evaluation of secondary care in oral health: a study of specialty clinics in Brazil. Cad. Saúde Pública. 2012;28(Suppl): S81–9. [DOI] [PubMed] [Google Scholar]
- 29.Tseveenjav B, Suominen AL, Varsio S, Knuuttila M, Vehkalahti MM. Do self-assessed oral health and treatment need associate with clinical findings? Results from the Finnish Nationwide Health 2000 Survey. Acta Odontologica Scandinavica. 2014;72: 926–35. 10.3109/00016357.2014.923110 [DOI] [PubMed] [Google Scholar]
- 30.American Dental Association on behalf of the Dental Quality Alliance (DQA). Quality Measurement in Dentistry. A guidebook. 2016 Jun. [cited 2017 Sep 10]. Available from: http://www.ada.org/~/media/ADA/Science%20and%20Research/Files/DQA_2016_Quality_Measurement_in_Dentistry_Guidebook.pdf?la=en.
- 31.Sarti TD, Campos CEA, Zandonade E, Ruschi GEC, Maciel ELN. Evaluation of health planning activities by family health teams. Cad. Saúde Pública. 2012. March;28(3): 537–48. [DOI] [PubMed] [Google Scholar]
- 32.Oandasan IF, Conn LG, Lingard L, Karim A, Jakubovicz D, Whitehead C, et al. The impact of space and time on interprofessional teamwork in Canadian primary health care settings: implications for health care reform. Primary Health Care Research & Development. 2009;10: 151–62. [Google Scholar]
- 33.Baum F, Freeman T, Jolley G, Lawless A, Bentley M, Vartto K. Health promotion in Australian multi-disciplinary primary health care services: case studies from South Australia and the Northern Territory. Health Promotion International. 2013. May;29(4). [DOI] [PubMed] [Google Scholar]
- 34.Griesse MA. The geographic, political, and economic context for corporate social responsibility in Brazil. Journal of Business Ethics. 2007;73: 21–37. [Google Scholar]
- 35.Martins RC, Reis CMR, Matta-Machado ATG, Amaral JHL, Werneck MAF, Abreu MHNG. Relationship between Primary and Secondary Dental Care in Public Health Services in Brazil. Plos One. 2016. October 18 pii: e0164986 10.1371/journal.pone.0164986 Available from: http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0164986. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Mendes SR, Martins RC, Matta-Machado ATG, Mattos GCM, Gallagher JE, Abreu MHNG. Dental Procedures in Primary Health Care of the Brazilian National Health System. International Journal of Environmental Research and Public Health. 2017;14: 1480. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Cavalcanti YW, Almeida LFD, Barbosa AS, Padilha WWN. Planning oral health and clinical discharge in Primary Care: the comprehensive dental care protocol outcome. The Journal of Contemporary Dental Practice. 2015. March;16(3): 172–7. [DOI] [PubMed] [Google Scholar]
- 38.Campbell SM, Scott A, Parker RM, Naccarella L, Furler JS, Young D, et al. Implementing pay-for-performance in Australian primary care: lessons from the United Kingdom and the United States. Med J Aust. 2010. October;193(7): 408–11. [DOI] [PubMed] [Google Scholar]
- 39.Reis CMR, Mambrini JVM, Matta-Machado ATG, Amaral JHL, Werneck MAF, Abreu MHNG. Primary dental care evaluation in Brazil: an item response theory approach. Journal of Public Health Dentistry. 2017. March;14: 1–8. [DOI] [PubMed] [Google Scholar]
- 40.Pinto RS, Roncalli AG, Abre MHNG, Vargas AMD. Use of public oral health services by the adult population: a multilevel analysis. Plos One. 2016. January;5:1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
BancoTatiana_Plos One.
(SAV)
Data Availability Statement
All relevant data are within the paper and its Supporting Information files.