Skip to main content
BMJ Open logoLink to BMJ Open
. 2016 Jul 7;6(7):e010425. doi: 10.1136/bmjopen-2015-010425

What can we learn on public accountability from non-health disciplines: a meta-narrative review

Sara Van Belle 1, Susannah H Mayhew 2
PMCID: PMC4947774  PMID: 27388347

Abstract

Objective

In health, accountability has since long been acknowledged as a central issue, but it remains an elusive concept. The literature on accountability spans various disciplines and research traditions, with differing interpretations. There has been little transfer of ideas and concepts from other disciplines to public health and global health. In the frame of a study of accountability of (international) non-governmental organisations in local health systems, we carried out a meta-narrative review to address this gap. Our research questions were: (1) What are the main approaches to accountability in the selected research traditions? (2) How is accountability defined? (3) Which current accountability approaches are relevant for the organisation and regulation of local health systems and its multiple actors?

Setting

The search covered peer-reviewed journals, monographs and readers published between 1992 and 2012 from political science, public administration, organisational sociology, ethics and development studies. 34 papers were selected and analysed.

Results

Our review confirms the wide range of approaches to the conceptualisation of accountability. The definition of accountability used by the authors allows the categorisation of these approaches into four groups: the institutionalist, rights-based, individual choice and collective action group. These four approaches can be considered to be complementary.

Conclusions

We argue that in order to effectively achieve public accountability, accountability strategies are to be complementary and synergistic.

Keywords: accountability, governance < HEALTH SERVICES ADMINISTRATION & MANAGEMENT, meta-narrative review, framework


Strengths and limitations of this study.

  • This is the first meta-narrative review of the concept of accountability in the disciplines of political science, public administration, organisational sociology, ethics and development studies, summarising knowledge with a view to improving public and private-non-profit sector health service management and service delivery.

  • Our meta-narrative review fits the research objectives well, given the wealth of differing interpretations in the literature on accountability (across disciplines).

  • Monographs and readers constituted a primary reference source. Since there is no specific book database covering monographies and readers in the disciplines included here, the review could not be entirely comprehensive.

  • On the basis of the results, we propose a multidimensional framework of accountability that covers the dimensions of professional, organisational, social and political accountability.

Background

In health policy and systems scholarship, accountability has since long been acknowledged as a central dimension. It is at the core of healthcare professionalism1 and community participation in health systems,2–6 as well as of governance.7 8 Many health system (performance) frameworks include accountability as part of the leadership and governance function9–16. A closer look at the public health literature shows us that accountability emerges under (at least) four major themes. First, accountability has been related to strategies to ensure quality of care. Clinical audits, for instance, are often used in efforts to reduce maternal mortality and near miss events and are framed in terms of negotiating accountability with health service providers.17–21 Second, accountability has been part of ‘community participation’, framed recently as strengthening the community's voice in order to improve accountability in health service delivery.22 The effects of decentralisation on participation were explored by Bossert and Mitchell.23 Third, accountability is a major theme in global health policy. Interest in tracking funding in order to improve ‘donor accountability’ has seen an upsurge, especially in maternal, neonatal and child health.13 24–27 Finally, accountability is framed in the ethics and human rights perspective. Daniels,28 for example, focused on procedural mechanisms for accountability in a health system priority setting. Human rights advocates focus on accountability in relation to healthcare and health policy, including the obligation of states to ensure the right to health and improving equity in access. Recently, the UN resolution on Universal Health Coverage argued that efforts to improve universal health coverage could only succeed if values such as transparency, equity and fairness are at the basis of decision-making. This should be supported by efforts to build accountability capability and fairness in process and results.15 29

In the public health literature, strategies to improve accountability have been described at the macrolevel of global governance and policymaking, the mesolevel of health system management, participative decision-making and priority setting, as well as at the microlevel of service delivery, where it is considered part of professional ethics and an element of quality of care.

While the concept of accountability is widely used in the public health literature, it remains an opaque concept. To start, it is not easy to differentiate between accountability and related concepts such as responsibility and responsiveness. Moreover, the literature on accountability in fact derives from different disciplines and research traditions. ‘Many authors have been writing about accountability in a variety of contexts but there has been little agreement, or even common ground for disagreement, over the general nature of accountability or its various mechanisms’.30

Most authors do tend to agree, however, on the most basic of definitions. Accountability is a derivative of ‘being accountable’, a quality or state of being where one accepts—or is obliged to accept—responsibility for one's actions (or inactions) towards another.31 It thus presupposes a relationship between two actors where one actor (the agent or duty bearer) has to account for his actions to another actor (the principal or claims holder), because the actions of the agent affect the principal or because they have been carried out on behalf of the principal.

Although some authors in the field of public health draw on concepts from other disciplines, there has been little systematic exploration of how accountability is treated in disciplines such as political science, public administration, organisational sociology, ethics and development studies. As a result, there has been little cross-fertilisation between these disciplines and public health.

To address this gap, we set out to identify the main schools of accountability across disciplines and to trace the current developments and debates. More specifically, we aimed at identifying the range of definitions of accountability and the frameworks that are being used in these different disciplines with the aim of countering the fragmentation on accountability—identified by Mulgan30 as a major problem. We also intended this review to inform the development of a comprehensive view on accountability in healthcare. In order to do so, we adopted the meta-narrative review method.

This review was part of a doctoral research project on public accountability in public health service delivery, in which we adopted the definition of Mulgan: ‘Public accountability is the obligation or moral imperative of public institutions and private-not-profit institutions involved in health service delivery to answer questions regarding their decisions and actions to the public, which is the source of their mandate, authority and legitimacy’.30

Below, we present the methodology of the meta-narrative review, provide an overview of the main findings and present some issues for discussion, including a multidimensional framework of public accountability.

Methods

The discussion of accountability as a concept and as an intervention is dispersed among different disciplines and fields. Theory mining in other relevant research traditions is therefore a good starting point in developing an understanding of accountability in health. Methodologically, the meta-narrative review is most appropriate in such cases, as it allows one to map concepts and definitions across research traditions, to trace the evolution over time and to identify any overarching conceptual approaches.32 We applied the meta-triangulation principles described by Lewis and Grimes33 to further improve the quality of the review and followed the guidance developed by Wong et al.34

Both the meta-narrative review and meta-triangulation are geared towards learning from different research traditions and use paradigms as heuristics to build a richer, more comprehensive picture of a complex topic area. Paradigms can be defined as ‘tightly coupled ideologies, ontologies, epistemologies and methodologies’ that guide different categories of action such as interventions or research.33 The meta-narrative review aims at making sense of ‘complex and heterogeneous literature disagreeing about epistemology, ontology and research approaches’,35 and focuses on the theoretical and conceptual basis of empirical studies. As such, it is a relevant approach for the broader study on accountability in local health systems, given the heterogeneous literature on accountability. Meta-triangulation reviews look for ‘bridges’ between concepts, theories and frameworks and explore tensions between different paradigms in order to build more comprehensive theories. ‘It is a strategy of applying paradigmatic diversity to foster greater insight and creativity’.33 Both approaches use similar synthesis techniques, that is, narrative synthesis of findings on the basis of exploration of commonalities, differences and tensions in assumptions underlying the different research traditions, followed by higher level abstraction.32

As mentioned above, we selected political science, public administration, organisational sociology, ethics and development studies as the disciplines to be covered, because these are the disciplines at the origins of theory-building and conceptual development on accountability. The lead author is a political scientist and anthropologist, with a PhD in public health, and has research and professional experience in the domains of development studies, political science, policy and public health in low and middle income countries (LMIC) in Africa. She is currently working at an institute of development studies and a tropical medicine research institute. Similarly, the coauthor has rich experience in research and policy development, including accountability, in LMIC and in global health institutions, and is working at an institute of tropical medicine.

The review questions were formulated as follows (see table 1):

  • What are the main approaches to accountability in the selected research traditions?

  • How is accountability defined?

  • Who is to be accountable to whom, for what and why?

Table 1.

Overview of journals selected

Discipline Journal JIF Results
Political science/public administration Governance 1.604 17
Public Administration Review 1.546 28
Development studies World Development 1.527 9
Public Administration and Development 1.21 28
Organisational sociology/management Academy of Management Review 7.475 1
Organisation Science 4.338 1
Voluntas-International Journal of Voluntary and Non-Profit Organisations 0.881 14
Non-Profit and Voluntary Sector Quarterly 1.490 18
Ethics Ethics 86
Public Health Ethics 0.788 1
Quarterly of Healthcare Ethics 0.846 3

The search covered peer-reviewed journals, monographs and article readers published in the period 1992–2012. To identify monographs and article readers, we searched the academic database ISI Web of Knowledge, did manual searching for online full-text collections of Wiley InterScience, SpringerLink, Sage and Elsevier and used snowballing (referencing of references). As theory-building and conceptual development were the key review interests, monographs and readers constituted a primary reference source. In addition, we reviewed journal top 10 rankings in each discipline (table 1). For each of the aforementioned disciplines, we selected the journals on the basis of expert advice or because we found relevant articles published by these journals as a reference in other articles pertaining to accountability in LMIC. In addition, much-cited journals of renown without Journal Impact Factor scores were selected.

Papers that contribute to theoretical development of the accountability concept in one of the aforementioned disciplines were included. When finding both, the theoretical model28 36 was chosen as the source instead of its empirical application.37–42 Critiques that do not offer an alternative or theoretically different model were excluded43–46. Papers presenting empirical studies without conceptual framework, and papers focusing exclusively on global governance or global policymaking, on financial accountability or which were only applicable to high-income countries, were also excluded (figure 1).

Figure 1.

Figure 1

Search results for the meta-narrative review.

The Google Scholar or Google (monographs) citation frequency is mentioned in table 1 and was used as an additional criterion of appraisal of the article's importance in the research tradition,i next to other authors' citation of the article and its alignment with the research question. It should be noted that citation frequency is just one criterion used in a meta-narrative review. Indeed, the aim is not to search just for the most popular publications, but also for the breadth of approaches within each discipline.

Thirty-four publications were retained for in-depth analysis (box 1).

Box 1. List of papers that were selected in the review.

 1. Ackerman S. Co-Governance for accountability: beyond “Exit” and “Voice”. World Dev 2004;32:447–63.

2. Behn RD. Rethinking democratic accountability. Washington DC: Brookings Institution Press, 2001.

3. Boin A, McConnell A, Hart PT. Governing after crisis. The politics of investigation, accountability and learning. Cambridge: Cambridge University Press, 2008.

4. Bovens M. The Quest for Responsibility. Accountability and citizenship in complex organisations. Cambridge: Cambridge University Press, 1998.

5. Bovens M, Schillemans T, Hart PT. Does public accountability work? An assessment tool. Public Adm 2008;86:225–42.

6. Brown LD, Moore MH. Accountability, strategy and international nongovernmental organizations. Nonprofit Voluntary Sector Q 2001;30:569–87.

7. Cornwall A, Coelho VSP. Spaces for change? The politics of participation in new democratic arenas. In: Cornwall A, Coelho VSP, eds. Spaces for change? The politics of participation in new democratic arenas. London: Zed Books, 2007:1–32.

8. Daniels N. Accountability for reasonableness. BMJ 2000;321:1300–1.

9. Daniels N. Just health. Meeting health needs fairly. Cambridge: Cambridge University Press, 2008.

10. Daniels N, Sabin JE. Setting limits fairly: can we learn to share medical resources? New York/Oxford: Oxford University Press, 2002.

11. Devas N, Grant U. Local government decision-making-citizen participation and local accountability: some evidence from Kenya and Uganda. Public Adm Dev 2003;23:307–16.

12. Dubnick M. Accountability and the promise of performance. Public Performance Manage Rev 2005;28:376–417.

13. Ebrahim A. Accountability in practice: mechanisms for NGOs. World Dev 2003;31:813–29.

14. Ebrahim A. Making sense of accountability: conceptual perspectives for northern and southern nonprofits. Nonprofit Manag Leadersh 2003;14:191–211.

15. Ebrahim A. Accountability myopia: losing sight of organisational learning. Nonprofit Voluntary Sector Q 2005;34:56–87.

16. Edwards M, Hulme M. NGO performance and accountability: introduction and overview. In: Edwards M, Hulme M, eds. Non-Governmental organisations—performance and accountability beyond the magic bullet. London: Earthscan, 1995:3–16.

17. Frink D, Klimoski RJ. Advancing accountability theory and practice. Introduction to the human resource management review special edition. Hum Resour Manag Rev 2004;14:1–17.

18. Gregory R. Accountability in modern government. In: Peters BG, Pierre J, eds. Handbook of public administration. London: Sage, 2003:557–68.

19. Kearns KP. Managing for accountability. Preserving the public trust in public and non-profit organizations. San Francisco: Jossey-Bass, 2010.

20. Kilby P. Accountability for empowerment: dilemmas facing non-governmental organizations. World Dev 2006;34:951–963.

21. Koppell J. Pathologies of accountability: ICANN and the challenge of “Multiple Accountabilities Disorder”. Public Adm Rev 2005;65:94–108.

22. Koppell J. The politics of quasi-government. Hybrid organizations and the dynamics of bureaucratic control. Cambridge: Cambridge University Press, 2006.

23. Moncrieffe J. Relational accountability. Complexities of Structural Injustice. London: Zed Books, 2011.

24. Mulgan R. Accountability. An ever-expanding concept? Public Adm 2000;78:555–73.

25. Mulgan R. Holding power to account: accountability in modern democracies. London: Palgrave MacMillan, 2003.

26. Najam A. NGO accounability: a conceptual framework. Dev Policy Rev 1996;14:339–53.

27. Newell P, Bellour S. Mapping accountability: origins, contexts and implications for development. IDS Working Paper 168. Brighton: Institute for Development Studies, 2002:24.

28. Newell P, Wheeler J. Rights, resources and the politics of accountability: an introduction. In: Newell P, Wheeler J, eds. Rights, resources and the politics of accountability. London: Zed Books, 2006:1–36.

29. Ospina S, Diaz W, O'Sullivan JF. Negotiating accountability: managerial lessons from identity-based nonprofit organizations. Nonprofit Voluntary Sector Q 2002;31:5–31.

30. Paul S. Accountability in public services: exit, voice and control. World Dev 1992;20:1047–60.

31. Romzek BS, LeRoux K, Blackmar JM. A preliminary theory of informal accountability among network organizational actors. Public Adm Rev 2012;72:442–53.

32. Schedler A. Conceptualizing accountability. In: Schedler A, Diamond L, Plattner MF, eds. The self-restraining state power and accountability in new democracies. Boulder, CO: Lynne Rienner, 1999:13–28.

33. Schedler A, Diamond L, Plattner MF, eds. The self-restraining state. Power and accountability in New Democracies. Boulder, CO: Lynne Rienner, 1999.

34. Steets J. Accountability in public policy partnerships. Basingstoke: Palgrave Macmillan, 2010.

We analysed the constituent elements of the frameworks and theories presented in these papers as follows in table 2:

  • The authors' definition of accountability

  • The accountability relationship (who is accountable to whom?)

  • The accountability dimension (what is one accountable for?)

  • The basis for the accountability claim (why is one accountable?)

  • The causal model: what are the processes and instruments, the contextual conditions and (expected) outcomes?

Table 2.

Summary of the results of the meta-review

Discipline Authors Accountability definition Who is accountable to whom? For what? Why? Processes Outcomes Contextual conditions
Political science/public administration Steets,95 Partnership accountability (partnership: voluntary arrangement between public, and/or private and/or civil society actors) Multitude of organisations involved in public policy to formal and informal principals and legal and fiscal authorities Finances compliance with rules and processes performance Delegated authority Information enforcement—clarifying roles and expectations of principals and agents Not mentioned Collaboration between actors
Mulgan,96 Mulgan,30 Plural accountability in modern democracies Government and public institutions to citizens or organisations that act on citizen's behalf (networks of accountability) Performance compliance with rules and regulations Delegated power, retributive justice and public deliberation Reporting, justification effective rectification: sanctions, remedial action Responsiveness Responsibility
Behn,60 Mutual compact accountability Public managers to multiple stakeholders/citizens Finances, fairness through rules and processes performance Flexibility in management Verification of standards for processes and trust regarding performance Not mentioned Cooperation, collective action
Boin et al87 Political accountability Political actors and institutions to stakeholders Goal achievements Name and shame Public investigation Improved performance public institutions Vibrant media, civil society
Schedler58 Public sector accountability Public institutions to citizens Political, financial, administrative, legal, professional Not mentioned Answerability and/or enforcement To curb or control political power Not mentioned
Development studies Newell and Bellour,47 Newell and Wheeler48 Rights-based accountability Institutions to citizens Resources Empowerment through collective action Strengthening demand side accountability: ‘enforcing rights over resources’ Social justice Not mentioned
Devas and Grant59 Political accountability at multiple levels (central-decentralised levels) Multiple accountability relationships between government, decentralised government agencies, public administration and citizens Resources Not mentioned Information central level leadership Public trust Political will government
Paul49 Microlevel exit and voice accountability Public sector institutions towards citizens Service delivery Customer power Strengthening demand mechanisms exit and voice based on information, organisational incentives Service performance improvement Perceived advantages and costs of using exit and voice
Ackerman50 Social accountability Not mentioned Service delivery Co-governance or empowered participatory governance Participation in decision-making Not mentioned Not mentioned
Organisational sociology Frink and Klimoski52 Organisational and self-accountability (internal) Employee to organisation Not mentioned Authority Social norms and norm expectations, evaluation, sanctions Long-term organisational viability Not mentioned
Kearns51 Organisational accountability (external) Organisation to the public Compliance with rules, laws and regulations+answering the public's expectations Organisation needs to be deserving of the public's trust Monitoring organisational standards of accountability Public trust Not mentioned
Ethics Daniels28 ‘Accountability for reasonableness’ Institutions to citizens Resource allocation of primary social goods that support human capabilities Collective action curbs power Fair decision-making processes Social justice Common value of fairness in process
Moncrieffe53 Relational accountability Democratic institutions to citizens Dependent on the actor and the context Power Equity based democratic institutions and decision-making Human development, democratic stability Democratic culture, institutional context

We would like to indicate some limitations in the application of the methods. Monographs and readers constituted a primary reference source. Since there is no specific book database covering monographies and readers in the disciplines included here, the review could not be entirely comprehensive. Another limitation is that we may have inadvertently ignored specific journals and some key authors, some of whom inevitably published after the timeframe included in the review.

Results

We present here the main themes we identified within the literature of each reviewed discipline, based on the overview in table 2. The first section presents an overview of disciplinary approaches, the second section traces the concept of accountability, and the third section provides a final summary presenting four main paradigms.

Disciplinary approaches

In the discipline of political science/public administration, the publications reviewed focused mainly on the accountability relationship between different categories of actors involved in public policy, often referring to the multitude of actors involved in public policy (as accountors), and to the notion of ‘citizens’ or ‘stakeholders’. For these authors, public policy actors are accountable to citizens for performance and compliance with regulations, as they possess delegated power or authority on behalf of the citizens. Financial accountability is separately mentioned by most authors. Processes to improve accountability focus on the supply side and include: reporting, public investigation and the verification of standards.

The publications reviewed in the discipline of development studies show various influences. Newell and Bellour47 and Newell and Wheeler48 consider accountability as grounded in citizens' rights, which can be enforced through empowerment of citizens and their collective action. As such, social justice can be achieved. On the other hand, for Paul, the accountability claim is grounded in a power relationship: the customer can ‘voice’ his concerns over bad performance and can ‘exit’ the service, that is, no longer make use of the services in question.49 In Ackerman's view, accountability in service delivery can only be improved via ‘co-governance’—actual participation of citizens in decision-making.50

The works reviewed in the field of organisational sociology are concerned with accountability within and of organisations. Accountability is mainly considered as a function of organisations, which, if managed well, contributes to gaining the public's trust. Kearns51 adheres to the view of accountability as a function directed towards the organisation's external environment. In this view, proactively maintaining accountability relationships is an integral part of the organisation's strategic management and leadership function. In contrast, Frink and Klimoski52 view accountability of an organisation as an internal function, which they relate to organisational culture.

Social justice and equity grounded in fair decision-making is the outcome envisaged in the discipline of ethics. For Daniels28 and Moncrieffe,53 accountability is part and parcel of a democratic culture that counters unbridled power. The Rawls-inspired ‘Accountability for Reasonableness’ framework developed by Daniels28 36 54 focuses on the fairness of the accountability process. For Daniels,28 supply-side measures such as enforcing compliance to rules, transparency and involvement of stakeholders can only work when these are supported by a strong demand from an empowered civil society.

Tracing the evolution of the concept of ‘accountability’

The emergence of New Public Management in the 1980s and its uptake in health policy and systems led to an active interest in governance and improved state accountability.30 55 During this period, development and donor agencies like the World Bank argued that states were failing their citizens and that governance systems were weak and non-responsive towards their citizens. It was argued that traditional public administration, grounded in hierarchy and rules, no longer provided fitting answers to rapidly changing environments. In response, the World Bank focused much on state-building interventions and ‘good governance’. In practice, health policies were reoriented towards decentralisation, provider-purchaser split, deregulation and contracting. The latter was considered as a central strategy to increase accountability of state actors, combined with deregulation and development of the private sector.

The World Bank followed the ideas of Paul,49 who proposed to strengthen both ‘exit’ (only a viable option for patients if alternative services exist) and ‘voice’ mechanisms to bolster accountability of public sector agencies. Paul, following Hirschman,56 argued that supply side competition enabling exit and participatory mechanisms enabling voice are effective only when they are bolstered by organisational incentives and adequate information and monitoring systems exist. Later, Roberts57 criticised adherents of New Public Management for reducing accountability to an issue, which can be solved by administrative regulation.

The much-cited monograph ‘The Self-Refraining State’ by Schedler et al58 offers insights on how public administration looked at accountability from a different perspective. It provides an early comprehensive conceptualisation of accountability that was intended to shape public sector reform policy in Africa and Latin America. Schedler et al consider accountability deficiencies as a failure of institutional arrangements to constrain power imbalances. The authors developed a two-dimensional concept of accountability, grounded in answerability and enforceability. Answerability is the obligation of civil servants to explain their actions, and enforceability is the capacity to sanction any wrongdoing of public officials or violation of the public service orientation.58

In the late 1990s, public administration scholars acknowledged the increased plurality of society and the effects of globalisation. They argued that in an interdependent world with multiple centres of decision-making, the relationships between state, civil society and the market become increasingly complex and opaque. Authors like Mulgan,30 Devas and Grant59 and Behn60 see contemporary accountability relationships as plural and dispersed among many actors and policymaking levels. However, multiple relations lead to multiple types of accountability, which in turn give rise to competing demands. Also, international organisations30 and partnerships between the public sector, private sector and civil society31 were considered to be surrounded by networks of accountability relations.

Three consequences of this hyperconnectedness were identified. First, organisations were seen to suffer from ‘multiple accountability disorder’,61 unable to respond to potentially conflicting demands for accountability.60 Second, Ackerman50 urged moving beyond mere ‘exit and ‘voice mechanisms and to provide new space for participatory mechanisms. Informal accountability in the form of enabling public dialogue was seen as a potential reinforcement of more traditional hierarchical accountability mechanisms.62 Third, attention was given to the mechanisms underlying accountability. While Schedler et al had identified answerability and enforceability as conditions for accountability, Dubnick63 pointed to three main processes that constitute account-giving behaviour: ‘reporting’, ‘mitigating’ and ‘reframing’. He identified the desire for approval or the urge to conform as mechanisms underlying accountability.

Four main paradigms to accountability

Table 2 shows how the authors we reviewed present a diversity of views and ideas on accountability. Yet, four distinct paradigms of accountability emerge: the institutionalist, the rights-based, the individual choice and the collective action paradigm.

The institutionalist paradigm proposes to use formal procedures and instruments and social norms in organisations and institutions to improve accountability. Accountability is mostly based on hierarchical relationships that are embedded in a ‘command and control’ bureaucratic structure and culture.64 It is enforced through verifying compliance with procedures, rules, laws and policies. Most of the frameworks within this approach have improved performance as the intended outcome. Institutionalist strategies sometimes entail community or stakeholder participatory processes as part of the stakeholder engagement or the monitoring and evaluation function of an organisation.1 8 10 51 52 61 65–70

The rights-based paradigm starts from the premise that accountability relationships rest on individual human rights or entitlements. Citizens delegate power and authority to government and public sector institutions, which in turn are accountable for the progressive realisation of citizens' rights and entitlements. Accountability is considered to be a value on itself: it is the key to curbing power differentials and bringing about more equitable relations through resource redistribution. Legal procedures can be a basis for enforcing accountability. Authors representing this line of thinking include.18 21 28 31 36 59 60 71 72

The individual choice paradigm regards accountability from a client perspective and relies on competitive market behaviour to explain accountability relationships. It considers that clients, as individual actors, make rational choices by weighing the perceived advantage and cost of all options. If the public sector institution is not delivering the appropriate service to the client, the latter can exercise his/her power as client and exit the service. Strategies to strengthen client power are based on verification of performance measures.49 63 73–75

In the collective action paradigm, accountability is seen as the product of groups of citizens. Individuals, organisations and institutions are considered to be connected by multiple accountability relationships. Actors can thus be account holder for some actions and accountor for other at the same time. The meaning of accountability is considered to be socially constructed and dependent on a given context. Actors can demand accountability through investigation and audits, ‘naming and shaming’ (through channels such as the media) and civil society protest. Alternatively, accountability is negotiated in a dialogue between the organisation and the public.17 22 48 50 53 76–81

Each of these paradigms differs in how accountability is defined and how it can be ensured. In the rights-based paradigm, improved accountability is an end in itself, while in the institutionalist paradigm it is a means to an end, that is, improved performance. The institutionalist paradigm primarily proposes measures on the ‘supply’ side to improve accountability, while the individual choice and collective action paradigms consider that accountability needs to be enforced by the account holders.

On the basis of the review of the literature and our professional background, we argue that the paradigms complement each other as in health services, accountability can be improved by taking measures both on the ‘supply’ and the ‘demand’ side.

Discussion: relevance of accountability approaches and concepts for health systems

The importance of accountability is now generally acknowledged in the fields of health policy and systems and global health, but it remains an elusive concept. Our meta-narrative review of current theories and frameworks in political science, public administration, organisational sociology, ethics and development studies indeed confirms that there is a wide range of approaches and definitions of accountability. This contributes potentially to the perception that there is no coherent body of knowledge. This in turn explains in part the research difficulties concerning accountability.22 73 Certain authors were not picked up by our search, such as John Gaventa and Anne Marie Goetz.82–85

Our analysis shows that four paradigms of accountability can be identified: the institutionalist, the rights-based, the individual choice and the collective action paradigm. Each of these emerged in reaction to specific challenges, which is reflected in the focus on specific relations and actors from either a professional, political, social or organisational perspective. This reflects Lasker's view that accountability approaches appear to suffer from the same predicament as work on community participation: ‘Practitioners and researchers (…) come from a variety of contexts, initiatives, and academic disciplines and few of them have integrated their work with experiences or literatures beyond their own domain’.86 While the disciplines here reviewed do not exist in silos, some accountability strategies remain limited to particular relations and actions and to ignoring the complex relationships between the multiple state and non-state actors in the current mixed health systems’ landscape in LMIC.

We argue that the four paradigms should be considered as complementary, that accountability may require action on both the ‘demand-side’ and ‘supply-side’, and that accountability can be both considered as a means to improve performance of health systems and as an end in itself. We thus propose to integrate the four main approaches to accountability in one comprehensive operational framework (figure 2).

Figure 2.

Figure 2

Multidimensional frame of public accountability in health systems.

This model has four dimensions: a provider, organisational, social and political dimension (box 2). The dimensions are not mutually exclusive and closed. Rather, the provider dimension is embedded in the organisational dimensions, which in itself is part of the social and political dimension.

Box 2. Four dimensions of accountability in health systems.

The provider dimension is based on professional ethos and providers’ commitment to quality of care and responsiveness. Strategies to enhance provider accountability include socialisation into the profession, enforcing professional standards and ethical codes, peer reviews and other remedial actions.

Organisational accountability is primarily undertaken to improve the organisational performance or to ensure that the organisation is responsive to its stakeholders. Measures to enhance accountability entail policies to enhance transparency and community control (including means for external verification), as well as the use of staff incentives to engage in dialogue with service users, performance reviews and organisational audits.

Accountability in the political dimension entails measures to safeguard the public interest and to improve citizens’ trust towards institutions to which they mandated certain responsibilities and means. Measures involve regulation processes based on mutually agreed roles and responsibilities between the actors in the health system and commonly agreed means for public participation in decision-making, including public investigation and public redress mechanisms.

Accountability measures specific to the social dimension of accountability involve relations and social processes. This includes processes of information sharing within self-organised networks (participatory processes in an organisational priority-setting), and collective action to redress unfairness and rights violations. The outcome of enhancing accountability in the social dimension is the bolstering of equity and fairness in the system.

The provider dimension focuses on the provider–patient relationship, in which one would use accountability measures and processes as an instrument to enhance quality of care. Examples include clinical audits. The organisational dimension focuses on responsiveness of the organisation to its stakeholders. Symptom boxes, ombudsman services and client satisfaction surveys can be used here. In the political dimension, one focuses primarily on regulatory processes in institutions to protect the public interest and to enhance the outcome of citizen trust. Finally, in the social dimension, strengthened public accountability is perceived mainly as an instrument to enhance equity and social justice grounded in community self-organisation.

This multidimensional frame has a number of advantages. First, it reflects the current multirelational nature of health systems and can help in identifying which accountabilities play out in which dimension. For instance, at the local level of health systems, district health managers might need to ensure accountability in the professional, the organisational and the political dimension, all at the same time. In effect, they might be accountable to standards set by a professional association, be accountable as employees of a particular healthcare organisation and be accountable as representatives of a public health institution. Second, the framework allows for identifying the roles of account-holder and accountor that actors and organisations often play simultaneously. For instance, the same district health managers are to hold their staff accountable for delivering quality services, while being themselves accountable to the public for the use of public funds. Third, it could inform the development of a tool to assess gaps in accountability. Finally, the frame points to the need for developing comprehensive accountability strategies that span the dimensions in which the organisation needs to be accountable. Indeed, if accountability has four dimensions, accountability interventions have to consist of bundled strategies that act on the different dimensions to be effective, taking into account the multiple relations of actors in the local health system.

Of course, numerous questions remain as to the applicability of this frame and how it could be translated into practical tools to assess the degree of public accountability.

Conclusions

Our meta-narrative review found that the literature on accountability in political science, public administration, organisational sociology, ethics and development studies displays a wide variation of definitions and concepts. Four main groups of approaches emerge: the institutionalist approach, the rights-based approach, the individual choice approach and the collective action approach. These four approaches can be integrated in a comprehensive accountability framework with professional, organisational, social and political dimensions.

Contributors: SVB conceived the review, carried out the search and the analysis and wrote the manuscript. SHM contributed to the review design, commented on the analysis and contributed to the writing of the final manuscript. Both authors read and approved the final manuscript.

Funding: This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data sharing statement: No additional data are available.

i

Google Scholar citation tracing was conducted in October 2013.

References

  • 1.Emanuel EJ, Emanuel LL. What is accountability in healthcare? Ann Intern Med 1996;124:229–39. 10.7326/0003-4819-124-2-199601150-00007 [DOI] [PubMed] [Google Scholar]
  • 2.Loewenson R. Participation and accountability in health systems: the missing factor in equity? Harare, Zimbabwe: Training and Research Support Centre, 2002. [Google Scholar]
  • 3.Rifkin SB. Lessons from community participation in health programmes. Health Policy Plan 1986;1:240–9. 10.1093/heapol/1.3.240 [DOI] [Google Scholar]
  • 4.Rifkin SB. Community Participation in MCH/FP programmes: an analysis based on case study materials. Geneva: WHO, 1990. [Google Scholar]
  • 5.Rifkin SB. Ten best readings on community participation and health. Afr Health Sci 2001;1:42–5. [PMC free article] [PubMed] [Google Scholar]
  • 6.Pérez D, Lefévre P, Romero MI et al. . Augmenting frameworks for appraising the practices of community based health interventions. Health Policy Plan 2009;24:335–41. 10.1093/heapol/czp028 [DOI] [PubMed] [Google Scholar]
  • 7.Hafner T, Shiffman J. The emergence of global attention to health system strengthening. Health Policy Plan 2013;28:41–50. 10.1093/heapol/czs023 [DOI] [PubMed] [Google Scholar]
  • 8.Mikkelsen-Lopez I, Wyss K, de Savigny D. An approach to addressing governance from a health system framework perspective. BMC Int Health Hum Rights 2011;11:13 10.1186/1472-698X-11-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.WHO. Everybody's business: strengthening health systems to improve health outcomes: WHO's framework for action. Geneva: World Health Organization, 2007. [Google Scholar]
  • 10.Siddiqi S, Masud TI, Nishtar S et al. . Framework for assessing governance of the health systems in developing countries: gateway to good governance. Health Policy 2009;90:13–25. 10.1016/j.healthpol.2008.08.005 [DOI] [PubMed] [Google Scholar]
  • 11.Atun R, de Jongh T, Secci F et al. . Integration of targeted health interventions into health systems: a conceptual framework for analysis. Health Policy Plan 2010;25:104–11. 10.1093/heapol/czp055 [DOI] [PubMed] [Google Scholar]
  • 12.Gruskin S, Ahmed S, Bogecho D et al. . Human rights in health systems frameworks: what is there, what is missing and why does it matter? Glob Public Health 2012;7:337–51. 10.1080/17441692.2011.651733 [DOI] [PubMed] [Google Scholar]
  • 13.Balabanova D, McKee M, Mills A et al. . What can global health institutions do to help strengthen health systems in low income countries? Health Res Policy Syst 2010;8:22 10.1186/1478-4505-8-22 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.de Savigny D, Adam T. Systems thinking for health systems strengthening. Geneva:Alliance for Health Policy and Systems Research & World Health Organisation, 2009. [Google Scholar]
  • 15.Fattore G, Tediosi F. The importance of values in shaping how health systems governance and management can support universal health coverage. Value Health 2013;16(1, Supplement):S19–23. 10.1016/j.jval.2012.10.008 [DOI] [PubMed] [Google Scholar]
  • 16.Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy 2008;85:263–76. 10.1016/j.healthpol.2007.09.003 [DOI] [PubMed] [Google Scholar]
  • 17.Béhague D, Kanhonou LG, Filippi V et al. . Pierre Bourdieu and transformative agency: a study of how patients in Benin negotiate blame and accountability in the context of severe obstetric events. Sociol Health Illn 2008;30:489–510. 10.1111/j.1467-9566.2007.01070.x [DOI] [PubMed] [Google Scholar]
  • 18.Freedman LP. Human rights, constructive accountability and maternal mortality in the Dominican Republic: a commentary. Int J Gynecol Obstet 2003;82:111–14. 10.1016/S0020-7292(03)00147-4 [DOI] [PubMed] [Google Scholar]
  • 19.George A. Using accountability to improve reproductive healthcare. Reprod Health Matters 2003;11:161–70. 10.1016/S0968-8080(03)02164-5 [DOI] [PubMed] [Google Scholar]
  • 20.George A. Accountability in health services. transforming relationships and contexts. Working Paper Series Cambridge, MA: Harvard Center for Population and Development Studies, 2003. [Google Scholar]
  • 21.Yamin AE. Beyond compassion: the central role of accountability in applying a Human Rights framework to health. Health Hum Rights 2008;10:1–20. [PubMed] [Google Scholar]
  • 22.Molyneux S, Atela M, Angwenyi V et al. . Community accountability at peripheral health facilities: a review of the literature and development of a conceptual framework. Health Policy Plan 2012;27:541–54. 10.1093/heapol/czr083 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bossert TJ, Mitchell AD. Health sector decentralization and local decision-making: decision space, institutional capacity and accountability in Pakistan. Soc Sci Med 2011;72:39–72. 10.1016/j.socscimed.2010.10.019 [DOI] [PubMed] [Google Scholar]
  • 24.Hsu J, Pitt C, Greco G et al. . Countdown to 2015: changes in official development assistance to maternal, newborn and child health in 2009-10, an assessment of progress since 2003. Lancet 2012;380:1157–68. 10.1016/S0140-6736(12)61415-9 [DOI] [PubMed] [Google Scholar]
  • 25.Kickbusch I. The development of international health policies-accountability intact? Soc Sci Med 2000;51:979–89. 10.1016/S0277-9536(00)00076-9 [DOI] [PubMed] [Google Scholar]
  • 26.Ooms G, Hammond R. Global governance of health and the requirements of human rights. Global Policy 2012;3:476–9. 10.1111/j.1758-5899.2012.00201.x [DOI] [Google Scholar]
  • 27.Requejo JH, Bryce J, Victora C et al. . Accountability for maternal, newborn and child survival. An update on progress in priority countries. Geneva: WHO/Countdown to 2015-Maternal, Newborn and Child Survival, 2012:18. [Google Scholar]
  • 28.Daniels N. Just health. Meeting health needs fairly. Cambridge: Cambridge University Press, 2008. [Google Scholar]
  • 29.United Nations General Assembly. Resolution on Universal Health Coverage. 67th Session, 53rd Meeting, New York, 2012.
  • 30.Mulgan R. Holding power to account: accountability in modern democracies. London: Palgrave MacMillan, 2003. [Google Scholar]
  • 31.Steets J. Accountability in public policy partnerships. Basingstoke: Palgrave Macmillan, 2010. [Google Scholar]
  • 32.Greenhalgh T, Robert G, Macfarlane F et al. . Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med 2005;61:417–30. 10.1016/j.socscimed.2004.12.001 [DOI] [PubMed] [Google Scholar]
  • 33.Lewis MW, Grimes AJ. Meta-triangulation: building theory from multiple paradigms. Acad Manage Rev 1999;24:672–90. [Google Scholar]
  • 34.Wong G, Greenhalgh T, Westhorp G et al. . RAMESES publication standards: meta-narrative reviews. BMC Med 2013;11:20 10.1186/1741-7015-11-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Greenhalgh T, Robert G, Macfarlane F et al. . Diffusion of innovations in service organization: systematic review and recommendations. Millbank Q 2004;82:581–629. 10.1111/j.0887-378X.2004.00325.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Daniels N, Sabin JE. Setting limits fairly: can we learn to share medical resources? New York/Oxford: Oxford University Press, 2002. [Google Scholar]
  • 37.Byskov J, Bloch P, Blystad A et al. . Accountable priority setting for trust in health systems—the need for research into a new approach for strengthening sustainable health action in developing countries. Health Res Policy Syst 2009;7:23 10.1186/1478-4505-7-23 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Mshana S, Shemilu H, Ndawi B et al. . What do district health planners in Tanzania think about improving priority setting using ‘Accountability for Reasonableness’? BMC Health Serv Res 2007;7:180 10.1186/1472-6963-7-180 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Maluka S, Kamuzora P, San Sebastiån M et al. . Decentralized health care priority-setting in Tanzania: evaluating against the accountability for reasonableness framework. Soc Sci Med 2010;71:751–9. 10.1016/j.socscimed.2010.04.035 [DOI] [PubMed] [Google Scholar]
  • 40.Maluka SO. Strengthening fairness, transparency and accountability in health care priority setting at district level in Tanzania. Glob Health Action 2011;4:7829 10.3402/gha.v4i0.7829 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Kapiriri L, Norheim OF, Heggenhougen K. Public participation in health planning and priority setting at the district level in Uganda. Health Policy Plan 2003;18:205–13. 10.1093/heapol/czg025 [DOI] [PubMed] [Google Scholar]
  • 42.Gibson JL, Martin DK, Singer PA. Priority setting in hospitals: fairness, inclusiveness, and the problem of institutional power differences. Soc Sci Med 2005;61:2355–62. 10.1016/j.socscimed.2005.04.037 [DOI] [PubMed] [Google Scholar]
  • 43.Rid A. Justice and procedure: how does “accountability for reasonableness” result in fair limit-setting decisions? J Med Ethics 2009;35:12–16. 10.1136/jme.2008.024430 [DOI] [PubMed] [Google Scholar]
  • 44.Friedman A. Beyond accountability for reasonableness. Bioethics 2008;22:101–12. 10.1111/j.1467-8519.2007.00605.x [DOI] [PubMed] [Google Scholar]
  • 45.Hasman A, Holm S. Accountablity for reasonableness: opening the black box of process. Healthcare Anal 2005;13:261–73. 10.1007/s10728-005-8124-2 [DOI] [PubMed] [Google Scholar]
  • 46.Lauridsen S, Lippert-Rasmussen K. Legitimate allocation of public healthcare: beyond accountability for reasonableness. Public Health Ethics 2009;2:59–69. 10.1093/phe/php001 [DOI] [Google Scholar]
  • 47.Newell P, Bellour S. Mapping accountability: origins, contexts and implications for development. IDS Working Paper 168 Brighton: Institute for Development Studies, 2002:24. [Google Scholar]
  • 48.Newell P, Wheeler J. Rights, resources and the politics of accountability: an introduction. In: Newell P, Wheeler J, eds. Rights, resources and the politics of accountability. London: Zed Books, 2006:1–36. [Google Scholar]
  • 49.Paul S. Accountability in public services: exit, voice and control. World Dev 1992;20:1047–60. 10.1016/0305-750X(92)90130-N [DOI] [Google Scholar]
  • 50.Ackerman S. Co-Governance for accountability: beyond “Exit” and “Voice”. World Dev 2004;32:447–63. 10.1016/j.worlddev.2003.06.015 [DOI] [Google Scholar]
  • 51.Kearns KP. Managing for accountability. Preserving the public trust in public and non-profit organizations. San Francisco: Jossey-Bass, 2010. [Google Scholar]
  • 52.Frink D, Klimoski RJ. Advancing accountability theory and practice. Introduction to the human resource management review special edition. Hum Resour Manag Rev 2004;14:1–17. [Google Scholar]
  • 53.Moncrieffe J. Relational accountability. Complexities of Structural Injustice. London: Zed Books, 2011. [Google Scholar]
  • 54.Daniels N. Accountability for reasonableness. BMJ 2000;321:1300–1. 10.1136/bmj.321.7272.1300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Peters BG. Institutional theory. Problems and prospects. In: Pierre JB, Peters BG, Stoker G, eds. Debating institutionalism. Manchester: Manchester University Press, 2008:1–17. [Google Scholar]
  • 56.Hirschman AO. Exit, voice and loyalty. Responses to decline in firms, organizations and states. Cambridge, MA: Harvard University Press, 1970. [Google Scholar]
  • 57.Roberts N. Keeping public officials accountable through dialogue: resolving the accountability paradox. Public Adm Rev 2002;62:658–68. 10.1111/1540-6210.00248 [DOI] [Google Scholar]
  • 58.Schedler A, Diamond L, Plattner MF, eds. The self-restraining state. Power and accountability in New Democracies. Boulder, CO: Lynne Rienner, 1999. [Google Scholar]
  • 59.Devas N, Grant U. Local government decision-making-citizen participation and local accountability: some evidence from Kenya and Uganda. Public Adm Dev 2003;23:307–16. 10.1002/pad.281 [DOI] [Google Scholar]
  • 60.Behn RD. Rethinking democratic accountability. Washington DC: Brookings Institution Press, 2001. [Google Scholar]
  • 61.Koppell J. Pathologies of accountability: ICANN and the challenge of “Multiple Accountabilities Disorder”. Public Adm Rev 2005;65:94–108. 10.1111/j.1540-6210.2005.00434.x [DOI] [Google Scholar]
  • 62.Gregory R. Accountability in modern government. In: Peters BG, Pierre J, eds. Handbook of public administration. London: Sage, 2003:557–68. [Google Scholar]
  • 63.Dubnick M. Accountability and the promise of performance. Public Performance Manage Rev 2005;28:376–417. [Google Scholar]
  • 64.Jaffee D. Organization theory. Tension and change. International edition ed. New York: McGraw-Hill, 2001. [Google Scholar]
  • 65.Edwards M, Hulme M. NGO performance and accountability: introduction and overview. In: Edwards M, Hulme M, eds. Non-Governmental organisations—performance and accountability beyond the magic bullet. London: Earthscan, 1995:3–16. [Google Scholar]
  • 66.Emanuel LL. A professional response to demands for accountability: practical recommendations regarding ethical aspects of patient care. Ann Intern Med 1996;124:240–9. 10.7326/0003-4819-124-2-199601150-00008 [DOI] [PubMed] [Google Scholar]
  • 67.Najam A. NGO accounability: a conceptual framework. Dev Policy Rev 1996;14:339–53. 10.1111/j.1467-7679.1996.tb00112.x [DOI] [Google Scholar]
  • 68.Ebrahim A. Accountability myopia: losing sight of organisational learning. Nonprofit Voluntary Sector Q 2005;34:56–87. 10.1177/0899764004269430 [DOI] [Google Scholar]
  • 69.Roberts M, Hsiao W, Berman P et al. . Getting health reform right. A guide to improving performance and equity. Oxford, New York: Oxford University Press, 2004. [Google Scholar]
  • 70.WHO. Towards better leadership and management in health: report on an international consultation on leadership and management in low-income countries. Making health systems work. Geneva: World Health Organisation, 2007. [Google Scholar]
  • 71.Schedler A. Conceptualizing accountability. In: Schedler A, Diamond L, Plattner MF, eds. The self-restraining state power and accountability in new democracies. Boulder, CO: Lynne Rienner, 1999:13–28. [Google Scholar]
  • 72.Gloppen S. Litigation as a strategy to hold governments accountable for implementing the right to health. Health Hum Rights 2008;10:21–36. 10.2307/20460101 [DOI] [PubMed] [Google Scholar]
  • 73.Berlan D, Shiffman J. Holding health providers in developing countries accountable to consumers: a synthesis of relevant scholarship. Health Policy Plan 2012;27:271–80. 10.1093/heapol/czr036 [DOI] [PubMed] [Google Scholar]
  • 74.Falisse JB, Meessen B, Ndayishimiye J et al. . Community participation and voice mechanisms under performance-based financing schemes in Burundi. Trop Med Int Health 2012;17: 674–82. 10.1111/j.1365-3156.2012.02973.x [DOI] [PubMed] [Google Scholar]
  • 75.McNamara P. Provider-specific report cards: a tool for health sector accountability in developing countries. Health Policy Plan 2006;21:101–9. 10.1093/heapol/czj009 [DOI] [PubMed] [Google Scholar]
  • 76.Cornwall A, Lucas H, Pasteur K. Introduction: accountability through participation: developing workable partnership models in the health sector. IDS Bulletin 2000;31:1–13. 10.1111/j.1759-5436.2000.mp31001001.x [DOI] [Google Scholar]
  • 77.Romzek BS, LeRoux K, Blackmar JM. A preliminary theory of informal accountability among network organizational actors. Public Adm Rev 2012;72:442–53. 10.1111/j.1540-6210.2011.02547.x [DOI] [Google Scholar]
  • 78.Pellegrino ED. Towards a reconstruction of medical morality. Am J Bioeth 2006;6:65–71. [DOI] [PubMed] [Google Scholar]
  • 79.Romzek BS, Dubnick MJ. Accountability in the public sector: lessons from the challenger tragedy. Public Adm Rev 1987;47:227–38. 10.2307/975901 [DOI] [Google Scholar]
  • 80.Bovens M, Schillemans T, Hart PT. Does public accountability work? An assessment tool. Public Adm 2008;86:225–42. 10.1111/j.1467-9299.2008.00716.x [DOI] [Google Scholar]
  • 81.George A. ‘By papers and pens, you can only do so much’: views about accountability and human resource management from Indian government health administrators and workers. Int J Health Plann Manage 2009;24:205–24. 10.1002/hpm.986 [DOI] [PubMed] [Google Scholar]
  • 82.Goetz AM, Gaventa J. Bringing citizen voice and client focus into service delivery. IDS Working Paper Brighton: Institute of Development Studies, 2001. [Google Scholar]
  • 83.Goetz AM, Jenkins R. Hybrid forms of accountability: citizen engagement in institutions of public sector oversight in India. Public Manag Rev 2001;3:363–83. 10.1080/14616670110051957 [DOI] [Google Scholar]
  • 84.Goetz AM, Jenkins R. Voice and accountability in service delivery. Dev outreach 2001;6:8–10. [Google Scholar]
  • 85.Jenkins R, Goetz AM. Accounts and accountability: theoretical implications of the right-to-information movement in India. Third World Q 1999;20:603–22. 10.1080/01436599913712 [DOI] [Google Scholar]
  • 86.Lasker RD, Weiss ES. Broadening participation in community problem solving: a multidsciplinary model to support collaborative practice and research. J Urban Health 2003;80:14–47. 10.1093/jurban/jtg014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Boin A, McConnell A, Hart PT. Governing after crisis. The politics of investigation, accountability and learning. Cambridge: Cambridge University Press, 2008. [Google Scholar]
  • 88.Bovens M. The Quest for Responsibility. Accountability and citizenship in complex organisations. Cambridge: Cambridge University Press, 1998. [Google Scholar]
  • 89.Brown LD, Moore MH. Accountability, strategy and international nongovernmental organizations. Nonprofit Voluntary Sector Q 2001;30:569–87. [Google Scholar]
  • 90.Cornwall A, Coelho VSP. Spaces for change? The politics of participation in new democratic arenas. In: Cornwall A, Coelho VSP, eds. Spaces for change? The politics of participation in new democratic arenas. London: Zed Books, 2007:1–32. [Google Scholar]
  • 91.Ebrahim A. Accountability in practice: mechanisms for NGOs. World Dev 2003;31:813–29. [Google Scholar]
  • 92.Ebrahim A. Making sense of accountability: conceptual perspectives for northern and southern nonprofits. Nonprofit Manag Leadersh 2003;14:191–211. [Google Scholar]
  • 93.Kilby P. Accountability for empowerment: dilemmas facing non-governmental organizations. World Dev 2006;34:951–963. [Google Scholar]
  • 94.Koppell J. The politics of quasi-government. Hybrid organizations and the dynamics of bureaucratic control. Cambridge: Cambridge University Press, 2006. [Google Scholar]
  • 95.Steets J. Accountability in public policy Oxford: Oxford University Press, 2005. [Google Scholar]
  • 96.Mulgan R. Accountability. An ever-expanding concept? Public Adm 2000;78:555–73. [Google Scholar]
  • 97.Ospina S, Diaz W, O'Sullivan JF. Negotiating accountability: managerial lessons from identity-based nonprofit organizations. Nonprofit Voluntary Sector Q 2002;31:5–31. [Google Scholar]

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES