ABSTRACT
Traditional ‘hierarchical’ regulation involves checks and balances and external accountability and review bodies. There have been high profile failures of this approach in England (Mid Staffs) and Australia (Bundaberg, Queensland). The regulatory framework needs to be transformed to recognise the increasing use of market and market-like mechanisms in health care. Improvement in the ability to measure quality and safety of care using routine (already collected) data facilitates this. New regulation needs to ensure quality and financial incentives are aligned. New instruments such as incorporating safety/quality measures into service descriptions, use of patient reported outcome measures, and making information about expected outcomes of care to patients available, ought to be used more widely. Improved data capture, including whether a diagnosis was present on admission, will help in improving quality and safety of care and its measurement.
KEYWORDS: Quality, safety, pay for performance, routine data
Background
Australia's new government elected in 2013 is following the practice of conservative governments elsewhere in conducting a war on ‘red tape’. In Australia, this is taking the form of a ‘repeal day’ where legislation considered to be outmoded, superseded or out of favour will be introduced into parliament. Two ‘repeal days’ will be scheduled each year.
‘Red tape’ is a term of derision, but one person's ‘red tape’ may be another's necessary safeguard. Crises beget regulations and they are layered on health (and other policy) systems like geological sediments, so an occasional spring cleaning may be worthwhile.
The place of regulation
The objective of public policy is typically to shape the behaviour of individuals, communities and organisations. There are a number of top-down instruments or levers that governments can use: provision of new services; financial levers (taxes, incentives, setting up markets); rules, laws, organisational changes and system targets; information provision; rhetoric; and changing values and culture (usually by a combination of the previous five and through initial education).1,2 Adherence to rules and targets can be accompanied by various levels of sanctions or ‘terror’.3,4 Bottom-up pressure for change can be manifest by governments adopting consumer empowerment or market-like strategies designed to achieve this.5
In general, each specific behaviour or target of policy requires a distinct policy instrument,6 partly explaining their accretion over time. Ideally, they will be aligned and work in the same direction. It is undesirable to create either policy instruments that the regulator expects the regulated to ignore, or complexity by instituting one policy instrument to counteract the unintended effects of another. Not all behaviours (or situations) can be predicted with certainty, which means that specification of what is expected is necessarily incomplete,7 creating uncertainty in the regulatory frame.
The relative balance across different instruments will vary over time, and according to the nature of the problem being addressed. Oliver Williamson, awarded a Nobel Prize in 2009, developed transaction cost economics to predict when different forms of interactions between a firm and its supply chain may be optimal.8 In brief, he identified the conditions under which a firm should go to market to acquire supplies or should produce them internally. This is termed the ‘make or buy’ decision. The choice is also characterised as being one between markets and hierarchies.9
Reliance on hierarchical controls, regulation and ‘red tape’ is out of fashion as a way of influencing behaviour, supplanted by market mechanisms and financial incentives. In the health sector, this has been made possible by advances in our ability to describe health services. A market cannot function when the products to be bought or sold cannot be defined adequately. The great advance in defining ‘products’ of hospital care was the development of diagnosis-related groups (DRGs) as a measure to control for the mix, or clinical heterogeneity, of hospital cases.10 In England, activity is measured using healthcare resource groups (HRGs).11 HRGs (and other case-mix measures) are incomplete descriptors of inpatient activity because they implicitly assume homogeneity of outcomes. As outcome measurement has improved, this assumption is increasingly questioned.12
The various policy instruments applied to healthcare have their impact by reinforcing or responding to the motivations or values of hospitals and their staff. Such motivations include professionalism, service to the local community, the financial health of the organisation, work satisfaction and maintenance of reputation. Different incentive designs have different impacts on these motivations, influencing the salience of the instrument.13
Contemporary regulatory approaches increasingly rely on ‘self-regulation’ and graded pyramidal interventional hierarchies, where greater levels of infringement lead to increasing intervention.14 The lower levels of the regulatory hierarchies involve the so-called ‘light touch’ approach and assume that strong internal motivations and professionalism, coupled with the threat of reputational risk if infringements are identified, are sufficient to ensure compliance.
Regulatory failure
Although inadequacies of standards of safety and quality rarely have a single cause, one contributing factor to recent system failures in both Australia and England may be regulatory in origin. The UK Francis Report is replete with stories of how the central regulators failed in their missions.15 But a more compelling narrative is that of failure of regulatory design, not of implementation.
The Mid Staffs story is one of failure to ensure alignment of instruments: the financial incentives on the Trust were in conflict with professional norms and values, and with the rules and regulations administered by ‘quality’ regulators.16 The system of potential financial rewards and penalties created perverse incentives in the Trust to cut corners, tolerate understaffing, and dispute or ignore warning signals, resulting in what one commentator called an ‘extraordinary muddle’.17
The same factors were at play in Queensland's safety scandal involving Bundaberg Base Hospital.18–21 Bundaberg Base Hospital is one of Queensland's network of regional hospitals, located 360 km (225 miles) north of the state capital, Brisbane. Queensland has had a lower per capita graduation rate of medical graduates than the rest of the country: contrast South Australia at around 14 new medical graduates per 100,000 population each year with a rate of 7 per 100,000 in Queensland. Queensland has had difficulty in recruiting Australian-trained doctors to work outside the south-east corner where Brisbane is located, which has meant a heavy reliance on internationally trained medical graduates to staff its rural and regional services.
These recruitment difficulties provided the environment in which American surgeon Dr Jayant Patel was recruited to provide surgery at Bundaberg Base Hospital. The first very serious complaint about Dr Patel occurred within 8 weeks of his starting. There were 22 complaints against Dr Patel during the 24 months of his employment at Bundaberg: taking into account periods of leave there was about one formal patient complaint or formal staff report for each month that he actually worked. Action was eventually taken only after a nurse who worked in Bundaberg Base Hospital blew the whistle, and her story was doggedly pursued by a journalist.22 Independent investigations subsequently confirmed that many of these complaints raised valid, serious questions about the competence of Dr Patel, including his clinical decision-making.
Dr Patel was a hard-working (and possibly over-confident) surgeon, who was willing to undertake surgery on patients whom other local surgeons would have declined to recommend for surgery or referred to larger centres. A number of patients on whom Dr Patel operated had serious adverse outcomes.
A critical issue in Bundaberg was not a problem of identifying aberrant poor practice but rather of acting on this knowledge. At the time, Queensland hospitals had a financial incentive to undertake additional activity to reduce waiting lists so Dr Patel's work generated significant additional revenue for the hospital. This partly explained the lack of action on complaints against Dr Patel.
The response to the Bundaberg scandal included a regime change at Queensland Health (minister, director-general and the senior leadership departed) and the introduction of a comprehensive programme of culture change and statistical process control monitoring of the safety of care.23–25 (The author was recruited to Queensland Health as part of that process.)
Up until recently, medical registration in Australia was a state responsibility. State laws generally allowed wide discretion to boards to approve registration for practitioners to work in ‘areas of need’ who might not be approved to work in areas with a better supply of medical practitioners.26 Perversely, this meant that the weakest practitioners were approved to work in the areas with the weakest supervision, creating well-documented system problems.27 In smaller states, the registration boards did not work fully independently, suffering a form of regulatory capture where they were overly swayed by local health system exigencies to approve registration. As part of wider regulatory reform, medical registration is now national, removing some of the regulatory capture risk (Table 1).
Table 1.
Australia: health system regulatory processes
An issue in policy design is the potential for unintended or perverse responses.28 This was evident in both Mid Staffordshire and Bundaberg, where perverse responses to financial incentives created safety issues. As mentioned above, policy instruments are aligned ideally, but, in these two instances, the financial incentives created responses that were counter to inherent culture and values of professionalism, and to formal regulatory rules, overwhelming the longer-term impacts (eg sanctions from the regulator) and more subtle internalised values. This created the environment in which warning signals were ignored by local management, a situation common to other safety scandals around the world.29
Directions for regulation in a developing healthcare market
An easy response to failures of regulation is to apply more, or to rearrange the regulatory deck chairs. Such changes create the impression of action, and allow politicians to appear to respond to concerns until public attention and sentiment have moved on. Unless policy instruments are aligned, similar problems are bound to emerge again.
Our thinking about regulation of healthcare is still framed by the ‘hierarchy’ period of health policy thinking and has not adapted properly to the market forces approach to provision. Although in theory hospitals might compete on quality to attract market share, the evidence that this leads to improved care is still scant, and mixed at that.30,31 Even high-profile scandals don't appear to have a lasting impact on patient flows.32
In the hierarchical period of service delivery organisation in countries such as Australia and the UK, hospitals were creatures of the state with direct line accountability as the mode of ensuring service responsiveness to the needs of patients and voters. Professional self-regulation was assumed to assure quality of care. Although these are seen by some as the halcyon days, the system was not fit for purpose and patient neglect, both procedural and caring,33 abounded, some evidenced in external enquiries after high-profile system failures.34
The move towards more market-like sector organisation has not been accompanied by a sufficient rethink of how regulation ought to occur.
Regulation framed in the hierarchical mode is set up as part of a ‘checks and balances’ approach, attempting to constrain managers from acting in an economically rational, albeit perhaps morally inappropriate, way. ‘Hierarchical’ regulation is generally slower to respond than the more immediate gratification provided by price signals. External ‘audit’ bodies, of variable effectiveness, have been added, attracting criticism for their added regulatory burden.35 The regulatory responses in this newly marketed sector need to be quicker, built on a wider range of policy instruments than hierarchical organisations, laws, external inspections and regulations.
An underlying problem of markets stems from the incomplete specification of the product being bought and sold, especially the implicit assumption of outcome or quality homogeneity. Better specification of policy objectives allows development of price signals for other (‘adjunct’) policy objectives relating to waiting times and other aspects of service quality.36 In particular, developments since DRGs/HRGs were originally constructed allow incorporation of quality measurement into price signals (and/or product definition), thus helping to align volume-related incentives and quality incentives.
The first new regulatory development should be to strengthen the use of quality measurement in payment design. There are a number of ways in which quality can be incorporated into pricing signals, including ‘pay for performance’ (P4P) or, more widespread in policy implementation, ‘no pay for non-performance’. The evidentiary basis for both types of initiatives is still weak37 and, in their first manifestations, little money is shifted around. However, both types of initiatives appear to be having an impact on behaviour, partly because of reputational risk (hospitals don't like being seen to have been penalised for poor quality) and partly because penalties evoke disproportionately stronger responses than rewards (‘loss aversion’).38
In England, a hesitant toe has been dipped into the P4P water with payment-by-results, ‘best practice’ pricing strategies in four areas: cholecystectomy, hip fractures, cataracts and stroke. In the USA almost all contemporary implementations of funding reform involve a blend of efficiency and P4P aspects.39 In the US's Medicare system, for example, a limited list of hospital-acquired conditions (so-called ‘never events’) is excluded in the assignment of cases in its case-mix classification algorithm. This effectively penalises hospitals where these events occur, because, in the absence of such an exclusion, the adverse event (say catheter-associated infection) would have potentially led to assignment to a higher DRG and hence a higher payment.40 Queensland has gone further than other Australian states with P4P, rewarding performance on a list of clinically developed indicators and penalising, with zero payment, six ‘never events’.41,42
Results from the broader collection of patient-reported outcome measures could be incorporated into pricing structures, alongside more clinical measures. This would increase the salience of patient-experience in quality measurement and overcome barriers to their use as part of internal hospital improvement efforts.43
Improved use of existing information should be the second strand of regulatory reform, which can also involve strengthening the hands of consumers. The full potential of the information currently collected about hospital performance should be used to inform patients about the potential outcomes of their treatment and for hospitals to monitor their own performance.
Feedback to Mid Staffs about its relative performance resulted in denial – the first of the Kübler–Ross grief stages.44 This response may have been evinced because of fear of penalties or punishment. An external accountability environment that was more supportive, focusing on what a hospital has done to change its practices (rather than just more punitive data analyses), may have led to more in-hospital ‘ownership’ of the signals.45 It would also be more consistent with the contemporary view that quality improvement is fostered by creating a ‘just and trusting culture’.46,47
There is increasing recognition of the potential for routinely collected data to contribute to health system improvement. In addition to their potential for facilitating use in research, such data can provide a rich source of feedback and the potential for a ‘continuous learning health system’.48,49 Hospitals should be encouraged and supported to analyse their own patterns of adverse events as already collected in the routine data.50
Routine data can also be used to provide patients with better information about the pattern of adverse events and likely outcomes of care, specific to their own circumstances and the experience of their treating clinician(s). Rather than generalised information about the potential outcomes of care, informed patient consent should be based on the specific local experience in terms of patterns of outcomes, preferably tailored to be age and sex specific.
The full potential of routine data sets will be garnered only if the UK catches up with other countries and incorporates a flag into its coding rules to indicate whether a diagnosis was ‘present on admission’.51,52
Clinical hubris contributes to clinicians predicting better outcomes of care than the average – the Lake Wobegon effect.53 A way around this is to collect information from clinicians about their perception of likely outcomes and compare this with actual results. Over time either clinicians will become more accurate in reporting likely outcomes or an optimism factor could be used to discount their advice.54,55
These suggestions for updating the regulatory approach need to be accompanied by a renewed emphasis on reinforcing good professional values and a safety-oriented NHS culture. This is what the Berwick report sets out to do, partly relying on rhetoric to reinforce desirable cultural attributes.56 Whether anyone will hear is a moot point.57
Streamlining the existing regulatory over-burden is also required. The problems identified at Mid Staffs and Bundaberg are not new. Nor are the responses proposed in the enquiries that these events stimulated.58 Walshe has conducted a meta-review of both the English reviews and international ones, identifying common themes and synthesising strategies that might prevent recurrence.59,60 To date, these lessons have been ignored. They should be dusted off and implemented.
Conclusions
Although there has been a waxing and waning of market language in the British NHS, the reality has been a slow but steady increase in use of market and market-like instruments over time. This has been facilitated by an improvement in the ability to define what is being provided, in turn facilitating pricing of those system outputs.
Over the last few years there has been an improvement in the ability to describe system outcomes as well. This development has not led to systematically incorporating outcome or quality measurement into the pricing framework. As a result, pricing incentives have created environments in which quality goals have been relegated to second place. Quality regulation has been a ‘pimple on a pumpkin’ supplement, to be avoided or circumvented in the pursuit of the monetary goal dangled in front of hospital leadership.
What is required is to augment current systems of quality regulation by new approaches that better align pricing and quality goals. This new approach transforms the improved ability to measure safety and outcomes of care into a policy instrument that hopefully will bring quality objectives into equal status (at least) with financial goals.
References
- 1.Tuohy CH. Accidental logics: the dynamics of change in the health care arena in the United States, Britain, and Canada. Oxford: Oxford University Press, 1999. [Google Scholar]
- 2.Hood C, Margetts H. The tools of government in the digital age. Basingstoke: Palgrave Macmillan, 2007. [Google Scholar]
- 3.Bevan G, Hood C. What's measured is what matters: targets and gaming in the English public health care system. Public Admin 2006;84:517–38. 10.1111/j.1467-9299.2006.00600.x [DOI] [Google Scholar]
- 4.Propper C, Sutton M, Whitnall C, Windmeijer R. Did ‘targets and terror’ reduce waiting times in England for hospital care? BE J Econ Analysis Policy 2008;8(2). [Google Scholar]
- 5.Prime Minister's Strategy Unit The UK government's approach to public service reform. London: Cabinet Office, 2006. [Google Scholar]
- 6.Tinbergen J. On the theory of economic policy. Amsterdam: North-Holland Publishing Co., 1952. [Google Scholar]
- 7.Williamson OE. Transaction-cost economics: the governance of contractual relations. J Law Econ 1979;22:233–61. 10.1086/466942 [DOI] [Google Scholar]
- 8.Williamson OE. Transaction cost economics: the natural progression. Am Econ Rev 2010;100:673–90. 10.1257/aer.100.3.673 [DOI] [Google Scholar]
- 9.Williamson OE. Markets and hierarchies: analysis and antitrust Implications. New York: The Free Press, 1975. [Google Scholar]
- 10.Fetter RB, Shin Y, Freeman JL, Averill RF, Thompson JD. Case mix definition by diagnosis related groups. Med Care 1980;18(suppl):1–53. [PubMed] [Google Scholar]
- 11.Mason AR, Ward P, Street A. England: The Healthcare Resource Group system. In: Busse R, Geissler A, Quentin W, Wiley M. (eds), Diagnosis-related groups in Europe: moving towards transparency, efficiency and quality in hospitals. Milton Keynes, Bucks: Open University Press, 2011. [Google Scholar]
- 12.Street A, Gutacker N, Bojke C, Devlin N, Daidone S. Variations in outcome and costs among NHS providers for common surgical procedures: econometric analyses of routinely collected data. Health Serv Deliv Res 2014;2(1). [PubMed] [Google Scholar]
- 13.Frølich A, Talavera JA, Broadhead P, Dudley RA. A behavioral model of clinician responses to incentives to improve quality. Health Policy 2007;80:179–93. 10.1016/j.healthpol.2006.03.001 [DOI] [PubMed] [Google Scholar]
- 14.Braithwaite J, Makkai T, Braithwaite VA. Regulating aged care: ritualism and the new pyramid. Cheltenham: Edward Elgar, 2007 10.4337/9781847206855 [DOI] [Google Scholar]
- 15.Francis RC. Report of the Mid Staffordshire NHS Foundation Trust public inquiry. London: The Stationery Office, 2013. [Google Scholar]
- 16.Dekker SWA, Hugh TB. A just culture after Mid Staffordshire. BMJ Qual Safety 2014;23:356–8. 10.1136/bmjqs-2013-002483 [DOI] [PubMed] [Google Scholar]
- 17.Limb M. Need for accountability should not result in ‘toxic’ blame culture in NHS, conference hears. BMJ 2014;348:g2282. [DOI] [PubMed] [Google Scholar]
- 18.Davies G, Chair Queensland Public Hospitals Commission of Inquiry: Report. Brisbane: Government Printer, 2005. [Google Scholar]
- 19.Forster P. Queensland Health Systems Review: Final Report. The Consultancy Bureau, 2005. Available at www.parliament.qld.gov.au/documents/tableOffice/TabledPapers/2005/5105T4447.pdf [Accessed 2 July 2014]. [Google Scholar]
- 20.van der Weyden MB. The Bundaberg Hospital scandal: the need for reform in Queensland and beyond. Med J Aust 2005;183:284–5. [DOI] [PubMed] [Google Scholar]
- 21.Duckett S. Accountability, transparency and participation: process values underpinning the new approach to governance of patient safety in Queensland Health. In: Healy J, Dugdale P. (eds), Patient safety first: responsive regulation in health care. Crows Nest, New South Wales: Allen & Unwin, 2009. [Google Scholar]
- 22.Thomas H. Sick to death: a manipulative surgeon and a health system in crisis – a disaster waiting to happen. Crows Nest, New South Wales: Allen & Unwin, 2007. [Google Scholar]
- 23.Crethar MP, Phillips JN, Stafford PJ, Duckett SJ. Leadership transformation in Queensland Health. Aust Health Rev 2009;33: 357–64. 10.1071/AH090357 [DOI] [PubMed] [Google Scholar]
- 24.Duckett S, Coory M, Sketcher-Baker K. Identifying variations in quality of care in Queensland hospitals. Med J Aust 2007;187:571–5. [DOI] [PubMed] [Google Scholar]
- 25.Coory M, Duckett S, Sketcher-Baker K. Using control charts to monitor quality of hospital care with administrative data. Int J Quality Health Care 2007;20:31–9. 10.1093/intqhc/mzm060 [DOI] [PubMed] [Google Scholar]
- 26.Spike NA. International medical graduates: The Australian perspective. Acad Med 2006;81:842–6. 10.1097/00001888-200609000-00016 [DOI] [PubMed] [Google Scholar]
- 27.McGrath BP. Integration of overseas-trained doctors into the Australian medical workforce. Med J Aust 2004;181:6–20. [PubMed] [Google Scholar]
- 28.Cots F, Chiarello P, Salvador X, Castells X, Quentin W. DRG-based hospital payment: Intended and unintended consequences. In: Busse R, Geissler A, Quentin W, Wiley M. (eds), Diagnosis-related groups in Europe: moving towards transparency, efficiency and quality in hospitals. Milton Keynes, Bucks: Open University Press, 2011. [Google Scholar]
- 29.Walshe K, Shortell SM. When things go wrong: how health care organizations deal with major failures. Health Affairs 2004;23:103–11. 10.1377/hlthaff.23.3.103 [DOI] [PubMed] [Google Scholar]
- 30.Propper C, Burgess S, Gossage D. Competition and quality: Evidence from the NHS internal market 1991–9. Econ J 2008;118(525):138–70. 10.1111/j.1468-0297.2007.02107.x [DOI] [Google Scholar]
- 31.Cooper Z, Gibbons S, Jones S, McGuire A. Does hospital competition save lives? Evidence from the English NHS patient choice reforms. Econ J 2011;121(554):F228–60. 10.1111/j.1468-0297.2011.02449.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Laverty AA, Smith PC, Pape UJ, et al. High-profile investigations into hospital safety problems in England did not prompt patients to switch providers. Health Affairs 2012;31:593–601. 10.1377/hlthaff.2011.0810 [DOI] [PubMed] [Google Scholar]
- 33.Reader T, Gillespie A. Patient neglect in healthcare institutions: a systematic review and conceptual model. BMC Health Serv Res 2013;13:156 10.1186/1472-6963-13-156 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Bevan G. Changing paradigms of governance and regulation of quality of healthcare in England. Health, Risk Society 2008;10:85–101. 10.1080/13698570701782494 [DOI] [Google Scholar]
- 35.Travers M. The new bureaucracy: quality assurance and its critics. Bristol: Policy Press, 2007. [Google Scholar]
- 36.Duckett S. Design of price incentives for adjunct policy goals in formula funding for hospitals and health services. BMC Health Serv Res 2008;8:72 10.1186/1472-6963-8-72 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Tanenbaum J. Pay for performance in Medicare: evidentiary irony and the politics of value. J Health Politics Policy Law 2009;34:717–46. 10.1215/03616878-2009-023 [DOI] [PubMed] [Google Scholar]
- 38.Camerer C, Loewenstein G. Behavioral economics: past, present, future. In: Camerer C, Loewenstein G, Rabin M. (eds), Advances in behavioral economics. Princeton, NJ: Russell Sage Foundation, Princeton University Press, 2004. [Google Scholar]
- 39.Schneider EC, Hussey PS, Schnyer C. Payment reform: analysis of models and performance measurement implications. Santa Monica, CA: RAND Corporation, 2011. [PMC free article] [PubMed] [Google Scholar]
- 40.Centers for Medicare and Medicaid Services, Department of Health and Human Services (US) Hospital-acquired conditions (HACs) in acute inpatient prospective payment system (IPPS) hospitals [fact sheet]. October 2012. Available at: www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/HospitalAcqCond/downloads/HACFactsheet.pdf [Accessed May 2014]. [Google Scholar]
- 41.Duckett S, Daniels S, Kamp M, et al. Pay for performance in Australia: Queensland's new clinical practice improvement -payment. J Health Serv Res Policy 2008;13:174–7. 10.1258/jhsrp.2008.007178 [DOI] [PubMed] [Google Scholar]
- 42.Queensland Health Health system priorities for Queensland 2013–14. Brisbane: Queensland Health, 2013. [Google Scholar]
- 43.Varagunam M, Hutchings A, Neuburger J, Black N. Impact on hospital performance of introducing routine patient reported outcome measures in surgery. J Health Serv Res Policy 2014;19:77–84. 10.1177/1355819613506187 [DOI] [PubMed] [Google Scholar]
- 44.Kübler-Ross E, Kessler D. On grief and grieving: finding the meaning of grief through the five stages of loss. New York: Scribner, 2005. [Google Scholar]
- 45.Duckett S, Collins J, Kamp M, Walker K. An improvement focus in public reporting: the Queensland approach. Med J Aust 2008;189:616–17. [DOI] [PubMed] [Google Scholar]
- 46.Reason J. Human error. Cambridge: Cambridge University Press, 1990 10.1017/CBO9781139062367 [DOI] [Google Scholar]
- 47.Reason J. Human error: models and management. BMJ 2000;320:768–70. 10.1136/bmj.320.7237.768 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Etheredge LM. A rapid-learning health system. Health Affairs 2007;26:w107–18. 10.1377/hlthaff.26.2.w107 [DOI] [PubMed] [Google Scholar]
- 49.Grossmann C, Goolsby AW, Olsen L, McGinnis JM, eds. Clinical data as the basic staple of health learning: creating and protecting a public good. Workshop summary Washington DC: National Academies Press, 2010. [PubMed] [Google Scholar]
- 50.Jackson TJ, Michel JL, Roberts RF, Jorm CM, Wakefield JG. A -classification of hospital-acquired diagnoses for use with routine hospital data. Med J Aust 2009;191:544–8. [DOI] [PubMed] [Google Scholar]
- 51.Coffey R, Milenkovic M, Andrews RM. The case for the present-on-admission (POA) indicator, 2006–01. Agency for Healthcare Research and Quality, 2006. [Google Scholar]
- 52.Needleman J, Buerhaus PI, Vanderboom C, Harris M. Using present-on-admission coding to improve exclusion rules for quality metrics: the case of failure-to-rescue. Med Care 2013;51:722–30. 10.1097/MLR.0b013e31829808de [DOI] [PubMed] [Google Scholar]
- 53.Wolf JH, Wolf KS. The Lake Wobegon effect: are all cancer patients above average? Milbank Q 2013;91:690–728. 10.1111/1468-0009.12030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Gruen N. Economic Reform – renovating the agenda: with an example from the market for information. Aust J Public Admin 2002;61:90–105. 10.1111/1467-8500.00276 [DOI] [Google Scholar]
- 55.Gruen N. Gruen tenders. Online, 2006. Available at: http://clubtroppo.com.au/2006/05/16/gruen-tenders [Accessed 2 August 2014]. [Google Scholar]
- 56.National Advisory Group on the Safety of Patients in England (Berwick D, chair) A promise to learn – a commitment to act: improving the safety of patients in England. London: Department of Health, 2013. [Google Scholar]
- 57.McKee M. Improving the safety of patients in England. BMJ 2013;347:f4898. 10.1136/bmj.f4898 [DOI] [PubMed] [Google Scholar]
- 58.Moss F. Learning from failings in healthcare: a challenge for all healthcare systems. Postgrad Med J 2013;89:551–3. 10.1136/postgradmedj-2013-132345 [DOI] [PubMed] [Google Scholar]
- 59.Walshe K, Higgins J. The use and impact of inquiries in the NHS. BMJ 2002;325:895–900. 10.1136/bmj.325.7369.895 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Walshe K, Shortell S.M. When Things go wrong: how health care organizations deal with major failures. Health Affairs 2004; 23:103–11. 10.1377/hlthaff.23.3.103 [DOI] [PubMed] [Google Scholar]

