Abstract
With demand for health services continuing to grow as populations age and new technologies emerge to meet health needs, healthcare policy-makers are under constant pressure to set priorities, ie, to make choices about the health services that can and cannot be funded within available resources. In a recent paper, Smith et al apply an influential policy studies framework – Kingdon’s multiple streams approach (MSA) – to explore the factors that explain why one health service delivery organization adopted a formal priority setting framework (in the form of programme budgeting and marginal analysis [PBMA]) to assist it in making priority setting decisions. MSA is a theory of agenda-setting, ie, how it is that different issues do or do not reach a decision-making point. In this paper, I reflect on the use of the MSA framework to explore priority setting processes and how the framework might be applied to similar cases in future.
Keywords: Priority Setting, Resource Allocation, Programme Budgeting and Marginal Analysis (PBMA), Canada
Introduction
With demand for health services continuing to grow as populations age and new technologies emerge to meet health needs, healthcare policy-makers are under constant pressure to set priorities, ie, to make choices about the health services that can and cannot be funded within available resources.1 Programme budgeting and marginal analysis (PBMA) is a process that supports healthcare decision-makers in making such significant decisions. Its key stages are well described in the literature, as are the factors that support and provide barriers to success.2-10 But very little has been written about why it is that formal processes such as PBMA come to be introduced in the first place.
An interesting approach has been taken by Smith et al11 in their application of an influential policy studies framework – Kingdon’s multiple streams approach (MSA)12,13 – to explore the factors that explain why one health service delivery organization (IWK Health Centre, Halifax, NS, Canada) adopted a formal priority setting framework (in the form of PBMA) to assist it in making priority setting decisions at a time when its budget was being frozen. In this Commentary, I consider the use of MSA to examine the decision to use PBMA by IWK to assist in its decision-making, and what further research might be undertaken to further explore how and why organizations choose to formally and explicitly set priorities and why they choose certain frameworks to assist them in such decision-making.
The Work of Smith et al With Kingdon’s Multiple Streams Approach
MSA is a theory of agenda-setting, ie, how it is that different issues do or do not reach a decision-making point. MSA posits that policy changes occur when a ‘policy window’ is opened, which in turn arises when multiple streams – a problem stream, a policy stream, and a politics stream – converge; often these are joined through a ‘policy entrepreneur’ who brings the three streams together and advocates for change.12,13
Smith et al11 use the core concepts from Kingdon’s MSA to help understand how it was possible to introduce a meaningful change to priority setting and resource allocation (PRSA) at the IWK. The background to the case study was that in 2011/2012 IWK’s budget was frozen, and the Executive Leadership Team (ELT) at IWK took various measures to cut spending; however, the process was criticized internally, for its lack of engagement with key stakeholders and for not adopting an integrated view of IWK’s health services delivery. With a further budget cut for 2012/2013, the ELT chose to use PBMA to make decisions about where to make cuts and PBMA was successfully implemented to support decision-making for the 2012/2013 year. Smith et al11 find that the problem stream (lack of broad engagement in the 2011/2012 PSRA decision process); policy stream (PBMA is easy to understand; has been used elsewhere with success; and addressed the identified problems); and politics stream (the province of Nova Scotia allowed the IWK to pursue PBMA) joined to allow IWK to change the way in which it made resource allocation decisions for 2012/2013. Policy entrepreneurs were those aware of PBMA, who brought it to the attention of colleagues, and who trialled it at the senior management level. IWK was largely (but not entirely) successful at implementing the recommendations of the PBMA process as well.
Using Multiple Streams Approach to Explore Priority Setting
Smith et al11 have shown that the MSA approach helps to explain why PBMA was able to be implemented at IWK in 2012/2013. Their analysis suggests that those wishing to bring about change in priority setting decision-making processes and/or promote PBMA would do well to consider whether a policy window has truly opened when they are asked to support agencies in undertaking a priority setting or PBMA exercise; the MSA provides a useful framework for thinking through such issues.
The work of Smith et al11 raised several issues for me. First, is a framework aimed at illuminating public policy decisions relevant to PBMA? In my mind, yes, it is: public policy involves decision-making (both action and inaction) by a government or equivalent authority13; IWK is an authority funded to deliver health services to the general public through a provincial government. In addition, policy can involve the making of executive decisions,14 clearly relevant in this case. Second, this raises a further question: IWK was allowed by the province of Nova Scotia (which funds IWK) to use PBMA as its priority setting approach in 2012/2013. This is a further layer of decision-making where an analysis using the MSA might be useful: what were the factors that supported this agreement?
Third, not all the recommendations from the PBMA exercise were accepted by the province. An analysis of the characteristics of the rejected decisions, using the MSA, might also be useful to guide future resource allocation and PBMA exercises. Perhaps each option needed its own problem, policy, and politics stream to converge, with policy entrepreneurs to back them? The logical conclusion from this analysis might be that some options for cutting services are excluded early on in a PBMA process on the grounds that they will not be accepted by the politics stream. However, it would be concerning if such options are systematically excluded: the potential for bias in decision-making (ie, support of services that do not do well on the decision criteria) is too great. Interestingly, however, Kingdon’s MSA tells us that if we have a set of policy options available, it may just be a matter of waiting for a future policy window to open so that previously rejected options become real considerations for change, given different problem and politics contexts. Smith et al11 note the “…government hear[d] about PBMA and stepp[ed] in, saying ‘Can you give us a list of your quick wins’? Which we said, no, we’re going to follow the process the whole way through.” This further supports the application of the MSA in this context: an existing list would have proven a highly important, readily available policy option (solution) to a difficult problem (the need to cut spending). To what extent, then, has the PBMA process undertaken by IWK provided a solution to future policy problems of the same type? This to me has always been a key reason why regular, formalised priority setting processes are crucial: they provide important information that might assist in solving future allocation problems (both those where there is new money available and those where budgets may need to be cut to remain within budget).
This links with a fourth issue: the time available to make decisions. A usual criticism of PBMA is that it takes time – in my own experience, quite a considerable period of time for key decision-makers to understand the approach, agree on its value, run the process, and reach decisions. IWK seems to have front-footed this for its 2012/2013 budget process – so was a key factor in the success of changing to PBMA that IWK had the time, resources, and information to run the process well? Where might this fit within the MSA framework?
Fifth, key to the success in changing the priority setting approach to PBMA was the extensive work that has been done by the research team and others in Canada in promoting, trialling, researching, and writing up, various PBMA exercises.15-20 This shows how important it is to have available evidence to hand when the problem and politics stream converge to demand a policy response. Building such an evidence base takes considerable time and resource. The MSA suggests that the policy solutions arising from evidence also need a problem and an appropriate political context with which to join for the research to taken up, an important issue for those working to improve the take-up of research findings and implement the findings from research.21
Sixth, the analysis of the IWK case also suggests that PBMA made it harder for people to advocate for their own area. It is not clear in the article why this was the case, but it likely required good leadership and a commitment by all decision-makers to the fair and systematic weighing up of alternatives. I personally have seen PBMA processes undermined by a strong senior manager suggesting changes to decision criteria or the weight they are accorded, or to the scores or value assigned to health services, that result in ‘pet’ projects trumping all others. Further analyses of why it was in the IWK case that it became harder for those involved to advocate for their own area would be useful.
Finally, it would be useful to know if PBMA is continuing to be used by IWK beyond the 2012/2013 budget year, and if not, why not?
Smith et al11 have opened up an interesting area for further research, one that could assist in the development of frameworks to support the use of PBMA in decision-making in healthcare. It would be useful to bring together the existing literature on PBMA and frame it within the MSA to assess what we do and do not know about why formal priority setting or PBMA approaches are and are not successfully introduced and their decisions acted upon. Smith et al11 used the core concepts of MSA in their analyses, but there are deeper levels of the framework that warrant further exploration.13 This in turn is likely to open up further areas of enquiry, to assist in the further development of the literature to support more systematic decision-making in healthcare in future.
Moreover, further analyses using MSA provide an opportunity to compare and contrast the advantages and disadvantages of MSA with alternative approaches, such as Rogers’s22 and Greenhalgh et al approach to the diffusion of innovations,23 and Sabatier’s work on implementation research.24 Such analyses may result in the generation of a framework that would allow more in-depth analyses of decision-making on whether or not to engage in explicit priority setting decision-making processes, the choice of process, and whether or not such formal decision-making is sustained over time.
Ethical issues
Not applicable.
Competing interests
Author declares that she has no competing interests.
Author’s contribution
JMC is the single author of the paper.
Citation: Cumming JM. Priority setting meets multiple streams: a match to be further examined? Comment on "Introducing new priority setting and resource allocation processes in a Canadian healthcare organization: a case study analysis informed by multiple streams theory." Int J Health Policy Manag. 2016;5(8):497–499. doi:10.15171/ijhpm.2016.58
References
- 1. Organisation for Economic Co-Operation and Development. Fiscal Sustainability of Health Systems: Bridging Health and Finance Perspectives. Paris: Organisation for Economic Co- Operation and Development; 2015.
- 2.Donaldson C, Mooney G. Needs assessment, priority setting and contracts for health care: an economic view. British Medical Journal. 1991;303:1529–1530. doi: 10.1136/bmj.303.6816.1529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Donaldson C, Walker A, Craig N. Programme Budgeting and Marginal Analysis: A Handbook for Applying Economics in Health Care Purchasing. Glasgow: Scottish Needs Assessment Programme, Scottish Forum for Public Health Medicine; 1995.
- 4. Mooney G, Gerard K, Donaldson C, Farrar S. Priority Setting in Purchasing: Some Practical Guidelines (Research Paper No. 6). Birmingham: National Association of Health Authorities and Trusts; 1992.
- 5.Posnett J, Street A. Programme budgeting and marginal analysis: an approach to priority setting in need of refinement. J Health Ser Res Policy. 1996;1(3):147–153. doi: 10.1177/135581969600100306. [DOI] [PubMed] [Google Scholar]
- 6.Scott A, Donaldson D, Scott S. Programme budgeting and marginal analysis: pragmatism and policy. J Health Ser Res Policy. 1999;4(1):1–2. doi: 10.1177/135581969900400101. [DOI] [PubMed] [Google Scholar]
- 7.Mitton C, Donaldson C. Twenty-five years of programme budgeting and marginal analysis in the health sector, 1974– 1999. J Health Ser Res Policy. 1999;6:239–248. doi: 10.1258/1355819011927558. [DOI] [PubMed] [Google Scholar]
- 8. Mitton C, Donaldson C. Priority Setting Toolkit: A Guide to the Use of Economics in Health Care Decision Making. London: BMJ Books; 2004.
- 9.Tsourapas A, Frew E. Evaluating ‘success’ in programme budgeting and marginal analysis: a literature review. J Health Serv Res Policy. 2011;16(3):177–183. doi: 10.1258/jhsrp.2010.009053. [DOI] [PubMed] [Google Scholar]
- 10.Edwards RT, Charles JM, Thomas S. et al. A national Programme Budgeting and Marginal Analysis (PBMA) of health improvement spending across Wales: disinvestment and reinvestment across the life course. BMC Public Health. 2014;14:837. doi: 10.1186/1471-2458-14-837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Smith N, Mitton C, Dowling L, Hiltz MA, Campbell M, Gujar SA. Introducing new priority setting and resource allocation processes in a Canadian healthcare organization: A case study analysis informed by multiple streams theory. Int J Health Policy Manag. 2016;5(1):23–31. doi: 10.15171/ijhpm.2015.169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Kingdon JW. Agendas, Alternatives and Public Policies. 2nd ed. New York: Harper Collins; 1995.
- 13. Sabatier P, Weibel C. Theories of the Policy Process. 3rd ed. Boulder, Colorado: Westview Press; 2014.
- 14. Birkland TA. An Introduction to the Policy Process. 3rd ed. Armonk, New York: M E Sharpe; 2010.
- 15.Patten S, Mitton C, Donaldson C. Using participatory action research to build a priority setting process in a Canadian Regional Health Authority. Soc Sci Med. 2006;63(5):1121–1134. doi: 10.1016/j.socscimed.2006.01.033. [DOI] [PubMed] [Google Scholar]
- 16.Mitton C, Mackenzie J, Cranston L, Teng F. Priority setting in the Provincial Health Services Authority: case study for the 2005/06 planning cycle. Healthcare Policy. 2006;2(1):91–106. [PMC free article] [PubMed] [Google Scholar]
- 17.Urquhart B, Mitton C, Peacock S. Introducing priority setting and resource allocation in home and community care programs. J Health Serv Res Policy. 2008;13(suppl 1):41–45. doi: 10.1258/jhsrp.2007.007064. [DOI] [PubMed] [Google Scholar]
- 18.Dionne F, Mitton C, Smith N, Donaldson C. Evaluation of the impact of program budgeting and marginal analysis in Vancouver Island Health Authority. J Health Serv Res Policy. 2009;14(4):234–242. doi: 10.1258/jhsrp.2009.008182. [DOI] [PubMed] [Google Scholar]
- 19.Mitton C, Dionne F, Damji R, Campbell M, Stirling B. Difficult decisions in times of constraint: Criteria-based Resource Allocation in the Vancouver Coastal Health Authority. BMC Health Serv Res. 2011;11:169. doi: 10.1186/1472-6963-11-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Cornelissen E, Mitton C, Davidson A. et al. Changing priority setting practice: The role of implementation in practice change. Health Policy. 2014;117(2):266–274. doi: 10.1016/j.healthpol.2014.04.010. [DOI] [PubMed] [Google Scholar]
- 21.Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. How can research organizations more effectively transfer research knowledge to decision makers? Milbank Q. 2003;81(2):221–248. doi: 10.1111/1468-0009.t01-1-00052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Rogers EM. Diffusion of Innovation. 5th ed. New York: Free Press; 1995.
- 23.Greenhalgh T, Robert G, Macfarlane F, Bates P, Kryriakidou O. Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Sabatier PA. Top-down and bottom-up approaches to implementation research: a critical analysis and suggested synthesis. J Public Policy. 1986;6(1):21–48. [Google Scholar]