Skip to main content
BMJ Global Health logoLink to BMJ Global Health
. 2022 Aug 1;7(8):e008664. doi: 10.1136/bmjgh-2022-008664

National learning systems to sustain and scale up delivery of quality healthcare: a conceptual framework

Samantha R Lattof 1, Blerta Maliqi 1,, Nigel Livesley 2, Nuhu Yaqub 3, Zainab Naimy 1, Moise Muzigaba 1, Minara Chowdhury 4, Peter Waiswa 5, Wilson M Were 1
PMCID: PMC9344983  PMID: 35914831

Abstract

All around the world, health systems fail to provide good quality of care (QoC). By developing learning systems, health systems are able to better identify good practices and to explain how to sustain and scale these good practices. To facilitate the operationalisation of national learning systems, the Network for Improving Quality of Care for Maternal Newborn and Child Health (the Network) developed a conceptual framework for national learning systems to support QoC at scale. The Network facilitated an iterative process to reach consensus on a conceptual framework for national learning systems to sustain and scale up delivery of quality healthcare. Following a landscape analysis, the Network Secretariat and WHO convened two consultative meetings with country partners, technical experts and stakeholders. Based on these inputs, we developed a conceptual framework for national learning systems to support QoC at scale. National learning systems use a variety of approaches to identify practices that have improved QoC at the patient and provider levels. They also facilitate scale up and sustain strategies used successfully to support quality improvement. Despite growing consensus on the importance of learning for QoC, no one has yet detailed how this learning should be operationalised nationally. Our conceptual framework is the first to facilitate the operationalisation of national learning systems so that health systems can begin to develop, adapt and implement mechanisms to learn about what works or fails and to scale up and sustain this learning for QoC.

Keywords: health education and promotion, health policy, health systems, health services research, public health


Summary box.

  • While good quality of care (QoC) practices exist, they are often unsuccessfully implemented or scaled up because health systems lack the knowledge and ability to implement them.

  • Our conceptual framework expands on existing best practices and the National Academy of Sciences’ five components of a learning healthcare system (ie, assembly of data, analysis, interpretation, feedback and change) by starting to assign roles and responsibilities to individuals and teams at different levels of the health system.

  • By using actual country experiences developing and implementing national learning systems to support QoC at scale, the framework addresses needs and challenges raised by country implementation teams (eg, clearer terminology, more concrete guidance on how to identify which QoC learning is relevant and at which levels to share this learning).

  • Ministries of Health interested in developing learning systems to identify and support sustainable quality improvement at scale can use this conceptual framework to initiate the process.

Introduction

All around the world, health systems fail to provide good quality care. This failure impacts populations unequally. While healthcare is often suboptimal in most countries, people in low-income and middle-income countries are especially likely to receive poor-quality care.1

Specific populations are likelier to receive poor-quality care: mothers may experience disrespectful treatment and abuse during childbirth, and health providers may incorrectly diagnose newborn asphyxia.2

Health-related investments cannot reduce inefficiencies and save lives if health services are delivered without quality.1 3 Improving population health requires health systems to embrace and deliver high-quality care, particularly in low-income and middle-income countries where high-quality care could save more than eight million lives annually.2 Supporting health systems and health providers in delivering high-quality care is especially crucial to improving maternal and newborn healthcare, as improved quality of care (QoC) could prevent half of maternal deaths.2

Practices delivering good QoC are often developed as unsustainable projects. Practices delivering good QoC may exist in specific facilities, but are not scaled and sustained.2 Facilities and providers operating in similar conditions may deliver different QoC. Districts operating in similar conditions with similar resource levels may achieve different quality results. While good QoC practices exist as projects, these projects are often unsuccessfully implemented or scaled up because health systems lack the knowledge and ability to implement them.4 5 If a health system is learning, there should be no gap between problems like these and their solutions. The health system should be able to adapt and adjust its delivery of QoC based on learning.

Improving QoC requires people to continuously learn from the successes and failures of implementing quality improvement (QI) and QoC processes. This learning aims to improve patient care; the management of QoC programmes; and programmes’ ability to sustain, scale up and replicate success.6 Learning about failures and sharing this learning is particularly valuable, as it prevents duplication of efforts that could waste valuable resources. By developing national learning health systems, health systems can better identify good practices (the ‘what’) and explain how to sustain and scale these good practices (the ‘how’). Learning healthcare systems are necessary for improving QoC, sustaining and scaling QI and achieving universal health coverage (UHC).3 7

Learning health systems contribute to greater self-reliant health systems, improved health system functioning and more adaptive and innovative health systems.8 Discussions and research on the need for learning health systems have focused primarily on high-income countries and clinical care contexts.8 Existing learning system frameworks generally address topics such as architecture,9 10 value creation,11 technological structures (eg, real-time clinical analytics),12 operationalisation of health data13 and work and enabling conditions required for learning health systems (eg, QI practices are standard practice).14

Much is yet to be learnt and understood about effectively deploying, learning from and sustaining practices that deliver quality care at the facility, district or national levels in low-income and middle-income countries. Most health systems in low-income and middle-income countries lack mechanisms to learn what works or what does not work and share this learning. Countries seeking to implement learning health systems to sustain and scale up the delivery of quality care actively seek more tangible guidance, clearer terminology and concrete examples of how to operationalise national learning systems.4

Developing effective learning systems should be a goal for national health systems seeking to improve QoC; for this reason, learning for QoC is embedded throughout calls to action and a high-quality health systems research agenda.4 Health systems need to recognise, facilitate and integrate lessons from QoC learning throughout the health system.

In 2016, the WHO prioritised improving QoC for women and children. In support of this vision, 10 countries led by WHO, UNICEF and United Nations Population Fund, as well as collaborating partners, joined forces and established the Network for Improving Quality of Care for Maternal Newborn and Child Health (the Network).15 The Network countries aim to halve the number of maternal and newborn deaths and stillbirths in participating health facilities within 5 years. This goal calls for identifying transformative responses that will support sustainable QI at scale. Under the leadership of Ministries of Health of the participating countries, the Network supports the implementation of national strategies for QoC in the health sector by pursuing four strategic objectives: leadership, action, learning and accountability.15

Learning is a core component within the Network due to the complexity and importance of learning for implementing sustainable quality care. Countries within the Network are actively developing and activating national learning systems that include mechanisms for sharing and facilitating the exchange of learning and processes for evidence-based analysis and synthesis of knowledge and sharing.4 Establishing learning systems is critical to facilitating documentation and sharing of learning within and across countries. This learning will inform systemic changes that encourage the application of QI sustainably and bring evidence-based best practices to scale for sustaining the implementation of QoC.16 The Network is looking beyond provider motivation by focusing on institutionalising continuous review, feedback and improvement processes based on analyses of data, including QI. The aim is to build a learning system that values continuous improvement, where learning is supported and sustained. The system will then encourage and enable QI and learning to facilitate adaptation, innovation and continuous improvement. To help operationalise national learning systems, we present an emerging conceptual framework for learning systems to support QoC at scale.

The framework development process

The Network facilitated an iterative process to reach a consensus on a conceptual framework for national learning systems to sustain and scale up the delivery of quality healthcare. WHO initiated this process by commissioning a landscape analysis on global learning systems that enable cross-country knowledge generation and transfer.17 This landscape analysis drew on 13 identified studies, in-depth interviews with key informants representing 9 global learning systems and 4 stakeholder interviews. Based on the findings from these data, the report highlights key issues and attributes for consideration when designing global learning systems.

Following the landscape analysis, the Network Secretariat and WHO convened two consultative meetings with country partners, technical experts and stakeholders.5 The first meeting in June 2017 involved members of the Network’s working group on learning who discussed the development of fundamental principles of learning systems and learning platforms. These principles included:

  • Remembering that learning is local.

  • Starting fast to get a win.

  • Allowing for failures.

  • Motivating members.

  • Coproducing goods.

  • Applying low-tech solutions.

Participants also discussed processes for developing systems to facilitate learning, including obtaining high-quality data; implementing knowledge management and communication systems; providing clinical and managerial learning opportunities; obtaining financial resources and information technology solutions; managing a safe space for data sharing, confidentiality and trust; and establishing a dedicated human resource team with the skill mix necessary to manage this system. Based on the principles and processes agreed on at this meeting, Network countries began developing and implementing government-led national learning systems.

Country partners, technical experts and stakeholders reconvened in April 2018 to examine the experiences of four countries (Ethiopia, Ghana, Malawi and Uganda) that adapted the Network’s guidance and capitalised on partners’ support for QoC to actively implement national learning systems.5 These country case studies addressed implementation experiences and lessons learnt that could inform the development of a national learning system. In addition to sharing experiences from country-based learning systems, the April 2018 technical consultation sought consensus on a framework to guide Network countries in developing national learning systems, including aspects of implementation documentation, operational research and information sharing.5

Based on these inputs, Network members codeveloped a conceptual framework for national learning systems to support QoC at scale. This framework and the experiences of Network countries contributed to new guidance on how to set up and use national learning healthcare systems to sustain and scale up delivery of quality maternal, newborn and child healthcare (2022).16 Ensuring sustainability of such learning is embedded in the Handbook for National Quality Policy and Strategy18 and its related planning guide.19

Before we present the conceptual framework that resulted from this development process, ‘learning’ warrants an upfront definition since the concept is central to our framework. The literature on learning frequently describes ‘learning’ as a process:

A process that leads to change, which occurs as a result of experience and increases the potential of improved performance and future learning (p. 3).20

We define learning as the transformative process of taking in information that, when internalized and mixed with what we have experienced, changes what we know and builds on what we can do. It’s based on input, process, and reflection. It is what changes us (p. 19).21

‘Learning’ can also be conceptualised as an outcome:

Learning is the relatively permanent change in a person’s knowledge or behavior due to experience. This definition has three components: 1) the duration of the change is long-term rather than short-term; 2) the locus of the change is the content and structure of knowledge in memory or the behavior of the learner; 3) the cause of the change is the learner’s experience in the environment rather than fatigue, motivation, drugs, physical condition or physiologic intervention (p. 1040).22

Therefore, learning for QoC could be considered both a process and an outcome.

The conceptual framework

In total, 149 experts from 20 countries participated in the consultative process to develop a conceptual framework for national learning systems to sustain and scale up the delivery of quality healthcare. Based on the landscape analysis, discussions, case studies and reports from this process, we identify and group concepts thematically. We first present the conceptual framework for a national learning system to support QoC at scale, and then describe the individual components that comprise each column of this learning system.

What is a national learning system that supports QoC?

Implementing partners have started to develop national learning systems to focus on topics such as QoC and QI in surgery,23 child health24 and SARS-CoV-2 exposure of healthcare personnel.25 The purpose of a national learning system that supports QoC is to: (1) use a variety of programmatic and implementation research approaches to identify practices that have improved QoC at the patient and provider levels, thus contributing to a robust health system; and (2) scale up and sustain strategies that district-level and national-level stakeholders have successfully used to support QI at the patient and provider levels, thus achieving the agreed-upon quality standards.

QoC-supportive national learning systems (table 1) address:

Table 1.

Components of a national learning system that supports QoC

Where is learning about QoC occurring in the health system? Who is involved in learning about QoC? What learning is important for QoC? How is learning about QoC collected, analysed and synthesised? How is learning about QoC shared within the health system? What additional support might QoC-related learning require?
National level Policy-makers
Managers
What is needed to scale up (support)
Problem-solving
Direction and guidance
Data monitoring Management systems
New communication platforms
Synthesis and analysis
Understanding the health system’s support for learning
Operational research
Communication platforms
Responsive governance, policy and management
District/regional level District leadership New practices or programmes for implementation
How to improve implementation and replication
Data monitoring
Stories (how to)
Management systems
Learning sessions
Communication platforms
Change in district management practices and learning
Communication platforms
Operational research
Facility/community level Facility leadership
Individual practitioners and teams involved in QoC
Community and patient representatives
New practices Data monitoring
Stories (how to)
Management system
Learning sessions
Communication platforms
Optimisation and use of existing management processes
quality improvement coaching

QoC, quality of care.

  • Where learning about QoC occurs in the health system.

  • Who is involved in learning about QoC.

  • What learning is important for QoC.

  • How learning about QoC is collected, analysed and synthesised.

  • How learning about QoC is shared within the health system.

  • What additional support QoC-related learning might require.

When all the above components of learning for QoC are combined, the result is a national learning system (figure 1; countries H and I).

Figure 1.

Figure 1

Opportunities for learning within a learning system.

For a national learning system to effectively support QoC, it must:

  • Have a dedicated learning centre to support the learning system.

  • Develop or strengthen data systems to integrate and use QoC data for improved care.

  • Develop and strengthen mechanisms to facilitate learning and to actively share knowledge through a learning system.

  • Actively analyse and synthesise data and practices for an evidence base on QI.

  • Allow information to flow freely (not be a bottleneck).

  • Build a learning culture that encourages transparency when things go wrong and focuses on understanding causes rather than ‘blaming and shaming’.

Learning centres actively work with national governments, districts and facilities to support documentation and sharing of learning related to QoC. These centres could be academic organisations or implementation partners. In Uganda, the Ministry of Health engaged Makerere University School of Public Health to provide learning sites with routine technical support, develop a community of practice, and pilot a district-level system to strengthen the collection and management of facility-level QoC data for maternal and newborn health.4 In turn, Makerere developed a Center of Excellence for Maternal, Newborn and Child Health to facilitate learning, generate evidence and build capacity of researchers and implementers. The centre runs a regional QI collaborative consisting of 12 districts that generate most of the learning.26 It also engages healthcare workers in real time to solve challenges such as referral, consult in managing difficult cases and disseminate new evidence.

In Bangladesh, the Ministry of Health and Family Welfare partnered with the National Institute of Preventive and Social Medicine to develop its national learning platform for supporting QoC implementation.4 Existing platforms in countries, such as annual national quality forums, may also be harnessed to provide this support while Ministries of Health work to identify learning centres.4

The role of national learning centres is to:

  1. Support QoC data generation and communities of practice to facilitate learning within and between countries.

  2. Build capacity, including the capacity to conduct operational research.

  3. Conduct implementation research.

  4. Contribute to the development of new standards and policies.

  5. Provide technical support to develop critical questions and how to answer them.

  6. Help synthesise evidence in support of scale up and implementation of best practices.

Learning centres should aim to develop capacity at various levels to facilitate learning and should promote the use of technological advancement in documenting learning.

Where is learning about QoC happening in the health system?

Learning opportunities occur at all health system levels and in both the public and private health sectors (figure 1). Within a facility, learning happens while implementing activities to reach a specific QoC aim. Any facility team or individual involved in improving QoC is learning from their experience. For example, staff trying to improve skin-to-skin contact for newborns learn what works and what does not.

Some of this knowledge for better patient care may be useful to staff at other facilities. For example, a team may learn how to improve the use of uterotonics to prevent postpartum haemorrhage during the third stage of labour. This learning is often of interest to other facilities operating under similar conditions and with similar challenges (figure 1; communities/facilities in countries A, C, D, F, H and I); however, this learning between facilities is often lost, leading to waste and inefficiency (figure 1; communities/facilities in countries B, E and G). Enabling facilities to share this learning can facilitate QoC improvement efforts and improve the efficacy of district management.

Learning occurs between districts (figure 1; districts/regions in countries E and I), when facility learning has the potential to be scaled up and sustained nationally. Scaling up this type of learning requires a national learning system to facilitate the identification, documentation and sharing of this learning throughout the health system (figure 1; country I). At the global level, learning across countries (figure 1; countries B, C and D; countries G, H and I) leads to the identification and development of evidence-based global goods (eg, guidelines, standards of care) that can be replicated globally when the goods are pushed back into national learning systems. This learning contributes to optimal patient care and helps close the evidence-to-practice gap.6 Learning at the global level also results in the identification of issues requiring additional research.

Who is involved in learning about QoC?

People at all levels of the health system are involved and responsible for learning to bring evidence-based best practices to scale for sustaining the implementation of QoC (table 2). Active learning is a crucial responsibility among front-line health workers involved in QoC, as clinical care is complex and requires quality at the front line. Active learning is also a crucial responsibility among managers and implementers. QI teams must explore innovative measures to promote the QI message and should remember that leadership is key. QoC champions are critical in the learning process, and leaders at all health system levels must be held accountable to improve QoC. National learning systems must specifically target leadership and management groups to support the documentation of learning.

Table 2.

Roles and responsibilities for improving QoC within the health system

Health system level Role in learning for QoC
Facility Staff involved in QoC should:
  1. Participate in peer-to-peer learning activities.

  2. Be open to sharing and learning with other facilities.

  3. Seek support, when needed, in learning how to:

    1. Use various methods and tools to identify the causes of poor care in their setting.

    2. Systematically make changes in how they provide care.

    3. Use data to learn how effective those changes are.

    4. Adapt changes until care has improved.


The QI team should:
  1. Share its experience of improving QoC with peers, facility leadership and other facilities (eg, in-person meetings, exchange visits, webinars, emails, instant messaging).

  2. Document how they are improving their services, their challenges and the results of their improvement efforts. Facilities should document which solutions worked and which did not and share them with the coach and the district support team. Such documentation can be shared with other facilities and used to understand what works and what does not.


Facility leadership should:
  1. Provide QI teams regular mechanisms and opportunities to share learning (eg, routine facility meetings).

  2. Facilitate staff learning.

  3. Communicate improvement work and the results to mothers, families and communities.

  4. Participate in district-level events (collaboratives) where the facility can compare and discuss its indicators and QI activities with other facilities. Larger facilities with multiple departments should use this opportunity to introduce QoC activities to other departments.

District District leadership should:
  1. Provide public and private facilities with opportunities to share their experiences in improving care (eg, integrate QoC into existing meetings; organise new meetings focused on improving QoC; create new forums for sharing such as WhatsApp; exchange visits). These sessions should not be training or monitoring sessions. Ideally, facility staff working on QoC will have a chance to meet and share every two to 3 months.

  2. Ensure that facility staff can discuss challenges and successes without fear of being reprimanded by senior staff.

  3. Plan how to help collect learning from facilities and how to organise meetings that encourage sharing.

  4. Develop a district-level QI team.

National National leadership should:
  1. Recognise that QoC and learning at the national leadership level are crucial to ensure the sustainability of learning health systems and prioritisation of QoC in policies and mandates.

  2. Develop a national-level QI team.

  3. Foster collaboration by connecting facilities, leaders and managers around the country.

  4. Proactively seek out information from efforts to improve QoC (eg, case studies, stories that combine data with details of the context and how improvement was achieved).

  5. Facilitate documentation of improvement activities.

  6. Create opportunities for evidence sharing and learning (eg, websites, online resource libraries, webinars, communities of practice, virtual or face-to-face meetings).

  7. Disseminate QoC implementation knowledge and tools (eg, newsletters, national forums, podcasts).

  8. Identify and respond to any learning needs in districts and facilities.

  9. Foster a positive, sustainable environment for learning and sharing.

  10. Use implementation science to learn and generate evidence for scale up.

  11. Update government policies based on QoC learning outcomes.

  12. Connect with other countries on QoC.

  13. Stay up to date on global developments in QoC.

  14. Integrate the national learning centre into the budget and advocate for the learning centre.

  15. Not become a bottleneck.

QI, quality improvement; QoC, quality of care.

In Ethiopia, the Ministry of Health financed QI projects, QI coaching and mentoring and conducted learning collaborative sessions in 48 learning facilities.4 However, workforce turnover necessitated ongoing training to prevent skills gaps and ensure the necessary QI skill development among new staff.

What learning is important for QoC?

Changing service delivery for QoC can be difficult. It requires providers to use both quantitative and qualitative data to learn if the changes they are making lead to better patient care. This process requires providers, managers and QI teams to:

  1. Gather information on what worked and what did not work.

  2. Synthesise the information.

  3. Share information in the right way at the right level with the right person.

  4. Channel/act on the information shared.

  5. Learn if the actions work.

Table 3 summarises some key questions for learning about QoC throughout the health system. The appendices provide detailed examples of learning in a facility that wanted to improve early initiation of breastfeeding (online supplemental appendix S1) and in a district that wanted to improve early initiation of breastfeeding in six facilities (online supplemental appendix S2).

Table 3.

Key questions required for learning about quality of care within the health system

Facility level District level National level
Internal learning
(eg, within a facility, within a district, within a nation)
  • What activities did we conduct?

  • How did we conduct them?

  • What was the effect on patient care?

  • What support did we provide to facilities?

  • What activities did we use to provide this support?

  • How did these activities change provider behaviour and patient care?

  • What support did we provide to districts and facilities?

  • What activities did we use to provide this support?

  • How did these activities change district or provider behaviour and patient care?

Horizontal learning
(eg, learning across facility to facility, learning across district to district)
What did other facilities do to improve care? What did other districts do to support facilities to improve care? What did other countries do to support districts and facilities to improve care?
Vertical learning
(eg, learning between facility and district, learning between district and national)
  • How effective was the guidance and support from the district?

  • What other guidance and support is required from the district?

  • How effective was the guidance and support from the national level?

  • What other guidance and support is required from the national level?

  • What have we learnt that can support other facilities to improve care?

  • How effective was the guidance and support from the global level?

  • What other guidance and support is required?

  • What have we learnt that can support other districts to improve care?

Supplementary data

bmjgh-2022-008664supp001.pdf (573.4KB, pdf)

How is learning about QoC collected, analysed and synthesised?

Learning requires data (on the process and patient-level outcomes) and stories. Without both components, there is no learning. How to package this information requires people to use their judgement about the purpose or expectations of learning at each health system level. At the facility level, data are the most important ingredient for learning about how facility staff changed patient care. Data help illustrate the impact of these QI activities. Without data on what happened to patients, there is no evidence that QI activities had any effect. The most compelling forms of facility-level QI data: (1) are objective; (2) show patient outcomes; (3) have multiple data points over time; (4) have frequent measurement; and (5) are reliable and validated.27 28

It is not always possible to obtain these types of data in facilities. Still, facilities should try to measure outcomes and processes, collect and review data frequently (daily or weekly for process measures, weekly or monthly for outcome measures) and have systems to validate their data. In Bangladesh, the QI Secretariat is establishing a set of uniform QoC indicators since these indicators are absent in current facility-level data collection through the District Health Information Software. The inclusion of uniform QoC indicators will support the Ministry of Health and Family Welfare in better understanding health system performance. It will also encourage learning and greater transparency. While facility-level data tell us if something changed or not, one must learn how these changes happened. Stories are the best way of describing what led to changes and influenced behaviour change.29 Stories come from the facility leaders and staff involved in changing patient care.

At the district level, data and stories generate learning about how districts support QI. Learning about a district’s efforts to improve quality requires data on patient care and data on the activities that a district conducted to support facilities. For example, if the district provided on-site clinical mentoring to support facilities, then data on the number of monthly clinical mentoring visits would be helpful. However, data solely on the number of clinical mentoring visits per month is unhelpful. Stories provide practical details about what the district did and how the facility staff adapted based on the district-led activities. For example, when telling the story of how district staff involved in developing and implementing QoC programmes supported facility-based staff to establish skills practice sessions, it is essential to describe what skills the practice sessions included and what methods or models the session used. It is also important to report the logistical details (eg, the optimal time for the district staff to visit to set up and support the initial practice sessions, where district staff found space for these sessions, and how they organised the sessions to ensure that all staff participated). These details are critical for other districts that would like to replicate this approach.

Once data and stories are collected at the facility and district levels, they must be organised and packaged. Information may be packaged by specific clinical topics (eg, preconception, immunisation) or how best to use the different quality interventions (eg, skills training, quality assurance). As the documentation process in Malawi revealed, health workers require user-friendly templates and tools to successfully organise and package the learning from their QI projects.4

How is learning about QoC shared within the health system?

Within the health system, learning is shared in multiple directions (online supplemental appendix S3). Learning can be shared internally (eg, within a facility, within a district), or it can be shared between similar groups (eg, facility to facility, district to district, nation to nation) as horizontal learning. Ideally, horizontal learning will allow other groups to apply the lessons from the original group to their own setting. Online supplemental appendix S4 illustrates different types of learning that groups might share horizontally. The mechanisms for sharing this learning will vary and may include, for example, face-to-face or virtual learning communities, review and supervision processes built within or outside the existing structures, and support mechanisms. In Malawi, district-level teams use social media platforms and WhatsApp groups to share QI-related learning and information between districts.4

Learning is also shared across different levels of the health system (eg, facility to district level, district to national level). This vertical learning involves transferring learning to other levels of the health system. Vertical learning can be shared upwards (eg, facility to district, district to national) or downwards (eg, national to district, district to facility). The type of learning shared and the direction in which it is shared depends on the purpose of the learning (table 4).

Table 4.

Examples of learning that could be shared vertically within the health system

Vertical learning direction Purpose of learning
Learning for programme management or programme implementation Learning to improve implementation and replication
Upwards
(eg, facility to district, district to national)
Describe activities
  • Aim selected

  • Team to improve care formed

  • Team meeting and taking action


Process results
  • Patient-level process data


Outcome results
  • Patient-level outcome data


Request support needed
  • What additional support is needed from the district or national level

Interventions and results
  • What activities were implemented?

  • What happened to patient care?

  • Community perspective of the QoC programme


Direction
  • What worked and what did not in setting the direction


Support and communication
  • What types of support and communication did facility staff receive?

  • What worked?

  • What did not?

  • What adaptions were made or should have been made?

  • What type of support was missing (facility and district perspective)?

Downwards
(eg, national to district, district to facility)
Clarify direction/guidance
  • District-level goals

  • What facilities are supposed to do


Clarify support
  • What support is available to facilities to reach the goals


Clarify problem-solving
  • What should facilities do if they need additional support

Clarify problem-solving
  • What should facilities do if they need additional support

  • How can the system help solve implementation/replication problems at facilities?

In Bangladesh, the QI Secretariat and other government entities share best practices from facilities (eg, from district hospitals, upazila health complexes and union health and family welfare centres) at district-level QI committee meetings, where improvement is discussed and learning is shared. The QI Secretariat also hosts quarterly development partner coordination meetings. These meetings bring together international and local development partners to share their learning from the implementation of various QoC interventions. This mechanism is effective for learning from one another, avoiding duplication of activities and supporting national efforts to extend QI in a coordinated manner.

Conclusion

QoC happens only if the mixed health system can sustain workforce capabilities to apply QI methods and then learn from these activities.4 Although learning is crucial to improve QoC and achieve UHC,7 current health systems fail to take learning seriously. Health systems rarely detail how this learning should be operationalised nationally, despite growing consensus on the importance of learning for QoC.1 3 7 Our conceptual framework is the first to facilitate the operationalisation of national learning systems for QoC so that health systems can begin to develop, adapt and implement mechanisms to learn about what works or fails and to scale up and sustain this learning for QoC. Learning must be used to improve QoC and make health systems more effective and responsive.

Prior efforts to describe learning healthcare systems and to suggest best practices highlight the roles played by technological tools, financing and the systems’ cultural environments.14 Our conceptual framework expands on these practices and the National Academy of Sciences’ five components of a learning healthcare system (assembly of data, analysis, interpretation, feedback and change) by starting to assign roles and responsibilities to individuals and teams at different levels of the health system.3 16 In this regard, the conceptual framework for learning systems to support QoC at scale complements calls to action for improving QoC and furthers the high-quality health systems research agenda.15

Reports and frameworks conceptualising learning health systems and discussing what is required to build them provide a valuable start.8 But countries seeking to implement learning health systems seek more tangible guidance, clearer terminology and concrete examples of how to operationalise national learning systems.4 One of this conceptual framework’s strengths is that actual countries’ needs and experiences shaped its development. These case studies and the experiences of the Network as a whole revealed that (1) strengthening coordination between knowledge generation and knowledge sharing and (2) policy-making and programme management processes are essential for institutionalising national learning systems.4 Another strength is the Network’s global reach in obtaining consensus on this conceptual framework. In conceptualising how national learning systems would operate in different contexts, we have distilled the primary components based on feedback from partners and experts across the globe.

This conceptual framework also has several limitations. All 10 Network countries could not develop and implement national learning systems by the April 2018 technical consultation. The four case studies used to develop this conceptual framework come from African countries. Case studies from country partners in Asia and elsewhere may possibly have resulted in a slightly different framework, particularly regarding the language we used to describe national learning networks and their implementation. Currently, Ethiopia and Ghana are the only two Network countries to have established functioning district learning networks.4 As Network members share new learning and guidance, the Network Secretariat will update this guidance on developing national learning systems to sustain and scale up delivery of quality maternal, newborn and child healthcare.16 Another limitation is that the Network’s consultations were limited to Network partners and bilateral organisations. Though we are unaware of national efforts to implement national learning systems outside the Network, we may have missed non-Network efforts to develop and implement national learning systems.

Developing and successfully implementing learning systems will require engaged and motivated leadership as well as a cultural shift by which health systems create and foster a culture of continual learning throughout the public and private health sectors.3 24 Cultural change occurred in Bangladesh following the application of the Maternal and Perinatal Death Surveillance and Response (MPDSR), an essential QI intervention. Now that the Directorate General of Health Services has trained most districts, the MPDSR platform and facility-level MPDSR committees support learning and sharing of information about where improvements are required. QI learning programmes at the community level are also integral to a culture of continual learning.

As others have noted, scaling up improvements requires sustainable solutions and not only financial sustainability or resilience.8 Network countries have approached the development of a learning health system as an integral part of implementing QoC in the health system. The learning health system is part of the implementation of the national quality policy and strategy (NPQS)18 and its implementation handbook.19 Implementing the NPQS across all levels requires resources that are or should be part of the national health budgets. Support for learning centres must be part of these efforts.

Practical questions remain as to how national health systems can develop and foster this needed cultural shift in learning and which institutions are best suited to serve as national learning centres to sustain and scale up good practices. Despite these unanswered questions and others, health systems must address the role of learning in sustaining existing and future QI efforts. This attention requires urgent action if countries are serious about achieving UHC and the Sustainable Development Goals by 2030.

QI efforts will continue to fail if health systems are not learning or fail to support and build capacity for learning at all health system levels. As countries begin to develop national learning systems and share their experiences developing them, we envision refining the conceptual framework to reflect new evidence and best practices. Using the conceptual framework as a foundation, the Network has developed technical guidance on how countries can operationalise national learning systems that support and scale up learning for QoC.16 This guidance provides concrete examples of how national learning systems can collect and share learning and how countries can establish national learning centres. It is time for Ministries of Health to renew their commitment to QoC and lead national efforts to develop learning systems to identify transformative responses that will support sustainable QI at scale.

Acknowledgments

For their input on this framework and their contributions to the development of national learning systems to sustain and scale-up delivery of quality maternal, newborn and child health, we wish to thank the Network’s working group on learning and participants at both the June 2017 technical consultation in Geneva, Switzerland, and the April 2018 technical consultation in Entebbe, Uganda. Special thanks to the April 2018 technical consultation’s four country delegations (Ethiopia, Ghana, Malawi and Uganda) led by their Ministries of Health for their leadership and commitment to developing national learning systems to sustain and scale up delivery of quality maternal, newborn and child health. We acknowledge the Quality of Care Network partners and bilateral organisations for their support and for enabling several country teams to participate in the technical consultation; All India Institutes of Medical Sciences, Center for Human Services, Institute for Healthcare Improvement (IHI), Liverpool School of Tropical Medicine, UNICEF, University Research and United States Agency for International Development for providing technical resources; and all meeting participants, session chairs and partners for their time, resources and technical contributions. We would like to thank Pierre Barker (IHI), Bennett Nemser (independent consultant) and Bernadette Daelmans (WHO) for helping brainstorm this work and providing feedback. We also thank the Bill & Melinda Gates Foundation for its continued trust and support.

Footnotes

Handling editor: Seye Abimbola

Contributors: Conceptualised the ideas: BM, MM, NL, NY, SRL, WMW and ZN. Wrote the paper: BM and SRL. Reviewed and edited the paper: MC, MM, NL, NY, PW, WMW and ZN.

Funding: This work was supported by the Bill & Melinda Gates Foundation.

Competing interests: None declared.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Data availability statement

All data relevant to the study are included in the article or uploaded as online supplemental information.

Ethics statements

Patient consent for publication

Not applicable.

Ethics approval

Not applicable.

References

  • 1.World Health Organization, Organisation for Economic Co-operation and Development, International Bank for Reconstruction and Development . Delivering quality health services: a global imperative for universal health coverage; 2018.
  • 2.Kruk ME, Gage AD, Arsenault C, et al. High-Quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health 2018;6:e1196–252. 10.1016/S2214-109X(18)30386-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.National Academies of Sciences, Engineering, and Medicine, Health and Medicine Division, Board on Health Care Services . Crossing the global quality chasm: improving health care worldwide. Washington (DC): National Academies Press (US); 2019. [PubMed] [Google Scholar]
  • 4.World Health Organization . The network for improving quality of care for maternal, newborn and child health: evolution, implementation and progress: 2017-2020 report, 2021. Available: https://www.who.int/publications/i/item/9789240023741 [Accessed 22 Jun 2022].
  • 5.The Network, World Health Organization . Developing national learning systems to sustain and scale up delivery of quality maternal, newborn and child health care in the network countries; 2017.
  • 6.Guise J-M, Savitz LA, Friedman CP. Mind the gap: putting evidence into practice in the era of learning health systems. J Gen Intern Med 2018;33:2237–9. 10.1007/s11606-018-4633-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ghebreyesus TA. How could health care be anything other than high quality? Lancet Glob Health 2018;6:e1140–1. 10.1016/S2214-109X(18)30394-2 [DOI] [PubMed] [Google Scholar]
  • 8.Alliance for Health Policy and Systems Research, World Health Organization . Learning health systems: pathways to progress, 2021. Available: https://apo.who.int/publications/i/item/learning-health-systems-pathways-to-progress [Accessed 22 Jun 2022].
  • 9.Psek WA, Stametz RA, Bailey-Davis LD, et al. Operationalizing the learning health care system in an integrated delivery system. EGEMS 2015;3:6. 10.13063/2327-9214.1122 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Lessard L, Michalowski W, Fung-Kee-Fung M, et al. Architectural frameworks: defining the structures for implementing learning health systems. Implement Sci 2017;12:78. 10.1186/s13012-017-0607-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Menear M, Blanchette M-A, Demers-Payette O, et al. A framework for value-creating learning health systems. Health Res Policy Syst 2019;17:79. 10.1186/s12961-019-0477-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lim HC, Austin JA, van der Vegt AH, et al. Toward a learning health care system: a systematic review and evidence-based conceptual framework for implementation of clinical analytics in a digital Hospital. Appl Clin Inform 2022;13:339–54. 10.1055/s-0042-1743243 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Enticott JC, Melder A, Johnson A, et al. A learning health system framework to Operationalize health data to improve quality care: an Australian perspective. Front Med 2021;8:730021. 10.3389/fmed.2021.730021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Easterling D, Perry AC, Woodside R, et al. Clarifying the concept of a learning health system for healthcare delivery organizations: implications from a qualitative analysis of the scientific literature. Learn Health Syst 2022;6:e10287. 10.1002/lrh2.10287 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.The Network, World Health Organization . Launch of the network for improving quality of care for maternal, newborn and child health: meeting report; 2017.
  • 16.World Health Organization . Guidance on developing national learning health-care systems to sustain and scale up delivery of quality maternal, newborn and child health care, 2022. Available: https://apps.who.int/iris/handle/10665/353739 [Accessed 22 Jun 2022].
  • 17.Marquez L, Dixon N, Fatta K. Landscape analysis of global learning networks to inform the development of a learning laboratory for quality universal health coverage. University research Co., LLC 2016. Available: https://pdf.usaid.gov/pdf_docs/PA00TCQ4.pdf
  • 18.World Health Organization . Handbook for national quality policy and strategy: a practical approach for developing policy and strategy to improve quality of care, 2018. Available: https://www.who.int/publications/i/item/9789241565561 [Accessed 22 Jun 2022].
  • 19.World Health Organization . Quality health services: a planning guide, 2020. Available: https://www.who.int/publications/i/item/9789240011632 [Accessed 22 Jun 2022].
  • 20.Ambrose SA, Bridges MW, DiPietro M. How learning works: seven Research-Based principles for smart teaching. San Francisco: Jossey-Bass, 2010. [Google Scholar]
  • 21.Bingham T, Conner M. The new social learning: a guide to transforming organizations through social media. San Francisco: Berrett-Koehler, 2010. [Google Scholar]
  • 22.Mayer RE. Encyclopedia of educational research. New York: The Free Press, 1982. [Google Scholar]
  • 23.Krapohl GL, Hemmila MR, Hendren S, et al. Building, scaling, and sustaining a learning health system for surgical quality improvement: a toolkit. Learn Health Syst 2020;4:e10215. 10.1002/lrh2.10215 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Irimu G, Ogero M, Mbevi G, et al. Approaching quality improvement at scale: a learning health system approach in Kenya. Arch Dis Child 2018;103:1013–9. 10.1136/archdischild-2017-314348 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ruscetti A, Chrisman M, Wagester S, et al. Healthcare personnel early return-to-work program after higher-risk SARS-CoV-2 exposure: a learning health system quality improvement project. Am J Infect Control 2022;50:542–7. 10.1016/j.ajic.2022.01.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Waiswa P, Wanduru P, Okuga M, et al. Institutionalizing a regional model for improving quality of newborn care at birth across hospitals in eastern Uganda: a 4-year story. Glob Health Sci Pract 2021;9:365–78. 10.9745/GHSP-D-20-00156 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q 2005;83:691–729. 10.1111/j.1468-0009.2005.00397.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.WHO, UNICEF, UNFPA . Improving the quality of care for mothers, newborns and children in health facilities: POCQI (point of care quality improvement) facilitator manual World Health Organization Regional Offi ce for South-East Asia; 2020. [Google Scholar]
  • 29.Brooks SP, Zimmermann GL, Lang M, et al. A framework to guide storytelling as a knowledge translation intervention for health-promoting behaviour change. Implement Sci Commun 2022;3:35. 10.1186/s43058-022-00282-6 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjgh-2022-008664supp001.pdf (573.4KB, pdf)

Data Availability Statement

All data relevant to the study are included in the article or uploaded as online supplemental information.


Articles from BMJ Global Health are provided here courtesy of BMJ Publishing Group

RESOURCES