Abstract
Background
The burden of preterm birth, fetal growth impairment, and associated neonatal deaths disproportionately falls on low- and middle-income countries where modern obstetric tools are not available to date pregnancies and monitor fetal growth accurately. The INTERGROWTH-21st gestational dating, fetal growth monitoring, and newborn size at birth standards make this possible.
Objective
To scale up the INTERGROWTH-21st standards, it is essential to assess the feasibility and acceptability of their implementation and their effect on clinical decision-making in a low-resource clinical setting.
Methods
This study protocol describes a pre-post, quasi-experimental implementation study of the standards at Jacaranda Health, a maternity hospital in peri-urban Nairobi, Kenya. All women with viable fetuses receiving antenatal and delivery services, their resulting newborns, and the clinicians caring for them from March 2016 to March 2018 are included. The study comprises a 12-month preimplementation phase, a 12-month implementation phase, and a 5-month post-implementation phase to be completed in August 2018. Quantitative clinical and qualitative data collected during the preimplementation and implementation phases will be assessed. A clinician survey was administered eight months into the implementation phase, month 20 of the study. Implementation outcomes include quantitative and qualitative analyses of feasibility, acceptability, adoption, appropriateness, fidelity, and penetration of the standards. Clinical outcomes include appropriateness of referral and effect of the standards on clinical care and decision-making. Descriptive analyses will be conducted, and comparisons will be made between pre- and postimplementation outcomes. Qualitative data will be analyzed using thematic coding and compared across time. The study was approved by the Amref Ethics and Scientific Review Committee (Kenya) and the Harvard University Institutional Review Board. Study results will be shared with stakeholders through conferences, seminars, publications, and knowledge management platforms.
Results
From October 2016 to February 2017, over 90% of all full-time Jacaranda clinicians (26/28) received at least one of the three aspects of the INTERGROWTH-21st training: gestational dating ultrasound, fetal growth monitoring ultrasound, and neonatal anthropometry standards. Following the training, implementation and evaluation of the standards in Jacaranda Health’s clinical workflow will take place from March 2017 through March 5, 2018. Data analysis will be finalized, and results will be shared by August 2018.
Conclusions
The findings of this study will have major implications on the national and global scale up of the INTERGROWTH-21st standards and on the process of scaling up global standards in general, particularly in limited-resource settings.
Registered Report Identifier
RR1-10.2196/10293
Keywords: ultrasound, gestational age, fetal growth, health care quality, anthropometry
Introduction
Background
The neonatal period (first 28 days of life) is the most vulnerable time for an infant’s survival. In 2016, 2.6 million neonates died globally representing 46% of all under-five deaths [1]. Most of these deaths took place in low- and middle-income countries (LMICs), including 80% in sub-Saharan Africa and South Asia [1]. Preterm birth related complications are the primary cause of neonatal deaths [1]. A common condition associated with preterm birth is low birth weight (LBW; <2.5 kg), which contributes to 60-80% of neonatal deaths [2] and can lead to long-term complications, including developmental delays [2-7]. There are two causes of LBW in neonates: prematurity, growth restriction during pregnancy resulting in a birthweight that is small for gestational age (SGA) [8], or a combination of the two conditions. SGA newborns have nearly twice the risk of neonatal and post-neonatal mortality [3] and account for 21.9% of neonatal deaths in LMICs [9].
To make sound clinical decisions and provide quality maternal and neonatal care, clinicians require measurement standards for accurate pregnancy dating, monitoring of fetal growth, and assessment of newborn size and growth [8]. Such standards enable clinicians to provide appropriately-timed antenatal care (ANC) [10]; identify the need for high-risk ANC consultations and referrals; and anticipate, identify, and manage fetal growth restriction [10,11], preterm labor [12,13], and maternal and neonatal [12] complications effectively [14]. The ability to date a pregnancy accurately affects a clinician’s ability to make informed decisions about appropriate timing of labor induction for maternal and fetal indications (including prolonged gestation) and elective or repeat caesarean sections [15]. Accurate gestational dating is also essential for birth preparedness, allowing women to plan for transportation to a birth facility at the appropriate time [16]. Lastly, at the time of birth, correctly assessing the neonate’s size for gestational age is critical for appropriate clinical management and potential referral for abnormal size and growth [17].
The date of the maternal last menstrual period (LMP) can be used for pregnancy dating but is often inaccurate or unknown; in these cases, ultrasound is the most accurate method for determining gestational age [12,18-20]. Ultrasound is also the gold standard for monitoring fetal growth disturbances [21]. However, ultrasound equipment is not always available and fully functional in low-resource settings; even when it is, there is often a lack of trained personnel with the technical knowledge to use it effectively [22,23]. As a result, gestational age is often not determined, which makes monitoring and intervention for poor fetal growth impossible [22,23]. Because of this, the standard for assessing gestational age and fetal growth in most LMICs is date of LMP [12] and fundal height [24], respectively. The literature has shown that both methods have a high margin of error, which can lead to inaccurate dating, diagnoses, and clinical management [25-27].
In 2014, the INTERGROWTH-21st Project completed a five-year, global, prospective study of growth, health, nutrition, and neurodevelopment. The study followed women and their infants longitudinally from less than 14 weeks gestation until two years postnatal. The project enrolled populations at low risk of adverse outcome in Brazil, Italy, Oman, UK, USA, China, India, and Kenya [28,29]. INTERGROWTH-21st data were compiled to develop new prospective standards to be used to assess pregnancy dating in the first trimester [30] and second trimester [19], fetal growth [11] (including fundal height [24] and ultrasound assessment [11]), and newborn size at birth [13,17]. With these evidence- and globally-based standards, for the first time, clinicians will be able to monitor growth based on how healthy babies in any population should grow [14]. These standards complement the World Health Organization (WHO) Child Growth Standards, together offering a standardized method to assess growth throughout the continuum of fetal life through early childhood development, which is useful for both clinicians and patients.
To scale these standards and affect preterm birth and its complications, including neonatal mortality, it is essential to assess the feasibility and acceptability of implementing these standards and their effect on clinical decision-making, particularly in low-resource clinical settings.
Aim
We aim to assess the feasibility and acceptability of implementing the INTERGROWTH-21st standards over a one-year period at Jacaranda Health, a private, social enterprise maternity hospital in peri-urban Nairobi, Kenya. To our knowledge, this is the first facility-based implementation study of the INTERGROWTH-21st standards in a limited-resource setting. The research design considers stakeholder inputs, the physical and institutional environment, and the health system structure.
The ultimate aim of the project is to use the results of the study to inform the implementation and scale up of the INTERGROWTH-21st standards in other settings and to inform the translation of guidelines and tools into routine clinical practice.
Primary Objective
The primary objective is to determine the facilitators and barriers to implementing the INTERGROWTH-21st standards at Jacaranda Health. The specific components of the primary objective are to assess the introduction of the INTERGROWTH-21st standards and the training of clinicians at Jacaranda Health, the effect of the implementation of the INTERGROWTH-21st standards on clinical practices at Jacaranda Health, clinicians’ experiences and satisfaction with the INTERGROWTH-21st standards, clinicians’ perceived effect of the standards on the clinical care they provide, and patient experiences and satisfaction with the care they received at Jacaranda Health during implementation of the INTERGROWTH-21st standards.
Secondary Objective
The secondary objective of this study is to assess the effect of implementing the INTERGROWTH-21st standards on clinicians’ decision-making and patient outcomes, including the processes for determining gestational age and estimated due date, internal referral to Jacaranda Health clinicians providing high-risk consultations, tertiary-center referral of high-risk pregnant women, and indications for and rates of labor inductions and caesarean sections.
Methods
Study Design
This is a pre-post, quasi-experimental implementation study using quantitative clinical data, focus group discussions (FGDs), in-depth interviews (IDIs), and a short clinician survey. The study describes the feasibility, acceptability, and the effect of implementing the INTERGROWTH-21st standards on clinical decision-making and management at Jacaranda Health. Study activities consisted of a 12-month preimplementation phase which included a baseline facility assessment, changes to facility protocols and charting forms, planning work flow adaptations to facilitate implementation of the standards, equipment procurement, training of clinicians, and baseline data collection; a 12-month implementation phase which included the implementation of the INTERGROWTH-21st clinical standards, revised facility protocols and charting forms into routine clinical practice, and data collection; and a five-month post-implementation phase which includes analysis and dissemination.
This study design was based on a conceptual model created by INTERGROWTH-21st researchers at Oxford University and researchers at the Harvard T.H. Chan School of Public Health.
Study Setting
This implementation study is currently being carried out at Jacaranda Health, a social enterprise, 18-bed maternity hospital that provides women in peri-urban Nairobi with affordable, safe, and respectful ANC, standard vaginal and cesarean delivery, and postnatal care (PNC) services. Women in preterm labor and newborns with LBW and/or complications are not managed at this facility and are referred to tertiary-level facilities for specialized care. With a model that emphasizes quality and affordable care provided primarily by nurse-midwives (and supported by a team of highly skilled physicians, clinical educators, and managers), Jacaranda Health provides an ideal venue for evaluating the implementation of the INTERGROWTH-21st standards and capturing factors that facilitate and challenge that process. Jacaranda Health patients come from densely-populated, peri-urban neighborhoods in northeastern Nairobi, including Kiambu, Thika, Gatundu, and Embakasi districts. These areas are served by many facilities that range from small pharmacies and outpatient care clinics to private and public sector secondary and tertiary hospitals with maternity wards; the services and prices vary substantially across these facilities.
Study Population
Pregnant women with a viable fetus presenting for ANC and/or delivery at Jacaranda Health were eligible for the following three elements of the intervention: (1) gestational dating standards for women who present for their initial ANC visit in the first or second trimester (more than eight and less than or equal to 26 weeks gestation); (2) fetal growth monitoring standards for women who present for an ANC visit in the third trimester (after 26 weeks gestation) and are identified as high-risk based on factors related to their surgical, medical, or obstetric history or current pregnancy; and (3) newborn size at birth standards for all newborns born at Jacaranda Health. We excluded pregnant women with a nonviable fetus in both quantitative and qualitative data collection, women who present for their initial ANC visit in the third trimester (after 26 weeks gestation) for gestational dating standards, and parents of stillborn infants in qualitative data collection. All eligible pregnant women and mothers of newborns described above were eligible to participate in FGDs and IDIs.
All clinicians delivering ANC and newborn anthropometry who attended INTERGROWTH-21st training sessions are eligible to participate in FGDs, IDIs, and a short clinician survey. Clinicians who only work in child wellness clinics and not in prenatal or intrapartum care units were excluded.
Patient and Public Involvement
The development of the study design, research questions, and outcome measures did not formally involve patient and public opinions and contributions. However, the study assesses patient and provider perceptions and experiences of the implementation of the INTERGROWTH-21st standards at Jacaranda Health to assess their acceptability and inform their further scale up. The results of the study will be disseminated to providers at Jacaranda Health by study staff at the end of the study.
Preimplementation Phase
Baseline Facility Assessment
Before implementing the INTERGROWTH-21st standards, we conducted a baseline assessment of current facility practices as they relate to our study objectives. Focus was placed on policies and practices related to ANC provision, pregnancy dating, identification and referral of high-risk pregnancies to high-risk care within Jacaranda Health and to tertiary facilities, fetal growth monitoring, newborn size measurement, and indications for and rates of cesarean section and labor induction.
The baseline assessment was conducted through clinic observations; a desk review of written policies; IDIs with Jacaranda Health’s director of clinical operations, clinical programs manager, and clinical educator; a chart review to understand clinician practices and indications for and rates of cesarean sections and labor inductions; an equipment and supply inventory with a focus on ultrasound and newborn anthropometry; and a human resource inventory to understand existing personnel and clinician roles and responsibilities related to clinic flow, pregnancy dating, fetal growth monitoring, and patient counseling. We then adapted ANC protocols to align with the 2002 WHO ANC model [31]. This work was done prior to the release of the 2016 WHO ANC recommendations [32].
Protocol, Charting, Equipment, and Work Flow Adaptations
A key element of preimplementation activities was ensuring that the hospital’s equipment, protocols, and procedures were updated and adapted for the implementation of the INTERGROWTH-21st standards. In partnership with Oxford University, we created a computerized calculator to calculate gestational age and fetal growth percentiles: clinicians use the ultrasound machine to measure the required biometrics for gestational dating or fetal growth, input the measurements into the calculator, and then record the resulting gestational age or fetal growth percentiles in the patient’s chart. Additionally, neonatal scales, measuring tapes, and infantometers, chosen in consultation with the INTERGROWTH-21st Oxford team and adjusted based on local availability and resource constraints, were sourced and integrated into clinical practice.
We updated Jacaranda Health clinical protocols for standard ANC, high-risk pregnancy classification and subsequent internal and tertiary-center referral, gestational dating, fetal growth monitoring, and newborn anthropometry, in addition to corresponding patient charting forms, to support the implementation and evaluation of the INTERGROWTH-21st standards.
Clinician job aids were created to facilitate the implementation of the standards and related decision-making algorithms. We also altered clinic flow processes to accommodate the introduction of ultrasound services; a separate room was designated exclusively for gestational dating ultrasounds. In the context of adapting clinical definitions of high-risk pregnancy criteria and processes for both internal and tertiary-center referrals, we trained clinicians to only do activities (like ultrasound) within their scope of practice as determined by the Nursing Council of Kenya.
Training
A main aim of implementation was training Jacaranda Health staff how to use the INTERGROWTH-21st standards. This was done in collaboration with the original INTERGROWTH-21st Project study team based at Oxford University and Aga Khan University Hospital (AKUH) in Nairobi, Kenya [33-37].
From October 2016 to February 2017, we conducted training of Jacaranda Health clinical and management staff on the purpose and use of the INTERGROWTH-21st gestational dating ultrasound, fetal growth monitoring ultrasound, and neonatal anthropometry standards. Emphasis was placed on including assessment, identification, and referral of high-risk patients as part of the study design to evaluate operational system capacity to support the implementation of the standards and their clinical implications.
An obstetrician-led half-day training included essential components of ANC, basic obstetric ultrasound skills, and the INTERGROWTH-21st standards and accompanying adaptations to charting practices and clinical protocols. Of the 23 participants in the training, 22 were nurse-midwives and one was a clinical officer; these staff provide the majority of ANC and PNC at Jacaranda Health.
An obstetrician and an INTERGROWTH-21st anthropometry trainer from AKUH provided a half-day anthropometry training which included theory, equipment, and techniques needed to perform accurate newborn length, weight, and head circumference measurements. The anthropometry trainer certified clinicians in neonatal anthropometry after they performed length, weight, and head circumference measurements accurately on newborns. One group of 24 clinicians, 23 nurse-midwives and one clinical officer, attended this training. Nearly 90% (24/28) of all full-time and part-time Jacaranda Health clinicians attended these initial trainings.
AKUH trained Jacaranda Health’s primary sonographer in INTERGROWTH-21st ultrasound measurements for the first, second, and third trimesters over the course of two weeks. At the end of the two weeks, the sonographer demonstrated proficiency in performing INTERGROWTH-21st measurements as determined by a senior radiologist at AKUH. The Jacaranda Health sonographer then trained a group of six Jacaranda Health nurse-midwives with prior experience in basic obstetric ultrasound during a half-day training on gestational dating ultrasounds. Three of the six nurse-midwives were certified to perform gestational dating ultrasounds after proving competence in performing measurements and calculating estimated delivery date accurately three consecutive times in the presence of the sonographer. This group of three nurse-midwives constitutes over 10% (3/28) of all clinicians.
Implementation Phase
After training was completed and equipment was put into place, the INTERGROWTH-21st standards, revised facility protocols, and adapted patient charting forms were introduced into routine clinical practice in March 2017. The clinic work flow adaptations were implemented to facilitate the identification of pregnant women eligible for ultrasound using the new standards and ensure that pregnant women were seen by the appropriate clinician. Work flow adaptations were not needed to implement the newborn size at birth standards since newborn anthropometry was an established part of routine practice.
Quality Monitoring
To ensure the quality of the implementation of the INTERGROWTH-21st standards, three quality monitoring processes were utilized: expert ultrasound image review, weekly clinic stakeholder meetings, and targeted refresher training. Our protocol includes sending copies of de-identified gestational dating and fetal growth ultrasound images to the quality assurance team at Oxford University. The team reviews the images, assesses the quality of each image based on INTERGROWTH-21st guidelines, and provides guidance to Jacaranda Health staff on how to improve ultrasound quality, if needed. Images were sent to Oxford for review every two months via a double password-protected Dropbox folder. The program management team at Jacaranda Health then shared feedback from the Oxford team with the ultrasound providers to strengthen sonography skills and processes. Reinforcement training was provided by Oxford University clinical researchers specializing in sonography midway through implementation to further improve the quality of the ultrasound procedures. Challenges in clinical implementation were discussed by the clinical staff during weekly meetings, which enabled staff to quickly resolve any problems. Lastly, through chart review and observation, the clinical and project management teams had the discretion to identify clinicians who required targeted refresher training and to provide that training at any point during the study. Important project notifications and reminders were administered to all staff at weekly clinical meetings by clinic managers and project management.
Study outcomes
Primary outcomes
The primary study outcomes are (1) clinicians’ and patients’ perception of facilitators and barriers to the implementation of the INTERGROWTH-21st standards and (2) uptake of gestational dating ultrasounds, fetal growth monitoring by ultrasound, and newborn anthropometry. These outcomes were explored through the following dimensions: feasibility, acceptability, appropriateness, adoption, fidelity and penetration [38].
Secondary outcomes
The secondary outcomes used to evaluate clinical decision-making include (1) proportion of ANC clients whose gestational age and estimated due date were correctly calculated and documented, (2) proportion of high-risk pregnant women who were referred internally to a high-risk clinician or to a tertiary care facility, (3) proportion of pregnant women receiving gestational dating scans who were induced for labor due to a prolonged pregnancy, and (4) proportion of pregnant women receiving gestational dating scans who delivered via cesarean section.
Data collection
During the preimplementation phase, baseline data were collected for 12 consecutive months (months 1-12) prior to the start of the implementation phase. Data were also collected for 12 consecutive months during the implementation phase (months 13-24). These preimplementation and implementation phase quantitative data come from patient charting forms completed in the two-year period. Qualitative data were also collected during the preimplementation phase (month eight) and the implementation phase (month 16 and month 24). Additionally, a one-time short provider survey was administered during the implementation phase at month 20 to assess clinicians’ attitudes and acceptability of the standards. (Table 1).
Table 1.
Method and tool | Preimplementation (months 1-12) | Implementation (months 13-24) | |||||
Month 8 | Months 1-12 | Month 16 | Month 20 | Month 24 | Months 13-24 | ||
Quantitative |
|
|
|
|
|
|
|
|
Chart review |
|
X |
|
|
|
X |
|
Clinic referral log |
|
X |
|
|
|
X |
Qualitative |
|
|
|
|
|
|
|
|
Patient in-depth interviews | X |
|
X |
|
X |
|
|
Patient focus group discussions | X |
|
X |
|
X |
|
|
Clinician in-depth interviews | X |
|
X |
|
X |
|
|
Clinician focus group discussions | X |
|
X |
|
X |
|
|
Clinician survey |
|
|
|
X |
|
|
Quantitative Data Collection
We collected outcome data from patient charts and from a clinic log of external referrals for pregnancies and deliveries one year before and one year after the start of implementation.
Qualitative Data Collection
We conducted FGDs and IDIs with participants sampled from two population groups using purposeful and convenience sampling: (1) patients who received ANC and/or delivery care at Jacaranda Health and (2) clinicians who work directly with patients (providing ANC, delivery care, or anthropometry at birth) including nurse-midwives, hospital managers, ultrasonographers, and physicians.
FGDs and IDIs with patients and clinicians were conducted in the preimplementation phase and twice during the implementation phase. Patients were interviewed to evaluate their perceptions, attitudes, and experiences of receiving an ultrasound for gestational dating and fetal growth, their newborn receiving a growth assessment, and their interactions with clinicians implementing this care. Clinicians were interviewed to evaluate their perceptions, attitudes, and experiences of the introduction and implementation of the new standards as part of their routine clinical practice.
The research team developed semistructured discussion guides for both FGDs and IDIs, which were piloted with Jacaranda Health staff and patients. Research assistants conducted all interviews in a private and secure location and took great care to protect the identity and confidentiality of all participants. To encourage patient participation in qualitative interviews, we offered reimbursement for transportation to the facility and free refreshments after the completion of the interviews. All FGDs and IDIs were audio-recorded and transcribed verbatim by an external transcriber; in the instances that participants spoke a language other than English, the transcriber translated the recording to English for the transcript. Hand-written notes taken by the research assistant provided the context for the interviews.
Additionally, a survey (10 questions) was administered by a research assistant to all clinicians during the implementation phase at month 20 via Survey Monkey on an Android tablet. Clinicians were asked to grade their comfort (using a Likert scale) with the INTERGROWTH-21st standards, the ease of integration into their workflow, and their perceptions of the effect of the standards on the quality of care they provided.
Sample Size
We used a census of clinicians and patients for this implementation study based on the inclusion and exclusion criteria described prior. According to clinic estimates and projections of ANC and delivery care utilization, data for up to 5,000 pregnant women and newborns will be recorded. The total number included in the final analysis will be based on the number of patients who meet eligibility criteria as confirmed at the time of data entry based on indicators in patient charting forms.
In each time period, the sample will be stratified into the following three categories: (1) pregnant women who attended ANC at Jacaranda Health and delivered there, allowing analysis of longitudinal ANC and delivery data; (2) pregnant women who attended ANC at Jacaranda Health but did not deliver there, providing ANC data only; and (3) women who did not attend ANC but who delivered at Jacaranda Health, capturing delivery and newborn data only. All clinic managers, physicians, and nurse-midwives who met the criteria are included. Clinician attrition will be documented.
Postimplementation Phase
Data Analysis and Management
Quantitative Data
Data from patient charts and referral logs were double-entered and managed in REDCap [39], a secure online data capture system with built-in data entry restrictions, data quality tools, and protection of personally identifiable information. Quality control measures have been in place to check the data at various stages on a routine basis using REDCap [39] and Stata 15 [40]. REDCap’s data quality features were utilized to ensure that data was entered within acceptable ranges and in the proper formats [39]. Additionally, data were checked for consistency and errors using a Stata 15 [40] script. All discrepancies have been resolved by checking original paper charts.
Most implementation and process indicators will be measured and presented using descriptive statistics. We will analyze changes in quantitative outcomes where relevant, by evaluating the difference in response to the indicators between pre- and postimplementation. Measurements of differences in continuous data will be assessed using t-tests for data that is normally distributed; otherwise, a non-parametric test will be performed. Categorical data will be compared using a chi-squared test. Quantitative data will be analyzed using Stata 15 [40]. All data will be de-identified before analysis begins.
Qualitative Data
For each cycle of qualitative data transcription, the transcriber completed transcription of one initial data file and sent it to the qualitative data manager at Jacaranda Health for quality control prior to transcribing the rest of the data files.
Qualitative data collected at each stage are being analyzed independently by two investigators using thematic coding in NVivo [41] and compared across time. Transcribed, de-identified qualitative data are being stored in a double password-protected Dropbox folder accessible only to a select number of study personnel.
Dissemination Policy
Results of the study will be shared with key stakeholders both in Kenya and globally through a national dissemination meeting, global conferences, an online knowledge management platform, and publications.
Ethical Considerations
The Amref Ethics and Scientific Review Committee of Kenya and the Harvard University Institutional Review Board approved all study activities, protocols, and standards prior to the commencement of study activities.
Facility-level informed consent was obtained from the Jacaranda Health hospital manager, acting as the facility’s representative, prior to the collection of any implementation data. The facility informed consent emphasized that no patient-identifiable health data would be shared or disseminated beyond the Jacaranda Health team. All FGD, IDI, and survey participants—patients and clinicians—provided written informed consent prior to any interview. Participants were informed that they could withdraw their consent at any time and be removed from the sample.
Results
From October 2016 to February 2017, over 90% of all Jacaranda Health clinicians (25 nurse-midwives and one clinical officer of 28 total Jacaranda Health clinicians) received at least one of the three aspects of the INTERGROWTH-21st training: gestational dating ultrasound, fetal growth monitoring ultrasound, and neonatal anthropometry standards. Following the training, the implementation and study of the INTERGROWTH-21st standards as part of Jacaranda’s clinical workflow took place from March 2017 through March 5, 2018. Data analysis will be finalized, and results are expected in August 2018.
Discussion
Significance
The findings of this study will have major implications on the national and global scale up of the INTERGROWTH-21st standards and on the process of scaling up global standards in general, particularly in limited-resource settings. The ability to implement a standard methodology of gestational dating, fetal growth monitoring, and assessment of newborn size at birth will result in better data to enable clinicians, researchers, and policy makers to more accurately identify and quantify high-risk pregnancies, preterm birth, and fetal and neonatal growth disturbances. In turn, standardized data that is comparable across global populations empowers researchers and policy makers to better understand and act on distributions of high-risk pregnancies, restricted growth, and prematurity. Lastly, based on this data, clinical practice and resources can be modified to meet the needs of pregnant women and their fetuses and newborns to decrease the incidence and morbidities associated with poor fetal and newborn growth and prematurity.
Limitations
While Jacaranda Health provides the right environment for this study, the generalizability of our findings needs to be carefully considered when applying lessons learned to other clinical settings. Given that clinic protocols were amended to meet the 2002 WHO ANC guidelines, which affected the criteria for high-risk referral, this change may confound the outcome of the percentage of women who are referred to high-risk care. The study is also limited in its ability to assess the long-term health outcomes of these standards, yet it will inform future research designed to assess them.
Strengths
This will be the first study to assess the feasibility and acceptability of introducing the new INTERGROWTH-21st clinical standards into a low-resource setting. Due to the dearth of innovative gestational dating tools and burden of preterm birth in low-resource settings, it is particularly important to study the implementation of these standards in this setting. The results of our evaluation will provide useful insights and recommendations for further implementation in similar clinical settings in Kenya and beyond.
Additionally, the mixed-methods approach used in this study will yield unique insights into the barriers, facilitators, and process of implementing the INTERGROWTH-21st standards and the resulting impact on short-term clinical decision-making. Lastly, Jacaranda Health is dedicated to health facility quality improvement in peri-urban Nairobi, which makes it an excellent venue for evaluating the implementation of the INTERGROWTH-21st standards and for capturing factors that facilitate and challenge that process.
Acknowledgments
We would like to thank Jacaranda Health patients for sharing their experiences; Jacaranda Health research assistants and program staff who made significant contributions to the design of the intervention, including Bhavana Vadrevu, Sylvia Aluoch, Grace Kimenju, Mary Muhando, Henry Njogu, Irene Njuru, Teresa Ogolla, Onana Omwodo, and Catherine Owinga; Leila Cheikh Ismail from Oxford University for her technical expertise in anthropometry training and research design; Maria Carvalho of Aga Khan University Hospital, Nairobi for her clinical, research, and programmatic expertise; and the Maternal Health Task Force/Women and Health Initiative staff at the Harvard T.H. Chan School of Public Health who assisted with designing the study during the proposal process, including Jacquelyn Caglia, Annie Kearns, and Alison Chatfield.
This work was supported by the Bill & Melinda Gates Foundation through grant number OPP1142163.
Abbreviations
- AKUH
Aga Khan University Hospital
- ANC
antenatal care
- FGD
focus group discussion
- IDI
in-depth interview
- LBW
low birth weight
- LMICs
low- and middle-income countries
- LMP
last menstrual period
- PNC
postnatal care
- SGA
small for gestational age
- WHO
World Health Organization
Footnotes
Authors' Contributions: All authors contributed to the development of the design of the implementation study. All authors also reviewed and approved the final manuscript. KM, MM, SP, LV, and SS drafted the protocol and manuscript with regular input from AL, JV, MNW and ATP and occasional feedback from CO, FM, RMJ, SL and NP. The study was conceptualized by KM, LV, AL, JV, ATP, and SP. KM, LV, MM, RMJ, SL and SS provided project management and coordination of the study. KM, SP, SS, MM, LV, ATP, and CO created the protocols and training materials for the study. KM, LV, SS, RMJ, SP, and MM designed the data collection instruments. LV and MM designed the database and data management systems. LV, KM, MM, RMJ, and SS created the data analysis plan for the study.
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form and declare ATP is supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) and all other authors declare no support from any organization for the submitted work, no financial relationships with any organizations that might have an interest in the submitted work in the previous three years, and no other relationships or activities that could appear to have influenced the submitted work.
References
- 1.United Nations Inter-agency Group for Child Mortality Estimation (UN IGME) UNICEF Publications. New York, NY: United Nations Children's Fund; 2017. Oct, [2017-11-10]. Levels & Trends in Child Mortality: Report 2017, Estimates Developed by the UN Inter-agency Group for Child Mortality Estimation https://www.unicef.org/publications/files/Child_Mortality_Report_2017.pdf . [Google Scholar]
- 2.Lawn JE, Cousens S, Zupan J, Lancet Neonatal Survival Steering Team 4 million neonatal deaths: When? Where? Why? Lancet. 2005 Mar;365(9462):891–900. doi: 10.1016/S0140-6736(05)71048-5.S0140-6736(05)71048-5 [DOI] [PubMed] [Google Scholar]
- 3.Katz J, Lee AC, Kozuki N, Lawn JE, Cousens S, Blencowe H, Ezzati M, Bhutta ZA, Marchant T, Willey BA, Adair L, Barros F, Baqui AH, Christian P, Fawzi W, Gonzalez R, Humphrey J, Huybregts L, Kolsteren P, Mongkolchati A, Mullany LC, Ndyomugyenyi R, Nien JK, Osrin D, Roberfroid D, Sania A, Schmiegelow C, Silveira MF, Tielsch J, Vaidya A, Velaphi SC, Victora CG, Watson-Jones D, Black RE. Mortality risk in preterm and small-for-gestational-age infants in low-income and middle-income countries: a pooled country analysis. Lancet. 2013 Aug;382(9890):417–425. doi: 10.1016/S0140-6736(13)60993-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Takeuchi A, Yorifuji T, Takahashi K, Nakamura M, Kageyama M, Kubo T, Ogino T, Doi H. Neurodevelopment in full-term small for gestational age infants: A nationwide Japanese population-based study. Brain Dev. 2016 Jun;38(6):529–537. doi: 10.1016/j.braindev.2015.12.013.S0387-7604(15)00281-8 [DOI] [PubMed] [Google Scholar]
- 5.Schieve LA, Tian LH, Rankin K, Kogan MD, Yeargin-Allsopp M, Visser S, Rosenberg D. Population impact of preterm birth and low birth weight on developmental disabilities in US children. Ann Epidemiol. 2016 Apr;26(4):267–274. doi: 10.1016/j.annepidem.2016.02.012. http://europepmc.org/abstract/MED/27085382 .S1047-2797(16)30068-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Guerra CC, Barros MCDM, Goulart AL, Fernandes LV, Kopelman BI, Santos AMND. Premature infants with birth weights of 1500-1999 g exhibit considerable delays in several developmental areas. Acta Paediatr. 2014 Jan;103(1):e1–6. doi: 10.1111/apa.12430. [DOI] [PubMed] [Google Scholar]
- 7.Barre N, Morgan A, Doyle LW, Anderson PJ. Language abilities in children who were very preterm and/or very low birth weight: a meta-analysis. J Pediatr. 2011 May;158(5):766–774.e1. doi: 10.1016/j.jpeds.2010.10.032.S0022-3476(10)00923-6 [DOI] [PubMed] [Google Scholar]
- 8.Royal College of Obstetricians & Gynaecologists. London, United Kingdom: 2014. [2017-07-14]. The Investigation and Management of the Small-for-Gestational-Age Fetus https://www.rcog.org.uk/en/guidelines-research-services/guidelines/gtg31/ [Google Scholar]
- 9.Lee AC, Kozuki N, Cousens S, Stevens GA, Blencowe H, Silveira MF, Sania A, Rosen HE, Schmiegelow C, Adair LS, Baqui AH, Barros FC, Bhutta ZA, Caulfield LE, Christian P, Clarke SE, Fawzi W, Gonzalez R, Humphrey J, Huybregts L, Kariuki S, Kolsteren P, Lusingu J, Manandhar D, Mongkolchati A, Mullany LC, Ndyomugyenyi R, Nien JK, Roberfroid D, Saville N, Terlouw DJ, Tielsch JM, Victora CG, Velaphi SC, Watson-Jones D, Willey BA, Ezzati M, Lawn JE, Black RE, Katz J, CHERG Small-for-Gestational-Age-Preterm Birth Working Group Estimates of burden and consequences of infants born small for gestational age in low and middle income countries with INTERGROWTH-21st standard: analysis of CHERG datasets. BMJ. 2017 Aug 17;358:j3677. doi: 10.1136/bmj.j3677. http://www.bmj.com/cgi/pmidlookup?view=long&pmid=28819030 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Morgan J, Cooper D. StatPearls. Treasure Island, FL: StatPearls Publishing; 2017. Pregnancy, Dating. [PubMed] [Google Scholar]
- 11.Papageorghiou AT, Ohuma EO, Altman DG, Todros T, Ismail LC, Lambert A, Jaffer YA, Bertino E, Gravett MG, Purwar M, Noble JA, Pang R, Victora CG, Barros FC, Carvalho M, Salomon LJ, Bhutta ZA, Kennedy SH, Villar J. International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project. Lancet. 2014 Sep;384(9946):869–879. doi: 10.1016/S0140-6736(14)61490-2. [DOI] [PubMed] [Google Scholar]
- 12.Lee AC, Panchal P, Folger L, Whelan H, Whelan R, Rosner B, Blencowe H, Lawn JE. Diagnostic Accuracy of Neonatal Assessment for Gestational Age Determination: A Systematic Review. Pediatrics. 2017 Dec;140(6) doi: 10.1542/peds.2017-1423.peds.2017-1423 [DOI] [PubMed] [Google Scholar]
- 13.Villar J, Giuliani F, Bhutta ZA, Bertino E, Ohuma EO, Ismail LC, Barros FC, Altman DG, Victora C, Noble JA, Gravett MG, Purwar M, Pang R, Lambert A, Papageorghiou AT, Ochieng R, Jaffer YA, Kennedy SH. Postnatal growth standards for preterm infants: the Preterm Postnatal Follow-up Study of the INTERGROWTH-21st Project. Lancet Glob Health. 2015 Nov;3(11):e681–e691. doi: 10.1016/S2214-109X(15)00163-1. [DOI] [PubMed] [Google Scholar]
- 14.Uauy R, Casanello P, Krause B, Kuzanovic JP, Corvalan C, International Fetal and Newborn Growth Consortium for the 21st Century Conceptual basis for prescriptive growth standards from conception to early childhood: present and future. BJOG. 2013 Sep;120(Suppl 2):3–8. doi: 10.1111/1471-0528.12057. doi: 10.1111/1471-0528.12057. [DOI] [PubMed] [Google Scholar]
- 15.Gardosi J, Vanner T, Francis A. Gestational age and induction of labour for prolonged pregnancy. BJOG. 1997 Jul;104(7):792–797. doi: 10.1111/j.1471-0528.1997.tb12022.x. [DOI] [PubMed] [Google Scholar]
- 16.Thaddeus S, Maine D. Too far to walk: maternal mortality in context. Soc Sci Med. 1994 Apr;38(8):1091–1110. doi: 10.1016/0277-9536(94)90226-7. [DOI] [PubMed] [Google Scholar]
- 17.Villar J, Ismail LC, Victora CG, Ohuma EO, Bertino E, Altman DG, Lambert A, Papageorghiou AT, Carvalho M, Jaffer YA, Gravett MG, Purwar M, Frederick IO, Noble AJ, Pang R, Barros FC, Chumlea C, Bhutta ZA, Kennedy SH. International standards for newborn weight, length, and head circumference by gestational age and sex: the Newborn Cross-Sectional Study of the INTERGROWTH-21st Project. Lancet. 2014 Sep;384(9946):857–868. doi: 10.1016/S0140-6736(14)60932-6. [DOI] [PubMed] [Google Scholar]
- 18.Mongelli M, Wilcox M, Gardosi J. Estimating the date of confinement: Ultrasonographic biometry versus certain menstrual dates. Am J Obstet Gynecol. 1996 Jan;174(1):278–281. doi: 10.1016/S0002-9378(96)70408-8. [DOI] [PubMed] [Google Scholar]
- 19.Papageorghiou AT, Kemp B, Stones W, Ohuma EO, Kennedy SH, Purwar M, Salomon LJ, Altman DG, Noble JA, Bertino E, Gravett MG, Pang R, Cheikh IL, Barros FC, Lambert A, Jaffer YA, Victora CG, Bhutta ZA, Villar J, International Fetal and Newborn Growth Consortium for the 21st Century (INTERGROWTH-21st) Ultrasound-based gestational-age estimation in late pregnancy. Ultrasound Obstet Gynecol. 2016 Dec;48(6):719–726. doi: 10.1002/uog.15894. doi: 10.1002/uog.15894. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ohuma EO, Papageorghiou AT, Villar J, Altman DG. Estimation of gestational age in early pregnancy from crown-rump length when gestational age range is truncated: the case study of the INTERGROWTH-21st Project. BMC Med Res Methodol. 2013 Dec 07;13:151. doi: 10.1186/1471-2288-13-151. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-13-151 .1471-2288-13-151 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Albu AR, Horhoianu IA, Dumitrascu MC, Horhoianu V. Growth assessment in diagnosis of Fetal Growth Restriction. Review. J Med Life. 2014 Jun 15;7(2):150–154. http://europepmc.org/abstract/MED/25408718 . [PMC free article] [PubMed] [Google Scholar]
- 22.Harris RD, Marks WM. Compact ultrasound for improving maternal and perinatal care in low-resource settings: review of the potential benefits, implementation challenges, and public health issues. J Ultrasound Med. 2009 Aug;28(8):1067–1076. doi: 10.7863/jum.2009.28.8.1067.28/8/1067 [DOI] [PubMed] [Google Scholar]
- 23.Kongnyuy EJ, van den Broek N. The use of ultrasonography in obstetrics in developing countries. Trop Doct. 2007 Apr;37(2):70–2. doi: 10.1177/004947550703700203. [DOI] [PubMed] [Google Scholar]
- 24.Papageorghiou AT, Ohuma EO, Gravett MG, Hirst J, da Silveira MF, Lambert A, Carvalho M, Jaffer YA, Altman DG, Noble JA, Bertino E, Purwar M, Pang R, Cheikh Ismail L, Victora C, Bhutta ZA, Kennedy SH, Villar J. International standards for symphysis-fundal height based on serial measurements from the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project: prospective cohort study in eight countries. BMJ. 2016 Nov 07;355(i5662):1–7. doi: 10.1136/bmj.i5662. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wingate MS, Alexander GR, Buekens P, Vahratian A. Comparison of gestational age classifications: date of last menstrual period vs. clinical estimate. Ann Epidemiol. 2007 Jun;17(6):425–430. doi: 10.1016/j.annepidem.2007.01.035.S1047-2797(07)00043-9 [DOI] [PubMed] [Google Scholar]
- 26.Dietz PM, England LJ, Callaghan WM, Pearl M, Wier ML, Kharrazi M. A comparison of LMP-based and ultrasound-based estimates of gestational age using linked California livebirth and prenatal screening records. Paediatr Perinat Epidemiol. 2007 Sep;21 Suppl 2:62–71. doi: 10.1111/j.1365-3016.2007.00862.x.PPE862 [DOI] [PubMed] [Google Scholar]
- 27.Qin C, Hsia J, Berg CJ. Variation between last-menstrual-period and clinical estimates of gestational age in vital records. Am J Epidemiol. 2008 Mar 15;167(6):646–652. doi: 10.1093/aje/kwm345.kwm345 [DOI] [PubMed] [Google Scholar]
- 28.Villar J, Altman DG, Purwar M, Noble JA, Knight HE, Ruyan P, Cheikh IL, Barros FC, Lambert A, Papageorghiou AT, Carvalho M, Jaffer YA, Bertino E, Gravett MG, Bhutta ZA, Kennedy SH, International Fetal and Newborn Growth Consortium for the 21st Century The objectives, design and implementation of the INTERGROWTH-21st Project. BJOG. 2013 Sep;120(Suppl 2):9–26. doi: 10.1111/1471-0528.12047. doi: 10.1111/1471-0528.12047. [DOI] [PubMed] [Google Scholar]
- 29.Villar J, Papageorghiou AT, Pang R, Ohuma EO, Ismail LC, Barros FC, Lambert A, Carvalho M, Jaffer YA, Bertino E, Gravett MG, Altman DG, Purwar M, Frederick IO, Noble JA, Victora CG, Bhutta ZA, Kennedy SH. The likeness of fetal growth and newborn size across non-isolated populations in the INTERGROWTH-21st Project: the Fetal Growth Longitudinal Study and Newborn Cross-Sectional Study. Lancet Diabetes Endocrinol. 2014 Oct;2(10):781–792. doi: 10.1016/S2213-8587(14)70121-4. [DOI] [PubMed] [Google Scholar]
- 30.Papageorghiou AT, Kennedy SH, Salomon LJ, Ohuma EO, Cheikh IL, Barros FC, Lambert A, Carvalho M, Jaffer YA, Bertino E, Gravett MG, Altman DG, Purwar M, Noble JA, Pang R, Victora CG, Bhutta ZA, Villar J, International Fetal Newborn Growth Consortium for the 21st Century (INTERGROWTH-21st) International standards for early fetal size and pregnancy dating based on ultrasound measurement of crown-rump length in the first trimester of pregnancy. Ultrasound Obstet Gynecol. 2014 Dec;44(6):641–648. doi: 10.1002/uog.13448. doi: 10.1002/uog.13448. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Villar J, Bergsjø P, WHO Antenatal Care Trial Research Group . WHO Antenatal Care Randomized Trial: Manual for the Implementation of the New Model. Geneva: World Health Organization; 2002. http://apps.who.int/iris/bitstream/10665/42513/1/WHO_RHR_01.30.pdf . [Google Scholar]
- 32.World Health Organization . WHO recommendations on antenatal care for a positive pregnancy experience. Geneva: World Health Organization; 2016. http://apps.who.int/iris/bitstream/10665/250796/1/9789241549912-eng.pdf?ua=1 . [PubMed] [Google Scholar]
- 33.de Onis M, Ismail LC, Chumlea C, Onyango A, Bhutta Z, Luna MS, Knight H, INTERGROWTH-21st Anthropometry Group . INTERGROWTH-21st: International Fetal and Newborn Growth Standards for the 21st Century. Oxford, UK: The International Fetal and Newborn Growth Consortium; 2012. Anthropometry Handbook http://www.medscinet.net/Intergrowth/patientinfodocs/Anthropometry%20Handbook%20April%202012.pdf . [Google Scholar]
- 34.INTERGROWTH-21st Newborn Group . INTERGROWTH-21st: International Fetal and Newborn Growth Standards for the 21st Century. Oxford, UK: The International Fetal and Newborn Growth Consortium; 2010. [2016-03-03]. Basic Neonatal Care Manual http://www.medscinet.net/Intergrowth/patientinfodocs/Neonatal%20Manual%20Final.pdf . [Google Scholar]
- 35.Papageorghiou AT, Salomon LJ, Ioannou C, Sarris I, INTERGROWTH‐21st Anthropometry team . INTERGROWTH-21st: International Fetal and Newborn Growth Standards for the 21st Century. Oxford, UK: The International Fetal and Newborn Growth Consortium; 2009. [2016-03-02]. Ultrasound Operations Manual http://www.medscinet.net/Intergrowth/patientinfodocs/US%20Manual%20FINAL.pdf . [Google Scholar]
- 36.Papageorghiou A, INTERGROWTH-21st Ultrasound Coordinating Unit . INTERGROWTH-21st: International Fetal and Newborn Growth Standards for the 21st Century. Oxford, UK: The International Fetal and Newborn Growth Consortium; 2010. [2016-03-03]. Correct measurement of fetal crown rump length and standardization of ultrasonographers http://www.medscinet.net/Intergrowth/patientinfodocs/CRLstandardisation_Website.pdf . [Google Scholar]
- 37.Geneva Foundation for Medical Education and Research. Maternal Health Taskforce. Oxford Maternal & Perinatal Health Institute. The Global Health Network . The Global Health Network. Oxford, UK: Global Health Training Centre; 2018. [2016-06-01]. Assessing Newborn Size by Anthropometry (e-Learning Course) https://globalhealthtrainingcentre.tghn.org/elearning/education/intergrowth-21st-course-maternal-fetal-and-newborn-growth-monitoring/neonatal-anthropometry/3001/ [Google Scholar]
- 38.Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011 Mar;38(2):65–76. doi: 10.1007/s10488-010-0319-7. http://europepmc.org/abstract/MED/20957426 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009 Apr;42(2):377–381. doi: 10.1016/j.jbi.2008.08.010. https://linkinghub.elsevier.com/retrieve/pii/S1532-0464(08)00122-6 .S1532-0464(08)00122-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.StataCorp . Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC; 2017. [Google Scholar]
- 41.QSR International Pty Ltd . NVivo Qualitative Data Analysis Software: Version 10. Victoria, Australia: QSR International Pty Ltd; 2012. [Google Scholar]