Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Oct 22;15(10):e0235877. doi: 10.1371/journal.pone.0235877

Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus

Michelle R Koenig 1,2, Elaina Razo 3, Ann Mitzey 2, Christina M Newman 1, Dawn M Dudley 1, Meghan E Breitbach 1, Matthew R Semler 1, Laurel M Stewart 1, Andrea M Weiler 4, Sierra Rybarczyk 4, Kathryn M Bach 5, Mariel S Mohns 1, Heather A Simmons 4, Andres Mejia 4, Michael Fritsch 1, Maria Dennis 6, Leandro B C Teixeira 7, Michele L Schotzko 4, T Michael Nork 8, Carol A Rasmussen 8, Alex Katz 8, Veena Nair 9, Jiancheng Hou 9, Amy Hartman 10, James Ver Hoeve 8, Charlene Kim 8, Mary L Schneider 5, Karla Ausderau 5, Sarah Kohn 9, Anna S Jaeger 11, Matthew T Aliota 11,¤, Jennifer M Hayes 4, Nancy Schultz-Darken 4, Jens Eickhoff 12, Kathleen M Antony 13, Kevin Noguchi 14, Xiankun Zeng 15, Sallie Permar 6, Vivek Prabhakaran 9, Saverio Capuano III 4, Thomas C Friedrich 4,7, Thaddeus G Golos 2,4,13, David H O’Connor 1,4, Emma L Mohr 3,*
Editor: Rafael da Costa Monsanto16
PMCID: PMC7580995  PMID: 33091010

Abstract

Congenital Zika virus (ZIKV) exposure results in a spectrum of disease ranging from severe birth defects to delayed onset neurodevelopmental deficits. ZIKV-related neuropathogenesis, predictors of birth defects, and neurodevelopmental deficits are not well defined in people. Here we assess the methodological and statistical feasibility of a congenital ZIKV exposure macaque model for identifying infant neurobehavior and brain abnormalities that may underlie neurodevelopmental deficits. We inoculated five pregnant macaques with ZIKV and mock-inoculated one macaque in the first trimester. Following birth, growth, ocular structure/function, brain structure, hearing, histopathology, and neurobehavior were quantitatively assessed during the first week of life. We identified the typical pregnancy outcomes of congenital ZIKV infection, with fetal demise and placental abnormalities. We estimated sample sizes needed to define differences between groups and demonstrated that future studies quantifying brain region volumes, retinal structure, hearing, and visual pathway function require a sample size of 14 animals per group (14 ZIKV, 14 control) to detect statistically significant differences in at least half of the infant exam parameters. Establishing the parameters for future studies of neurodevelopmental outcomes following congenital ZIKV exposure in macaques is essential for robust and rigorous experimental design.

Introduction

A spectrum of abnormalities result from in utero Zika virus (ZIKV) exposure and includes birth defects, termed congenital Zika syndrome, and neurodevelopmental deficits. Approximately 10% of infants have defects apparent at birth, including ocular anomalies, brain anomalies, cranial dysmorphologies, congenital contractures and hearing loss [1]. Twenty-eight percent of ZIKV-exposed children are asymptomatic at birth and present with neurodevelopmental deficits in early childhood [14]. These neurodevelopmental abnormalities include delays in gross motor, fine motor, and problem-solving skills [3, 5, 6] along with diminished mobility, communication, and social cognition [4, 5]. There are currently no tools to distinguish the infants that will develop neurodevelopmental deficiencies from those who will remain asymptomatic, as the long-term outcomes in children who were born during the 2015–2016 ZIKV epidemic remain to be fully defined [3, 4, 68].

Translational models of ZIKV infection during pregnancy and subsequent infant neurodevelopment are necessary to define the neuropathogenesis and early neural predictors of deficits. Different fetal exposure times during gestation, ZIKV strains, and genetic and socioeconomic backgrounds all confound our ability to understand the neuropathogenesis of in utero ZIKV infection in human studies. Furthermore, in human studies, we are unable to correlate histopathology with functional outcomes. Therefore, translational animal models must be used to define neuropathogenesis and predictors of deficits, with the end goal of identifying targets for intervention and therapy [911].

Currently, there is no established nonhuman primate model for defining the neuropathogenesis of the most common phenotype of congenital ZIKV infection: children who develop neurodevelopmental deficits but lack the birth defects found in congenital Zika syndrome [12]. Early macaque studies have provided insight into in utero ZIKV infection and defined fetal neuropathology of gestational ZIKV infection [11, 13, 14], placental pathology [13], fetal tissue viral distribution [1417], and birth defects in neonates [18]. None of these studies have defined long-term neurodevelopmental deficits or outlined a clear study design for how to evaluate long-term neurodevelopment in congenital ZIKV-exposed infant macaques. Such a study design needs to be well planned, with proven quantitative neurodevelopmental outcomes and sufficient sample sizes.

Before long-term studies defining the pathogenesis of neurodevelopmental deficits in ZIKV-exposed macaques are undertaken, we must determine whether tests defining neurodevelopmental outcomes, such as quantitative structural brain imaging, ocular examinations and hearing tests, are feasible in infant macaques. This feasibility examination includes translating appropriate human quantitative clinical exams to an infant macaque population and determining what sample sizes are required for statistically defining differences between control and ZIKV-exposed infants. These short-term macaque feasibility studies would be analogous to what is required in human clinical trial work [19, 20].

This study aims to demonstrate the feasibility of quantitatively defining developmental outcomes and viral tissue tropism in a macaque model of congenital ZIKV exposure by concentrating infant exams and tissue viral RNA (vRNA) analyses in the first week of life. We performed the same qualitative clinical exams that human infants receive to assess for birth defects [21]. We developed a panel of quantitative infant exams to define subtle abnormalities in structural brain volumes, visual pathway structure and function, hearing and neurobehavior. We defined the number of infants needed detect significant differences in these quantitative infant exam parameters in post-hoc power analyses. Tissue viral loads and histopathology were also assessed in the infant macaques. Our results demonstrate that ZIKV vRNA is not identified in all ZIKV-exposed infants and it is feasible to quantitatively define infant neurodevelopment with moderately sized studies.

Materials and methods

Study design

Indian-origin rhesus macaques (Macaca mulatta) were inoculated with ZIKV alone or phosphate buffered saline (PBS) alone during the first trimester (term is 165±10 days) (Table 1). All dams were part of the Specific Pathogen Free (SPF) colony at the Wisconsin National Primate Research Center (WNPRC) and were free of Macacine alphaherpesvirus 1 (Herpes B), simian retrovirus type D (SRV), simian T-lymphotropic virus type 1 (STLV), and simian immunodeficiency virus (SIV).

Table 1. Characteristics of the dams inoculated with ZIKV or PBS.

Dam identification numbers
ZIKV inoculation PBS* inoculation
664184 484880 795784 918724 730267 020101
Maternal age at conception (years) 4 11 16 14 13 8
Number of prior pregnancies 0 5 4 7 6 3
Gestational age at ZIKV inoculation (days) 46 43 41 50 44 47

*Phosphate buffered saline (PBS).

Ethics statement

All monkeys are cared for by the staff at the WNPRC in accordance with the regulations and guidelines outlined in the Animal Welfare Act and the Guide for the Care and Use of Laboratory Animals, the recommendations of the Weatherall report (https://royalsociety.org/topics-policy/publications/2006/weatherall-report), and the principles described in the National Research Council's Guide for the Care and Use of Laboratory Animals. The University of Wisconsin—Madison Institutional Biosafety Committee approved this work under protocol number B00000117. See study approval section below for animal protocol details.

Care & use of macaques

All animals were housed in enclosures with required floor space and fed using a nutritional plan based on recommendations published by the National Research Council. Dams were fed a fixed formula, extruded dry diet with adequate carbohydrate, energy, fat, fiber, mineral, protein, and vitamin content. Macaque dry diets were supplemented with fruits, vegetables, and other edible objects (e.g., nuts, cereals, seed mixtures, yogurt, peanut butter, popcorn, marshmallows, etc.) to provide variety to the diet and to inspire species-specific behaviors such as foraging. Infants were fed 5% dextrose for the first 24 hours of life and liquid formula subsequently. To further promote psychological well-being, animals were provided with food enrichment, structural enrichment, and/or manipulanda. Environmental enrichment objects were selected to minimize chances of pathogen transmission from one animal to another and from animals to care staff. While on study, all animals were evaluated by trained animal care staff at least twice each day for signs of pain, distress, and illness by observing appetite, stool quality, activity level, and physical condition. Animals exhibiting abnormal presentation for any of these clinical parameters were provided appropriate care by certified veterinarians. Prior to all minor/brief experimental procedures, macaques were sedated using ketamine anesthesia and monitored regularly until fully recovered from sedation.

For breeding, the female macaques were co-housed with a compatible male and observed daily for menses and breeding. Pregnancy was detected by ultrasound examination of the uterus at approximately 20–24 gestation days (gd) following the predicted day of ovulation. The gd was estimated (+/- 2 days) based on the dam’s menstrual cycle, observation of copulation, and the greatest length of the fetus at initial ultrasound examination which was compared to normative growth data in this species [22]. For physical examinations, virus inoculations, some ultrasound examinations, and blood and swab collections, the dam was anesthetized with an intramuscular dose of ketamine (10 mg/kg). Blood samples from the femoral or saphenous vein were obtained using a vacutainer system or needle and syringe. Pregnant macaques were monitored daily prior to and after viral inoculation for any clinical signs of infection (e.g., diarrhea, inappetence, inactivity, fever and atypical behaviors).

Inoculation and monitoring

Macaques were inoculated subcutaneously with 1x104 PFU Zika virus/H.sapiens-tc/PUR/2015/PRVABC59_v3c2 (PRVABC59, GenBank: KU501215). This virus was originally isolated from a traveler to Puerto Rico and passaged three times on Vero cells (American Type Culture Collection (ATCC): CCL-81). The seed stock was obtained from Brandy Russell (CDC, Ft. Collins, CO). Virus stocks were prepared by inoculation onto a confluent monolayer of C6/36 cells (Aedes albopictus mosquito larval cells; ATCC: CCL-1660) with two rounds of amplification. The animals were anesthetized as described above, and 1 mL of inoculum at 1 x 104 PFU dilution in PBS was administered subcutaneously over the cranial dorsum. Post-inoculation, the animals were closely monitored by veterinary and animal care staff for adverse reactions or any signs of disease.

Pregnancy monitoring and fetal measurements

Weekly ultrasounds were conducted to observe the health of the fetus and to obtain measurements including fetal femur length (FL), biparietal diameter (BPD), head circumference (HC), abdominal circumference (AC) and heart rate as previously described [16]. Growth curves were developed for FL, BPD, and HC using mean measurements and standard deviations from Tarantal et al. [22] and the ultrasound measurements were plotted against this normative data. Doppler ultrasounds to measure fetal heart rate were performed biweekly.

vRNA isolation from body fluids and tissues and qRT-PCR

RNA was extracted from 300 μl of plasma using the Viral Total Nucleic Acid Purification kit (Promega, Madison, WI, USA) on a Maxwell 16 MDx instrument. qRT-PCR was performed as previously described [23]. The limit of quantification for the assay is 100 copies/mL for qRT-PCR from plasma. Fetal and maternal-fetal interface tissues were preserved with RNAlater® (Invitrogen, Carlsbad, CA) immediately following collection. RNA was isolated from maternal and fetal tissues using the Trizol Plus RNA Purification kit (Invitrogen, Carlsbad, CA) following the manufacturer’s instructions or a similar method described by Hansen et al. [24]. In the latter method, RNA was recovered from up to 200 mg of tissue disrupted in TRIzol (Life Technologies, Waltham, MA) with 2 x 5 mm stainless steel beads using the TissueLyser (Qiagen, Hilden, Germany) for 3 minutes at 25 r/s twice. Following homogenization, samples in TRIzol were separated using Bromo-chloro-propane (Sigma). The aqueous phase was collected and glycogen was added as a carrier. The samples were precipitated in isopropanol and washed in 70% ethanol. RNA was fully re-suspended in 5 mM tris pH 8.0.

Plaque Reduction Neutralization Test (PRNT)

Macaque serum samples were screened for ZIKV neutralizing antibodies using a plaque reduction neutralization test (PRNT). Endpoint titrations of reactive sera, using a 90% cutoff (PRNT90), were performed as described [25] against ZIKV strain PRVABC59. Briefly, ZIKV was mixed with serial 2-fold dilutions of serum for 1 hour at 37°C prior to being added to Vero cells and neutralization curves were generated using GraphPad Prism software (La Jolla, CA). The resulting data were analyzed by nonlinear regression to estimate the dilution of serum required to inhibit 90% of infection.

Whole virion ZIKV-specific binding antibody ELISA

High-binding 96-well ELISA plates (Greiner; Monroe, NC) were coated with 40 ng/well of 4G2 monoclonal antibody, which was produced in a mouse hybridoma cell line (D1-4G2-4-15, ATCC; Manassas, VA), diluted to 0.8 ng/uL in 0.1M carbonate buffer (pH 9.6) and incubated overnight at 4°C. Plates were blocked with 1X Tris-buffered saline containing 0.05% Tween-20 and 5% normal goat serum (cat.# G6767, Sigma-Aldrich, St. Louis, MO) or 1 hour at 37°C, followed by incubation with 1.15 x 105 focus-forming units (ffu)/well Zika virus (PRVABC59, BEI; Manassas, VA) for 1 hour at 37°C. Serum samples were tested at a dilution of 1:12.5–204,800 in serial 4-fold dilutions and incubated for 1 hour at 37°C, along with a ZIKV-specific monoclonal antibody, H24 (10 ug/mL), isolated from a ZIKV-infected rhesus macaque. Horseradish peroxidase (HRP)-conjugated mouse anti-monkey IgG secondary antibody (Southern BioTech; Birmingham, AL) was used at a 1:4,000 dilution and incubated at 37°C for 1 hour, followed by the addition of SureBlue Reserve TMB Substrate (KPL; Gaithersburg, MD). Reactions were terminated by Stop Solution (KPL; Gaithersburg, MD) after a 7-minute incubation per plate in the dark. Optical density (OD) was detected at 450 nm on a Victor X Multilabel plate reader (PerkinElmer; Waltham, MA). Binding was considered detectable if the sample OD value at the lowest dilution was greater than that of the background OD, defined as the OD value of the negative control at the lowest dilution plus 2 standard deviations (SD). For samples considered positive, their OD values for the serial dilution were entered into Prism v8 (GraphPad Software; San Diego, CA) to determine the 50% effective dilution (ED50). Briefly, the ED50 was calculated by transforming the fold dilution into log10. The transformed data was then analyzed using a sigmoidal dose-response nonlinear regression model. Any sample considered negative was assigned an ED50 of 12.5, the lowest dilution tested, because ED50 cannot be accurately calculated below the lowest dilution tested. The log10 50% effective dilutions (ED50) were calculated for IgG binding responses against the whole virion and compared between 0, 7, 14 and 28 dpi time points.

ZIKV IgM enzyme-linked immunosorbent assay (ELISA)

Infant macaque serum samples were screened for anti-ZIKV IgM antibodies using commercial human anti-ZIKV IgM ELISA assays targeting ZIKV nonstructural protein 1 (NS1) antigen. We utilized a sandwich ELISA (cat# ab213327, Abcam, Cambridge, Massachusetts, USA) and an indirect ELISA (cat# el26689601M, Euroimmun, Mountain Lakes, New Jersey, USA), following manufacturer instructions. Controls included manufacturer-provided human serum samples and rhesus macaque serum collected at 0 and 14 days post-infection with PRVABC59 from an adult rhesus macaque (animal ID 244667). Infant serum samples were run in triplicate. All samples and controls were read on a Synergy HTX plate reader at 450 nm. Sample values were reported in "Abcam units" (Abcam) or "ratio" (Euroimmun), which are the ratio of sample serum absorbance to the absorbance of a manufacturer-provided solution containing the upper limit of the reference range of non-infected biological sample ("cutoff" (Abcam) or "calibrator" (Euroimmun)). This method of reporting results is recommended by the manufacturers to control for inter-assay variability.

Cesarean delivery and maternal necropsy

All infants were delivered by cesarean section at approximately 155 gestational days (gd), except for the single fetal demise at 133 gd. Infants were delivered approximately 10 days before the typical gestational age of a natural birth at the WNPRC (166 gd) to ensure that the placenta could be collected for evaluation. Amniotic fluid was collected just prior to infant delivery via aspiration with a syringe and needle inserted through the chorioamniotic membranes. Sterile instruments were used for the dissection and collection of all maternal and maternal-fetal interface tissues during the gross post-mortem examination. Each tissue was collected with a unique set of sterile instruments and placed in a separate sterile petri dish before transfer to RNAlater for ZIKV qRT-PCR or fixed for histology to prevent cross-contamination.

Infant care

After delivery, infants were dried, stimulated and received respiratory support as necessary, and placed in a warmed incubator. All liveborn infants were transferred to the nursery where they remained until euthanasia and necropsy on day of life 7–8. Infants were reared in the nursery to enable continuous access to the infants for testing and to prevent confounding of maternal rearing differences on neurobehavior. During this period, multiple examinations were completed as described in Fig 1. Infant weights from day of life (DOL) 0 to DOL 8 were recorded daily by the nursery staff. The volumes of 5% dextrose and liquid formula consumed by each infant were recorded.

Fig 1. Infant examination schedule.

Fig 1

Infants were evaluated by the Schneider Neonatal Assessment for Primates (SNAP), ophthalmic exam (OP), optical coherence tomography (OCT), auditory brainstem response (ABR), visual electrophysiology (EP) and brain MRI prior to euthanasia and necropsy (NX). Urine (*) and blood (#) were collected at the indicated times. Symbols are under the collection line for an individual animal.

Neurobehavioral assessments

We evaluated neonatal macaque neurobehavior with a well-validated assessment developed for rhesus macaques less than 1 month of age, termed the Schneider Neonatal Assessment for Primates (SNAP) [2630], which is based on the Brazelton Newborn Behavioral Assessment Scale [31]. The Schneider Neonatal Assessment for Primates (SNAP) [29], a 20 minute battery of developmental tests, was administered at 1, 3–5, and 6–7 DOL, with the day of birth considered DOL 0 (summarized in S1 Table). This assessment captures detailed developmental behaviors in macaques less than 1 month of age. The SNAP assesses neonatal neurobehavior using 68 individually scored test items in four constructs (i.e. domains): motor maturity and activity, orientation, sensory, and state control (S2 Table). Testing occurred midway between feedings at approximately the same time each day. Ratings were based on a five-point Likert scale ranging from 0 to 2, with a higher value representing higher performance. An average score was calculated for each of the four constructs. Examiners were trained in standardized administration and scoring procedures by the SNAP developer, M. Schneider, requiring a check-out protocol prior to administration. Two examiners (M. Schneider and K. Ausderau) performed the neurobehavioral testing and scoring to ensure test administration reliability (>95%).

Ophthalmic exam

Infants were anesthetized as described in S3 Table for eye exams performed by a human ophthalmologist with retinal fellowship training (M. Nork). Pupillary reactivity was assessed, and intraocular pressures were obtained prior to eye dilation with ophthalmic drops (0.05% proparacaine, tropicamide, phenylephrine). Slit-lamp biomicroscopy and indirect ophthalmoscopy were performed after pupillary dilation.

Optical coherence tomography

Spectral-domain optical coherence tomography (SD-OCT) uses non-invasive light waves to evaluate the anterior segment of the eye (i.e. the ocular structures anterior to the vitreous) and the retina. Scans of the retina and anterior segment were carried out in both eyes of most infants using a Heidelberg™ Spectralis HRA + OCT (Heidelberg™ Engineering, Heidelberg, Germany) instrument. Segmentation and determination of corneal and retinal layer thickness was performed using combined manual and automatic segmentation algorithms from both Heidelberg and EXCELSIOR [32]. EXCELSIOR Preclinical’s functionalities for retinal segmentation (EdgeSelect™) and automated image analysis were used to calculate mean thicknesses for retinal layers.

Visual electrophysiology

To objectively evaluate visual function in ZIKV-exposed neonatal rhesus macaques, a clinically trained visual electrophysiologist (J. Ver Hoeve) performed standard visual electrodiagnostic procedures including a full-field electroretinogram (ERG) and the cortical-derived visual evoked potential (VEP) [33]. The light-adapted (LA) full-field flash ERG, recorded on a rod-saturating background, measures the electrical activity generated predominantly by cone photoreceptor and bipolar cells, which are found in high density in the primate macula and are primarily responsible for light-adapted, high acuity and color vision. The ERG is used clinically to assess generalized retinal function under light-adapted (focused on cone photoreceptors) and dark-adapted (focused on rod photoreceptors) conditions [33] and has been used to characterize maculopathy in acute ZIKV infection [34]. The VEP reflects the function of the entire visual pathway from the retina via the optic nerve to the visual cortex of the brain [33]. We performed standard LA ERGs to measure how the cone photoreceptors function.

Photopic full-field ERGs to a series of flash strengths and photopic flash visual-evoked potentials were recorded in that order. Measurements were recorded using a BigShot™ electrodiagnostic system (LKC Technologies™, Gaithersburg, MD). When isoflurane was used during an earlier procedure in the same sedation event, a washout period was allowed before visual electrophysiology studies to minimize isoflurane suppression of cortical activity [35]. Corneas were anesthetized with topical 0.5% proparacaine prior to application of ERG-149 jet™ (Universo™, Switzerland) contact lens electrodes and a conductive wetting solution. Reference electrodes were subdermal stainless-steel needle electrodes inserted near the ipsilateral outer canthus of each eye. Visual evoked potentials were recorded from two active subdermal electrodes situated approximately 1 cm superior to the occipital ridge and 1 cm lateral to the midline; VEP reference electrodes were situated adjacent to one another along the midline at the vertex. Replicates (2–4) of 80 flashes each were performed on each macaque. ERG and VEP waveforms were processed off-line and machine scored using software written in Matlab™ (Nattick, MA). Photopic flash VEPs were quantified as the root-mean-square of the response from 50–150 msec post flash. S1 Fig illustrates the waveform characteristics quantified with the ERGs and VEPs.

Auditory brainstem response testing

Hearing, or auditory brainstem function, was assessed with auditory brainstem response audiometry, which measures brainstem evoked potentials generated by a brief click. Examinations were performed by a human audiologist with pediatric training (A. Hartman). Auditory brainstem response (ABR) thresholds were obtained for auditory (click) stimuli, as described in [36], using the Biologic Navigator Pro system. Ambient noise level was minimized. For the ABR, needle electrodes were placed at the brow ridge (positive input) and behind the right pinna (negative input) for channel 1 and from the brow ridge (positive input) and behind the left pinna (negative input) for channel 2. An electrode was placed below the brow ridge on the forehead for the ground. Electrode impedances were below 10 kohm for all electrodes. Physiological filters were set to pass 100–3000 Hz. The stimuli were clicks with rarefaction and condensation alternating polarity and a Blackman window with 2-ms rise-fall and 1 ms plateau times. Insert earphones (Etymotic ER-3A) were used to obtain the click thresholds. Signal levels were presented at 70, 50, and 30 dB nHL and wave IV was observed at each presentation level.

Brain MRI

Data acquisition

Neuroimaging data were collected using a 3T MRI scanner (GE750, GE Healthcare, Waukesha, WI) with a Tx/Rx 8-channel volume coil. Data were acquired in a single session with the parameters: repetition time (TR) = 9272 ms, echo time (TE) = 4064 ms, θ = 12°, field of view (FOV) = 100 × 100 mm, slice thickness = 0.8 mm. Animals were scanned in the supine position in the same orientation, achieved by placement and immobilization of the head in a custom-made head holder via ear bars. Scans were collected under anesthesia described in S3 Table. End-tidal CO2, inhaled CO2, O2 saturation, heart rate, respiratory rate, blood pressure and body temperature were monitored continuously and maintained during each MRI session.

Data processing

For structural MRI data processing and analysis, we used the AutoSeg_3.3.2 pipeline, developed at the Neuro Image Research and Analysis Laboratories (NIRAL) of the University of North Carolina at Chapel Hill and publicly available on the NITRC website, at http://www.nitrc.org/projects/autoseg. This software pipeline employs BatchMake pipeline scripts that call tools within the AutoSeg toolset, based on the Insight Tool Kit (ITK). T1w DICOMs were initially imported in 3D Slicer (http://www.slicer.org) and saved to NRRD format, and orientation and obliquity of each dataset checked and corrected to LPI (neurological) orientation using the ANTS software [37]. Image processing in AutoSeg proceeded using the step as described in S2 Fig. The first step was to perform an intensity inhomogeneity correction using the N4 algorithm [38]. The second step was to perform rigid-body registration of the subject MRI to the 2-week old UNC-Emory infant rhesus macaque atlas [39] using the 3D BRAINSFit [40] tool within 3D Slicer. The third step was tissue segmentation and skull stripping separating the brain tissues [gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF)] from non-brain image. AutoSeg uses the Atlas Based Classification (ABC) tool [4143] to perform tissue segmentation as well as skull-stripping integrated into a single method. The fourth step was registration of the atlas to the subject’s brain to generate cortical parcellations (affine followed by deformable ANTS registration) [37] to register each skull-stripped atlas image to the skull-stripped subject image using a cross-correlation similarity metric and a symmetric diffeomorphic deformation model that preserves anatomical topology even with large deformation (S2B and S2C Fig). Previous studies have shown that the cross-correlation metric offers enhanced reliability and accuracy as the image registration metric within ANTS [44]. This analysis outputs volumes of brain WM and GM, CSF, and cortical (temporal, prefrontal, frontal, parietal, occipital lobes, and cerebellum) and subcortical (hippocampus, amygdala, caudate, and putamen) regions, which has been previously described [39, 44].

Infant or fetus necropsy

Infants were sedated and euthanized on DOL 7 or 8. Fetus 416597 was stillborn prematurely and was submitted to necropsy immediately after delivery. Sterile instruments were used for the dissection and collection of all tissues during gross post-mortem examinations. Each tissue was collected with a unique set of sterile instruments and placed in a separate sterile petri dish before transfer to RNAlater for ZIKV qRT-PCR or 4% paraformaldehyde for histology. Ten slices of the fetal/infant cerebrum (~5 mm in thickness) were prepared in the coronal plane with section 1 located most anteriorly and section 10 located most posteriorly, and three slices of the cerebellum were prepared in the sagittal plane with section 1 located most medially and section 3 most laterally; alternate sections were taken for qRT-PCR to analyze vRNA and for histology.

Histology

Tissues were fixed in 4% PFA other than cerebrum, cerebellum and one eye for histology which were fixed in 10% neutral buffered formalin. Tissues were sectioned (~5 mm), routinely processed and embedded in paraffin. Paraffin sections (5 μm and 8 μm for the brain) were stained with HE or Gram stain using standard methods. The pathologists were blinded to vRNA findings when evaluating and describing tissue sections and assigning morphologic diagnoses. Photomicrographs were obtained using brightfield microscopes Olympus BX43 and Olympus BX46 (Olympus Inc., Center Valley, PA) with attached Olympus DP72 digital camera (Olympus Inc.) and Spot Flex 152 64 Mp camera (Spot Imaging, Sterling Heights, MI), and captured using commercially available image-analysis software (cellSens DimensionR, Olympus Inc. and Spot 5.3 Software). The ear diagram used to describe where ear sections were obtained from is a composite of multiple histologic sections of infant 020501 with the addition of an external pinna based on gross images.

In situ hybridization

In situ hybridization (ISH) was conducted either in brain tissues post-fixed in neutral buffered formalin or in non-brain tissues post-fixed in 4% PFA for 24 hours, alcohol processed and paraffin embedded. ISH probes against ZIKV genome were purchased commercially (Advanced Cell Diagnostics, Cat No. 468361, Newark, California, USA). ISH was performed using the RNAscope® Red 2.5 Kit (Advanced Cell Diagnostics, Cat No. 322350) according to the manufacturer’s instructions. Briefly, after deparaffinization with xylene, a series of ethanol washes, and peroxidase blocking, sections were heated in antigen retrieval buffer and then digested by proteinase. Sections were exposed to ISH target probe and incubated at 40°C in a hybridization oven for 2 h. After rinsing, ISH signal was amplified using company-provided Pre-amplifier followed by the Amplifier containing labelled probe binding sites and developed with a Fast Red chromogenic substrate for 10 min at room temperature. Sections were then stained with hematoxylin, air-dried, and mounted. Positive control probes for endogenous rhesus macaque mRNA (Advanced Cell Diagnostics, Cat No. 457711, Newark, California, USA) and negative control probes for bacterial mRNA (Advanced Cell Diagnostics, Cat No. 310043, Newark, California, USA) were used as process controls to verify ISH labelling procedure was successful. Mouse brain tissue served as a positive control for ZIKV ISH in brain tissues and mouse spleen served as a positive control for ZIKV ISH in non-brain tissues.

Statistical analysis

Standardized differences, i.e., effect size d’s [45], were calculated for quantifying the differences between ZIKV-exposed and control neonates in specific quantitative infant exam parameters. Due to the small sample size in the control group, only the standard deviations of the ZIKV-exposed group observations were used for the effect size estimation. Effect sizes d of 0.2 were considered as small, 0.5 as moderate and >0.8 as large (45). Due to the small sample sizes of the current study, detecting statistically significant differences in the quantitative infant exam parameters was not anticipated. However, the current study provided data to evaluate the distribution of effect sizes for comparing differences ZIKV-exposed and control neonates in quantitative infant exam parameters. We conducted in depth post-hoc power and sample size calculations to define the sample sizes required to discern differences between ZIKV-exposed and control neonates in quantitative infant exam parameters which might be useful for the planning of future studies. These specific quantitative infant parameters included: scores for each time point and construct in the neonatal neurobehavior assay (SNAP), each ocular layer thickness (OCT), each wave characteristic in the visual electrophysiology assays (ERG and VEP), infant weight gain trajectory, infant cumulative feeding volume, and each brain region volume (structural MRI). Sample size estimates were performed to detect observed effect sizes with 80% power at the two-sided 0.05 significance level and were based on a two-sample t-test with equal variances and assuming either 1:1 or 2:1 sample size allocations between the ZIKV-exposed and control groups. Both sample size allocations were selected (1:1 and 2:1) because some study designs have more ZIKV-exposed infants than control infants. The post-hoc power analysis was conducted using SAS (SAS Institute, Cary, NC, version 9.4) (S1 Appendix) and histograms were generated using R statistical language (R Development Core Team 2019), version 3.6.3.

Study approval

The University of Wisconsin-Madison, College of Letters and Science and Vice Chancellor for Research and Graduate Education Centers Institutional Animal Care and Use Committee approved the nonhuman primate research covered under protocol number G005401-R01.

Results

ZIKV inoculation during pregnancy

Five dams were inoculated with ZIKV and one dam was inoculated with PBS in the first trimester (41–50 gestational days (gd)), as described in Table 1 above. No dams had fever, rash, or inappetence following inoculation. One dam had a stillbirth at gestational day 133 and the fetus was found partially delivered. The remaining infants were delivered by cesarean delivery at 154–155 gd (term = 166.5 gd) (45) (Fig 2) to ensure collection of maternal-fetal interface (MFI) tissues. Maternal plasma viremia peaked 3–5 days post inoculation, and 4 of 5 animals had extended plasma viremia for at least 28 days (S3A Fig). The dams also developed the expected immune response to the virus: ZIKV-specific neutralizing and binding antibodies were detected at 28 dpi and persisted until the last time point measured at necropsy (S3B and S3C Fig, S4 Fig).

Fig 2. Pregnancy experimental design, maternal plasma vRNA loads and maternal antibody responses.

Fig 2

Pregnant macaques were inoculated with ZIKV-PR (all colors) or PBS (grey color) in the first trimester. One female had a stillbirth at 133 gestational days (gd). Maternal blood was obtained at the times indicated for each animal (vertical lines on each animal’s timeline) and ultrasound analyses of the fetus and placenta were performed weekly (black vertical lines).

Pregnancy course and fetal ultrasonography

None of the fetuses had microcephaly (defined as less than 2 SD below the mean) in the ultrasound immediately prior to delivery, even though there was variability in head circumference compared with the normative mean throughout gestation (Fig 3). The fetuses also did not have a femur length or abdominal circumference that was greater than 2 SD below the mean just prior to delivery (S5A and S5B Fig). The single fetal demise (664184) was identified by an absent fetal heart rate, and this was preceded by decreasing fetal heart rate (bradycardia) from gd85 until stillbirth at gd133 when the fetus (416597) was found partially delivered (S5C Fig). The remaining four fetuses had no life-threatening events in utero.

Fig 3. Fetal head growth during pregnancy.

Fig 3

Fetal ultrasonography depicting head circumference (A) and biparietal diameter (B) during gestation. The growth curve standard deviation (SD) was calculated from normative fetal rhesus macaque measurements [22].

Maternal-fetal interface vRNA tissue distribution and histopathology

Histologic evaluation of maternal-fetal interface (MFI) tissues revealed minimal to moderate inflammation in the ZIKV-infected pregnancies (Fig 4 and S4 Table), whereas the control pregnancy had none. The ZIKV-inoculated and control dams revealed some degree of maternal vascular malperfusion, a common finding in the macaque placenta [46, 47]. One dam, 664184, had a large uterine diverticulum (outpouching of the uterine wall) with severe segmental uterine infarction, necrosuppurative inflammation, and ischemic necrosis, confounding interpretation of the stillbirth.

Fig 4. Placental bed and placental villous pathology.

Fig 4

(A-F) Uterine placental bed histology reveals minimal to severe lymphoplasmacytic myometritis or neutrophilic to lymphoplasmacytic endometritis (caret symbol) in 4 of 5 ZIKV-exposed dams (A, B, C, E) but not in one of the ZIKV-exposed dams (D) or control decidua (F). (G-L) Within the placenta, 3 of the 5 ZIKV-exposed pregnancies have villitis (arrow heads) (H, I, J) but not in 2 of the ZIKV-exposed dams (G, K) or a control placental villi (L). Colors of macaques in each image represent individual animals as depicted at the top of the figure. Scale bar is 100 μm.

Two of the five ZIKV-exposed animals had detectable RNA (by qRT-PCR or ISH) in the maternal-fetal interface tissues at the time of delivery (Fig 5). The decidua of ZIKV-exposed dam 795784 had ZIKV RNA of 56 copies/mg detected by qRT-PCR. ZIKV-exposed dam 644184 had ZIKV RNA detected by ISH in the decidua and amniotic/chorionic membrane. However, ZIKV RNA was not detected in the uterine placental bed, uterus, vagina, placental discs, umbilical cord or amniotic fluid.

Fig 5. Viral loads and ISH in the maternal-fetal interface.

Fig 5

(A) Viral loads were assessed in female reproductive and fetal extraembryonic tissues by qRT-PCR at delivery and sections of some of these tissues were assessed by ISH. (B) Positive ZIKV ISH in the decidua of dam 664184. (C) Positive ISH staining in the amniotic/chorionic membrane of fetus 416597. ND = not detected (below the limit of detection), NT = not tested, NC = not collected, NA = not applicable.

Infant clinical courses

Four of the five ZIKV-exposed and control infants required noninvasive respiratory support during resuscitation efforts after delivery (S5 Table); it is unclear whether the need for respiratory support at this premature gestational age is unusual because there is not a large cohort of infants delivered before gd165 by cesarean section at WNPRC available for comparison. One infant had significant respiratory disease (499874), requiring noninvasive respiratory support for almost a day after delivery, and then again following sedated exams. No clinical etiology of for the respiratory symptoms were identified as the chest x-ray was unremarkable. Following placement in the nursery, all infants underwent a rigorous schedule of qualitative and quantitative assessments as described in Fig 1.

Infant viral loads and antibody responses

We did not identify a ZIKV-specific IgM response in the ZIKV-exposed infants (S6A and S6B Fig). Plasma, urine and CSF viral loads were also negative in the ZIKV-exposed infants (S6C Fig). Neutralizing antibody concentrations in infants are comprised of vertically transmitted maternal IgG antibodies and some fetal-derived IgG [48]. The neutralizing antibody concentration in the infants was lower than the maternal neutralizing antibody concentration in all the ZIKV-exposed infants (S6D Fig, with infant neutralizing antibody dilution curves in S7 Fig).

Infant growth and feeding volume sample size estimation

Infant weight gain and formula consumption were monitored closely to evaluate for secondary effects of dysphagia, or difficulty swallowing, which affects some children with congenital Zika syndrome [49]. We demonstrate that all the infants gained weight and had increasing cumulative feeding volumes during their first week of life (Fig 6A and 6B). In order to determine whether our study was powered to detect differences in weight gain and feeding volume trajectories between groups, we conducted post-hoc power and sample size calculations based on observed effect sizes. Large effects sizes were observed for both weight gain trajectory (d = 1.23) and cumulative feeding volumes (d = 0.9). We demonstrate that the sample size required to define differences between the weight gain trajectories in ZIKV-exposed and control infants is 12 infants per group (Fig 6C). A larger group of infants (n = 21 per group) is required to define significant differences between cumulative feeding volumes (Fig 6C).

Fig 6. Infant weight gain, cumulative feeding volumes, and sample size estimates.

Fig 6

Cumulative feeding volumes (A) and weights (B) were measured during their first week of life. Observed effect sizes and sample size requirements (C) for detecting observed effect sizes for weight gain and feeding volume trajectory with 80% power at the two-sided 0.05 significance level, assuming a sample size allocation of 1:1 and 1:2 ZIKV to control animals.

Infant neurobehavioral development

The ZIKV-exposed infants had similar trending scores as the control infant in multiple domains of neonatal neurobehavior, including orientation, motor maturity and activity, sensory and state control (Fig 7). The only domain in which the ZIKV-exposed infants had a lower trending score than the control infant was in one of the time points of the orientation construct (Fig 7A), which assesses both visual and auditory orientation skills. We did not statistically define differences between ZIKV-exposed and control groups because of our small sample size and because published normative data for neonatal neurobehavior do not match our infant population closely enough to be useful as a comparator due to the early delivery in our sample [29, 30]. To determine what sample size will be necessary in future studies to statistically define differences between ZIKV-exposed and control groups, we calculated effect sizes and performed sample size assessments for each construct and time point, resulting in 12 effect and sample size calculations (S6 Table). We developed a histogram showing the distribution of the effect sizes (Fig 7E). The histogram demonstrates that 25% of the effect sizes are >1.5 (Fig 7E), which corresponds to a sample size of 8 infants or less per group required to statistically define differences between ZIKV-exposed and control infants (S6 Table). The constructs with the most difference between groups, i.e. effect size > 1.5, included time points in the motor maturity and activity construct, and the orientation construct (S6 Table). This means that sample sizes of at least 8 animals per group are needed to statistically define differences in 25% of neonatal neurobehavioral parameters.

Fig 7. Neurobehavioral assessment.

Fig 7

The (A) Orientation construct, (B) Motor Maturity and Activity construct, (C) Sensory construct and (D) State Control construct were assessed on three separate days (Trials 1–3) during the infants’ 8 days of life before necropsy, as described in S2 Table. Test items are scored from 0–2, with 0 representing no response or performance and 2 representing a higher performance of the measured behaviors. (E) A histogram illustrates the distribution of effect sizes for all four constructs at each of the three time points.

Infant vision evaluation

Two of the ZIKV-exposed infants had minor ocular defects similar to defects observed in human infants with congenital ZIKV infection identified with indirect ophthalmoscopy, a corneal defect and retinal pigmented epithelium mottling (S7 Table). No other ocular birth defects associated with congenital Zika syndrome were identified [50], including no optic nerve hypoplasia, choroidal lesions, lens abnormalities or vitreous opacities. We next quantified the thickness of each ocular layer in the anterior and posterior segments of the eye by ocular coherence tomography (Fig 8A) because subtle ocular defects that impact vision may not be apparent on ophthalmic exam. Full thickness ocular layers (choroid, cornea and retina) did not display much variability between ZIKV-exposed and control animals (Fig 8B). In contrast, there is more variation in the thickness of individual retinal layers between animals (Fig 8C). We did not define differences between groups because of our small sample size, and instead estimated effect and sample sizes needed to define differences for future studies. An effect size of >1.5 corresponds to a sample size of 8 infants or less per group required to statistically define differences between ZIKV-exposed and control infants (S8 Table). Of the 10 ocular layer thicknesses we measured in the anterior and posterior segment, 4 of the 10 layers had an effect size of >1.5 as shown in a histogram in Fig 8D. The layers with the largest effect sizes are the ganglion cell layer (GCL), inner plexiform layer (IPL), outer nuclear layer (ONL) and photoreceptor outer segment layer (S8 Table). This means that sample sizes of at least 8 animals per group are needed to statistically define differences in 4 of the 10 ocular layer parameters. When considering all 10 ocular layer thicknesses together, the total number of animals needed to define differences in 50% of the parameters is 13 animals per group, with an observed effect size of 1.16.

Fig 8. Ocular and retinal layer thicknesses measured by optical coherence tomography.

Fig 8

(A) Retinal layer segmentation was performed using EXCELSIOR Preclinical, and layers are marked as an example from infant 424847. (B) Thicknesses of the retina, central cornea and choroid were measured in the ZIKV-exposed and control infants with the designated color scheme. Values from the left and right eyes are demonstrated with a circle and a square, respectively. (C) Retinal layer thicknesses were measured using the segmentation demonstrated in part A for ZIKV exposed and control infants. Both the right and left eyes were measured in all animals except for animal 499874 whose left eye was not able to be measured due to anesthesia limitations. (D) A histogram illustrates the distribution of effect sizes for all ocular layer thicknesses.

Visual function may be altered in structurally normal eyes, so we assessed retinal function using electroretinography and visual evoked potentials to assess the cortical visual pathway (Fig 1). The ZIKV-exposed and control infants demonstrated no apparent trends of the retinal function or cortical visual function in electroretinography (Fig 9A) or visual evoked potential (Fig 9B) studies, respectively. As with the other quantitative neonatal assessments, we defined effect and sample sizes needed to statistically define differences in future studies. An effect size of >1.5 corresponds to sample size estimates of 8 animals needed per group to statistically define differences between ZIKV-exposed and control infants with 80% power at the two-sided 0.05 significance level (S9 Table). Two of the 18 visual pathway parameters assessed had effect sizes of >1.5 (Fig 9C). The visual pathway parameters with an effect size >1.5 are the A wave amplitude and latency. When considering all 18 electroretinography and visual evoked potential parameters together, the total number of animals needed to define differences in 50% of the parameters is 22 animals per group, with an observed effect size of 0.87.

Fig 9. Visual function measured by electroretinography and visual evoked potentials.

Fig 9

(A) Light-adapted ERGs were performed for each infant and the amplitude and latency of the A and B waves were recorded. Right and left eye values were graphed separately with a square or circle, respectively. (B) Visual evoked potentials (VEP) were performed on an uncovered right or left eye, and the amplitude, latency and root-mean-square (RMS) of the N2 and P2 waves were recorded. (D) A histogram illustrates the distribution of effect sizes for each ERG, VEP, and RMS value.

Infant hearing evaluation

We assessed hearing quantitatively with auditory brainstem response testing (Fig 1) because hearing loss is one of the findings in congenital Zika syndrome [51]. One ZIKV-exposed and one control infant demonstrate a similar trend of auditory brainstem evoked potential generated by click stimuli, as demonstrated by the wave IV latency (Fig 10A). These one week old infants display wave IV latencies similar to other neonatal macaques [52], suggesting that they had normal hearing. Only two infants underwent auditory brainstem response testing because of equipment availability and group differences were not statistically defined. Instead, we defined the number of animals that will be needed in future studies to statistically define differences between ZIKV-exposed and control groups in each of the 6 parameters (3 click intensities on the left and right sides). All of the hearing parameters had an effect size of 1.41, given the small number of infants, which corresponds to a sample size estimate of 9 animals needed per group to statistically define differences between ZIKV-exposed and control infants with the observed effect sizes.

Fig 10. Hearing measured by auditory brainstem response testing.

Fig 10

(A) Auditory brainstem response testing Wave IV thresholds to click stimuli. (B) Effect sizes and sample size requirements for detecting the observed effect sizes with 80% power at the two-sided 0.05 significance level, assuming a sample size allocation of 1:1 and 1:2 ZIKV to control animals.

Infant brain imaging

We found no severe brain abnormalities consistent with congenital Zika syndrome [53] in our ZIKV-exposed or control infants, including subcortical calcifications, ventriculomegaly, cortical thinning, gyral pattern anomalies, cerebellar hypoplasia or corpus callosum anomalies on qualitative neuroradiological interpretation. Next, we evaluated for subtle changes that would not be apparent on qualitative neuroradiological interpretation by defining structural brain region volumes of the cortical and subcortical regions (Fig 2B and 2C). A total of 40 brain region volumes were quantified, including the total volume of regions (cortical, subcortical, CSF) relative to total brain volume (TBV) or intracranial volume (ICV) to take into account the infant’s brain and head size, respectively (S10 Table). The single control infant had the largest total brain, CSF and lateral ventricle volume of all the infants (Fig 11A), even though it was the youngest infant at the time of the MRI (020501 was 159 corrected gestational days, whereas the ZIKV-exposed infants were 161–163 corrected gestational days old) (S1 Table). The control infant also had the largest relative total white matter volume as corrected for total brain volume, and the smallest grey matter volume (Fig 11B). Volumetric brain analyses at this young neonatal age are challenging because the grey to white matter contrast is limited, and future studies could improve the imaging results by acquiring and averaging multiple runs of T1w and T2w images. The biological significance of these volume differences cannot be determined in this pilot study; longer term studies are being pursued to evaluate these findings.

Fig 11. Volumetric brain analysis and effect sizes.

Fig 11

(A) Structural MRI measurements in cubic millimeters for total brain volume (TBV), lateral ventricles and cerebrospinal fluid (CSF). (B) Grey matter and white matter specific areas corrected for TBV in all infants. (C) A histogram illustrates the distribution of effect for entire brain regions and regions corrected by TBV (tissue type, cortical regions, subcortical regions).

To define how many infants will be required in future studies to detect differences between ZIKV-exposed and control groups, we calculated effect sizes and conducted post-hoc sample size calculations. Ten of 40 brain region volumes quantified (total volumes and TBV corrected) had effect sizes of >1.5 (Fig 11C), which corresponds to a sample size of 8 infants per group required to sufficiently define differences between ZIKV-exposed and control infants (S10 Table). The brain regions with the largest effect sizes included the total brain volume and relative white matter, gray matter, right temporal auditory region and right temporal visual region corrected by total brain volume (S10 Table). The intracranial volume correction shows similar results as the total brain volume correction, with 10 of 40 brain regions demonstrating effect sizes of >1.0 (S10 Table). In summary, this feasibility study demonstrates that sample sizes of at least 8 infants per group are sufficient to define differences in 25% of the brain region volumes.

Infant tissue vRNA distribution and histopathology

No ZIKV vRNA was identified by qRT-PCR in over 45 tissues and body fluids examined per infant/fetus at necropsy (S11 Table), including multiple brain sections. Brain sections were also examined by in situ hybridization (ISH) for ZIKV RNA, and there was no positive staining in any of the fetus/infant brain sections evaluated (S8 Fig). We also searched for ZIKV RNA by ISH of the infant/fetus lung tissue, as this tissue had high viral loads in our previous studies [15], and in the cochlea, because of the clinical findings of sensorineural hearing loss in human congenital ZIKV infection, however no fetal/infant lung or cochlea section had positive ZIKV ISH. The control and ZIKV-exposed infants had similar morphometric measurements at necropsy (S12 Table).

Histopathology demonstrated two key findings in the ZIKV-exposed infants but not control infant: neutrophilic otitis media (i.e. middle ear inflammation) in 3 of 5 ZIKV-exposed fetuses/infants (Fig 12) and bronchopneumonia in 2 of 5 ZIKV-exposed infants (Fig 13), summarized in S13 Table. The infant who had respiratory distress after birth and with each sedation event (499874) had an unremarkable chest x-ray, but bronchopneumonia was identified histologically. The other infant with histological bronchopneumonia (226691) had no respiratory symptoms. Together, this means that 4 of the 5 ZIKV-exposed infants either had neutrophilic otitis media or bronchopneumonia, and only one of these infants displayed signs of illness. There were no lesions identified by hematoxylin and eosin (HE) staining in the eye, brainstem or CNS tissues of any of the ZIKV-exposed infants or in the control infant; additionally, no remaining tissues had lesions that affected more than one fetus/infant (all tissue histopathology described in S14 Table). HE stained brains had no significant histologic lesions; quantitative analyses are in progress.

Fig 12. Fetus/Infant tissue histopathology of the ear.

Fig 12

Neutrophilic otitis media (40x inset) is present in 3 of 5 ZIKV-exposed fetus/infants (A, C, D) and not in a control infant (F) or two ZIKV-exposed infants (B, E). Arrowheads denote the location of the neutrophilic inflammation. (G) Ear diagram depicting where tissue sections were obtained for the 2x and 40x magnifications. Macaque colors represent animals as depicted at the top of the figure. Scale bar is 100 μm.

Fig 13. Fetus/Infant tissue histopathology of the lung.

Fig 13

(A-F) Diffuse bronchopneumonia is present in 2 of 5 ZIKV-exposed infants (C, E) but not in a control infant (F) or 3 of the ZIKV-exposed infants (A, B, D) (images with bronchopneumonia are denoted with an asterisk). The lung in the stillborn macaque (A) is atelectatic (uninflated) due to stillbirth. Macaque colors represent individual animals as depicted at the top of the figure. Scale bar is 100 μm.

Quantitative infant exam sample size estimations

Comprehensively defining infant neurodevelopment and underlying abnormalities requires understanding how many infants will be needed to define differences between ZIKV-exposed and control groups. When all the quantitative infant exams are combined, a total of 76 individual parameters were quantified (S15 Table). A sample size of 8 animals per group is adequate for defining statistically significant differences in 22% of all the quantitative infant exam parameters, assuming similar observed effect sizes to our population. If the sample sizes increases to 14 animals per group, 51% of the exam parameters will have adequate sample sizes to define statistically significant differences.

Discussion

Our results indicate that it is feasible to define infant development quantitatively with moderately sized studies. These quantitative infant exam results generate testable hypotheses about visual pathway abnormalities in congenitally ZIKV-exposed infants, which can be assessed in future appropriately powered studies. We also demonstrate that ZIKV vRNA is not identified in all ZIKV-exposed infants and identify a novel pathological finding in ZIKV-exposed infants: neutrophilic acute otitis media and bronchopneumonia. This battery of quantitative infant macaque-adapted exams complemented by histopathological analyses may be useful for defining early predictors of abnormal development in congenital ZIKV infection and other congenital infections, such as cytomegalovirus.

This model of congenital ZIKV exposure is similar to human clinical studies where maternal infection is confirmed and no ZIKV vRNA or IgM is detected in the infants [21, 5456]. The lack of ZIKV vRNA or IgM in infants may occur if fetuses clear the infection before delivery and/or clear an early IgM response before delivery. Another reason may be a lower inoculation dose and earlier inoculation compared with the only other macaque model that has isolated ZIKV vRNA in liveborn macaque [18]. We identified ZIKV vRNA in the maternal-fetal interface of 2 of the 5 dams at delivery, a similar pattern to other macaque studies [1517, 57, 58], demonstrating vRNA persistence in some compartments for a long duration. The lack of vRNA and IgM in infant body fluids occurs commonly in human infants exposed to ZIKV in utero [5961]. This is why human clinical trials do not require evidence of ZIKV RNA in infant body fluids or ZIKV-specific IgM to enroll infants into studies characterizing the long term outcomes of children born to women with documented or suspected ZIKV infection during pregnancy. The challenge in confirming infant infection following documented maternal infection, especially in cases where ZIKV vRNA is present in the maternal-interface at the time of delivery, indicates that better tools to diagnose infant exposure/infection need to be developed.

This is the first time that sample size estimates have been reported for quantitative examinations in infant macaques, although there are limitations to our sample size estimates. A limitation of our sample size calculations is that they are based on measurements from only five infants (4 ZIKV-exposed and 1 control) and were performed only in the early neonatal period. We concentrated our exams in this early period because we wanted to define ZIKV vRNA tissue tropism in neonates before infection was cleared and wanted to associate viral tropism with the development of birth defects. Given that we did not identify any ZIKV vRNA in the infants and did not identify any severe birth defects, we felt it was a better use of precious resources to assign future pregnant animals to studies of long-term neurodevelopment, rather than include additional control animals in this short-term study. Studies of long-term neurodevelopment are better suited for macaque studies because the incidence of congenital ZIKV-associated developmental deficits is more common than congenital ZIKV syndrome-associated birth defects [14]. The variance seen in infant exam parameters in the neonatal period may not represent the variance present later in infancy, so researchers should confirm their own effect sizes from their own study animals when defining significant differences between ZIKV-exposed and control animals. Even with our small sample size and the resulting sample size estimation limitations, these estimations are useful as a starting point for study design and bring the discussion of effect sizes in congenital infection macaque studies to the forefront.

The quantitative infant exam results generate testable hypotheses about specific visual pathway abnormalities in congenitally ZIKV-exposed infants. We hypothesized that the visual pathway may be affected in our ZIKV-exposed infants because it is affected in human infants with congenital ZIKV infection [62]. We wanted to see which parts of the visual pathway may have abnormalities, so we looked for biological connections between quantitative infant exam parameters with similar large effect sizes. Quantitative measurements may be functionally related if they have a similar size of difference between groups, i.e. effect size. We identified multiple parameters with large effect sizes (>1.5) functionally related to visual function. These infant exam parameters include the photoreceptor outer segment layer thickness, electroretinography A wave latency, temporal visual region volume and SNAP orientation at the middle time point. These parameters are functionally related: photoreceptor layer thickness corresponds to photoreceptor function, as measured by the A wave [63], and overall visual function, as assessed by visual orientation tasks in the SNAP orientation construct [30]. Visual function is also impacted by the organization of the temporal visual region, which is involved in object, face and scene perception [64] and alterations in this function may impact visual orientation skills assessed in the SNAP orientation construct. Based on their similar effect sizes and functional relatedness, we hypothesize that a thinner photoreceptor layer results in decreased photoreceptor function, smaller visual temporal visual region, and decreased visual orientation skills. Our hypothesis aligns with the finding that some human children with congenital ZIKV exposure have a thinned photoreceptor [65]. Abnormalities downstream of the thinned photoreceptor layer remain to be defined in human children, so macaque studies should fill this void by defining specific visual pathway abnormalities in appropriately powered studies. Identification of specific structural abnormalities in young infants that are associated with visual function deficits in childhood could provide a pathway for early diagnosis of neurodevelopmental deficits.

We identified neutrophilic otitis media and bronchopneumonia in ZIKV exposed macaque infants, which is the first time that these acute inflammatory findings have been identified in this model. Congenital ZIKV infection has not been associated with neutrophilic otitis media before, although it is associated with sensorineural hearing loss and rarely with conductive hearing loss [66]. It is unclear whether the otitis media may be within the range of normal findings on histopathologic evaluation of neonatal macaques because the prevalence of otitis media in infant rhesus macaques is unknown. We presume it is a rare finding in macaques because otitis media is found in only 4% of human neonates less than 2 weeks old [67]. We do not know whether the infants with otitis media in our study had hearing loss because the infants with histologic changes did not have ABR testing due to lack of equipment early in our study. Pneumonia is a common cause of death in human infants with congenital ZIKV infection, likely secondary to dysphagia and reflux [68]. The etiology of this acute inflammation may be a bacterial infection, but this cannot be confirmed in all animals because we only obtained bacterial cultures on the lung tissue of the symptomatic infant who had respiratory distress. The functional outcomes of these pathologies included the respiratory distress in one infant; the remaining infant had no respiratory symptoms. Future long-term neurodevelopmental studies of congenital ZIKV exposed macaque infants should include sequential hearing tests on all infants and consider videofluoroscopic swallow studies to better understand the impact of micro aspiration on pulmonary function.

In summary, we demonstrate that moderately size macaque studies are statistically sufficient to define visual, hearing and brain abnormalities, complementing the qualitative clinical and histopathological assessments commonly conducted in ours and other macaque models of prenatal ZIKV exposure [18]. Longitudinal studies of macaque development based on this feasibility study will complement human studies by filling critical knowledge gaps: identification of early neural predictors of neurodevelopmental deficits and pathogenesis of these deficits. Early identification of neurodevelopmental deficits is critical to improving long-term functional outcomes of affected children because early intervention is the only evidence-based intervention that improves outcomes in children with neurodevelopmental deficits [69].

Supporting information

S1 Fig. Scoring of representative ERG and VEP waveforms.

These ERG and VEP waveforms were recorded simultaneously from control infant r18076. Red solid arrows: amplitude of labelled waveform features. ERG A- and VEP N2-wave amplitudes are measured relative to pre-flash voltage; ERG B-and VEP P2-wave amplitude measured from preceding A- and N2-waves, respectively (horizontal dotted line). Red dashed arrows: latency-to-peak, all measured from the onset of the flash stimulus (vertical dotted line). The neonatal rhesus photopic ERG contains a prominent short-latency wave (*) prior to the B-wave that decreases in prominence with age and was not quantified for this study.

(TIF)

S2 Fig. Cortical and subcortical volumetric analysis work flow and parcellations.

(A) AutoSeg grey matter parcellation with axial (left), sagittal (middle) and coronal (right) views. (B) AutoSeg subcortical structure parcellation with axial (left), sagittal (middle) and coronal (right) views. Parcellations are overlaid on the subject T1w image, registered to the Emory-Cross 2 week infant template.

(TIF)

S3 Fig. Maternal viremia and antibody response.

(A) Maternal plasma vRNA loads were measured by qRT-PCR. (B) Estimated EC90 values for serum neutralization of ZIKV assessed prior to infection, 7 dpi, 28 dpi and at maternal necropsy. (C) Estimated EC50 values for serum ZIKV IgG titers obtained prior to infection, 7 dpi, 28 dpi and at maternal necropsy. The dashed line indicates the limit of detection.

(TIF)

S4 Fig. PRNT and whole virion ELISA dose response curves.

(TIF)

S5 Fig. Fetal abdominal circumference, femur length and heart rate measurements.

(TIF)

S6 Fig. Infant IgM titers, body fluid viral loads and PRNTs.

Sera from ZIKV-exposed infants were evaluated for the presence of ZIKV-specific IgM by two commercial assays: Abcam (A) and Euroimmun (B). The manufacturer provided positive and negative human IgM controls are shown in grey. Pre and post-ZIKV infection serum collected from an adult rhesus macaque (244667) was used as a species-specific positive and negative control (shown in black). The dashed line indicates the positive cutoff value for each assay. (C) Infant body fluids (plasma, urine, CSF) were assessed for the presence of ZIKV RNA by qRT-PCR at the days indicated and were negative. NA, not applicable (because no samples were available from the stillborn fetus). (D) PRNTs were performed on infant serum from day of life (DOL) 2–5 from liveborn infants and ED90 values were reported in comparison with maternal PRNT ED90 values from necropsy.

(TIF)

S7 Fig. Infant PRNT dose response curves.

Infant serum was collected at the day of life (DOL) indicated.

(TIF)

S8 Fig. Localization of ZIKV RNA by ISH in brain tissues from ZIKV-exposed infants.

(A) ZIKV genomic RNA (red dots) in a ZIKV-exposed murine lateral geniculate brain section (20x). ZIKV-exposed fetus/infant brain sections exposed to ZIKV RNA probe (10x) (B) 527421 cerebral cortex (rostral to LGN), (C) 499874 cerebral cortex, (D) 226691 cerebral cortex, (E) 424847 cerebrum containing the lateral geniculate nucleus, (F) 416597 cerebellar brain section.

(TIF)

S1 Appendix. Effect size and post-hoc sample size calculations SAS code.

(DOCX)

S1 Table. Infant ages at examination/evaluation and infant sex.

(DOCX)

S2 Table. SNAP constructs.

(DOCX)

S3 Table. Infant procedural sedation medication record.

(DOCX)

S4 Table. Histopathological description of decidua, placental bed and uterus, and placenta.

(DOCX)

S5 Table. Infant clinical course summary.

(DOCX)

S6 Table. SNAP effect sizes and sample size estimates.

(DOCX)

S7 Table. Ophthalmic exam summary of ZIKV-exposed and control infants.

(DOCX)

S8 Table. Ocular coherence tomography effect sizes and sample size estimates.

(DOCX)

S9 Table. Visual electrophysiology effects sizes and sample sizes estimates.

(DOCX)

S10 Table. Cortical and subcortical brain region volumes with sample size estimates, corrected by total brain volume or intracranial volume.

(DOCX)

S11 Table. Fetus/Infant tissue viral loads.

(DOCX)

S12 Table. Infant/fetus morphometric measurements at necropsy.

(DOCX)

S13 Table. Histopathological description of the lung and middle ear in fetuses/infants.

(DOCX)

S14 Table. Histopathological description of fetal/infant tissues excluding the lung and ear.

(DOCX)

S15 Table. Summary of sample size estimates for all quantitative infant exams.

(DOCX)

Acknowledgments

We thank Nathan Diers, Seth Eaton and Peter Cueno for assistance with OCT segmentation. We thank Clara R. Landucci for making the ear illustration. We thank Marina Emborg for her critical review of the manuscript. We thank Martin Styner for his assistance with the AutoSeg sotware.

Data Availability

Data are available: (https://go.wisc.edu/0n9g6o).

Funding Statement

This study was supported by the National Institutes of Health (P01 AI132132 (DHO), R01 AI138647 (DHO), R01 AI116382-01A1S1 (DHO), K08 AI139341 (ELM), R01 AI132563 (MTA and TCF)) and the Pediatric Infectious Diseases Society funded by Stanley A. Plotkin and Sanofi Pasteur (www.pids.org) (ELM). This study was also supported by the Clinical and Translational Science Award (CTSA) program, through the NIH National Center for Advancing Translational Sciences (NCATS), grant UL1TR002373-02 and TL1002375-02 (ELM). This study was supported in part by the Core Grant for Vision Research from the NIH to the University of Wisconsin-Madison (P30 EY016665) (PI: Curtis Brandt), McPherson Eye Research Institute’s Retina Research Foundation Kathryn & Latimer Murfee Chair (TMN), and an unrestricted grant from Research to Prevent Blindness to the University of Wisconsin Department of Ophthalmology and Visual Sciences (TMN). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

References

  • 1.Rice ME, Galang RR, Roth NM, Ellington SR, Moore CA, Valencia-Prado M, et al. Vital Signs: Zika-Associated Birth Defects and Neurodevelopmental Abnormalities Possibly Associated with Congenital Zika Virus Infection—U.S. Territories and Freely Associated States, 2018. MMWR Morbidity and mortality weekly report. 2018;67(31):858–67. Epub 2018/08/10. 10.15585/mmwr.mm6731e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Hoen B, Schaub B, Funk AL, Ardillon V, Boullard M, Cabie A, et al. Pregnancy Outcomes after ZIKV Infection in French Territories in the Americas. The New England journal of medicine. 2018;378(11):985–94. Epub 2018/03/15. 10.1056/NEJMoa1709481 . [DOI] [PubMed] [Google Scholar]
  • 3.Nielsen-Saines K, Brasil P, Kerin T, Vasconcelos Z, Gabaglia CR, Damasceno L, et al. Delayed childhood neurodevelopment and neurosensory alterations in the second year of life in a prospective cohort of ZIKV-exposed children. Nature medicine. 2019. Epub 2019/07/10. 10.1038/s41591-019-0496-1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Mulkey SB, Arroyave-Wessel M, Peyton C, Bulas DI, Fourzali Y, Jiang J, et al. Neurodevelopmental Abnormalities in Children With In Utero Zika Virus Exposure Without Congenital Zika Syndrome. JAMA pediatrics. 2020. Epub 2020/01/07. 10.1001/jamapediatrics.2019.5204 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Peçanha PM, Gomes Junior SC, Pone SM, Pone MVdS, Vasconcelos Z, Zin A, et al. Neurodevelopment of children exposed intra-uterus by Zika virus: A case series. PloS one. 2020;15(2):e0229434–e. 10.1371/journal.pone.0229434 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Vianna RAO, Lovero KL, Oliveira SA, Fernandes AR, Santos T, Lima L, et al. Children Born to Mothers with Rash During Zika Virus Epidemic in Brazil: First 18 Months of Life. Journal of tropical pediatrics. 2019. Epub 2019/04/22. 10.1093/tropej/fmz019 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Gerzson LR, de Almeida CS, da Silva JH, Feitosa MMA, de Oliveira LN, Schuler-Faccini L. Neurodevelopment of Nonmicrocephalic Children, After 18 Months of Life, Exposed Prenatally to Zika Virus. Journal of child neurology. 2019:883073819892128 Epub 2019/12/28. 10.1177/0883073819892128 . [DOI] [PubMed] [Google Scholar]
  • 8.Melo AS, Aguiar RS, Amorim MM, Arruda MB, Melo FO, Ribeiro ST, et al. Congenital Zika Virus Infection: Beyond Neonatal Microcephaly. JAMA neurology. 2016. Epub 2016/10/04. 10.1001/jamaneurol.2016.3720 . [DOI] [PubMed] [Google Scholar]
  • 9.Mohr EL. Modeling Zika Virus-Associated Birth Defects in Nonhuman Primates. Journal of the Pediatric Infectious Diseases Society. 2018;7(suppl_2):S60–s6. Epub 2018/12/28. 10.1093/jpids/piy120 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Osuna CE, Whitney JB. Nonhuman Primate Models of Zika Virus Infection, Immunity, and Therapeutic Development. The Journal of infectious diseases. 2017;216(suppl_10):S928–s34. Epub 2017/12/22. 10.1093/infdis/jix540 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Dudley DM, Aliota MT, Mohr EL, Newman CM, Golos TG, Friedrich TC, et al. Using Macaques to Address Critical Questions in Zika Virus Research. Annual review of virology. 2019. Epub 2019/06/11. 10.1146/annurev-virology-092818-015732 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Klionsky DJ, Abdalla FC, Abeliovich H, Abraham RT, Acevedo-Arozena A, Adeli K, et al. Guidelines for the use and interpretation of assays for monitoring autophagy. Autophagy. 2012;8(4):445–544. Epub 2012/09/12. 10.4161/auto.19496 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Dudley DM, Van Rompay KK, Coffey LL, Ardeshir A, Keesler RI, Bliss-Moreau E, et al. Miscarriage and stillbirth following maternal Zika virus infection in nonhuman primates. Nature medicine. 2018;24(8):1104–7. Epub 2018/07/04. 10.1038/s41591-018-0088-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Coffey LL, Keesler RI, Pesavento PA, Woolard K, Singapuri A, Watanabe J, et al. Intraamniotic Zika virus inoculation of pregnant rhesus macaques produces fetal neurologic disease. Nature communications. 2018;9(1):2414 Epub 2018/06/22. 10.1038/s41467-018-04777-6 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Mohr EL, Block LN, Newman CM, Stewart LM, Koenig M, Semler M, et al. Ocular and uteroplacental pathology in a macaque pregnancy with congenital Zika virus infection. PloS one. 2018;13(1):e0190617 Epub 2018/01/31. 10.1371/journal.pone.0190617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Nguyen SM, Antony KM, Dudley DM, Kohn S, Simmons HA, Wolfe B, et al. Highly efficient maternal-fetal Zika virus transmission in pregnant rhesus macaques. PLoS pathogens. 2017;13(5):e1006378 Epub 2017/05/26. 10.1371/journal.ppat.1006378 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Martinot AJ, Abbink P, Afacan O, Prohl AK, Bronson R, Hecht JL, et al. Fetal Neuropathology in Zika Virus-Infected Pregnant Female Rhesus Monkeys. Cell. 2018. Epub 2018/04/03. 10.1016/j.cell.2018.03.019 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Steinbach RJ, Haese NN, Smith JL, Colgin LMA, MacAllister RP, Greene JM, et al. A neonatal nonhuman primate model of gestational Zika virus infection with evidence of microencephaly, seizures and cardiomyopathy. PloS one. 2020;15(1):e0227676 Epub 2020/01/15. 10.1371/journal.pone.0227676 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Rajadhyaksha V. Conducting feasibilities in clinical trials: an investment to ensure a good study. Perspect Clin Res. 2010;1(3):106–9. . [PMC free article] [PubMed] [Google Scholar]
  • 20.Huber HF, Jenkins SL, Li C, Nathanielsz PW. Strength of nonhuman primate studies of developmental programming: review of sample sizes, challenges, and steps for future work. Journal of developmental origins of health and disease. 2019:1–10. Epub 2019/10/01. 10.1017/s2040174419000539 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Adebanjo T, Godfred-Cato S, Viens L, Fischer M, Staples JE, Kuhnert-Tallman W, et al. Update: Interim Guidance for the Diagnosis, Evaluation, and Management of Infants with Possible Congenital Zika Virus Infection—United States, October 2017. MMWR Morbidity and mortality weekly report. 2017;66(41):1089–99. Epub 2017/10/20. 10.15585/mmwr.mm6641a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Tarantal AF. Ultrasound Imaging in Rhesus (Macaca mulatta) and Long-tailed (Macaca fascicularis) Macaques: Reproductive and Research Applications Ultrasound Imaging: Elsevier Ltd; 2005. [Google Scholar]
  • 23.Dudley DM, Aliota MT, Mohr EL, Weiler AM, Lehrer-Brey G, Weisgrau KL, et al. A rhesus macaque model of Asian-lineage Zika virus infection. Nature communications. 2016;7:12204 Epub 2016/06/29. 10.1038/ncomms12204 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hansen SG, Piatak M Jr., Ventura AB, Hughes CM, Gilbride RM, Ford JC, et al. Immune clearance of highly pathogenic SIV infection. Nature. 2013;502(7469):100–4. Epub 2013/09/13. 10.1038/nature12519 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lindsey HS, Calisher CH, Mathews JH. Serum dilution neutralization test for California group virus identification and serology. Journal of clinical microbiology. 1976;4(6):503–10. Epub 1976/12/01. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Laughlin NK, Lasky RE, Giles NL, Luck ML. Lead effects on neurobehavioral development in the neonatal rhesus monkey (Macaca mulatta). Neurotoxicology and teratology. 1999;21(6):627–38. Epub 1999/11/24. 10.1016/s0892-0362(99)00036-7 . [DOI] [PubMed] [Google Scholar]
  • 27.Schneider ML, Moore CF, Kraemer GW, Roberts AD, DeJesus OT. The impact of prenatal stress, fetal alcohol exposure, or both on development: perspectives from a primate model. Psychoneuroendocrinology. 2002;27(1–2):285–98. Epub 2001/12/26. 10.1016/s0306-4530(01)00050-6 . [DOI] [PubMed] [Google Scholar]
  • 28.Schneider ML, Roughton EC, Koehler AJ, Lubach GR. Growth and development following prenatal stress exposure in primates: an examination of ontogenetic vulnerability. Child development. 1999;70(2):263–74. Epub 1999/04/28. 10.1111/1467-8624.00020 . [DOI] [PubMed] [Google Scholar]
  • 29.Schneider ML, Suomi SJ. Neurobehavioral Assessment in Rhesus Monkey Neonates (Macaca mulatta): Developmental Changes, Behavioral Stability and Early Experience. Infant Behavior and Development. 1992;15:155–77. [Google Scholar]
  • 30.Coe CL, Lubach GR, Crispen HR, Shirtcliff EA, Schneider ML. Challenges to maternal wellbeing during pregnancy impact temperament, attention, and neuromotor responses in the infant rhesus monkey. Developmental psychobiology. 2010;52(7):625–37. Epub 2010/10/01. 10.1002/dev.20489 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Brazelton TB. Assessment of the infant at risk. Clinical obstetrics and gynecology. 1973;16(1):361–75. Epub 1973/03/01. 10.1097/00003081-197303000-00020 . [DOI] [PubMed] [Google Scholar]
  • 32.Huang Y, Danis RP, Pak JW, Luo S, White J, Zhang X, et al. Development of a semi-automatic segmentation method for retinal OCT images tested in patients with diabetic macular edema. PloS one. 2013;8(12):e82922 Epub 2014/01/05. 10.1371/journal.pone.0082922 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Robson AG, Nilsson J, Li S, Jalali S, Fulton AB, Tormene AP, et al. ISCEV guide to visual electrodiagnostic procedures. Documenta ophthalmologica Advances in ophthalmology. 2018;136(1):1–26. Epub 2018/02/06. 10.1007/s10633-017-9621-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Wong CW, Ng SR, Cheung CM, Wong TY, Mathur R. ZIKA-RELATED MACULOPATHY. Retinal cases & brief reports. 2017. Epub 2017/02/22. 10.1097/icb.0000000000000552 . [DOI] [PubMed] [Google Scholar]
  • 35.Sitdikova G, Zakharov A, Janackova S, Gerasimova E, Lebedeva J, Inacio AR, et al. Isoflurane suppresses early cortical activity. Annals of clinical and translational neurology. 2014;1(1):15–26. Epub 2014/10/31. 10.1002/acn3.16 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Hall III JW. New Handbook of Auditory Evoked Responses: Pearson; 2006. 736 p. [Google Scholar]
  • 37.Avants BB, Epstein CL, Grossman M, Gee JC. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med Image Anal. 2008;12(1):26–41. Epub 2007/06/23. 10.1016/j.media.2007.06.004 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, et al. N4ITK: improved N3 bias correction. IEEE Trans Med Imaging. 2010;29(6):1310–20. Epub 2010/04/08. 10.1109/TMI.2010.2046908 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Shi Y, Budin F, Yapuncich E, Rumple A, Young JT, Payne C, et al. UNC-Emory Infant Atlases for Macaque Brain Image Analysis: Postnatal Brain Development through 12 Months. Frontiers in neuroscience. 2016;10:617 Epub 2017/01/26. 10.3389/fnins.2016.00617 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Johnson HH, G. Williams K. BRAINSFit: mutual information registrations of whole-brain 3D images, using the insight toolkit. Insight Journal. 2007. Epub December. PubMed Central PMCID: PMC1022. [Google Scholar]
  • 41.Van Leemput K, Maes F, Vandermeulen D, Suetens P. Automated model-based bias field correction of MR images of the brain. IEEE Trans Med Imaging. 1999;18(10):885–96. 10.1109/42.811268 . [DOI] [PubMed] [Google Scholar]
  • 42.Van Leemput K, Maes F, Vandermeulen D, Suetens P. Automated model-based tissue classification of MR images of the brain. IEEE Trans Med Imaging. 1999;18(10):897–908. 10.1109/42.811270 . [DOI] [PubMed] [Google Scholar]
  • 43.Prastawa M, Bullitt E, Moon N, Van Leemput K, Gerig G. Automatic brain tumor segmentation by subject specific modification of atlas priors. Acad Radiol. 2003;10(12):1341–8. 10.1016/s1076-6332(03)00506-3 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Wang J, Vachet C, Rumple A, Gouttard S, Ouziel C, Perrot E, et al. Multi-atlas segmentation of subcortical brain structures via the AutoSeg software pipeline. Front Neuroinform. 2014;8:7–. 10.3389/fninf.2014.00007 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Sullivan GM, Feinn R. Using Effect Size-or Why the P Value Is Not Enough. J Grad Med Educ. 2012;4(3):279–82. 10.4300/JGME-D-12-00156.1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Myers RE. The gross pathology of the rhesus monkey placenta. The Journal of reproductive medicine. 1972;9(4):171–98. Epub 1972/10/01. . [PubMed] [Google Scholar]
  • 47.Bunton TE. Incidental lesions in nonhuman primate placentae. Veterinary pathology. 1986;23(4):431–8. Epub 1986/07/01. 10.1177/030098588602300413 . [DOI] [PubMed] [Google Scholar]
  • 48.Fouda GG, Martinez DR, Swamy GK, Permar SR. The Impact of IgG transplacental transfer on early life immunity. Immunohorizons. 2018;2(1):14–25. 10.4049/immunohorizons.1700057 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Leal MC, van der Linden V, Bezerra TP, de Valois L, Borges ACG, Antunes MMC, et al. Characteristics of Dysphagia in Infants with Microcephaly Caused by Congenital Zika Virus Infection, Brazil, 2015. Emerging infectious diseases. 2017;23(8):1253–9. Epub 2017/06/13. 10.3201/eid2308.170354 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Yepez JB, Murati FA, Pettito M, Penaranda CF, de Yepez J, Maestre G, et al. Ophthalmic Manifestations of Congenital Zika Syndrome in Colombia and Venezuela. JAMA ophthalmology. 2017;135(5):440–5. Epub 2017/04/19. 10.1001/jamaophthalmol.2017.0561 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.de Carvalho Leal M, Ramos DS, Caldas Neto SS. Hearing Loss From Congenital Zika Virus Infection. Topics in magnetic resonance imaging: TMRI. 2019;28(1):19–22. Epub 2019/03/01. 10.1097/RMR.0000000000000191 . [DOI] [PubMed] [Google Scholar]
  • 52.Doyle WJ, Saad MM, Fria TJ. Maturation of the auditory brain stem response in rhesus monkeys (Macaca mulatta). Electroencephalography and clinical neurophysiology. 1983;56(2):210–23. Epub 1983/08/01. 10.1016/0013-4694(83)90075-5 . [DOI] [PubMed] [Google Scholar]
  • 53.Ribeiro BNF, Muniz BC, Gasparetto EL, Ventura N, Marchiori E. Congenital Zika syndrome and neuroimaging findings: what do we know so far? Radiologia brasileira. 2017;50(5):314–22. Epub 2017/11/01. 10.1590/0100-3984.2017.0098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Moreira ME. Vertical Exposure to Zika Virus and Its Consequences for Child Neurodevelopment (ZIKVIRUSIFF) [updated 5.3.187.6.19]. Available from: https://ClinicalTrials.gov/show/NCT03255369.
  • 55.Rojas MA. Neurodevelopment Outcome of Newborns Exposed to Zika Virus (ZIKV) in Utero 2019 [updated 1.17.197.5.19]. Available from: https://ClinicalTrials.gov/show/NCT02943304.
  • 56.Institut National de la Santé Et de la Recherche Médicale F. Zika Virus Infection's Neonatal and Pediatric Consequences in French Department of America [updated 8.30.167.6.19]. Available from: https://ClinicalTrials.gov/show/NCT02810210.
  • 57.Adams Waldorf KM, Stencel-Baerenwald JE, Kapur RP, Studholme C, Boldenow E, Vornhagen J, et al. Fetal brain lesions after subcutaneous inoculation of Zika virus in a pregnant nonhuman primate. Nature medicine. 2016. Epub 2016/09/13. 10.1038/nm.4193 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Hirsch AJ, Roberts VHJ, Grigsby PL, Haese N, Schabel MC, Wang X, et al. Zika virus infection in pregnant rhesus macaques causes placental dysfunction and immunopathology. Nature communications. 2018;9(1):263 Epub 2018/01/19. 10.1038/s41467-017-02499-9 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Zika in Infants and Pregnancy (ZIP). Available from: https://ClinicalTrials.gov/show/NCT02856984.
  • 60.ZIKAlliance Children Cohort (ZIKAllianceCH). Available from: https://ClinicalTrials.gov/show/NCT03393286.
  • 61.Neurodevelopment Outcome of Newborns Exposed to Zika Virus (ZIKV) in Utero. Available from: https://ClinicalTrials.gov/show/NCT02943304.
  • 62.Marquezan MC, Ventura CV, Sheffield JS, Golden WC, Omiadze R, Belfort R Jr., et al. Ocular effects of Zika virus-a review. Survey of ophthalmology. 2018;63(2):166–73. Epub 2017/06/18. 10.1016/j.survophthal.2017.06.001 . [DOI] [PubMed] [Google Scholar]
  • 63.Miyake Y, Shinoda K. Chapter 8—Clinical Electrophysiology In: Ryan SJ, Sadda SR, Hinton DR, Schachat AP, Sadda SR, Wilkinson CP, et al. , editors. Retina (Fifth Edition). London: W.B. Saunders; 2013. p. 202–26. [Google Scholar]
  • 64.Conway BR. The Organization and Operation of Inferior Temporal Cortex. Annual review of vision science. 2018;4:381–402. Epub 2018/07/31. 10.1146/annurev-vision-091517-034202 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Aleman TS, Ventura CV, Cavalcanti MM, Serrano LW, Traband A, Nti AA, et al. Quantitative Assessment of Microstructural Changes of the Retina in Infants With Congenital Zika Syndrome. JAMA ophthalmology. 2017;135(10):1069–76. Epub 2017/09/08. 10.1001/jamaophthalmol.2017.3292 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Barbosa MHM, Magalhaes-Barbosa MC, Robaina JR, Prata-Barbosa A, Lima M, Cunha A. Auditory findings associated with Zika virus infection: an integrative review. Brazilian journal of otorhinolaryngology. 2019. Epub 2019/07/13. 10.1016/j.bjorl.2019.05.002 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Syggelou A, Fanos V, Iacovidou N. Acute otitis media in neonatal life: a review. Journal of chemotherapy (Florence, Italy). 2011;23(3):123–6. Epub 2011/07/12. 10.1179/joc.2011.23.3.123 . [DOI] [PubMed] [Google Scholar]
  • 68.de Fatima Viana Vasco Aragao M, van der Linden V, Petribu NC, Valenca MM, Parizel PM, de Mello RJV. Congenital Zika Syndrome: The Main Cause of Death and Correspondence Between Brain CT and Postmortem Histological Section Findings From the Same Individuals. Topics in magnetic resonance imaging: TMRI. 2019;28(1):29–33. Epub 2019/03/01. 10.1097/RMR.0000000000000194 . [DOI] [PubMed] [Google Scholar]
  • 69.Zwaigenbaum L, Bauman ML, Choueiri R, Fein D, Kasari C, Pierce K, et al. Early Identification and Interventions for Autism Spectrum Disorder: Executive Summary. Pediatrics. 2015;136 Suppl 1:S1–9. Epub 2015/10/03. 10.1542/peds.2014-3667B . [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Rafael da Costa Monsanto

30 Jul 2020

PONE-D-20-18920

Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus

PLOS ONE

Dear Dr. Mohr,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Academic editor comments:

First of all, my sincere apologies on the delay on the review process. The subject of the manuscript certainly merits an in-depth investigation. Although the manuscript is interesting and may provide a significant contribution to the literature, there are still some methodological concerns raised by the reviewers that must be clarified before the paper is further considered for publication.

Please submit your revised manuscript by Sep 13 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Rafael da Costa Monsanto, M.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.Thank you for stating the following in the Competing Interests section:

[DHO is a paid consultant for Battelle, devoted to research in the areas of assisting in the design and interpretation of their nonhuman primate ZIKV studies. His relationship does not carry with it any restrictions on publication, and any associated intellectual property will be disclosed and processed according to UW-Madison policy. None of the animals used in this study are involved in any studies with Battelle.].

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you very much for the opportunity to review the paper titled: "Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus". This a dense, but very interesting study on Zika virus infection and brings a lot of knowledge on the different fields. The authors assessed the methodological and statistical feasibility of a congenital ZIKV exposure macaque model for identifying brain abnormalities and also other sensitive organs (eye and ear) that may underlie neurodevelopmental deficits.

The text is very well writen and the language is clear. I congratulate the authors for this study!

I just have few comments regarding this study on its present format.

1. Introduction: I would write the full term before abbreviation (ZIKV).

2. In Materials and Methods: the authors wrote: "Indian-origin rhesus macaques (Macaca mulatta) were inoculated with ZIKV or phosphate buffered saline (PBS)." It is not clear if the PBS should act as a control or the ZIKV was inoculated WITH PBS. What is the idea of using PBS? Please clarify.

3. What was assessed in indirect ophthalmoscopy? Please describe the parameters.

4. Why the authors decided to observe wave IV (superior olivary complex) behavior instead of wave III (cochlear nucleus) or maybe V (inferior coliculus and lateral lemniscus)?

5. In references, please use the complete references format according to what is described in PlosONE webpage.

Reviewer #2: The article entitled "Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus" by Koenig and colleagues describes a quantitative definition to analyse various phenotypes of the Congenital Zika Syndrome in macaques. I find this study could be of interest and the authors could contribute to a better characterisation of developmental events impaired caused by Zika virus infection. However, some key points should be addressed:

1) Microcephaly is the hallmark of Congenital Zika Syndrome. What could account for the lack of this phenotype in your model?

2) It is not clear if the authors managed to produce the Congenital Zika Syndrome model with ZIKV vertical transmission.

3) Even without the statistical analysis there could have been an effort to describe qualitatively the various phenotypes.

4) The paper could be re-written as a method paper or a qualitative paper.

Reviewer #3: Synopsis: This manuscript describes detailed evaluation of neonatal rhesus macaques born to dams exposed to Zika virus (n=5) or an uninfected control dam (n=1). In this study, the authors followed the neonates for 8 d post Caesarean birth at 155 dGA, followed by necropsy. Assessments of neurobehavior, visual and hearing function, as well as brain MRI were conducted during the time of observation, and histopathology post-necropsy. In general, the sample size was too small to reveal significant statistical differences in any of the observed parameters with the control animal. This is not surprising, as previous studies indicate a broad spectrum of phenotypes in the Rhesus macaque congenital infection model. This model has also been shown to result in pregnancy loss, which occurred in one of this studies’ animals. Nevertheless, a strength of this study is the wide range of assays deployed to evaluate ZIKV-associated phenotypes, potentially setting the standard for future studies.

Specific comments/ concerns:

1. The post-hoc power analysis has the potential to add significant value to this study by contributing information to future experimental design. However, it is unclear if it is valid to calculate and effect size based on the single control animal, since no standard deviation can be calculated from the control group. Would it be preferable to treat all animals as a single population to calculate SD? Such results could still be extrapolated to a power analysis.

2. Has the NBAS or similar test been applied to human neonates post in utero ZIKV exposure? If so, is an effect of viral infection detected early after birth, or, as mentioned in the introduction (lines 63-64), are abnormalities observed later? Could such results suggest a time post-birth in the NHP model that subtle phenotypes due to in utero infection might be observed.

3. Minor point: In figure 1, the figure has the abbreviation NBAS, while the legend uses the abbreviation SNAP.

4. Minor point: Could the color for the control animal be changed to bright green or something else that makes it more easily identified in the figures?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Oct 22;15(10):e0235877. doi: 10.1371/journal.pone.0235877.r002

Author response to Decision Letter 0


15 Sep 2020

Response to reviewers

Reviewer #1: Thank you very much for the opportunity to review the paper titled: "Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus". This a dense, but very interesting study on Zika virus infection and brings a lot of knowledge on the different fields. The authors assessed the methodological and statistical feasibility of a congenital ZIKV exposure macaque model for identifying brain abnormalities and also other sensitive organs (eye and ear) that may underlie neurodevelopmental deficits.

The text is very well written and the language is clear. I congratulate the authors for this study!

I just have few comments regarding this study on its present format.

We appreciate this reviewer’s positive response about our manuscript languate and style.

1. Introduction: I would write the full term before abbreviation (ZIKV).

This change has been made as recommended.

2. In Materials and Methods: the authors wrote: "Indian-origin rhesus macaques (Macaca mulatta) were inoculated with ZIKV or phosphate buffered saline (PBS)." It is not clear if the PBS should act as a control or the ZIKV was inoculated WITH PBS. What is the idea of using PBS? Please clarify.

The single control pregnancy was inoculated with phosphate buffered saline to mirror the same amount of prenatal stress associated with inoculation as the ZIKV-challenged dams experienced. I clarified the language in the methods section to say that “… were inoculated with ZIKV alone or phosphate buffered saline (PBS) alone during the first trimester… “. The first sentence of the Results section explains the inoculation substances as well: “Five dams were inoculated with ZIKV and one dam was inoculated with PBS in the first trimester”.

3. What was assessed in indirect ophthalmoscopy? Please describe the parameters.

Indirect ophthalmoscopy assessed the parameters described in Supplementary Table 7, which includes the pupillary response, eyelids and adnexa, conjunctiva, cornea, anterior chamber, iris, lenses, vitreous, hyaloid artery, tunica vasculosa lentis, optic nerve, retina, and choroid. I described the finding of a corneal defect and retinal pigmented epithelium mottling in the Results section, and highlighted that these results were identified with indirect ophthalmoscopy in this revision. The revised sentence reads “Two of the ZIKV-exposed infants had minor ocular defects similar to defects observed in human infants with congenital ZIKV infection identified with indirect ophthalmoscopy, a corneal defect and retinal pigmented epithelium mottling (S7 table). No other ocular birth defects associated with congenital Zika syndrome were identified [1], including no optic nerve hypoplasia, choroidal lesions, lens abnormalities or vitreous opacities.”

4. Why the authors decided to observe wave IV (superior olivary complex) behavior instead of wave III (cochlear nucleus) or maybe V (inferior coliculus and lateral lemniscus)?

In humans, wave V is examined when assessing hearing thresholds because it is the most robust and reliable out of the five waveforms. Waves I-III are not typically looked at for this reason. Brainstem auditory evoked potentials in rhesus macaques have only 4 main vertex-positive peaks in response to click sounds, which is one less than humans. Studies comparing human and rhesus BAEP hypothesize that the human peak I and II combine into a single peak in rhesus because of their shorter auditory nerve [2]. Peak II in the rhesus macaque corresponds to peak III in humans, peak III to peak IV, and peak IV to peak V. Due to the finding that rhesus macaques only have 4 waveforms, and that wave IV corresponds to the inferior colliculus response in macaques, we utilize wave IV in data analysis and threshold estimations.

5. In references, please use the complete references format according to what is described in PlosONE webpage.

I have updated the references as recommended.

Reviewer #2: The article entitled "Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus" by Koenig and colleagues describes a quantitative definition to analyse various phenotypes of the Congenital Zika Syndrome in macaques. I find this study could be of interest and the authors could contribute to a better characterisation of developmental events impaired caused by Zika virus infection. However, some key points should be addressed:

1) Microcephaly is the hallmark of Congenital Zika Syndrome. What could account for the lack of this phenotype in your model?

Microcephaly is observed in only 5% of infants born to women with laboratory evidence of Zika virus infection during pregnancy [3]. Up to 15% of infants born to women with laboratory evidence of Zika virus infection during pregnancy have a Zika-associated birth defect [3]. It is unlikely that we will observe microcephaly and severe birth defects in our macaque model with the small sample size of four liveborn infant macaques. In future studies we will focus on the most common phenotype of congenital Zika virus infection – developmental delays, which occurs in about 30% of children. We did not focus on these long-term developmental outcomes in this study because we assessed tissue viral loads at 1 week of age.

2) It is not clear if the authors managed to produce the Congenital Zika Syndrome model with ZIKV vertical transmission.

We did not observe microcephaly or severe birth defects such contractures, qualitatively apparent brain anomalies, chorioretinal anomalies or hearing loss. These severe birth defects occur in up to 15% of infants born to women with laboratory evidence of Zika virus infection during pregnancy [3]. We were not sure when we began these studies if we would observe congenital Zika syndrome, so set out to capture as much quantitative detail about vision, hearing and brain volumes as we could, to define more subtle differences.

3) Even without the statistical analysis there could have been an effort to describe qualitatively the various phenotypes.

We did not observe a phenotype consistent with severe Zika-associated birth defects, which means there is not a “birth defect” phenotype to describe. Subtle brain abnormality phenotypes, such as alterations in visual electrophysiology or brain region volume changes, require sufficient number of control animals. We do not have a sufficient number of animals for these types of studies in our neonatal macaques because we decided to change our focus to long-term neurodevelopment, as these are a more common phenotype (28%) of congenital Zika exposure [4], and because neurodevelopment is best studied longitudinally in childhood, rather than just the first week of life. This current macaque study was carefully designed to describe birth defect phenotypes and define viral tissue tropism, something that has to be done in the early neonatal period. We agree with the reviewer that future studies should define phenotypes and we hope to do this with long-term studies that describe subtle neurodevelopmental deficits along with the underlying neuropathway abnormalities.

4) The paper could be re-written as a method paper or a qualitative paper.

We appreciate this comment because one of our goals was to describe a comprehensive battery of tests that need be done in macaque models of congenital Zika infection in order to fully define the effect of therapeutic interventions, such as vaccines or antiviral therapy. Much of the field until this point has utilized endpoints such as microcephaly or tissue viral loads as the endpoint of therapeutic interventions. These endpoints tell only part of the story and leave out the more common outcome, developmental deficits and subtle brain abnormalities that underlie these deficits. We hope that our detailed methods section describing optical coherence tomography, visual electrophysiology, hearing tests, and brain region volume analyses in infant macaques will pave the way for other groups to perform these quantitative tests in their macaque models of congenital viral infections. We took our manuscript a step beyond the methods description to help researchers design future studies of congenital viral infection interventions by performing post-hoc sample size calculations. Hopefully our methods descriptions and sample size estimates will assist other groups in their studies of congenital viral infection in a macaque model.

Reviewer #3: Synopsis: This manuscript describes detailed evaluation of neonatal rhesus macaques born to dams exposed to Zika virus (n=5) or an uninfected control dam (n=1). In this study, the authors followed the neonates for 8 d post Caesarean birth at 155 dGA, followed by necropsy. Assessments of neurobehavior, visual and hearing function, as well as brain MRI were conducted during the time of observation, and histopathology post-necropsy. In general, the sample size was too small to reveal significant statistical differences in any of the observed parameters with the control animal. This is not surprising, as previous studies indicate a broad spectrum of phenotypes in the Rhesus macaque congenital infection model. This model has also been shown to result in pregnancy loss, which occurred in one of this studies’ animals. Nevertheless, a strength of this study is the wide range of assays deployed to evaluate ZIKV-associated phenotypes, potentially setting the standard for future studies.

Specific comments/ concerns:

1. The post-hoc power analysis has the potential to add significant value to this study by contributing information to future experimental design. However, it is unclear if it is valid to calculate and effect size based on the single control animal, since no standard deviation can be calculated from the control group. Would it be preferable to treat all animals as a single population to calculate SD? Such results could still be extrapolated to a power analysis.

We appreciate this comment because it allowed us to clarify our statistical methods description. We used the standard deviation estimation of the ZIKV group to estimate the effect sizes. The underlying assumption is that there is no difference in variability in the measurements between groups. This is similar to the calculation used for Glass's delta effect sizes where the standard deviation of only the control group is used for the calculation of the effect sizes. We have clarified this in the Statistical Analysis section of the revised manuscript. Alternatively, standard deviations of the pooled groups could be used. However, this could result into inflated standard deviations estimates if there are large differences in the group means. We added a sentence in the Statistical Analyses sections: “Due to the small sample size in the control group, only the standard deviations of the ZIKV-exposed group observations were used for the effect size estimation.”

2. Has the NBAS or similar test been applied to human neonates post in utero ZIKV exposure? If so, is an effect of viral infection detected early after birth, or, as mentioned in the introduction (lines 63-64), are abnormalities observed later? Could such results suggest a time post-birth in the NHP model that subtle phenotypes due to in utero infection might be observed.

I appreciate this interesting question from the reviewer. The question is whether the newborn behavioral test we utilized has been used in human development studies following congenital viral infection, and if so, is there is an optimal time during childhood when we would expect to find developmental abnormalities. First, the neurobehavioral assessment we used in newborn macaques is the Schneider Neonatal Assessment for Primates (SNAP) [5-9], which is based on the human newborn assessment called the Brazelton Newborn Behavioral Assessment Scale [10]. Human congenital infection researchers use the Brazelton Newborn Behavioral Assessment to define infant development after prenatal CMV exposure [11], but its use in infants with congenital Zika exposure has not been described. We selected this test because it has been well validated in macaques specifically in the neonatal age we were evaluating. The SNAP is a well known test for neonatal macaques and has been used by other researchers to define infant macaque neurobehavior in postnatal Zika virus infection [12]. Human studies of infants with congenital Zika virus exposure indicate that developmental deficits become apparent in early childhood, by about 24 months. Macaques develop faster than humans, so we hypothesize that we’d start seeing developmental deficits by 8 months of age in macaques. We will do these long-term studies in the future now that we know they are methologically and statistically feasible from this foundational study.

3. Minor point: In figure 1, the figure has the abbreviation NBAS, while the legend uses the abbreviation SNAP.

We have made this change as suggested.

4. Minor point: Could the color for the control animal be changed to bright green or something else that makes it more easily identified in the figures?

We selected the color grey to avoid color differentiation challenges for persons with red-green color blindness. We think the grey color is still apparent and nicely contrasts the ZIKV-exposed infants in multiple colors with the control infant in the non-color of grey. We hope this reviewer will understand the logic of selecting this color for the control infant.

Reviewer #4: In this paper, the authors plan to assess the methodological and statistical feasibility of a congenital ZIKV exposure macaque model for identifying infant neurobehavior and brain abnormalities that may underlie neurodevelopmental deficits

Gap presented: “no established nonhuman primate model for defining the neuropathogenesis of the most common phenotype of congenital ZIKV infection: children who develop neurodevelopmental deficits but lack the birth defects found in congenital Zika syndrome”

This is an appropriate experimental model to attempt to create. However, most of the studies that have found neurobehavioral problems in children with a history of in utero Zika virus exposure have found largest differences in neurocognitive testing is performed when at least 12-18 months old (Faiçal, A. V., et al. (2019). (Neurodevelopmental delay in normocephalic children with in utero exposure to Zika virus." BMJ Paediatr Open 3(1): e000486; Rice, M. E., et al. (2018); Vital Signs: Zika-Associated Birth Defects and Neurodevelopmental Abnormalities Possibly Associated with Congenital Zika Virus Infection - U.S. Territories and Freely Associated States, 2018." MMWR. Morbidity and mortality weekly report 67(31): 858-867.). As the authors allude to in the paper, the infant neurobehavior metrics will be best evaluated by performing the non-invasive studies proposed in this paper soon after birth and then following up with neurocognitive testing in toddler-equivalent age macaques.

We wholeheartedly agree with this reviewer that non-invasive studies performed in infancy followed by neurocognitive testing in toddler-equivalent age macaques will be the best way to identify early predictors of deficits, but in order to carry out these long-term studies successfully, we needed to demonstrate that these noninvasive studies are methodogically and statistically feasible. We describe in our introduction why a feasibility study is necessary to ensure a robust and statistically sound experimental design in long-term studies, much like how human clinical trials often begin with a feasibility study. “None of these [previous ZIKV] studies have defined long-term neurodevelopmental deficits or outlined a clear study design for how to evaluate long-term neurodevelopment in congenital ZIKV-exposed infant macaques. Such a study design needs to be well planned, with proven quantitative neurodevelopmental outcomes and sufficient sample sizes. Before long-term studies defining the pathogenesis of neurodevelopmental deficits in ZIKV-exposed macaques are undertaken, we must determine whether tests defining neurodevelopmental outcomes, such as quantitative structural brain imaging, ocular examinations and hearing tests, are feasible in infant macaques.”

We hope this reviewer will agree that performing a feasibility study to refine methods and estimate sample sizes is necessary before embarking on the expensive, long-term studies necessary for defining the pathogenesis of developmental deficits. Nonhuman primates are a precious scientific resource, especially now in the time when SARS-CoV-2 vaccine and therapeutic trials are involving significant numbers of nonhuman primates. We want to ensure that future long-term studies are optimally designed and powered to capture all necessary data points.

________________________________________

References for this Response to Reviewers

1. Yepez JB, Murati FA, Pettito M, Penaranda CF, de Yepez J, Maestre G, et al. Ophthalmic Manifestations of Congenital Zika Syndrome in Colombia and Venezuela. JAMA ophthalmology. 2017;135(5):440-5. Epub 2017/04/19. doi: 10.1001/jamaophthalmol.2017.0561. PubMed PMID: 28418539.

2. Møller AR, Burgess J. Neural generators of the brain-stem auditory evoked potentials (BAEPs) in the rhesus monkey. Electroencephalography and clinical neurophysiology. 1986;65(5):361-72. Epub 1986/09/01. doi: 10.1016/0168-5597(86)90015-8. PubMed PMID: 2427327.

3. Rice ME, Galang RR, Roth NM, Ellington SR, Moore CA, Valencia-Prado M, et al. Vital Signs: Zika-Associated Birth Defects and Neurodevelopmental Abnormalities Possibly Associated with Congenital Zika Virus Infection - U.S. Territories and Freely Associated States, 2018. MMWR Morbidity and mortality weekly report. 2018;67(31):858-67. Epub 2018/08/10. doi: 10.15585/mmwr.mm6731e1. PubMed PMID: 30091967; PubMed Central PMCID: PMCPMC6089332.

4. Mulkey SB, Arroyave-Wessel M, Peyton C, Bulas DI, Fourzali Y, Jiang J, et al. Neurodevelopmental Abnormalities in Children With In Utero Zika Virus Exposure Without Congenital Zika Syndrome. JAMA pediatrics. 2020. Epub 2020/01/07. doi: 10.1001/jamapediatrics.2019.5204. PubMed PMID: 31904798.

5. Laughlin NK, Lasky RE, Giles NL, Luck ML. Lead effects on neurobehavioral development in the neonatal rhesus monkey (Macaca mulatta). Neurotoxicology and teratology. 1999;21(6):627-38. Epub 1999/11/24. PubMed PMID: 10560769.

6. Schneider ML, Moore CF, Kraemer GW, Roberts AD, DeJesus OT. The impact of prenatal stress, fetal alcohol exposure, or both on development: perspectives from a primate model. Psychoneuroendocrinology. 2002;27(1-2):285-98. Epub 2001/12/26. PubMed PMID: 11750784.

7. Schneider ML, Roughton EC, Koehler AJ, Lubach GR. Growth and development following prenatal stress exposure in primates: an examination of ontogenetic vulnerability. Child development. 1999;70(2):263-74. Epub 1999/04/28. PubMed PMID: 10218255.

8. Schneider ML, Suomi SJ. Neurobehavioral Assessment in Rhesus Monkey Neonates (Macaca mulatta): Developmental Changes, Behavioral Stability and Early Experience. Infant Behavior and Development. 1992;15:155-77. PubMed PMID: 1002; PubMed Central PMCID: PMC1002.

9. Coe CL, Lubach GR, Crispen HR, Shirtcliff EA, Schneider ML. Challenges to maternal wellbeing during pregnancy impact temperament, attention, and neuromotor responses in the infant rhesus monkey. Developmental psychobiology. 2010;52(7):625-37. Epub 2010/10/01. doi: 10.1002/dev.20489. PubMed PMID: 20882585; PubMed Central PMCID: PMCPMC3065369.

10. Brazelton TB. Assessment of the infant at risk. Clinical obstetrics and gynecology. 1973;16(1):361-75. Epub 1973/03/01. PubMed PMID: 4575534.

11. Ancora G, Lanari M, Lazzarotto T, Venturi V, Tridapalli E, Sandri F, et al. Cranial ultrasound scanning and prediction of outcome in newborns with congenital cytomegalovirus infection. The Journal of pediatrics. 2007;150(2):157-61. Epub 2007/01/24. doi: 10.1016/j.jpeds.2006.11.032. PubMed PMID: 17236893.

12. Maness NJ, Schouest B, Singapuri A, Dennis M, Gilbert MH, Bohm RP, et al. Postnatal Zika virus infection of nonhuman primate infants born to mothers infected with homologous Brazilian Zika virus. Scientific reports. 2019;9(1):12802. Epub 2019/09/07. doi: 10.1038/s41598-019-49209-7. PubMed PMID: 31488856.

Attachment

Submitted filename: Response to reviewers 09122020.docx

Decision Letter 1

Rafael da Costa Monsanto

6 Oct 2020

Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus

PONE-D-20-18920R1

Dear Dr. Mohr,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Rafael da Costa Monsanto, M.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: No

Acceptance letter

Rafael da Costa Monsanto

12 Oct 2020

PONE-D-20-18920R1

Quantitative definition of neurobehavior, vision, hearing and brain volumes in macaques congenitally exposed to Zika virus

Dear Dr. Mohr:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Rafael da Costa Monsanto

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Scoring of representative ERG and VEP waveforms.

    These ERG and VEP waveforms were recorded simultaneously from control infant r18076. Red solid arrows: amplitude of labelled waveform features. ERG A- and VEP N2-wave amplitudes are measured relative to pre-flash voltage; ERG B-and VEP P2-wave amplitude measured from preceding A- and N2-waves, respectively (horizontal dotted line). Red dashed arrows: latency-to-peak, all measured from the onset of the flash stimulus (vertical dotted line). The neonatal rhesus photopic ERG contains a prominent short-latency wave (*) prior to the B-wave that decreases in prominence with age and was not quantified for this study.

    (TIF)

    S2 Fig. Cortical and subcortical volumetric analysis work flow and parcellations.

    (A) AutoSeg grey matter parcellation with axial (left), sagittal (middle) and coronal (right) views. (B) AutoSeg subcortical structure parcellation with axial (left), sagittal (middle) and coronal (right) views. Parcellations are overlaid on the subject T1w image, registered to the Emory-Cross 2 week infant template.

    (TIF)

    S3 Fig. Maternal viremia and antibody response.

    (A) Maternal plasma vRNA loads were measured by qRT-PCR. (B) Estimated EC90 values for serum neutralization of ZIKV assessed prior to infection, 7 dpi, 28 dpi and at maternal necropsy. (C) Estimated EC50 values for serum ZIKV IgG titers obtained prior to infection, 7 dpi, 28 dpi and at maternal necropsy. The dashed line indicates the limit of detection.

    (TIF)

    S4 Fig. PRNT and whole virion ELISA dose response curves.

    (TIF)

    S5 Fig. Fetal abdominal circumference, femur length and heart rate measurements.

    (TIF)

    S6 Fig. Infant IgM titers, body fluid viral loads and PRNTs.

    Sera from ZIKV-exposed infants were evaluated for the presence of ZIKV-specific IgM by two commercial assays: Abcam (A) and Euroimmun (B). The manufacturer provided positive and negative human IgM controls are shown in grey. Pre and post-ZIKV infection serum collected from an adult rhesus macaque (244667) was used as a species-specific positive and negative control (shown in black). The dashed line indicates the positive cutoff value for each assay. (C) Infant body fluids (plasma, urine, CSF) were assessed for the presence of ZIKV RNA by qRT-PCR at the days indicated and were negative. NA, not applicable (because no samples were available from the stillborn fetus). (D) PRNTs were performed on infant serum from day of life (DOL) 2–5 from liveborn infants and ED90 values were reported in comparison with maternal PRNT ED90 values from necropsy.

    (TIF)

    S7 Fig. Infant PRNT dose response curves.

    Infant serum was collected at the day of life (DOL) indicated.

    (TIF)

    S8 Fig. Localization of ZIKV RNA by ISH in brain tissues from ZIKV-exposed infants.

    (A) ZIKV genomic RNA (red dots) in a ZIKV-exposed murine lateral geniculate brain section (20x). ZIKV-exposed fetus/infant brain sections exposed to ZIKV RNA probe (10x) (B) 527421 cerebral cortex (rostral to LGN), (C) 499874 cerebral cortex, (D) 226691 cerebral cortex, (E) 424847 cerebrum containing the lateral geniculate nucleus, (F) 416597 cerebellar brain section.

    (TIF)

    S1 Appendix. Effect size and post-hoc sample size calculations SAS code.

    (DOCX)

    S1 Table. Infant ages at examination/evaluation and infant sex.

    (DOCX)

    S2 Table. SNAP constructs.

    (DOCX)

    S3 Table. Infant procedural sedation medication record.

    (DOCX)

    S4 Table. Histopathological description of decidua, placental bed and uterus, and placenta.

    (DOCX)

    S5 Table. Infant clinical course summary.

    (DOCX)

    S6 Table. SNAP effect sizes and sample size estimates.

    (DOCX)

    S7 Table. Ophthalmic exam summary of ZIKV-exposed and control infants.

    (DOCX)

    S8 Table. Ocular coherence tomography effect sizes and sample size estimates.

    (DOCX)

    S9 Table. Visual electrophysiology effects sizes and sample sizes estimates.

    (DOCX)

    S10 Table. Cortical and subcortical brain region volumes with sample size estimates, corrected by total brain volume or intracranial volume.

    (DOCX)

    S11 Table. Fetus/Infant tissue viral loads.

    (DOCX)

    S12 Table. Infant/fetus morphometric measurements at necropsy.

    (DOCX)

    S13 Table. Histopathological description of the lung and middle ear in fetuses/infants.

    (DOCX)

    S14 Table. Histopathological description of fetal/infant tissues excluding the lung and ear.

    (DOCX)

    S15 Table. Summary of sample size estimates for all quantitative infant exams.

    (DOCX)

    Attachment

    Submitted filename: Response to reviewers 09122020.docx

    Data Availability Statement

    Data are available: (https://go.wisc.edu/0n9g6o).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES