Skip to main content
PMC home page
PLOS ONE logoLink to PLOS ONE
. 2021 Jun 9;16(6):e0252074. doi: 10.1371/journal.pone.0252074

Development and psychometric evaluation of the CO-PARTNER tool for collaboration and parent participation in neonatal care

Nicole R van Veenendaal 1,2,*, Jennifer N Auxier 3, Sophie R D van der Schoor 1,*, Linda S Franck 4, Mireille A Stelwagen 1, Femke de Groof 5, Johannes B van Goudoever 2, Iris E Eekhout 6, Henrica C W de Vet 7, Anna Axelin 3, Anne A M W van Kempen 1,*
Editor: Elisabete Alves8
PMCID: PMC8189480  PMID: 34106929

Abstract

Background

Active parent participation in neonatal care and collaboration between parents and professionals during infant hospitalization in the neonatal intensive care unit (NICU) is beneficial for infants and their parents. A tool is needed to support parents and to study the effects and implementation of parent-partnered models of neonatal care.

Methods

We developed and psychometrically evaluated a tool measuring active parent participation and collaboration in neonatal care within six domains: Daily Care, Medical Care, Acquiring Information, Parent Advocacy, Time Spent with Infant and Closeness and Comforting the Infant. Items were generated in focus group discussions and in-depth interviews with professionals and parents. The tool was completed at NICU-discharge by 306 parents (174 mothers and 132 fathers) of preterm infants. Subsequently, we studied structural validity with confirmatory factor analysis (CFA), construct validity, using the Average Variance Extracted and Heterotrait-Monotrait ratio of correlations, and hypothesis testing with correlations and univariate linear regression. For internal consistency we calculated composite reliability (CR). We performed multiple imputations by chained equations for missing data.

Results

A 31 item tool for parent participation and collaboration in neonatal care was developed. CFA revealed high factor loadings of items within each domain. Internal consistency was 0.558 to 0.938. Convergent validity and discriminant validity were strong. Higher scores correlated with less parent depressive symptoms (r = -0.141, 95%CI -0.240; -0.029, p = 0.0141), less impaired parent-infant bonding (r = -0.196, 95%CI -0.302; -0.056, p<0.0001), higher parent self-efficacy (r = 0.228, 95%CI 0.117; 0.332, p<0.0001), and higher parent satisfaction (r = 0.197, 95%CI 0.090; 0.308, p = 0.001). Parents in a family integrated care model had higher scores than in standard care (beta 6.020, 95%CI 4.144; 7.895, p<0.0001) and mothers scored higher than fathers (beta 2.103,95%CI 0.084; 4.121, p = 0.041).

Conclusion

The CO-PARTNER tool explicitly measures parents’ participation and collaboration with professionals in neonatal care incorporating their unique roles in care provision, leadership, and connection to their infant. The tool consists of 31 items within six domains with good face, content, construct and structural validity.

Introduction

Active parent participation in neonatal care during infant hospitalization in the neonatal intensive care unit (NICU) can ameliorate adverse outcomes for infants and their parents [1–7]. Through parent participation in neonatal care, parents can be a central part of the NICU care team, gain confidence in taking care of their infant, and prepare themselves for discharge [8, 9]. Although the NICU has been incorporating parent involvement practices for decades, attention directed toward parent-partnered models fidelity and implementation through the examination of active parent participation and integration into care teams is currently lacking [2].

Several tools have been developed and used to assess parent participation in the pediatric care setting [10–12]. In the neonatal setting, studies have mainly focused on constructs related to parent participation [13] such as the passive construct of (time) being present in the NICU or holding the infant [14–17], and healthcare professional recordings of parent competencies and activities [17, 18]. Other tools have focused on aspects such as feeling guided or supported by healthcare professionals [19] or constructs related to maternal knowledge, confidence, expectations and social support within infant care engagement and risk evaluation [13, 20–22].

However, all aforementioned tools lack the assessment of parent active participation, and the inherent collaborative partnerships and processes that are currently changing the NICU environment from healthcare-led to parent-led infant care [2]. Most tools have also not included fathers from initial development. It is important to have validated tools to measure levels of parent participation and collaboration in the NICU to tailor care practices in real-time, to be able to assess parent-partnered care models such as family integrated care (FICare) [2, 3]. Above all, a broader measure is needed, that is not only centred around risk-evaluation but can also be used in a strengths-based approach to promote parent active participation in care and achieve better outcomes for infants and their parents.

In this study we developed and psychometrically evaluated the CO-PARTNER tool measuring parent participation and inherent collaboration with healthcare professionals in neonatal care during NICU hospitalization.

Methods

This psychometric study was conducted before and during a multicentre non-randomized prospective study on the effects of FICare on infants and their parents in a NICU level 2 context in the Netherlands [23], including a group of parents and infants who experienced family integrated care (FICare) in single family room units and a group who experienced standard care in open bay units (the AMICA study, see S1 Appendix of S1 File for details on FICare and standard care in the different participating units). In the AMICA study, preterm infants admitted for at least 7 days to one of the participating wards and their parents were included. The primary outcome in the AMICA study was the effect of FICare in single family rooms on neurodevelopment of preterm infants. In the AMICA study, outcomes in parents (mothers and fathers separately) were also included as secondary outcomes in the short and longer term [23]. We excluded families if mothers or fathers had severe psychosocial problems (for instance acute psychiatric illness or if a family was under supervision of social services etc.), if death of a sibling occurred or if a congenital or metabolic syndrome was present in the infant.

Before conduct of the AMICA study, we considered parent active participation as a possible mediator in the pathway between the FICare-setting and improved health outcomes (for mothers, fathers and infants). However, as no validated measure of parent participation existed, we decided to conduct the generation, validation and psychometric evaluation of the CO-PARTNER tool before and during the AMICA study. We first included parents and healthcare professionals in the item generation phase using purposive sampling in May 2016-April 2017. For the validation and psychometric evaluation, we included parents who participated in the AMICA study and who filled out the CO-PARTNER tool at hospital discharge of their infant. Recruitment of the AMICA study took place May 2017-January 2020. The medical ethical review board of MEC-U in Nieuwegein, The Netherlands, approved the study and all parents provided written informed consent. The work described has been carried out in accordance with The Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving humans. The AMICA trial was registered on the 23rd of December 2016 in the Netherlands Trial Registry NL6175 [23].

We used the quality checklist developed for the reporting of health-related-patient reported outcomes [24] for this study. The primary outcomes for this study were content validity, structural validity, and construct validity of the CO-PARTNER tool.

Description of the construct to be measured

We adapted the definition as proposed by Power and Franck for parent participation, including the unique roles parents have during infant NICU stay and the process of collaboration with staff for developing capacity to perform activities independently [25]. Parent participation is defined as “The activities performed by a parent/guardian for their infant in the hospital setting in which they share, take part or independently act in the care of their infant across the entire hospital episode. Activities are defined as physical, psychological, or social performed by parents to improve the health and/or psychological well-being of their infant, with or without collaboration with healthcare professionals.” We developed a formative measure to the concept of parent participation.

Content validity

The Index of Parent Participation (IPP, developed for paediatric care) [11] questionnaire was used as a starting point as many of the 36 items could be completed by parents during infant hospitalization in the NICU.

Item generation

Two researchers (NvV and SvdS) independently and blind from each other extracted relevant items from the IPP [11] for the NICU setting. We simultaneously consulted the original author of the IPP on which items of the 36 in the original IPP could be applied to a NICU care context (see acknowledgments). This resulted in 26 items to be included in the item generation phase. Focus groups, one-on-one interviews and scoring of the instrument was performed with a purposive sample of six healthcare professionals and forty-five parents. Healthcare professionals included a speech therapist experienced in FICare and nurses and midwives who either worked at the FICare or the standard care unit, with a large range in working experience (8 to 30 years in profession). Parents (mothers or fathers >18 years of age) had a preterm infant (born at a gestational age between 24 weeks—36 6/7 weeks), were at the time experiencing or had experienced a NICU stay in the previous 2 years, and had experience in either a standard or FICare unit participating in the AMICA trial. Parents and professionals were approached by independent researchers. Specifically for parents, the researchers were not involved in the care of their infants. Participants were asked to identify (additional) items on parent participation. Above, we investigated their views on content of items, how response options to items should be presented and on the rightful inclusion of the 26 items from the original IPP in the first version of the tool [26]. Participants were asked to score items (during generation from the original IPP, focus groups or one-on-one interviews) as; (1) relevant or not relevant in light of parent participation in the NICU; (2) if the items needed a yes/no response, or if the items had to be scored on a scale and were intended to examine a collaborative process in care towards being able to perform activities independently (‘the nurse does this’, ‘the nurse and I do this together’ and ‘I do this independently’). Inclusion of participants ended after no new items were identified and consensus was reached on item responses.

The research team, healthcare professionals and parent consultants identified a total of 88 relevant items that could be considered meaningful to the concept of parent participation and the process of collaboration in the NICU context. Two neonatologists, a researcher specialized in parent empowerment, and one neonatal nurse (see acknowledgments), independently and blind from each other, scored the items as to their applicability to the concept of parent participation and collaboration in the NICU. If at least 3 out of 4 experts rated the item as relevant, it was included in the CO-PARTNER tool. A total number of 34 items were generated during the item generation phase but three items were dropped during the analysis phase (see Structural validity) resulting in a total of 31 items included.

Conceptualizing six domains

After item generation research members consulted together on concept use, and current state in the literature [2, 5, 27]. Language considerations are described in the S2 Appendix of S1 File. The research team identified the definition of parent participation to be multidimensional and items were applied to each domain based on informal consensus in an empirical and iterative process.

The six domains are based upon essential parent participation, collaboration and role within the NICU context: (1) Daily Care; (2) Medical Care; (3) Acquiring Information; (4) Parent Advocacy; (5) Time Spent with Infant; and (6) Closeness and Comforting the Infant (See Table 1).

Table 1. CO-PARTNER tool.
Activity Response
Domain 1. Daily Care
1. Bath my child/clean my child with a washcloth. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
2. Change my child’s diaper. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
3. Feed my child (breast or bottle). o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
4. Change my child’s clothing. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
5. Get my child out of the incubator/cradle. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
6. Give my child medication. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
7. Weigh my child. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
8. Keep track of output (urination and defecation) of my child o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
9. Measure the temperature of my child. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
10. Keep track of my child’s weight. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
11. Keep track of drinking and my child’s feeds. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
Domain 2. Medical Care
12. Give tube feeding to my child. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
13. Look at my child’s monitor and handling accordingly (e.g. stimulating during a bradycardia). o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
14. Regulate the visiting of others to my child. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
15. Participate in the daily rounds with the doctor. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
Domain 3. Acquiring Information
16. Did you ask healthcare professionals information on the health of your child? o Yes
o No
17. Did you ask the healthcare professionals for information about your child for times when you were not present? o Yes
o No
18. Did you talk with another parent about your experiences? o Yes
o No
Domain 4. Parent Advocacy
19. I stood up for my child; I told somebody to do something in the care of my child. o Yes
o No
20. I stood up for my child; I told somebody NOT to do something in the care of my child; I gave boundaries o Yes
o No
21. I gave an explanation on the daily routines of my child to a healthcare professional. o Yes
o No
Domain 5. Time Spent with Infant
22. On average, how many hours were you present in the hospital with your child? Number of hours per day:
23. On average, how many hours a day do you have contact with your child? Number of hours per day:
24. On average, how many hours were you really close with your child? Number of hours per day:
Domain 6. Closeness and Comforting the Infant
25. Hold/rock/cuddle my child. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
26. Comfort my child whenever he/she needs it. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
27. Kangaroo care / skin to skin contact. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
28. Be together with my child, be close with my child (intimate time). o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
29. Be together with my child (be present). o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
30. Soothe my child during a painful procedure (for instance drawing blood). o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
31. Recognize my child’s signals. o The nurse does this
o I do this together with the nurse
o I do this independently (without the help of the nurse)
o This is not applicable
Open in a new tab

Domains 1 and 2 consist of 11 and 4 items, respectively, and measure the nature of parent participation in activities of daily care and medical care. The degree of collaboration between parents and healthcare professionals is indicated by the response options. These items are measured on a 3-point scale (e.g. I do this myself/independently; I do this together with the nurse; or The nurse does this) or scored as “This was not applicable”. The following three items measure Acquiring Information and the next three items measure the nature of Parent Advocacy activities while caring for their child in the NICU. Questions are answered either yes or no. Three questions pertain to the amount of Time Spent with Infant in the NICU. This domain represents the mean time over the hospital stay that parents reported to be present and felt close with their child per day in hours. Seven items pertain to Closeness and Comforting the Infant, and include activities such as comforting the infant during painful procedures and kangaroo care, and the process of collaboration with staff is visible through the response options.

Data collection

The tool was evaluated by fathers and mothers of infants enrolled in the AMICA study, a prospective non-randomized study evaluating the effect of a family integrated care model in level 2 NICUs in the Netherlands (see S3 Appendix of S1 File for an elaborate description of the neonatal population and caregiving practices in the Netherlands). Questionnaires were sent using Castor Electronic Data Capturing [28] at admission and at discharge from the level 2 NICU. In the case of families with multiple births, fathers and mothers received 1 questionnaire per time point. Parents received 2 reminders if they did not fill out the questionnaire (1 and 2 weeks after the initial questionnaire was sent). All parents completed a survey package that included the tool and additionally, surveys on perceived stress in the NICU (PSS-NICU) [29], depression and anxiety [30] (HADS), parent-self-efficacy (PMP-SE) [31], satisfaction and empowerment (subscale on parent participation, EMPATHIC-N) [32], and impaired parent-infant bonding (PBQ) [33] (see S4 Appendix of S1 File for details on the characteristics of the questionnaires).

Statistical analyses

Sample size calculation

We performed a sample size calculation for the AMICA study for the primary outcome of neurodevelopment in preterm infants at 2 years of age corrected for prematurity (See S5 Appendix of S1 File for details on the sample size calculation [23]). We included sufficient parents for our psychometric analyses, as we had 10 participant responses per item [34].

Dealing with non-applicable responses and missing data

We used the proposed guidance as explained by Sterne et al. [35] for missing data and applied the multivariate imputation by chained equations (mice) procedure with parcel summary scores to missing data at the item level [36]. Imputed datasets were used for further analyses [37], including confirmatory factor analysis (CFA) and construct validity [38]. We performed sensitivity analyses for data considered missing if participants did not fill out a question, or if items were scored as “this was non-applicable”. For all datasets we performed 10 imputations and 50 iterations to obtain imputed datasets (see S6 Appendix of S1 File for variables included in the missing data model). Convergence was checked graphically with stripplots for Domain 1, 2, 3, 4 and 6, and convergence plots for Domain 5. Pooled estimates for further analyses were derived applying Rubin’s Rules [39, 40].

Structural validity

Confirmatory factor analysis. Confirmatory factor analysis was done on imputed datasets using structural equation modelling. We used diagonally weighted least squares (DWLS). The DWLS approach uses the weighted least squares (WLS) estimator with polychoric correlations as input to create the asymptotic covariance matrix [41]. We calculated the following fit measures: comparative fit index (CFI), Tucker-Lewis index (TLI), Root Mean Square Error of Approximation (RMSEA) and the (Standardized) Root Mean Square Residual (SRMR) [42].

Internal consistency. We calculated composite reliability (CR) for each domain to assess internal consistency, as the CR is calculated from factor loadings and acknowledges the possibility of heterogeneous item-construct relations and estimates true score variance from the factor loadings resulting in more precision for multilevel confirmatory factor analyses than the commonly used Cronbach’s alpha [43]. Desirable values for CR are between 0.6 and 0.9 [44].

Construct validity

Distinctiveness between domains. We analyzed construct validity by using the Average Variance Extracted and Heterotrait-Monotrait criterion [44]. First, we determined the Average Variance Extracted (AVE) which informs how closely each domain is related based on the item characteristics within each domain, the AVE should be greater than 0.05 to be acceptable [44]. To examine the distinctiveness between domains we performed Heterotrait-Monotrait (HTMT), a new method that measures a ratio of correlation [44]. The HTMT method has emerged as a discriminant validity method that has been shown to achieve higher sensitivity and specificity (99% and 97%) than the commonly used cross-loadings and Fornell-Lacker methods [44]. We set our threshold for the HTMT analysis at 0.85 [44].

Total scoring. Total scores per domain were obtained by summing scores for hypothesis testing. For Domain 1, 2 and 6 we calculated 0 for ‘The nurse does this’, 1 for ‘The nurse and I do this together’ and 2 for ‘I do this independently’ (minimum scores 0 to 22, 8 and 14 respectively), indicating the positive inherent relationship between participation and collaboration. We performed sensitivity analyses on non-applicable items, either transforming them to 0 (no participation in this item) indicating that parents did not participate or did not experience an item or to missing before multiple imputation (and thus rendering a 0,1, or 2 value after multiple imputation). For domain 3 and 4 ‘yes’ was scored as 1, and ‘no’ as 0 (minimum scores 0 to maximum 3). For the domain Time Spent with Infant (3 items) we performed sensitivity analyses including the items as scored originally (minutes or hours of relevant items) or as quartiles (minimum 0 maximum 12). Quartiles were calculated in imputed datasets. A total participation score was obtained by summing all domain scores. Minimum total scores were 0 and maximum 62.

Hypotheses testing. We calculated Pearson correlation coefficients (rho) and associations for hypothesis testing. We set up 5 hypotheses. A priori, we hypothesized (Hypothesis 1) that the total score would have a negative correlation with parent well-being outcomes such as depression and anxiety, of -0.3 to -0.5, meaning that if parents were depressed or anxious, they would demonstrate lower active parent participation. Contrarily, Hypothesis 2 was that the total score would have a positive correlation with self-efficacy and satisfaction and empowerment, of +0.3 to +0.5. We used univariate linear regression analysis to compare groups and test for associations. We stated that (Hypothesis 3) the CO-PARTNER-tool would be able to discriminate between high and low parent presence (Domain 5) and participation (total score) within the trial on the effect of FICare in SFR on parent and infant outcomes [23]. Also, we anticipated (Hypothesis 4) that mothers would be more present (Domain 5) than fathers, as fathers in the Netherlands had on average 2–5 days of paternity leave, and resume to work quickly after birth during conduct of the study [45]. The last hypothesis (Hypothesis 5) was that parents who were more present (Domain 5), would participate more in daily care (Domain 1).

Statistical packages and software

We used R for statistical analyses (version 3.6.1) [46] for missing data analysis the ‘mice’-package [47], for confirmatory factor analysis the ‘lavaan’-package and ‘semTools’-package [48, 49]. For all tests, a p-value of less than 0.05 was considered statistically significant.

Results

During the conduct of the AMICA study, 1213 preterm infants were assessed for eligibility. In total, 309 families were included, with 358 infants, 296 mothers and 263 fathers (Fig 1). One hundred and seventy-four out of 296 included mothers and 132 out 263 included fathers (response rates 58.8% and 50.2% respectively) filled out the questionnaire on parent participation and collaboration at NICU discharge of their infant and were included in this psychometric study (see S7 Appendix of S1 File on parent responses to the CO-PARTNER tool). There were 233 infants within 205 families. The median gestational age of their infants was 33+3 weeks, and parents filled out the CO-PARTNER tool at a median postmenstrual age of their infants of 37+1 weeks. Baseline characteristics of the sample are outlined in Table 2.

Fig 1. Flow diagram of study.

Fig 1

Open in a new tab

Table 2. Baseline characteristics of the sample.

Included (n = 306 parents) Missing (n (%))
Mothers (n (%)) 174 (56.9) 0
Admitted to FICare setting (n, (%)) 157 (51.3) 0
Gestational age of infant at birth (weeks+days, median (IQR), range (min- max)) 33+3, (31+0–34+6), (24+5–36+6) 0
Postmenstrual age of infant at discharge to home (weeks+days, median (IQR)) 37+1 (36+4–38+0) 0
Age (years, mean (SD)) 34.4 (4.7) 7 (2.3)
Higher education level (n, (%)) 273 (89.2) 14 (4.6)
Employed (n, (%)) 259 (84.6) 14 (4.6)
Work hours per week (mean (SD)) 38 (7.4) 2 (0.7)
Identifies with Dutch background (n, (%)) 270 (88.2) 9 (2.9)
Attended FICare sessions (n, (%)) 64/157 (40.8) 27 (8.8)
Supported by child psychologist during NICU stay (n, (%)) 73 (23.9) 42 (13.7)
Intends to raise child with partner (n, (%)) 277 (90.5) 15 (4.9)
Single parent (n, (%)) 8 (2.6) 15 (4.9)
First child upbringing (n, (%)) 209 (68.3) 13 (4.2)
Level of experienced stress during pregnancy (scale 1–5) (mean (SD)) 2.2 (1.2) 9 (2.9)
Level of experienced stress during birth (scale 1–5) (mean (SD)) 2.8 (1.3) 12 (3.9)
Anxiety and depression score at discharge (median, IQR) 7 (4–12) 23 (7.5)
Self-efficacy score at discharge (mean, SD) 63 (8.9) 29 (9.5)
Parent NICU stress score at discharge (total, mean (SD)) 47.0 (23.6) 23 (7.5)
Impaired parent-infant bonding score at discharge (median, IQR)) 8 (4–13) 13 (4.2)
Parent participation in EMPATHIC-N score (median, IQR) 5.6 (5.1–6.0) 10 (3.3)
Open in a new tab

n: number, FICare: family integrated care, NICU: neonatal intensive care unit, SD: standard deviation.

Structural validity. Three items were removed, and included items highly correlated with each other (“Keep track of defecation of my child” and “Keep track of urination of my child”, transformed into “Keep track of output (urination and defecation) of my child”) and two items were deemed redundant in the analysis phase by the author group (“Walking a small round with my child if it is permitted” and “On average, how many minutes did you perform skin-to-skin per day?”). A total of 31 items were used in CFA. The fit parameters demonstrated good to moderate fit, CFI and TLI were 0.923 and 0.914, respectively, RMSEA 0.030 (90%CI: 0.021; 0.037), and SRMR (0.129). Factor loadings for domains are described in Table 3. Sensitivity analyses for missing data, revealed that model fit was better without transforming the non-applicable items to missing (see S8 Appendix of S1 File for sensitivity analyses). The overall model fit increased if the domain Time Spent with Infant (Domain 5) was scored with quartiles.

Table 3. Factor loadings after confirmatory factor analysis.

Domain Factor loading Standard Error
Domain 1. Daily Care
1. Bath my child/clean my child with a washcloth. 0.508 0.058
2. Change my child’s diaper. 1.003 0.046
3. Feed my child (breast or bottle). 0.681 0.068
4. Change my child’s clothing. 0.862 0.061
5. Get my child out of the incubator/cradle. 0.640 0.084
6. Give my child medication. 0.714 0.044
7. Weigh my child. 0.652 0.043
8. Keeping track of output (urination and defecation) of my child 0.775 0.033
9. Measure the temperature of my child. 0.777 0.040
10. Keep track of my child’s weight. 0.775 0.033
11. Keep track of drinking and my child’s feeds. 0.790 0.031
Domain 2. Medical Care
12. Give tube feeding to my child. 0.537 0.071
13. Look at my child’s monitor and handling accordingly (e.g. stimulating during a bradycardia). 0.424 0.079
14. Regulate the visiting of others to my child. 0.591 0.093
15. Participate in the daily rounds with the doctor. 0.399 0.072
Domain 3. Acquiring Information
16. Did you ask health care professionals information on the health of your child? 0.84 0.198
17. Did you ask the healthcare professionals for information about your child for times when you were not present? 0.584 0.167
18. Did you talk with another parent about your experiences? 0.671 0.117
Domain 4. Parent Advocacy
19. I stood up for my child; I told somebody to do something in the care of my child. 0.775 0.071
20. I stood up for my child; I told somebody NOT to do something in the care of my child; I gave boundaries 0.747 0.064
21. I gave an explanation on the daily routines of my child to a healthcare professional. 0.913 0.070
Domain 5. Time Spent with Infant
22. On average, how many hours per day were you present in the hospital with your child? 0.946 0.122
23. On average, how many hours per day do you have contact with your child? 0.98 0.128
24. On average, how many hours per day were you really close with your child? 0.799 0.132
Domain 6. Closeness and Comforting the Infant
25. Hold/rock/cuddle my child. 0.943 0.057
26. Comfort my child whenever he/she needs it. 0.511 0.102
27. Kangaroo care / skin to skin contact. 0.487 0.066
28. Be together with my child, be close with my child. (intimate time). 0.566 0.095
29. Be together with my child (be present). 0.995 0.048
30. Soothe my child during a painful procedure (for instance drawing blood). 0.653 0.055
31. Recognize my child’s signals. 0.665 0.064
Open in a new tab

The domains Acquiring Information (Domain 3) and Parent Advocacy (Domain 4) were initially included and evaluated as one domain (Advocacy). CFA revealed low factor loadings of Acquiring Information items to the overall domain of Advocacy. Post-hoc, better loadings were achieved when items were within the domain of Acquiring Information.

Factor loadings were 0.508 or higher in Daily Care (Domain 1, range 0.508–1.003). Within Medical Care (Domain 2) factor loadings ranged between 0.399 and 0.591. Acquiring Information (Domain 3) and Parent Advocacy (Domain 4) had overall good representation and items within the domain on Time Spent with Infant (Domain 5) loaded all above 0.7. The Closeness and Comforting the Infant domain showed overall factor loadings equal to or above 0.65, three items were low (between 0.487–0.566). The three lower items were, “Soothe my child during a painful procedure (for instance drawing blood)”; “Skin to skin contact”; and “Comfort my child whenever he/she needs it”. CR scores were strong in Daily Care (Domain 1, CR: 0.934), Acquiring Information (Domain 3, CR: 0.745), Parent Advocacy (Domain 4, CR: 0.855); Time Spent with Infant (Domain 5, CR:0.839) and Closeness and Comforting the Infant (Domain 6, CR: 0.871). CR within participation in Medical Care showed results just outside desirable ranges (Domain 2, CR: 0.558, see S9 Appendix of S1 File for CR scores).

Construct validity. The Average Variance Extracted and HTMT demonstrated strong construct validity and distinctiveness of domains (see S10 Appendix of S1 File for construct validity and distinctiveness outcomes). The direction of correlation between total and domain scores met our prespecified hypotheses (Fig 2 and S11 Appendix of S1 File for outcomes of hypotheses testing). Negative correlations were present between total and domain scores on the CO-PARTNER tool with depression and impaired parent-infant bonding (Hypothesis 1). No correlations were found between the CO-PARTNER tool and parent NICU stress (total and domain scores). We found positive correlations for total and domain scores between parent participation and parent self-efficacy and parent satisfaction and empowerment (Hypothesis 2).

Fig 2. Results of hypothesis testing.

Fig 2

Open in a new tab

Scatterplot and boxplot values are shown from the first imputed dataset. Correlation coefficients and significance are pooled outcomes from all imputed datasets. r: correlation coefficient (Pearson’s rho).

We confirmed our Hypothesis 3 that parents in the FICare group participated more, they had significantly higher total CO-PARTNER total scores (beta 6.020, 95%CI 4.144; 7.895, p<0.0001). Also, parents in FICare had higher subdomain scores than parents in the standard care group (including time being present, Domain 5), except for Domain 3 (Acquiring Information, see S11 Appendix of S1 File). Likewise (Hypothesis 4), mothers had higher CO-PARTNER scores than fathers (beta 2.103, 95%CI 0.084; 4.121, p = 0.041). Overall, parents who were present more (Domain 5) participated more in daily care (Hypothesis 5, Domain 1, beta 0.390, 95%CI +0.240; + 0.540, p<0.0001, see S11 Appendix of S1 File for outcomes of hypothesis testing).

Discussion

To our knowledge, this is the first study to perform rigorous instrument development and psychometric testing methodology to develop a measure of parent participation and inherent collaboration with healthcare staff in neonatal care. The six domains of this tool explicitly measure parents’ participation and collaboration with care providers in their unique roles in care provision, leadership, and connection to their infant.

The psychometric evaluation demonstrated good content, construct and structural validity of the CO-PARTNER tool to the construct of parent participation in neonatal care. Overall, it was able to measure our pre-specified hypotheses. However, the factor loadings within Domain 2 (Medical Care) were not as desirable as we had hypothesized beforehand. This domain represents areas of care that are associated with hospital unit specific tasks and might contain items that parents were not familiar with (yet), insufficiently coached into, or in which nurses were not comfortable supporting parents in. There might also be individual preferences or variations to what extent parents want to participate in medical care. Parent participation in medical care is rapidly evolving and a new area of neonatal care that needs to be further explored. Specifically, the item on daily rounds should be studied more carefully as parents’ desired role could be different from their actual role, possibly explaining the low factor loading within that domain [8]. Nevertheless, from a FICare perspective, parent active participation in daily rounding is key and therefore should be incorporated in the tool. Equally, the closeness and comforting items were loading satisfactory but not excellent. These questions have been formed with a collaborative component (in the item generation phase) when in fact the collaboration between parents and healthcare professionals might not be a relevant component for these items.

The CO-PARTNER tool encompasses elements of parent participation such as time spent with the infant, closeness with infant, collaboration and competencies in daily care activities that have been previously measured separately [14–18]. The CO-PARTNER tool included fathers from initial conception, which provided insight into their specific needs and support to feel comfortable and competent in caring for their baby. In contrast to previous tools, our newly developed tool incorporates collaborative features explicitly describing and incorporating the process of collaboration between parents and healthcare professionals within daily and medical care and decision-making for hospitalized neonates, in alignment with the construct to be measured [2]. Above, one of the main strengths is, that the tool was developed in close collaboration with parents, ensuring face and content validity. The tool was also acceptable and feasible for parents to fill out, with an average missingness in items of 2.3%, with 4 items >5% missingness and a maximum of 8.9%.

The findings from this study should be considered in light of its limitations. First, the CO-PARTNER tool is unable to distinguish between different kinds of collaboration, as that would increase the data collection burden. However, collaboration details can be explored within the context of trusting relationships between nurses and families. Together they could view results of the CO-PARTNER tool and consider the parent development towards performing activities independently as an examination of their collaborative processes during NICU hospitalization of their infant. Second, learning is not explicitly assessed with the tool. For instance (learning how to) feed a preterm or sick neonate can be technically challenging and parents develop skills over time [50]. The answer option “the nurse and I do this together” can be seen as a proxy for a learning scale, eventually resulting in parents feeling competent to do this independently. As the level of learning is different from the level of collaboration the tool is unable to measure learning processes directly. Another limitation is that the directions of correlations between the total participation score met our pre-specified hypotheses but were not strong. This could be due to the fact that the constructs for which we assessed the correlation were different. The correlation between depression and participation is expected to be much weaker than the correlation of the scores of the CO-PARTNER tool with another patient participation instrument, but this was not assessed within this study as no such tool was available. Within this psychometric study, we did not adjust for clustering within families but included fathers and mothers as separate individuals. Therefore, the possibility of non-independence of a couple’s responses cannot be ruled out [51] and should be explored in future studies. Also, parents who completed the tool were highly educated, and therefore future studies should include a more diverse sample of mixed levels of educated parents to validate our results.

The CO-PARTNER tool can be used to support quality improvement by health organizations, practitioners, and care specialists working within various NICU settings and with different models of (parent-partnered) care. This tool could potentially be used for benchmarking across and comparing settings. All items included in the CO-PARTNER tool can be performed by parents and this should be fully supported by units, as is advocated by parent representatives and the WHO [52, 53]. With CO-PARTNER scores parents can provide actionable quantitative data on the level of parent participation in care, with lower scores suggesting more tasks performed solely by healthcare professionals without participation of parents. Equally, the CO-PARTNER tool can potentially enable comparison of parent-partnered care practices and to study (health) outcomes in infants and their parents through, for instance, mediation analysis [54].

For clinical practice we envision that there is no summing of total scores, as the measure is intended to be a guide in understanding each parent’s unique style of caring and participation and identify gaps in the culture of the unit. One could consider adding open-ended free-text questions to allow participants to explain some difficulties in their own words. However, for research and benchmarking between units total scoring can be meaningful; measuring parent participation in total or within subdomains can inform if interventions are needed to ameliorate family care practices. By measuring parent participation, researchers and parents can identify which collaborative practices are occurring in the NICU, which items are deemed not applicable by the parents, and subsequently work together to develop individualized strategies for improving parent participation rather than simply reporting quantity and types of tasks completed by parents.

Future research should focus on use of the tool in different settings (for instance in level 3 units), different countries, different intercultural contexts (for instance immigration, language or lower levels of education) and different resource settings (for instance in units relying on care delivery by families out of necessity), and with parents of infants with a wider range of diagnoses to determine if further adaptation is needed to account for context. It would also be interesting to evaluate the inter-rater-reliability between perspectives of parents and nurses on the items in this tool, which could enable an assessment of nurses’ ability to collaborate with parents and enable parents’ participation and tailor education programs further if deemed insufficient for parents or healthcare professionals. Likewise, the CO-PARTNER tool could be studied to evaluate progress within parents (beginning and end of hospital stay) or to evaluate changes in parent participation and collaboration after implementation of education programs for parents and healthcare professionals. Above, analyses of non-applicable items and their meanings related to unit culture could be studied further, preferably in mixed-method research understanding qualitative features of hospital care culture.

Conclusions

The CO-PARTNER tool is able to assess parent participation and the collaborative process between parents and healthcare professionals in the NICU for research and in care. The CO-PARTNER tool, developed on the basis of participation theory and with parent engagement design methods, can reignite health organizations’ motivation toward researching, monitoring and implementing parent-delivered and parent support interventions in the NICU. The tool could serve as a standard measurement for parent-partnered interventions in the neonatal care unit.

Supporting information

S1 File

(DOCX)

Click here for additional data file. (305.2KB, docx)

Acknowledgments

We would like to acknowledge the help of professor B. Melnyk in her guidance and help during the development of this tool. Dr. W. Heideman in her help during the initial development of the tool. Professor J. Latour for his guidance in scoring of the EMPATHIC-N questionnaire. Mrs. Z. Borger, neonatal nurse, for her help during item selection.

Data Availability

There are ethical and legal restrictions on sharing a de-identified data set. Data from the study are available upon request, as there are legal and ethical restrictions on sharing these data publicly due to the data containing sensitive and identifiable information. The data set contains information like birthweight and gestational age of infants and information on parents - information that could be used to link and identify individuals, in relation with the information that the study was conducted in Amsterdam, the Netherlands. Above, sensitive information includes data on depression, anxiety, and stress in parents. In the informed consents signed by the parents and guardians of the infants of this study and granted by the regional committee for medical ethics in Nieuwegein, The Netherlands, guardians were not asked about data sharing. Researchers interested in the data may contact the Privacy protection officer in OLVG (fg@olvg.nl) and the ethics committee that approved the study (info@mec-u.nl) and provide the reference: NL ABR 56691.

Funding Statement

NvV is supported by an unrestricted research grant, provided by Nutricia, the Netherlands during the conduct of the study. AvK, SvdS and FdG are supported by a research grant, provided by Nutricia, the Netherlands outside the submitted work. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Ahlqvist-Björkroth S, Axelin A, Korja R, Lehtonen L. An educational intervention for NICU staff decreased maternal postpartum depression. Pediatr Res. 2019;85: 982–986. doi: 10.1038/s41390-019-0306-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Franck LS, O’Brien K. The evolution of family‐centered care: From supporting parent‐delivered interventions to a model of family integrated care. Birth Defects Res. 2019; bdr2.1521. doi: 10.1002/bdr2.1521 [DOI] [PubMed] [Google Scholar]
  • 3.O’Brien K, Robson K, Bracht M, Cruz M, Lui K, Alvaro R, et al. Effectiveness of Family Integrated Care in neonatal intensive care units on infant and parent outcomes: a multicentre, multinational, cluster-randomised controlled trial. Lancet Child Adolesc Heal. 2018;2: 245–254. doi: 10.1016/S2352-4642(18)30039-7 [DOI] [PubMed] [Google Scholar]
  • 4.van Veenendaal NR, Heideman WH, Limpens J, van der Lee JH, van Goudoever JB, van Kempen AAMW, et al. Hospitalising preterm infants in single family rooms versus open bay units: a systematic review and meta-analysis. Lancet Child Adolesc Heal. 2019;3: 147–157. doi: 10.1016/S2352-4642(18)30375-4 [DOI] [PubMed] [Google Scholar]
  • 5.van Veenendaal NR, van Kempen AAMW, Franck LS, O’Brien K, Limpens J, van der Lee JH, et al. Hospitalising preterm infants in single family rooms versus open bay units: A systematic review and meta-analysis of impact on parents. EClinicalMedicine. 2020;23. doi: 10.1016/j.eclinm.2020.100388 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Young A, McKechnie L, Harrison CM. Family integrated care: What’s all the fuss about? Arch Dis Child Fetal Neonatal Ed. 2019;104: 118–9. doi: 10.1136/archdischild-2018-315307 [DOI] [PubMed] [Google Scholar]
  • 7.Caporali C, Pisoni C, Gasparini L, Ballante E, Zecca M, Orcesi S, et al. A global perspective on parental stress in the neonatal intensive care unit: a meta-analytic study. Journal of Perinatology. J Perinatol; 2020. pp. 1739–1752. doi: 10.1038/s41372-020-00798-6 [DOI] [PubMed] [Google Scholar]
  • 8.Axelin A, Outinen J, Lainema K, Lehtonen L, Franck LS. Neonatologists can impede or support parents’ participation in decision-making during medical rounds in neonatal intensive care units. Acta Paediatr Int J Paediatr. 2018;107: 2100–2108. doi: 10.1111/apa.14386 [DOI] [PubMed] [Google Scholar]
  • 9.Gooding JS, Cooper LG, Blaine AI, Franck LS, Howse JL, Berns SD. Family support and family-centered care in the neonatal intensive care unit: origins, advances, impact. Semin Perinatol. 2011;35: 20–28. doi: 10.1053/j.semperi.2010.10.004 [DOI] [PubMed] [Google Scholar]
  • 10.Jones DC. Effect of parental participation on hospitalized child behavior. Issues Compr Pediatr Nurs. 1994;17: 81–92. doi: 10.3109/01460869409078293 [DOI] [PubMed] [Google Scholar]
  • 11.Melnyk BM. Coping with unplanned childhood hospitalization: effects of informational interventions on mothers and children. Nurs Res. 1994;43: 50–55. [PubMed] [Google Scholar]
  • 12.Melnyk BM, Alpert-Gillis L, Feinstein NF, Crean HF, Johnson J, Fairbanks E, et al. Creating opportunities for parent empowerment: program effects on the mental health/coping outcomes of critically ill young children and their mothers. Pediatrics. 2004;113. doi: 10.1542/peds.113.6.e597 [DOI] [PubMed] [Google Scholar]
  • 13.Samra HA, Mcgrath JM, Fischer S, Schumacher B, Dutcher J, Hansen J. The NICU parent risk evaluation and engagement model and instrument (PREEMI) for neonates in intensive care units. JOGNN—J Obstet Gynecol Neonatal Nurs. 2015;44: 114–126. doi: 10.1111/1552-6909.12535 [DOI] [PubMed] [Google Scholar]
  • 14.Aija A, Toome L, Axelin A, Raiskila S, Lehtonen L. Parents’ presence and participation in medical rounds in 11 European neonatal units. Early Hum Dev. 2019;130: 10–16. doi: 10.1016/j.earlhumdev.2019.01.003 [DOI] [PubMed] [Google Scholar]
  • 15.Raiskila S, Axelin A, Toome L, Caballero S, Tandberg BS, Montirosso R, et al. Parents’ presence and parent–infant closeness in 11 neonatal intensive care units in six European countries vary between and within the countries. Acta Paediatr Int J Paediatr. 2017;106: 878–888. doi: 10.1111/apa.13798 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Garten L, Maass E, Schmalisch G, Bührer C. O father, where art thou?: Parental NICU visiting patterns during the first 28 days of life of very low-birth-weight infants. J Perinat Neonatal Nurs. 2011;25: 342–348. doi: 10.1097/JPN.0b013e318233b8c3 [DOI] [PubMed] [Google Scholar]
  • 17.Pineda RG, Stransky KE, Rogers C, Duncan MH, Smith GC, Neil J, et al. The single-patient room in the NICU: Maternal and family effects. J Perinatol. 2012. doi: 10.1038/jp.2011.144 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Lester BM, Hawes K, Abar B, Sullivan M, Miller R, Bigsby R, et al. Single-Family Room Care and Neurobehavioral and Medical Outcomes in Preterm Infants. Pediatrics. 2014;134: 754–760. doi: 10.1542/peds.2013-4252 [DOI] [PubMed] [Google Scholar]
  • 19.Shields L, Tanner A. Pilot study of a tool to investigate perceptions of family-centered care in different care settings. Pediatr Nurs. 2015;30: 189–97. [PubMed] [Google Scholar]
  • 20.Makris NM, Vittner D, Samra HA, McGrath JM. The PREEMI as a measure of parent engagement in the NICU. Appl Nurs Res. 2019;47: 24–28. doi: 10.1016/j.apnr.2019.03.007 [DOI] [PubMed] [Google Scholar]
  • 21.Novak JL, Vittner D. Parent engagement in the NICU. J Neonatal Nurs. 2020. doi: 10.1016/J.JNN.2020.11.007 [DOI] [Google Scholar]
  • 22.D V, S B, K S, N M, E B, H S, et al. Parent Engagement Correlates With Parent and Preterm Infant Oxytocin Release During Skin-to-Skin Contact. Adv Neonatal Care. 2019;19. doi: 10.1097/ANC.0000000000000558 [DOI] [PubMed] [Google Scholar]
  • 23.van Veenendaal NR, van Kempen AAMW, Maingay F, Recourt-Vollebregt M, van der Schoor SRD, van Goudoever J. Family Integrated Care in the Neonatal Ward—the AMICA study. 2017 [cited 19 Mar 2020]. Available: https://www.trialregister.nl/trial/6175
  • 24.Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Qual Life Res. 2010;19: 539–549. doi: 10.1007/s11136-010-9606-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Power N, Franck L. Parent participation in the care of hospitalized children: a systematic review. J Adv Nurs. 2008;62: 622–641. doi: 10.1111/j.1365-2648.2008.04643.x [DOI] [PubMed] [Google Scholar]
  • 26.Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technology Assessment. 1998. doi: 10.3310/hta2140 [DOI] [PubMed] [Google Scholar]
  • 27.Stelwagen MA, van Kempen AAMW, Westmaas A, Blees YJ, Scheele F. Integration of maternity and neonatal Care to Empower Parents. J Obstet Gynecol Neonatal Nurs. 2020;49: 65–77. doi: 10.1016/j.jogn.2019.11.003 [DOI] [PubMed] [Google Scholar]
  • 28.Castor Electronic Data Capture. CastorEDC. 2019 [cited 19 Mar 2020]. Available: https://www.castoredc.com/
  • 29.Miles MS, Funk S, Carlson J. Parental Stressor Scale: Neonatal Intensive Care Unit. Nurs Res. 1993;42: 148–152. [PubMed] [Google Scholar]
  • 30.Spinhoven P, Ormel J, Sloekers PPA, Kempen GIJM, Speckens AEM, Van Hemert AM. A validation study of the Hospital Anxiety and Depression Scale (HADS) in di?erent groups of Dutch subjects. Psychol Med. 1997. doi: 10.1016/S0163-8343(03)00043-4 [DOI] [PubMed] [Google Scholar]
  • 31.Barnes CR, Adamson-Macedo EN. Perceived Maternal Parenting Self-Efficacy (PMP S-E) tool: Development and validation with mothers of hospitalized preterm neonates. J Adv Nurs. 2007;60: 550–560. doi: 10.1111/j.1365-2648.2007.04445.x [DOI] [PubMed] [Google Scholar]
  • 32.Latour JM, Duivenvoorden HJ, Hazelzet JA, Van Goudoever JB. Development and validation of a neonatal intensive care parent satisfaction instrument. Pediatr Crit Care Med. 2012;13: 554–559. doi: 10.1097/PCC.0b013e318238b80a [DOI] [PubMed] [Google Scholar]
  • 33.Brockington IF, Fraser C, Wilson D. The Postpartum Bonding Questionnaire: A validation. Arch Womens Ment Health. 2006;9: 233–242. doi: 10.1007/s00737-006-0132-1 [DOI] [PubMed] [Google Scholar]
  • 34.Kyriazos TA. Applied Psychometrics: Sample Size and Sample Power Considerations in Factor Analysis (EFA, CFA) and SEM in General. Psychology. 2018;09: 2207–2230. doi: 10.4236/psych.2018.98126 [DOI] [Google Scholar]
  • 35.Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338: 1–7. doi: 10.1136/bmj.b2393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Eekhout I, De Vet HCW, Twisk JWR, Brand JPL, De Boer MR, Heymans MW. Missing data in a multi-item instrument were best handled by multiple imputation at the item score level. J Clin Epidemiol. 2014;67: 335–342. doi: 10.1016/j.jclinepi.2013.09.009 [DOI] [PubMed] [Google Scholar]
  • 37.Van Buuren S, Groothuis-Oudshoorn K. Multivariate Imputation by Chained Equations. J Stat Softw. 2011;45: 1–67. doi: 10.1177/0962280206074463 [DOI] [PubMed] [Google Scholar]
  • 38.Eekhout I, de Vet HCW, de Boer MR, Twisk JWR, Heymans MW. Passive imputation and parcel summaries are both valid to handle missing items in studies with many multi-item scales. Stat Methods Med Res. 2018;27: 1128–1140. doi: 10.1177/0962280216654511 [DOI] [PubMed] [Google Scholar]
  • 39.Heymans M, Eekhout I. Applied Missing Data Analysis With SPSS and (R)Studio. Amsterdam; 2019.
  • 40.Rubin DB. Multiple imputation for nonresponse in surveys. Wiley; 1987. [Google Scholar]
  • 41.Newsom J. Alternative estimation methods. 2018. [Google Scholar]
  • 42.Hooper D, Coughlan J, Mullen MR, Mullen J, Hooper D, Coughlan J, et al. Structural Equation Modelling: Guidelines for determining model fit structural equation modelling: guidelines for determining model fit. Dublin Inst Technol ARROW @ DIT. 2008;6: 53–60. [Google Scholar]
  • 43.Geldhof GJ, Preacher KJ, Zyphur MJ. Reliability estimation in a multilevel confirmatory factor analysis framework. Psychol Methods. 2014. doi: 10.1037/a0032138 [DOI] [PubMed] [Google Scholar]
  • 44.Ab Hamid MR, Sami W, Mohmad Sidek MH. Discriminant validity assessment: use of Fornell & Larcker criterion versus HTMT criterion. Journal of Physics: Conference Series. 2017. doi: 10.1088/1742-6596/890/1/012163 [DOI]
  • 45.OECD. Policy Brief Parental leave: Where are the fathers? 2016; 2.
  • 46.R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing. 2016. doi: 10.1017/CBO9781107415324.004 [DOI] [Google Scholar]
  • 47.Package “mice” Title Multivariate Imputation by Chained Equations. 2018. doi: [DOI]
  • 48.Rosseel Y. lavaan: An R Package for Structural Equation Modeling. J Stat Softw. 2012;48: 1–36. doi: 10.18637/jss.v048.i02 [DOI] [Google Scholar]
  • 49.Enders CK. A note on the use of missing auxiliary variables in full information maximum likelihood-based structural equation models. Struct Equ Model. 2008. doi: 10.1080/10705510802154307 [DOI] [Google Scholar]
  • 50.Stevens EE, Gazza E, Pickler R. Parental experience learning to feed their preterm infants. Adv Neonatal Care. 2014;14: 354–361. doi: 10.1097/ANC.0000000000000105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Kim THM, Delahunty-Pike A, Campbell-Yeo M. Effect of Fathers’ Presence and Involvement in Newborn Care in the NICU on Mothers’ Symptoms of Postpartum Depression. JOGNN—J Obstet Gynecol Neonatal Nurs. 2020;49: 452–463. doi: 10.1016/j.jogn.2020.05.007 [DOI] [PubMed] [Google Scholar]
  • 52.WHO (World Health Organization). Survive & thrive: Transforming care for every small and sick newborn. 2019.
  • 53.EFCNI. European Standards of Care for Newborn Health. 2018. [Google Scholar]
  • 54.van Veenendaal NR, van der Schoor SRD, Heideman WH, Rijnhart JJM, Heymans MW, Twisk JWR, et al. Family integrated care in single family rooms for preterm infants and late-onset sepsis: a retrospective study and mediation analysis. Pediatr Res. 2020. doi: 10.1038/s41390-020-0875-9 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Elisabete Alves

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

6 Jan 2021

PONE-D-20-36004

Development and psychometric evaluation of the CO-PARTNER tool for collaboration and parent participation in neonatal care

PLOS ONE

Dear Dr. van Veenendaal,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Feb 20 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Elisabete Alves

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please ensure you have included the registration number for the clinical trial referenced in the manuscript.

3. In your Methods section, please provide additional information about the participant recruitment method and the demographic details of your participants. Please ensure you have provided sufficient details to replicate the analyses such as: a) the recruitment date range (month and year), b) descriptions of where participants were recruited and where the research took place.

4. Please provide a sample size and power calculation in the Methods, or discuss the reasons for not performing one before study initiation.

5.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

6.Thank you for stating the following in the Financial Disclosure  section:

"NvV is supported by an unrestricted research grant, provided by Nutricia, the Netherlands during the conduct of the study. AvK and SvdS are supported by a research grant, provided by Nutricia, the Netherlands outside the submitted work. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

We note that you received funding from a commercial source: Nutricia

Please provide an amended Competing Interests Statement that explicitly states this commercial funder, along with any other relevant declarations relating to employment, consultancy, patents, products in development, marketed products, etc.

Within this Competing Interests Statement, please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your amended Competing Interests Statement within your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

7. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

5. Review Comments to the Author

Reviewer #1: Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently. Further please note that any ‘statistical review’ is generally done under the assumption that (such) study specific methodological [as well as execution] issues are perfectly taken care of by the investigator(s). This review is not an exception to that and so does not cover clinical aspects {however, seldom comments are made only if those issues are intimately / scientifically related & intermingle with ‘statistical aspects’ of the study}. Agreed that ‘statistical methods’ are used as just tools here, however, they are vital part of methodology [and so should be given due importance].

COMMENTS: Actually this excellent study which developed and psychometrically evaluated a tool measuring active parent participation and collaboration in neonatal care is most welcome, however, I wonder to note that the refer number 40 {one which is otherwise important} is quoted only in the context of ‘values for CR are between 0.6 and 0.9 (40)’ in line 198. Reference 40 [‘Discriminant Validity Assessment: Use of Fornell & Larcker criterion versus HTMT Criterion’, M. Hamid, Waqas Sami, M. Sidek, Published 2017 with DOI:10.1088/1742-6596/890/1/012163] compares Fornell and Larcker criterion with Heterotrait-Monotrait (HTMT) ratio of correlations which is a new method emerged for establishing the discriminant validity assessment.

I fully agree that the Fronell-Larcker criterion is one of the most popular techniques used to check the discriminant validity of measurements models {though I am not really very familiar/no-first-hand-experience with these techniques [which probably is the reason of raising such question(s)]}. According to this criterion, the convergent validity of the measurement model can be assessed by the Average Variance Extracted (AVE) and Composite Reliability (CR).

However, recent research suggests that the Fornell-Larcker criterion is not effective under certain circumstances pointing to a potential weakness in the most commonly used discriminant validity criterion (??). Assessment of discriminant validity is a must in any research that involves latent variables for the prevention of multicollinearity issues. It is well-known that Fornell and Larcker criterion is the most widely used method for this purpose. However, a new method should have been discussed/mentioned, I guess.

Use of COSMIN checklist for assessing the methodological quality is most appreciated (linen 90). Why you say “for this substudy”, whereas, this is a full study. Or have you used COSMIN checklist only for some substudy/subsample? As pointed out in reference 32, it is true that ‘Missing data in a multi-item instrument were best handled by multiple imputation at the item score level’.

What is ‘Singleton’ [n=260, (72.6 %)] in Table 2 on ‘Baseline characteristics of the sample’. Just out of curiosity – Do they differ from others/remining?

CONGRATULATIONS on rigorous instrument development and psychometric testing methodology to develop a measure of parent participation and partnership in neonatal care.

Reviewer #2: This manuscript adds valuable information on the assessment of the active participation of parents within the NICU. The manuscript clearly explains the process of item generation and the participatory method used is appreciated. The possible application of the new tool in the field is exciting! However, there are several instances where some clarification could assist the reader in understanding the flow of the study and the results. The many references to the supplemental information make this manuscript challenging to follow and incorporating more of the information through brief descriptions of the content of the tables may be more beneficial than simply referring to the tables. Maybe consider dividing the manuscript into 2 papers, one focusing on the development of the tool and the item generation and a second paper describing the construct validity, etc. It will be useful to clarify the hypotheses and the correlation with the results using consistent terminology. Please consider elaborating on the nature of the items included in the tool and highlight how it is related to collaboration as the manuscript makes several references to this construct however it is unclear how the tool explicitly assesses it. Limitations: please describe the limitations related to this study in addition to the limitations of the tool itself. Please clarify how the active independent or assisted completion of tasks are related to collaboration. There are several instances where participation and collaboration are used interchangeably, yet it is unclear for the reader how the items in the tool specifically assess collaboration as opposed to parental participation in caregiving and medical tasks. Please look through the reference list again as there were some inconsistencies with regard to capitalization.

Please see document attached for all comments to the authors including minor and major concerns.

Reviewer #3: Thank you for giving me the opportunity to review this original study that is well integrated to current trends in literature and answers specific unmet needs for tools and procedures to better monitor the quality of parental integration in care in NICUs. As shown in the literature review and in other articles not cited, many studies and measures were developed for pediatrics in general; however, these did not consider the specificities of neonatology intensive care or were centered only on the maternal side of parenting.

INTRODUCTION

The research problem is well constructed in a concise manner and relies on pertinent and recent literature. The discussion provides further details comparing the new proposed tool and the PREEMI tool (p. 17, lines 321-323). Further information should be integrated to the introduction to put in perspective what the study adds to the comparison with PREEMI, the latter being a well-known tool used in many studies on parent engagement in NICUs and referenced in major practice recommendations and implementation strategies presented in evidence-based practice guidelines for neonatal clinicians.

Novak, J. L., & Vittner, D. (2020). Parent engagement in the NICU. Journal of Neonatal Nursing.

Vittner, D., Butler, S., Smith, K., Makris, N., Brownell, E., Samra, H., & McGrath, J. (2019). Parent engagement correlates with parent and preterm infant oxytocin release during skin-to-skin contact. Advances in Neonatal Care, 19(1), 73-79.

Monroe, M. (2016). Guidelines for Protected Sleep. Trauma-Informed Care in the NICU: Evidenced-Based Practice Guidelines for Neonatal Clinicians, chp.7, table 7.4, p.146.

PREEMI is also included in a meta-analysis on parental stress in NICUs that should be included in the references presented in the introduction.

Caporali, C., Pisoni, C., Gasparini, L., Ballante, E., Zecca, M., Orcesi, S., & Provenzi, L. (2020). A global perspective on parental stress in the neonatal intensive care unit: a meta-analytic study. Journal of Perinatology, 40(12), 1739-1752.

It would also be useful if the introduction highlighted that the new tool has a broader reach, as it is not centered on risk evaluation, it involved an important proportion of fathers in its initial development stage, and its conceptualization aims to link participation to outcomes.

METHODS

The construct of parent participation is pertinent and credible, with a good and wide operationalizable definition. From the beginning, item generation is solidly anchored around the IPP with a rigorous procedure (method of extraction by two analysists and consultation with author of the IPP and with parents). The participation of parents in reviewing questions and answer options was thorough, thus the article could, with a few adjustments, include an evaluation of the tool’s acceptability.

In the section “Conceptualizing Six Domains”, I am not sure the mention that the construct went from multifactorial to dimensions is necessary. The six dimensions seem to be dimensions per se and not factors conditioning participation (daily care, medical care, information, advocacy, time, closeness). I would suggest simply introducing the definition of parent participation as multidimensional and proceeding to describe the six identified dimensions.

The two columns of table 1 should have head titles for clarity purposes (e.g. proposition/choice of answers). The wording of the propositions should be the same (e.g. “measure the temperature of my child” instead of “measuring”). The verb form in Domains 1 and 2 should also be harmonized.

Furthermore, I have a doubt when it comes to the phrasing of items 19 and 20: ”I stuck up for my child” should probably read “I stood up for my child”.

Specification about individual questionnaire (p. 10, line 165): Was there an individualized questionnaire for each child, for mothers and fathers, or for both?

Strength: evaluation by fathers, use of individualized questionnaires for multiple births.

There was a good use of parallel questionnaires in the survey. Question: Were all concurrent questionnaires also filled at two timepoints (admission and discharge) using individualized questionnaires?

RESULTS

In the methodology section, it is said that the questionnaire was filled at admission and discharge, but in the results, we only mention the discharge from the NICU. Did participants fill the questionnaire at both moments? If some did not fill the second one, were they excluded from the study? And if this is the case, how many filled only the first questionnaire?

In table 2, it is said that a certain number of participants were non-Dutch speaking. What language did they speak and how did they fill the questionnaire? Was it offered in several languages?

The percentage of participants with a higher education level seems high (89.2%). Does this cover postsecondary education or university education? Could this be a sample bias or is it simply a reflection of the situation in the Netherlands? In Canada, 56.7% of adults hold postsecondary education diplomas – this is the lowest level of higher education – which is a higher rate than in the United States and than the world average, yet it is still much lower than the percentage in the study.

In the structural validity section, there may be a translation mistake, as it is not obvious that “output of my child” is appropriate and understandable for parents as “defecation and urination of my child”. Also, it is said that the elements regarding walking a small round and perform skin-to-skin were redundant, but there is no precision as to how this was resolved and if it was integrated to Domain 1 or 5.

DISCUSSION

The interpretation of Domain 2 (Medical care) as being seemingly not as desirable as hypothesized could include a mention of the possibility that some parents simply do not want to get too involved in the direct medical care of their baby. Some actions in this domain greatly differ from normal baby care, which is central to the experience parents want to live throughout the exceptional experience that is hospitalization in a NICU. Medical care can be very stressful, complicated, even scary for many parents, and to some extent, exactly the opposite of normal daily care. As such, some parents may want to leave most of the medical care at the hands of the healthcare providers and instead concentrate on a way of parenting that is as close as possible to what they would do at home. Note that this is just a spontaneous reaction shared with the authors, not an obligation to add this nuance if it does not resonate with them.

Comparison with the PREEMI tool in the discussion should include the fact that the new tool truly integrated fathers from its initial conception , which will be very useful to better understand their needs and the areas in which they could need special support and attention in order to feel more comfortable and competent in caring for their baby.

A suggestion would be to add open qualitative questions to the tool with skip logic links to some answers in order allow participants to explain some difficulties in their own words. This would make the tool even more useful for quick and well-directed interventions when the tool is used for monitoring and quality control in clinical interventions, and not only to produce research data.

Future research should probably also include testing the tool in an intercultural context (immigration, language, lower level of education, religious identity when available, etc.), study with parents who had lost a sibling and with parents of a baby suffering from a congenital or metabolic syndrome. It is possible to eventually make evaluation for distinct questionnaires for fathers and mothers to deepen the understanding of the fathers’ experience and perspective using their own personal answers to some questions addressed specifically to them.

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: renamed_bfe4b.docx

Click here for additional data file. (15.6KB, docx)
Attachment

Submitted filename: Reviewer comments Dec 2020 Copartner.docx

Click here for additional data file. (21.9KB, docx)
PLoS One. 2021 Jun 9;16(6):e0252074. doi: 10.1371/journal.pone.0252074.r002

Author response to Decision Letter 0

14 Apr 2021

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Response: we amended the authors and manuscript according to your style requirements. We used PACE to convert figures, please let us know if this was done sufficiently.

2. Please ensure you have included the registration number for the clinical trial referenced in the manuscript.

Response: we have included the trial registration number in the Methods section: “The AMICA trial was registered on the 23rd of December 2016 in the Netherlands Trial Registry NL6175.”

3. In your Methods section, please provide additional information about the participant recruitment method and the demographic details of your participants. Please ensure you have provided sufficient details to replicate the analyses such as: a) the recruitment date range (month and year), b) descriptions of where participants were recruited and where the research took place.

Response: we have included the following in the Methods section: “This psychometric study was conducted before and during a multicentre non-randomised prospective study on the effects of FICare on infants and their parents in a NICU level 2 context in the Netherlands, including a group of parents and infants who experienced family integrated care (FICare) in single family room units and a group who experienced standard care in open bay units (the AMICA study, see S1. Appendix for details on FICare and standard care in the different participating units). In the AMICA study, preterm infants admitted for at least 7 days to one of the participating wards and their parents were included. The primary outcome in the AMICA study was the effect of FICare in single family rooms on neurodevelopment of preterm infants. In the AMICA study, outcomes in parents (mothers and fathers separately) were also included as secondary outcomes in the short and longer term. We excluded families if mothers or fathers had severe psychosocial problems (for instance acute psychiatric illness or if a family was under supervision of social services etc.), if death of a sibling occurred or if a congenital or metabolic syndrome was present in the infant.

Before conduct of the AMICA study, we considered parent active participation as a possible mediator in the pathway between the FICare-setting and improved health outcomes (for mothers, fathers and infants). However, as no validated measure of parent participation existed, we decided to conduct the generation, validation and psychometric evaluation of the CO-PARTNER tool before and during the AMICA study. We first included parents and healthcare professionals in the item generation phase using purposive sampling in May 2016-April 2017. For the validation and psychometric evaluation, we included parents who participated in the AMICA study and who filled out the CO-PARTNER tool at hospital discharge of their infant. Recruitment of the AMICA study took place May 2017-January 2020. The medical ethical review board of MEC-U in Nieuwegein, The Netherlands, approved the study and all parents provided written informed consent. The work described has been carried out in accordance with The Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving humans. The AMICA trial was registered on the 23rd of December 2016 in the Netherlands Trial Registry NL6175.”

4. Please provide a sample size and power calculation in the Methods, or discuss the reasons for not performing one before study initiation.

Response: we included a sample size calculation in our methods section: “We performed a sample size calculation for the AMICA study for the primary outcome of neurodevelopment in preterm infants at 2 years of age corrected for prematurity (See S5. Appendix for details on the sample size calculation). We included sufficient parents for our psychometric analyses, as we had 10 participant responses per item.”

5.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Response: see our Cover letter and:

“Data availability

There are ethical and legal restrictions on sharing a de-identified data set. Data from the study are available upon request, as there are legal and ethical restrictions on sharing these data publicly due to the data containing sensitive and identifiable information. The data set contains information like birthweight and gestational age of infants and information on parents - information that could be used to link and identify individuals, in relation with the information that the study was conducted in Amsterdam, the Netherlands. Above, sensitive information includes data on depression, anxiety, and stress in parents. In the informed consents signed by the parents and guardians of the infants of this study and granted by the regional committee for medical ethics in Nieuwegein, The Netherlands, guardians were not asked about data sharing. Researchers interested in the data may contact the Privacy protection officer in OLVG (fg@olvg.nl) and the ethics committee that approved the study (info@mec-u.nl) and provide the reference: NL ABR 56691.”

6.Thank you for stating the following in the Financial Disclosure section:

"NvV is supported by an unrestricted research grant, provided by Nutricia, the Netherlands during the conduct of the study. AvK, SvdS and FdG are supported by a research grant, provided by Nutricia, the Netherlands outside the submitted work. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

We note that you received funding from a commercial source: Nutricia

Please provide an amended Competing Interests Statement that explicitly states this commercial funder, along with any other relevant declarations relating to employment, consultancy, patents,

Within this Competing Interests Statement, please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your amended Competing Interests Statement within your cover letter. We will change the online submission form on your behalf

Response: We have added our statement in our cover letter and altered our statement in the manuscript towards: “NvV is supported by an unrestricted research grant, provided by Nutricia, the Netherlands during the conduct of the study. AvK, SvdS and FdG are supported by a research grant, provided by Nutricia, the Netherlands outside the submitted work. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. This does not alter our adherence to PLOS ONE policies on sharing data and materials.” Please let us know if this is sufficient.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Response: we confirm that we have declared on behalf of all authors all potential competing interests.

7. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript.

Response: our ethics statement only appears in the Methods section of our manuscript.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: I Don't Know

3. Have the authors made all data underlying the findings in their manuscript fully available?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

4. Is the manuscript presented in an intelligible fashion and written in standard English?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

5. Review Comments to the Author

Reviewer #1

Reviewer #1: Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently. Further please note that any ‘statistical review’ is generally done under the assumption that (such) study specific methodological [as well as execution] issues are perfectly taken care of by the investigator(s). This review is not an exception to that and so does not cover clinical aspects {however, seldom comments are made only if those issues are intimately / scientifically related & intermingle with ‘statistical aspects’ of the study}. Agreed that ‘statistical methods’ are used as just tools here, however, they are vital part of methodology [and so should be given due importance].

COMMENTS: Actually this excellent study which developed and psychometrically evaluated a tool measuring active parent participation and collaboration in neonatal care is most welcome.

1. However, I wonder to note that the refer number 40 {one which is otherwise important} is quoted only in the context of ‘values for CR are between 0.6 and 0.9 (40)’ in line 198. Reference 40 [‘Discriminant Validity Assessment: Use of Fornell & Larcker criterion versus HTMT Criterion’, M. Hamid, Waqas Sami, M. Sidek, Published 2017 with DOI:10.1088/1742-6596/890/1/012163] compares Fornell and Larcker criterion with Heterotrait-Monotrait (HTMT) ratio of correlations which is a new method emerged for establishing the discriminant validity assessment.

I fully agree that the Fornell-Larcker criterion is one of the most popular techniques used to check the discriminant validity of measurements models {though I am not really very familiar/no-first-hand-experience with these techniques [which probably is the reason of raising such question(s)]}. According to this criterion, the convergent validity of the measurement model can be assessed by the Average Variance Extracted (AVE) and Composite Reliability (CR).

However, recent research suggests that the Fornell-Larcker criterion is not effective under certain circumstances pointing to a potential weakness in the most commonly used discriminant validity criterion (??). Assessment of discriminant validity is a must in any research that involves latent variables for the prevention of multicollinearity issues. It is well-known that Fornell and Larcker criterion is the most widely used method for this purpose. However, a new method should have been discussed/mentioned, I guess.

Response: Thank you for your observations on the comparison between the HTMT method and the Fornell-Larcker criterion. We reviewed the source (40) again and have decided to enhance our methods by completing and conducting the HTMT method instead of the previous (Fornell-Lacker criterion) analysis. We feel that the reader would benefit to understand the comparisons between our domains with a measure that has both a higher specificity and sensitivity than the previous method we used.

See abstract for changes to the description of our methods: “Subsequently, we studied structural validity with confirmatory factor analysis (CFA), construct validity, using the Average Variance Extracted and Heterotrait-Monotrait ratio of correlations, and hypothesis testing with correlations and univariate linear regression.”

See Section, Construct Validity, Methods: (we used the Hamid et al. reference, which is now differently numbered due to alterations in referencing at the beginning of the manuscript): “We analyzed construct validity by using the Average Variance Extracted and Heterotrait-Monotrait criterion. First, we determined the Average Variance Extracted (AVE) which informs how closely each domain is related based on the item characteristics within each domain, the AVE should be greater than 0.05 to be acceptable. To examine the distinctiveness between domains we performed Heterotrait-Monotrait (HTMT), a new method that measures a ratio of correlation. The HTMT method has emerged as a discriminant validity method that has been shown to achieve higher sensitivity and specificity (99% and 97%) than the commonly used cross-loadings and Fornell-Lacker methods. We set our threshold for the HTMT analysis at 0.85.”

See Section, Construct Validity, Results: and Appendix S10 for a description of our subsequent HTMT findings: “The Average Variance Extracted and HTMT demonstrated strong construct validity and distinctiveness of domains (see S10. Appendix for construct validity and distinctiveness outcomes).”

2. Use of COSMIN checklist for assessing the methodological quality is most appreciated (line 90). Why you say “for this substudy”, whereas, this is a full study. Or have you used COSMIN checklist only for some substudy/subsample? As pointed out in reference 32, it is true that ‘Missing data in a multi-item instrument were best handled by multiple imputation at the item score level’.

Response: Thank you for this question. We conducted this study before and during our AMICA study (see Methods). Therefore, we first regarded this as a substudy. We have altered our methods section towards the following to elaborate and make clear how we performed our study: “This psychometric study was conducted before and during a multicentre non-randomised prospective study on the effects of FICare on infants and their parents in a NICU level 2 context in the Netherlands, including a group of parents and infants who experienced family integrated care (FICare) in single family room units and a group who experienced standard care in open bay units (the AMICA study, see S1. Appendix for details on FICare and standard care in the different participating units). In the AMICA study, preterm infants admitted for at least 7 days to one of the participating wards and their parents were included. The primary outcome in the AMICA study was the effect of FICare in single family rooms on neurodevelopment of preterm infants. In the AMICA study, outcomes in parents (mothers and fathers separately) were also included as secondary outcomes in the short and longer term. We excluded families if mothers or fathers had severe psychosocial problems (for instance acute psychiatric illness or if a family was under supervision of social services etc.), if death of a sibling occurred or if a congenital or metabolic syndrome was present in the infant.

Before conduct of the AMICA study, we considered parent active participation as a possible mediator in the pathway between the FICare-setting and improved health outcomes (for mothers, fathers and infants). However, as no validated measure of parent participation existed, we decided to conduct the generation, validation and psychometric evaluation of the CO-PARTNER tool before and during the AMICA study. We first included parents and healthcare professionals in the item generation phase using purposive sampling in May 2016-April 2017. For the validation and psychometric evaluation, we included parents who participated in the AMICA study and who filled out the CO-PARTNER tool at hospital discharge of their infant. Recruitment of the AMICA study took place May 2017-January 2020. The medical ethical review board of MEC-U in Nieuwegein, The Netherlands, approved the study and all parents provided written informed consent. The work described has been carried out in accordance with The Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving humans. The AMICA trial was registered on the 23rd of December 2016 in the Netherlands Trial Registry NL6175.

We used the quality checklist developed for the reporting of health-related-patient reported outcomes for this study. The primary outcomes for this study were content validity, structural validity, and construct validity of the CO-PARTNER tool.”

Also, we removed “substudy”: “We used the quality checklist developed for the reporting of health-related-patient reported outcomes for this study.”

3. What is ‘Singleton’ [n=260, (72.6 %)] in Table 2 on ‘Baseline characteristics of the sample’. Just out of curiosity – Do they differ from others/remining?

Response: These are the infants that were not part of twins.

4. CONGRATULATIONS on rigorous instrument development and psychometric testing methodology to develop a measure of parent participation and partnership in neonatal care

Response: thank you very much for reviewing our manuscript!

Reviewer #2

This manuscript adds valuable information on the assessment of the active participation of parents within the NICU. The manuscript clearly explains the process of item generation and the participatory method used is appreciated. The possible application of the new tool in the field is exciting! However, there are several instances where some clarification could assist the reader in understanding the flow of the study and the results.

1. The many references to the supplemental information make this manuscript challenging to follow and incorporating more of the information through brief descriptions of the content of the tables may be more beneficial than simply referring to the tables.

Response: We agree with you and we have added brief descriptions of the content (of the tables) of the supplement when we are referring to the supplement, and hope this clarifies the manuscript further.

2. Maybe consider dividing the manuscript into 2 papers, one focusing on the development of the tool and the item generation and a second paper describing the construct validity, etc.

Response: we would respectfully like to decline this request, and we left this suggestion to the editors to decide if they think this is needed. We would preferably keep this manuscript with tool development and validation as one complete paper.

3. It will be useful to clarify the hypotheses and the correlation with the results using consistent terminology.

Response: We agree with your comment and we have clarified our hypotheses and correlations using consistent terminology throughout the paper. Most importantly, we numbered our hypotheses, to aid the reader: “We calculated Pearson correlation coefficients (rho) and associations for hypothesis testing. We set up 5 hypotheses. A priori, we hypothesized (Hypothesis 1) that the total score would have a negative correlation with parent well-being outcomes such as depression and anxiety, of -0.3 to -0.5, meaning that if parents were depressed or anxious, they would demonstrate lower active parent participation. Contrarily, Hypothesis 2 was that the total score would have a positive correlation with self-efficacy and satisfaction and empowerment, of +0.3 to +0.5. We used univariate linear regression analysis to compare groups and test for associations. We stated that (Hypothesis 3) the CO-PARTNER-tool would be able to discriminate between high and low parent presence (Domain 5) and participation (total score) within the trial on the effect of FICare in SFR on parent and infant outcomes. Also, we anticipated (Hypothesis 4) that mothers would be more present (Domain 5) than fathers, as fathers in the Netherlands had on average 2-5 days of paternity leave, and resume to work quickly after birth during conduct of the study. The last hypothesis (Hypothesis 5) was that parents who were more present (Domain 5), would participate more in daily care (Domain 1).”

4. Please consider elaborating on the nature of the items included in the tool and highlight how it is related to collaboration as the manuscript makes several references to this construct however it is unclear how the tool explicitly assesses it.

Response: Thank you for this observation. We note that we have incorporated collaboration inherently in our definition of parent participation (see page 5, lines 147-154). The specific items were activities that can be done by parents in collaboration with healthcare professionals. The degree of collaboration perceived by the parent is indicated by the response options. Consensus was achieved during the tool development phase:

“Above, we investigated their views on content of items, how response options to items should be presented and on the rightful inclusion of the 26 items from the original IPP in the first version of the tool. Participants were asked to score items (during generation from the original IPP, focus groups or one-on-one interviews) as; (1) relevant or not relevant in light of parent participation in the NICU; (2) if the items needed a yes/no response, or if the items had to be scored on a scale and were intended to examine a collaborative process in care towards being able to perform activities independently (‘the nurse does this’, ‘the nurse and I do this together’ and ‘I do this independently’). Inclusion of participants ended after no new items were identified and consensus was reached on item responses.”

We have revised the language in our descriptions of these items to ensure the reader understands these items are intended to examine a collaborative process within specific care activities, as rated by the respondent.

5. Limitations: please describe the limitations related to this study in addition to the limitations of the tool itself.

Response: We added the following limitations to our discussion: “Within this psychometric study, we did not adjust for clustering within families but included fathers and mothers as separate individuals. Therefore, the possibility of non-independence of a couple’s responses cannot be ruled out and should be explored in future studies. Also, parents who completed the tool were highly educated, and therefore future studies should include a more diverse sample of mixed levels of educated parents to validate our results.”

6. Please clarify how the active independent or assisted completion of tasks are related to collaboration.

Response: Thank you for this comment, we consider active independent or assisted completion of tasks as a collaborative process within neonatal care (see response to question 4).

7. There are several instances where participation and collaboration are used interchangeably, yet it is unclear for the reader how the items in the tool specifically assess collaboration as opposed to parental participation in caregiving and medical tasks.

Response: Thank you for this helpful comment, guiding our thinking on how to provide more clarity in our report. See responses in points 4 and 6 of Reviewer #2 for changes we made to provide clarity. The tool captures the collaborative process within the response options of the tool. We have revised the language and hope to have clarified this throughout our manuscript.

8. Please look through the reference list again as there were some inconsistencies with regard to capitalization.

Response: we have amended the reference list to omit inconsistencies.

Minor concerns:

9. Line 112: “22 parents participated in the focus groups to assist with item generation”

Please include a rationale for selecting 22 parents. How were they recruited?

Response: Thank you for the comment, we have included the rationale for selecting these parents. We had a purposive sample of the target user group, and we have added further detail about how the participants were recruited. We went back to our original data, to ensure thoroughness. Due to this, we noticed that some details were not reported within our original manuscript. The item generation phase is now described with more detail:

“Two researchers (NvV and SvdS) independently and blind from each other extracted relevant items from the IPP for the NICU setting. We simultaneously consulted the original author of the IPP on which items of the 36 in the original IPP could be applied to a NICU care context (see acknowledgments). This resulted in 26 items to be included in the item generation phase. Focus groups, one-on-one interviews and scoring of the instrument was performed with a purposive sample of six healthcare professionals and forty-five parents. Healthcare professionals included a speech therapist experienced in FICare and nurses and midwives who either worked at the FICare or the standard care unit, with a large range in working experience (8 to 30 years in profession). Parents (mothers or fathers >18 years of age) had a preterm infant (born at a gestational age between 24 weeks - 36 6/7 weeks), were at the time experiencing or had experienced a NICU stay in the previous 2 years, and had experience in either a standard or FICare unit participating in the AMICA trial. Parents and professionals were approached by independent researchers. Specifically for parents, the researchers were not involved in the care of their infants. Participants were asked to identify (additional) items on parent participation. Above, we investigated their views on content of items, how response options to items should be presented and on the rightful inclusion of the 26 items from the original IPP in the first version of the tool. Participants were asked to score items (during generation from the original IPP, focus groups or one-on-one interviews) as; (1) relevant or not relevant in light of parent participation in the NICU; (2) if the items needed a yes/no response, or if the items had to be scored on a scale and were intended to examine a collaborative process in care towards being able to perform activities independently (‘the nurse does this’, ‘the nurse and I do this together’ and ‘I do this independently’). Inclusion of participants ended after no new items were identified and consensus was reached on item responses.

The research team, healthcare professionals and parent consultants identified a total of 88 relevant items that could be considered meaningful to the concept of parent participation and the process of collaboration in the NICU context. Two neonatologists, a researcher specialized in parent empowerment, and one neonatal nurse (see acknowledgments), independently and blind from each other, scored the items as to their applicability to the concept of parent participation and collaboration in the NICU. If at least 3 out of 4 experts rated the item as relevant, it was included in the CO-PARTNER tool.”

10. Line 132: “current state in the literature”(2)

This statement would be better supported by a different article. The article cited may not be sufficient to conclude on the “current state of the literature” in a broad sense. Please consider rephrasing or supplementing the statement with additional citations.

Response: We agree with this comment. We have reflected on the literature that supported our team’s decisions on the conceptualization of the six domains and we have added two more that supported our decisions. One of the additional sources cited now is a literature review, which also discusses the concept and measurement of parent participation.

11. Line 227-9: “For domain 3 and 4 ‘yes’ was scored as 1, and ‘no’ as 0 (minimum scores 0 to 3). Non-applicable items were transformed to 0 (no participation in this item).”

Please clarify why 0 is used for both No and Not applicable?

Response: Thank you for this comment and we realize our sentence was not clear and could be interpreted in several ways. We rephrased this section, as “non applicable” is indeed not an option in domain 3 and 4, and we clarified it as follows: “Total scores per domain were obtained by summing scores for hypothesis testing. For Domain 1, 2 and 6 we calculated 0 for ‘the nurse does this’, 1 for ‘the nurse and I do this together’ and 2 for ‘I do this independently’ (minimum scores 0 to 22, 8 and 14 respectively), indicating the positive inherent relationship between participation and collaboration. We performed sensitivity analyses on non-applicable items, either transforming them to 0 (no participation in this item) indicating that parents did not participate or did not experience an item or to missing before multiple imputation (and thus rendering a 0,1, or 2 value after multiple imputation). For domain 3 and 4 ‘yes’ was scored as 1, and ‘no’ as 0 (minimum scores 0 to 3). For the domain Time Spent with Infant (3 items) we performed sensitivity analyses including the items as scored originally (minutes or hours of relevant items) or as quartiles (minimum 0 maximum 12). Quartiles were calculated in imputed datasets. A total participation score was obtained by summing all domain scores. Minimum total scores were 0 and maximum 62.”

12. In line 258 it states: “Factor loadings for domains are described in Table 3. Sensitivity analyses for missing data, revealed that model fit was better without transforming the non-applicable items (scored -1) to missing (see S7. Appendix).”

This seems somewhat contradicting to the information stated in line 227-229?

Response: We have amended this and now this sentence should not be contradicting anymore with earlier statements: “Factor loadings for domains are described in Table 3. Sensitivity analyses for missing data, revealed that model fit was better without transforming the non-applicable items to missing (see S8. Appendix for sensitivity analyses).”

13. Line 241: Please consider adding Postmenstrual age at time of assessment along with GA

Response: Thank you for this comment, we agree. We added the following to our results and Table 2: “Their infants were born at a median gestational age of 33+3 weeks, and parents filled out the CO-PARTNER tool at a median postmenstrual age of their infant of 37+1 weeks.”

14. Line 277: Table 3: Please consider repeating the header row for tables broken across two pages

Response: we would like to request the typesetter to repeat table header rows on subsequent pages, when tables run across pages if our manuscript is accepted for publication.

15. References: Some inconsistency with the capitalization of titles noted throughout reference list

Response: we have amended the reference list to omit inconsistencies.

Major concerns:

16. Line 127: “a total of 34 items were generated.”

This section leads directly into “Domains” and then table 1 where only 31 items appear. It may be useful to include the rationale for dropping items prior to Table 1 or refer the reader to the specific section where it is explained as the reader would expect to see 34 items in Table 1 based on the information provided in line 127. The rationale is only explained in line 250.

Response: thank you for pointing this out. We amended as follows: “A total number of 34 items were generated during the item generation phase but three items were dropped during the analysis phase (see Structural validity) resulting in a total of 31 items included.”

17. Line 247: Table 2

Please explain why the number of parents included is lower than the number of families included:

Reponse: for this psychometric study we included parents who filled out the questionnaire at discharge of their infant. We have altered this in our methods section: “For the validation and psychometric evaluation, we included parents who participated in the AMICA study and who filled out the CO-PARTNER tool at hospital discharge of their infant.”

And have added the following to the results section for further clarification: “During the conduct of the AMICA study, 1213 preterm infants were assessed for eligibility. In total, 309 families were included, with 358 infants, 296 mothers and 263 fathers (Fig 1). One hundred and seventy-four out of 296 included mothers and 132 out 263 included fathers (response rates 58.8% and 50.2% respectively) filled out the questionnaire on parent participation and collaboration at NICU discharge of their infant and were included in this psychometric study (S7. Appendix on parent responses to the CO-PARTNER tool). There were 233 infants within 205 families. The median gestational age of their infants was 33+3 weeks, and parents filled out the CO-PARTNER tool at a median infant postmenstrual age of their infants of 37+1 weeks. Baseline characteristics of the sample are outlined in Table 2.”

18. Table 2 contains 2 lines for Gestational age and singletons: please explain why there is a difference between the first line and the second line under included infants. Please clarify what the top section of table 2 represents – is this the characteristics across the larger FICARE study?

Response: we acknowledge that this might be confusing, and indeed the top lines were characteristics of the larger FICare study. However, for clarification we have deleted these rows, and have focused on the parents who filled out the CO-PARTNER tool at hospital discharge of their infants. Therefore, we have also amended our Figure 1, with the included fathers and mothers (see also above response to comment Reviewer #2 question 17).

As we included fathers and mothers, and evaluated them separately (independent of the family they belonged to), we acknowledge that clustering could have occurred, and therefore we have added this to the limitations of our study: “Within this psychometric study, we did not adjust for clustering within families but included fathers and mothers as separate individuals. Therefore, the possibility of non-independence of a couple’s responses cannot be ruled out and should be explored in future studies.”

19. Line 328: “The findings from this study should be considered in light of its limitations.” This section should deal with the limitations of this study yet it only lists the limitations of the tool. The tool limitations are important to mention, but study limitations should also be included. This also lends toward separation into two manuscripts: one on development followed by one on evaluating the tool.

Response: We agree with you and we have added the following limitations to the discussion: “Within this psychometric study, we did not adjust for clustering within families but included fathers and mothers as separate individuals. Therefore, the possibility of non-independence of a couple’s responses cannot be ruled out and should be explored in future studies. Also, parents who completed the tool were highly educated, and therefore future studies should include a more diverse sample of mixed levels of educated parents to validate our results.”

20. Line 347: “This tool can be used for benchmarking across settings” This is a strong statement-consider softening.

Response: we agree. We altered towards: “This tool could potentially be used for benchmarking across and comparing settings.”

21. Line 349: “With these scores parents can give feedback on how well they partnered with providers during care and to what extent participation and collaboration were possible for them during the hospital stay.”

This section seems somewhat confusing. How will the parents be able to describe “ to what extent they could collaborate” – the tool only provides measures of whether the parents did tasks independently or not and does not ask a question related to the amount of collaboration in the unit. Some units across the globe rely on families to deliver care (out of necessity) and therefore completing a task independently is not necessarily a direct measure of collaboration between healthcare workers and parents – it is just a measure of parental active participation.

Response: we agree with you that this tool should also be validated/studied in different resource settings and have added this to the discussion: “Future research should focus on use of the tool in different settings (for instance in level 3 units), different countries, different intercultural contexts (for instance immigration, language or lower levels of education) and different resource settings (for instance in units relying on care delivery by families out of necessity), and with parents of infants with a wider range of diagnoses to determine if further adaptation is needed to account for context.”

In our methods, we state that the responses for Domains 1, 2, and 6 are on a scale and intended to examine a collaborative process in care, supporting parents eventually into performing tasks independently. The responses for these domains were developed in close collaboration with our parent consultants.

We rephrased the mentioned sentence for clarification towards the following: “All items included in the CO-PARTNER tool can be performed by parents and this should be fully supported by units, as is advocated by parent representatives and the WHO. With CO-PARTNER scores parents can provide actionable quantitative data on the level of parent participation in care, with lower scores suggesting more tasks performed solely by healthcare professionals without participation of parents.”

22. Domain 3 has dichotomous questions on whether parents requested information: If information was freely volunteered by health care staff, parents may not have needed to request it, yet it would not be a marker of decreased collaboration or participation.

Response: you are absolutely right, and this is an interesting finding we have encountered in other analyses (as of now preliminary and unpublished). We acknowledge this concern, and the domain 3 items (Acquiring Information) could be studied more in-depth in relation towards parent-partnered care models. If information was freely expressed by healthcare staff as you rightfully suggest, parents may indeed not have needed to request it, which would lead to a lower score on participation in the CO-PARTNER tool. However, parents indicated that acquiring information was an important act of participation and collaboration in the item generation phase, and therefore it is included in the tool.

23. Line 351: “Equally, the CO-PARTNER tool enables comparison of parent partner care practices and to study (health) outcomes in infants and their parents through, for instance, mediation analysis (51).”

This statement does not seem pertinent to the current manuscript as infant outcomes were not discussed or reported.

Response: we altered the wording towards the following for clarification: “Equally, the CO-PARTNER tool can potentially enable comparison of parent-partnered care practices and to study (health) outcomes in infants and their parents through, for instance, mediation analysis.” We hypothesize parent participation and collaboration is a large mediator of the effect of parent partnered care models on outcomes in infants and parents, which we have also hypothesized in our larger AMICA study. We will evaluate these outcomes in a separate manuscript.

24. Line 369:“Likewise, the COPARTNER tool could be studied to evaluate progress within parents (beginning and end of hospital stay) or to evaluate the effect of education programs for parents and healthcare professionals on parent participation and collaboration.”-consider rewording to …”to evaluate changes in parent participation…”

Response: we agree; we have rephrased towards: “Likewise, the CO-PARTNER tool could be studied to evaluate progress within parents (beginning and end of hospital stay) or to evaluate changes in parent participation and collaboration after implementation of education programs for parents and healthcare professionals.”

25. Line 211: Hypothesis testing. It may be useful to include the hypotheses in a previous section of the paper (introduction?) rather than in the statistics section. Please consider numbering the hypotheses for ease of referring back to them and linking it directly to the results obtained using consistent terminology.

Response: Thank you for this suggestion; we have added numbers to the hypotheses in the section on methods: “Hypotheses testing”: “We calculated Pearson correlation coefficients (rho) and associations for hypothesis testing. We set up 5 hypotheses. A priori, we hypothesized (Hypothesis 1) that the total score would have a negative correlation with parent well-being outcomes such as depression and anxiety, of -0.3 to -0.5, meaning that if parents were depressed or anxious, they would demonstrate lower active parent participation. Contrarily, Hypothesis 2 was that the total score would have a positive correlation with self-efficacy and satisfaction and empowerment, of +0.3 to +0.5. We used univariate linear regression analysis to compare groups and test for associations. We stated that (Hypothesis 3) the CO-PARTNER-tool would be able to discriminate between high and low parent presence (Domain 5) and participation (total score) within the trial on the effect of FICare in SFR on parent and infant outcomes . Also, we anticipated (Hypothesis 4) that mothers would be more present (Domain 5) than fathers, as fathers in the Netherlands had on average 2-5 days of paternity leave, and resume to work quickly after birth during conduct of the study. The last hypothesis (Hypothesis 5) was that parents who were more present (Domain 5), would participate more in daily care (Domain 1).”

And in the results: “The direction of correlation between total and domain scores met our prespecified hypotheses (Fig 2 and S11. Appendix for outcomes of hypotheses testing). Negative correlations were present between total and domain scores on the CO-PARTNER tool with depression and impaired parent-infant bonding (Hypothesis 1). No correlations were found between the CO-PARTNER tool and parent NICU stress (total and domain scores). We found positive correlations for total and domain scores between parent participation and parent self-efficacy and parent satisfaction and empowerment (Hypothesis 2).

We confirmed our Hypothesis 3 that parents in the FICare group participated more, they had significantly higher total CO-PARTNER total scores (beta 6.020, 95%CI 4.144; 7.895, p<0.0001). Also, parents in FICare had higher subdomain scores than parents in the standard care group (including time being present, Domain 5), except for Domain 3 (Acquiring Information, see S11. Appendix). Likewise (Hypothesis 4), mothers had higher CO-PARTNER scores than fathers (beta 2.103, 95%CI 0.084; 4.121, p=0.041). Overall, parents who were present more (Domain 5) participated more in daily care (Hypothesis 5, Domain 1, beta 0.390, 95%CI +0.240; + 0.540, p<0.0001, see S11. Appendix for outcomes of hypothesis testing).”

Hypotheses: line 211-223 Results reported: line 280-293 Comments Response

“ A priori, we hypothesized that the total score would have a negative correlation with parent well-being outcomes such as depression and anxiety, of -0.3 to -0.5, meaning that if parents were depressed or anxious they would demonstrate lower active parent participation.” “Negative correlations were present between total and domain scores on the CO-PARTNER tool with depression and impaired parent-infant bonding.”

“No correlations were found between the CO-PARTNER tool and parent NICU stress (total and domain scores).” Line 282: “Overall the direction of correlation between the participation score met our prespecified

283 hypotheses (Fig 2 and S10. Appendix)”

The word “overall” seems misleading as no correlation between CO-Partner and NICU stress was found

We agree, and have removed the word “overall”.

“For self-efficacy and satisfaction we defined a positive correlation with our parent participation tool of +0.3 to +0.5.”

positive correlations for total and domain scores between parent participation and parent self-efficacy and parent empowerment.

The hypothesis mentions parental satisfaction, yet the result only refers to participation and self-efficacy – not parental satisfaction You are correct, we have added “satisfaction and empowerment”

“We hypothesized that the COPARTNER-tool would be able to discriminate between high and low parent presence and participation within the trial on the effect of FICare in SFR on parent and infant outcomes (19).”

“Parents in the FICare group had significantly higher CO-PARTNER total scores (beta 6.020, 95%CI 4.144; 7.895, p<0.0001) and higher subdomain scores than parents in the standard care group, except for domain 3 (Acquiring Information, see S10. Appendix).”

Please clarify if higher total scores are synonymous with presence? Explicitly state if this hypothesis was correct?

Infant outcomes were not reported in this manuscript. Please add some clarification on why this hypothesis was used for this specific study or clarify whether it related more to the overarching study

We have clarified this towards: “We confirmed our Hypothesis 3 that parents in the FICare group participated more, they had significantly higher total CO-PARTNER total scores (beta 6.020, 95%CI 4.144; 7.895, p<0.0001). Also, parents in FICare had higher subdomain scores than parents in the standard care group (including time being present, Domain 5), except for Domain 3 (Acquiring Information, see S11. Appendix).”

Concerning the infant outcomes, this is part of the larger trial. We acknowledge that this might be confusing, therefore we rephrased our wordings within the methods section, and hope this makes clear what we have done in this study.

“Also we hypothesized that mothers would be more present (Domain 5) than fathers, as fathers in the Netherlands had on average 2-5 days of paternity leave, and resume to work quickly after birth during conduct of the study (42).”

“Likewise, mothers had higher COPARTNER scores than fathers (beta 2.103, 95%CI 0.084; 4.121, p=0.041).”

“We also hypothesized that parents who were more present (domain 5), would perform more daily tasks independently (domain 1).” “Overall, parents who were present more (Domain 5) participated more in daily care (Domain 1, beta 0.390, 95%CI +0.240; +0.540, p<0.0001).”

Does participation in daily care mean the same as independent participation – the scale gave the option that the parent does a task with the nurse- this may mean participation, but not independent participation as hypothesized. You are correct; and we did not phrase our hypothesis correctly. Therefore, we have rephrased our hypothesis towards: “The last hypothesis (Hypothesis 5) was that parents who were more present (Domain 5), would participate more in daily care (Domain 1).”

 

Reviewer #3

Reviewer #3: Thank you for giving me the opportunity to review this original study that is well integrated to current trends in literature and answers specific unmet needs for tools and procedures to better monitor the quality of parental integration in care in NICUs. As shown in the literature review and in other articles not cited, many studies and measures were developed for pediatrics in general; however, these did not consider the specificities of neonatology intensive care or were centered only on the maternal side of parenting.

INTRODUCTION

The research problem is well constructed in a concise manner and relies on pertinent and recent literature.

1. The discussion provides further details comparing the new proposed tool and the PREEMI tool (p. 17, lines 321-323). Further information should be integrated to the introduction to put in perspective what the study adds to the comparison with PREEMI, the latter being a well-known tool used in many studies on parent engagement in NICUs and referenced in major practice recommendations and implementation strategies presented in evidence-based practice guidelines for neonatal clinicians.

Novak, J. L., & Vittner, D. (2020). Parent engagement in the NICU. Journal of Neonatal Nursing.

Vittner, D., Butler, S., Smith, K., Makris, N., Brownell, E., Samra, H., & McGrath, J. (2019). Parent engagement correlates with parent and preterm infant oxytocin release during skin-to-skin contact. Advances in Neonatal Care, 19(1), 73-79.

Monroe, M. (2016). Guidelines for Protected Sleep. Trauma-Informed Care in the NICU: Evidenced-Based Practice Guidelines for Neonatal Clinicians, chp.7, table 7.4, p.146.

Response: We agree with you and have incorporated this into the introduction with your recommended references: “Other tools have focused on aspects such as feeling guided or supported by healthcare professionals or constructs related to maternal knowledge, confidence, expectations and social support within infant care engagement and risk evaluation.

However, all aforementioned tools lack the assessment of parent active participation, and the inherent collaborative partnerships and processes that are currently changing the NICU environment from healthcare-led to parent-led infant care. Most tools have also not included fathers from initial development. It is important to have validated tools to measure levels of parent participation and collaboration in the NICU to tailor care practices in real-time, to be able to assess parent-partnered care models such as family integrated care (FICare). Above all, a broader measure is needed, that is not only centred around risk-evaluation but can also be used in a strengths-based approach to promote parent active participation in care and achieve better outcomes for infants and their parents.”

2. PREEMI is also included in a meta-analysis on parental stress in NICUs that should be included in the references presented in the introduction.

Caporali, C., Pisoni, C., Gasparini, L., Ballante, E., Zecca, M., Orcesi, S., & Provenzi, L. (2020). A global perspective on parental stress in the neonatal intensive care unit: a meta-analytic study. Journal of Perinatology, 40(12), 1739-1752.

Response: we included this reference in the introduction.

3. It would also be useful if the introduction highlighted that the new tool has a broader reach, as it is not centered on risk evaluation, it involved an important proportion of fathers in its initial development stage, and its conceptualization aims to link participation to outcomes.

Response: thank you for this suggestion. We have added to the introduction the following: “Other tools have focused on aspects such as feeling guided or supported by healthcare professionals or constructs related to maternal knowledge, confidence, expectations and social support within infant care engagement and risk evaluation.

However, all aforementioned tools lack the assessment of parent active participation, and the inherent collaborative partnerships and processes that are currently changing the NICU environment from healthcare-led to parent-led infant care. Most tools have also not included fathers from initial development. It is important to have validated tools to measure levels of parent participation and collaboration in the NICU to tailor care practices in real-time, to be able to assess parent-partnered care models such as family integrated care (FICare). Above all, a broader measure is needed, that is not only centred around risk-evaluation but can also be used in a strengths-based approach to promote parent active participation in care and achieve better outcomes for infants and their parents.”

METHODS

The construct of parent participation is pertinent and credible, with a good and wide operationalizable definition. From the beginning, item generation is solidly anchored around the IPP with a rigorous procedure (method of extraction by two analysists and consultation with author of the IPP and with parents).

4. The participation of parents in reviewing questions and answer options was thorough, thus the article could, with a few adjustments, include an evaluation of the tool’s acceptability.

Response: Thank you for this feedback. As we did not include this in our main objectives of our study, we did not define this a priori, and we did not assess the time investment it took for parents to fill out the tool we did not include this in our methods and results, but did include it within our discussion: “Above, one of the main strengths is, that the tool was developed in close collaboration with parents, ensuring face and content validity. The tool was also acceptable and feasible for parents to fill out, with an average missingness in items of 2.3%, with 4 items >5% missingness and a maximum of 8.9%.”

5. In the section “Conceptualizing Six Domains”, I am not sure the mention that the construct went from multifactorial to dimensions is necessary. The six dimensions seem to be dimensions per se and not factors conditioning participation (daily care, medical care, information, advocacy, time, closeness). I would suggest simply introducing the definition of parent participation as multidimensional and proceeding to describe the six identified dimensions

Response: we agree; we have altered this towards: “The research team identified the definition of parent participation to be multidimensional and items were applied to each domain based on informal consensus in an empirical and iterative process.”

6. The two columns of table 1 should have head titles for clarity purposes (e.g. proposition/choice of answers).

Response: we have included this.

7. The wording of the propositions should be the same (e.g. “measure the temperature of my child” instead of “measuring”).

Response: we have amended this.

8. The verb form in Domains 1 and 2 should also be harmonized.

Response: we have amended this.

9. Furthermore, I have a doubt when it comes to the phrasing of items 19 and 20: ”I stuck up for my child” should probably read “I stood up for my child”.

Response: We have amended this.

10. Specification about individual questionnaire (p. 10, line 165): Was there an individualized questionnaire for each child, for mothers and fathers, or for both? Strength: evaluation by fathers, use of individualized questionnaires for multiple births.

Response: parents filled out 1 questionnaire per time point (independent of if they had singletons or twins) to decrease the burden of filling out questionnaires. We amended this towards: “In the case of families with multiple births, fathers and mothers received 1 questionnaire per time point.”

11. There was a good use of parallel questionnaires in the survey. Question: Were all concurrent questionnaires also filled at two timepoints (admission and discharge) using individualized questionnaires?

Response: that is correct; parents received all questionnaires at two timepoints. But for this study we focused on the CO-PARTNER at discharge. Outcomes relating to the other questionnaires and differences over time, will be subject to a different paper, as this was not the aim of the presented study.

RESULTS

12. In the methodology section, it is said that the questionnaire was filled at admission and discharge, but in the results, we only mention the discharge from the NICU. Did participants fill the questionnaire at both moments? If some did not fill the second one, were they excluded from the study? And if this is the case, how many filled only the first questionnaire?

Response: we included all parents who filled out the CO-PARTNER at discharge, and have amended this throughout the manuscript, to aid in clarification.

13. In table 2, it is said that a certain number of participants were non-Dutch speaking. What language did they speak and how did they fill the questionnaire? Was it offered in several languages?

Response: as proposed by one of the other reviewers, we have discarded the top of Table 2. In S2 we elaborate on language considerations: “The initial IPP and literature searches for definitions of parent participation were conducted primarily in English. The location of the pilot test within the larger intervention study was in Amsterdam, The Netherlands. The project leader is bilingual in English and Dutch. Forward translations of the 26 items from the IPP were completed from English to Dutch in duplicate. Forward translation occurred of both the parent participation definition and the 26 items from the IPP, and the following 62 items were obtained through Dutch language interviews. The 88 items were evaluated by Dutch speaking experts and parents. The final 34 items (CO-PARTNER) were used in a large Dutch language intervention study.”

14. The percentage of participants with a higher education level seems high (89.2%). Does this cover postsecondary education or university education? Could this be a sample bias or is it simply a reflection of the situation in the Netherlands? In Canada, 56.7% of adults hold postsecondary education diplomas – this is the lowest level of higher education – which is a higher rate than in the United States and than the world average, yet it is still much lower than the percentage in the study.

Response: you are correct, a large proportion of parents with university degrees participated in our studies, reflecting the highly educated parents participating in research and the highly educated sample of Amsterdam. We added this to the limitations of our study: “Also, parents who completed the tool were highly educated, and therefore future studies should include a more diverse sample of mixed levels of educated parents to validate our results.”

15. In the structural validity section, there may be a translation mistake, as it is not obvious that “output of my child” is appropriate and understandable for parents as “defecation and urination of my child”. Also, it is said that the elements regarding walking a small round and perform skin-to-skin were redundant, but there is no precision as to how this was resolved and if it was integrated to Domain 1 or 5.

Response: we have amended this towards: “Three items were removed, and included items highly correlated with each other ( “Keep track of defecation of my child” and “Keep track of urination of my child”, transformed into “Keep track of output (urination and defecation) of my child”) and two items were deemed redundant in the analysis phase by the author group (“Walking a small round with my child if it is permitted”) and “On average, how many minutes did you perform skin-to-skin per day?”).”

DISCUSSION

16. The interpretation of Domain 2 (Medical care) as being seemingly not as desirable as hypothesized could include a mention of the possibility that some parents simply do not want to get too involved in the direct medical care of their baby. Some actions in this domain greatly differ from normal baby care, which is central to the experience parents want to live throughout the exceptional experience that is hospitalization in a NICU. Medical care can be very stressful, complicated, even scary for many parents, and to some extent, exactly the opposite of normal daily care. As such, some parents may want to leave most of the medical care at the hands of the healthcare providers and instead concentrate on a way of parenting that is as close as possible to what they would do at home. Note that this is just a spontaneous reaction shared with the authors, not an obligation to add this nuance if it does not resonate with them.

Response: thank you for this insightful comment. We agree with you that this might be hypothesized, but in our own clinical experience with FICare, parents actually do want to participate in medical care as long as they are supported and coached sufficiently by nurses and other healthcare professionals. Nevertheless, we have added your insightful suggestion: “This domain represents areas of care that are associated with hospital unit specific tasks and might contain items that parents were not familiar with (yet), insufficiently coached into, or in which nurses were not comfortable supporting parents in. There might also be individual preferences or variations to what extent parents want to participate in medical care.”

17. Comparison with the PREEMI tool in the discussion should include the fact that the new tool truly integrated fathers from its initial conception , which will be very useful to better understand their needs and the areas in which they could need special support and attention in order to feel more comfortable and competent in caring for their baby.

Response: we totally agree, and we have taken the liberty to use your phrase in a sentence which we added: “The CO-PARTNER tool included fathers from initial conception, which provided insight into their specific needs and support to feel comfortable and competent in caring for their baby.”

18. A suggestion would be to add open qualitative questions to the tool with skip logic links to some answers in order allow participants to explain some difficulties in their own words. This would make the tool even more useful for quick and well-directed interventions when the tool is used for monitoring and quality control in clinical interventions, and not only to produce research data.

Response: we agree with you that this would be a nice feature to the tool. We therefore added it towards the discussion: “For clinical practice we envision that there is no summing of total scores, as the measure is intended to be a guide in understanding each parent’s unique style of caring and participation and identify gaps in the culture of the unit. One could consider adding open-ended free-text questions to allow participants to explain some difficulties in their own words.”

19. Future research should probably also include testing the tool in an intercultural context (immigration, language, lower level of education, religious identity when available, etc.), study with parents who had lost a sibling and with parents of a baby suffering from a congenital or metabolic syndrome. It is possible to eventually make evaluation for distinct questionnaires for fathers and mothers to deepen the understanding of the fathers’ experience and perspective using their own personal answers to some questions addressed specifically to them.

Response: thank you for this insightful suggestion; we added this to the discussion: “Future research should focus on use of the tool in different settings (for instance in level 3 units), different countries, different intercultural contexts (for instance immigration, language or lower levels of education) and different resource settings (for instance in units relying on care delivery by families out of necessity), and with parents of infants with a wider range of diagnoses to determine if further adaptation is needed to account for context.”

Attachment

Submitted filename: 20210401_ResponseToReviewers.docx

Click here for additional data file. (249.8KB, docx)

Decision Letter 1

Elisabete Alves

10 May 2021

Development and psychometric evaluation of the CO-PARTNER tool for collaboration and parent participation in neonatal care

PONE-D-20-36004R1

Dear Dr. van Veenendaal,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Elisabete Alves

Academic Editor

PLOS ONE

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: I Don't Know

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: COMMENTS: As already said, that everything [like execution, methodology, statistical analyses, etc] are very good [i.e. study is excellent]. Writing/presentation is also excellent. Later, comments {particularly regarding the comparison between the HTMT method and the Fornell-Larcker criterion} made [probably by other respected reviewers as well] were/are attended or answered positively/adequately, I am fully satisfied and the manuscript is improved a lot. I recommend acceptance.

Reviewer #3: Thank you for the detailed response you provided. This is a beautiful and rigorous article that will inspire many to explore the application of the new tool in the field. Measuring and documenting parents’ participation in the NICU is crucial to understanding how to better support them and learning about fathers’ specific experiences. This well-done study is sure to be useful!

At the beginning of the Methods section, the sentence beginning with “This psychometric study…” is a bit long and could be divided into two sentences. The addition of a comment and references about the limits of other tools in the introduction is appreciated and shows the pertinence of the selected validated tool for this study. The comment added in the discussion about the acceptability and feasibility of the tool is well supported using appropriate information, although I understand that the tool assessment was not embedded in the methodological design. Well done.

In the section about domains conceptualization, the new sentence is clear and simplifies reading. Again, well done! The addition of titles in Table 1, the standardization of the propositions’ wording and the harmonization of verbs when naming the domains are just what was needed to make it clearer. Changing the phrasing of pointed items in the form of short citations and in the descriptions of the survey process brings rigor and quality.

The discussion should mention that the comparison between the responses at admission and at discharge will be covered in a different paper. Precisions about language use and translation are clear and understandable. The comment about the fact that the participating parents were characterized as highly educated and the possibility of pursuing research with participants with mixed levels of education in the future is truly pertinent.

Amending the items in the structural validity section was relevant. The comment that was added about the parents’ possibly differentiated desire to participate in medical care is nicely nuanced and very appropriate. Thank you for considering the suggestion. The comment on the integration of fathers in the tool used was well integrated and extremely appropriate; it is an indirect but important way of recognizing and valuing their role.

In the discussion, suggestions to add open-ended questions to the tool in the future and explore different settings and contexts are well presented and will probably be extremely useful for future works inspired by your strong methodological design.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr. Sanjeev Sarmukaddam

Reviewer #3: No

Acceptance letter

Elisabete Alves

25 May 2021

PONE-D-20-36004R1

Development and psychometric evaluation of the CO-PARTNER tool for collaboration and parent participation in neonatal care

Dear Dr. van Veenendaal:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Elisabete Alves

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (DOCX)

    Click here for additional data file. (305.2KB, docx)
    Attachment

    Submitted filename: renamed_bfe4b.docx

    Click here for additional data file. (15.6KB, docx)
    Attachment

    Submitted filename: Reviewer comments Dec 2020 Copartner.docx

    Click here for additional data file. (21.9KB, docx)
    Attachment

    Submitted filename: 20210401_ResponseToReviewers.docx

    Click here for additional data file. (249.8KB, docx)

    Data Availability Statement

    There are ethical and legal restrictions on sharing a de-identified data set. Data from the study are available upon request, as there are legal and ethical restrictions on sharing these data publicly due to the data containing sensitive and identifiable information. The data set contains information like birthweight and gestational age of infants and information on parents - information that could be used to link and identify individuals, in relation with the information that the study was conducted in Amsterdam, the Netherlands. Above, sensitive information includes data on depression, anxiety, and stress in parents. In the informed consents signed by the parents and guardians of the infants of this study and granted by the regional committee for medical ethics in Nieuwegein, The Netherlands, guardians were not asked about data sharing. Researchers interested in the data may contact the Privacy protection officer in OLVG (fg@olvg.nl) and the ethics committee that approved the study (info@mec-u.nl) and provide the reference: NL ABR 56691.

    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES