Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Jun 15;16(6):e0252473. doi: 10.1371/journal.pone.0252473

Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A mixed-method study

Tayyebeh Ali-Abadi 1, Abbas Ebadi 2,3, Hamid Sharif Nia 4, Mohsen Soleimani 5, Ali Asghar Ghods 5,*
Editor: Paola Gremigni6
PMCID: PMC8205183  PMID: 34129615

Abstract

Introduction

Resilience has been proposed as a suitable solution to better deal with nursing students in cases of challenges but the complex and multidimensional nature of resilience has made its measurement challenging. This study aimed to develop and validate a new inventory theory-driven labeled Nursing Student Academic Resilience Inventory.

Methods

This study was performed with an exploratory sequential mixed-method design. In the qualitative phase of the study, individual interviews were conducted by including 15 participants to elicit the concept of resilience through purposive sampling. In the quantitative phase, psychometric analysis of the extracted items was performed using face, content, and construct validities (exploratory and confirmatory factor analyses) on a sample size of 405 nursing students. Besides, reliability has been tested using internal consistency and test-retest methods. According to the COSMIN standards, beside two important indicators of validity and reliability, responsiveness and interpretability were also considered.

Results

A 6-factor structure (optimism, communication, self-esteem/evaluation, self-awareness, trustworthiness, and self-regulation) with 24 items were extracted in terms of the derived categories from the qualitative phase. In confirmatory factor analysis, the χ2/df ratio was calculated as 2.11 for the NSARI six-factor structure. Suitable values were obtained for the goodness of fit indices (CFI = 0.904, AGFI = 0.885, IFI = 0.906, PCFI = 0.767, and RMSEA = 0.053). In the second-order factor analysis, AVE = 0.70 indicated the existence of both convergent and divergent validities. The Cronbach’s alpha and omega coefficients were investigated as (0.66–0.78) and (0.66–0.80), respectively. The AIC was between 0.33 and 0.45 for all factors, which is an acceptable rate. Additionally, an intraclass correlation coefficient (ICC) was obtained as .903 for the whole instrument (CI .846- .946, P <0.0001).

Conclusion

Multidimensional nature of resilience was supported through exploring its 6-factor structures in the nursing students’ field. This tool also showed an acceptable validity and reliability for measuring resilience in the population of nursing students.

1. Introduction

Previous studies conducted in Iran showed that nursing students are affected by various stressors such as lack of effective communication between trainer and students, unclear training goals, lack of essential efficacy when attending the patient’s bedside, fear of infectious diseases, assignments’ overload, and dissatisfaction with their field of study [13]. Resilience has been suggested as a beneficial solution for better dealing with challenges in nursing students, which leads them to play their professional roles in the future [4].

Resilience has evolved in the 1970s to understand why psychopathology is not always the consequence of risky environments among children [5]. Resilience is described as a characteristic, process or outcome that depends on the theory accepted by the researcher [6]. Theories can be effective on identifying and understanding the factors influencing an event or behavior as well as on determining how they work together. Therefore, a conceptual model can lead to obtain a better understanding of the existing conditions [7]. Resilience’s theories can be outlined to the following three different models of resilience: “compensatory”, “protective”, and “inoculation/challenge” [5]. In this study, Stephen’s resilience model as a protective model was used [4]. Whilst this model requires further empirical testing methods to validate its utility, it would provide a conceptual framework for designing a tool in nursing students, because this model mostly emphasizes on the importance of defining the concept of resilience as a process performed based on antecedent/perceived adversities, attributes/protective factors, and consequences/cumulative successes. Moreover, the proposed model combines perceived adversities with the use of individual protective factors to cope and/or be adapted with the difficulties effectively. The cumulative successes of these events would lead to the increased resilience demonstrated by the enhanced coping/adaptive abilities and well-being status [4].

The result of a review study yielded by Chmitorz et al. showed that various resilience scales have been developed [8], because resilience is a multidimensional construct that differs in different contexts, times, ages, and life conditions [9]. Several studies have found different factor structures of resilience in different populations and cultures [10, 11]. In addition, only one exploratory study was found performed in nursing student setting [12]. Therefore, it is not yet clear which factors measure the resilience in nursing students [13] that seems to be related to different natures of potential risk factors and protective processes which have led to some contradictions while the evaluation of designed interventions to promote resilience demands reliable and valid measures. In this way, researchers and clinicians do not have strong evidences regarding the choice of resilience measurement tools, which may make inappropriate choices in the field of study [14].

1.1 Research purpose and specific questions

To address the explained concerns, and regarding the lack of specific resilience tools in nursing students, the present study, in the first phase, aimed to explore the dimensions of resilience in nursing students based on the Stephen’s resilience theory. Moreover, the overall aim of the study was to design a new valid and reliable inventory for measuring resilience in nursing students. Therefore, to achieve this aim, there were two research questions as follows:

  1. What factors are related to the resilience of nursing students?

  2. Which one of these factors has a statistically significant effect on the resilience of nursing students?

2. Methods

2.1 Study design and procedures

This exploratory sequential mixed-method study [15] was conducted in Iran from May 2019 to August 2020. It is assumed that all methods in this regard have bias and weaknesses, but based on triangulating data sources in this kind of design as well as the collection of both quantitative and qualitative data, the weaknesses of each form of data is neutralized [15]. The data in the qualitative phase were collected through performing semi-structured interviews based on the resilience Stephen’s model in nursing students. Item generation and developing inventory were also done based on the categories extracted from the qualitative phase. Finally, psychometric properties were evaluated in the quantitative phase.

2.2 Participants

In the qualitative phase, thirteen under graduated bachelor’s nursing students aged between 18 and 25 years old (5 female and 8 male), one female nurse, and one female trainer who had good communication skills, including being fluent in Persian language, no hearing or speech problem, and intended to participate in this study were recruited. Two students were dropout of keeping the education and one student was conditional student.

As well, the quantitative phase included several stages. Face validity was tested by 13 nursing students (7 female, 6 male) in different semesters. Moreover, 11 experts in instrument development, nursing, and psychology were invited by email to validate this inventory in terms of content validity. 200 nursing students for EFA as well as 205 nursing students for CFA analysis were recruited from 6 different provinces in Iran (age = 21.70 ± 2.50; female = 258, male = 147).

2.3 Data collection

In the qualitative phase, the semi-structured individual interviews were conducted in a quiet room in the university or the educational class of hospital regarding the student’s choice. Students were selected through purposive sampling. The interviews were started by asking an icebreaker question through which the individual was allowed to talk openly about the topic. Exploratory questions were asked following asking the main questions derived from the Stephen resilience model. The exclusion criteria were any circumstance that may interfere with study participation such as speech and hearing impairments and having work experience in medical settings. In the qualitative studies, sample size cannot be pre-established, so the interviews were perpetuated until data saturation [16].

Data from the qualitative phase were used to develop Nursing Student Academic Resilience Inventory (NSARI) for the quantitative phase. At face validity stage the new designed inventory were completed by nursing students. Concerning content validity all experts were expertise in tool’s validation. Item analysis has been done by 36 nursing students who were selected using the stratified sampling. For construct validity, the final designed questionnaire was sent by some messengers to 405 nursing students who were selected by simple sampling method.

2.4 Statistical analysis

In qualitative phase, the analysis method used was deductive content analysis approach, which was recommended firstly by Elo et al. [17]. The interviews were audio-recorded, transcribed, and finally analyzed using MAXQDA software version 10. Data analysis was performed at three stages of preparation, organization, and reporting. During the preparation phase, semantic units were identified based on the purpose of the study. To get immersed in the data, the written interviews were read several times. To make sense, the researchers frequently asked wh-questions during performing the analysis. In the organizing phase, the text was read line by line and paragraph by paragraph in terms of the purpose of the study, and then important sentences and codes were identified. After this open coding, the lists of categories were classified under higher-order headings based on the comparison between these data and other observations that were not associated with the exact category. To assure data credibility, the samples were selected with maximum variations (from private and public universities, at different semesters, different ages, sexes, and scores). Additionally, to cover the variation of the phenomenon, a small data batch were firstly analyzed carefully and then it was determined that what additional data are needed in this regard. As well, peer checking was also done by three co-authors experienced in qualitative studies [17]. An example of the data analysis is shown in Table 1.

Table 1. An example of analysis process with category and theme.

Meaning unit Condensed meaning unit Code Category Theme
The higher experience, the more learning you will achieve. You can revise your mistakes and enhance your strengths. Learning through doing more Experience to find challenges The enhanced coping /adaptive abilities
Whatever you do for the second time, you will do it more safely if you have a successful previous experience. Convenience after a successful experience reducing stress through Successful experience Cumulative success

In the quantitative phase, the psychometric properties of the NSARI were assessed using face, content, and construct validities (exploratory and confirmatory factor analysis).

2.4.1 Face and content validity

Face validity only refers to the appearance of the instrument to the responders; in other words, what the test constructor intended to measure [18]. Confusing items were revised, duplicate, redundant items were merged, and essential items were added based on the results of the face and content validities. In terms of qualitative face validity, 13 nursing students were requested through convenience sampling to read the items loudly, explain the meaning of each item, and then identify problematic or ambiguous words for reconsideration. Following revising the items of the designed inventory according to the comments of the participants, at the qualitative face validity stage, quantitative face validity was assessed using the impact factor method based on the following equation:

ImpactScore=Frequency(%)*Importance

The items equal to 1.5 and above were retained and the other items were modified [16, 19]. Due to the COSMIN definition, content validity is “the degree to which the content of an instrument is an adequate reflection of the construct to be measured” [16]. In this way, content validity ratio (CVR) was done by 11 experts to determine the essential items according to the cut-off point proposed in a study by Lawshe [19]. The Content Validity Index for each item (ICVI), and then the modified kappa coefficient were calculated based on the following equation [20]. Finally, S-CVI was estimated.

K=I.CVIPC1PCPC=N!A!(NA)!×0.5N

2.4.2 Item analysis

Using a pilot study, the internal consistency was assessed before conducting the construct validity assessment, in order to recognize potential problems in the NSARI through estimating Cronbach’s alpha and inter-item correlation. The items whose corrected item-total correlation score was less than 0.3, were then removed from the analysis [21].

2.4.3 Construct validity

2.4.3.1. Exploratory factor analysis. Exploratory factor analysis was conducted to test the factor structure of the items of the NSARI. Thereafter, the Kaiser-Meyer-Olkin (KMO) statistic of sampling adequacy and the Bartlett test of sphericity were calculated to check the suitability of the data for factor analysis. In this regard, KMO 0.8 was considered as acceptable. Hence, the latent factors were extracted by estimating the maximum likelihood; an oblique factor rotation technique, promax. The allocation of the item to a factor was determined based on the formula CV = 5.152 √ (n -2), which was obtained as approximately 0.3 [22]. According to the three indicator rules, at least 3 items must be retained for each factor in the EFA [23]. Finally, the items with communalities less than 0.2 were removed from the EFA [24].

2.4.4 Confirmatory factor analysis

Confirmatory factor analysis was done on different samples including 205 nursing students selected by convenience sampling, in order to examine fit indices of the extracted factors using Amos 24 software. Table 2 shows the accepted fit indices (CMIN/ DF, RMSEA, PCFI, IFI, CFI, and PNFI) [25]. In the second-order factor analysis, it was supposed that the extracted latent factors in the first-order factor analysis are a reflection of a more general concept in the upper levels [26]; therefore, the second-order factor analysis was performed following performing the first-order factor analysis.

Table 2. Exploratory factor analysis of the NSARI.
Factor Items Factor loading h2 a Eigenvalue Variance (%)
Optimism Q12. There are many opportunities in nursing field for me .789 0.58 2.82 11.75
Q20. I am looking forward to be a great nurse in near future. .739 0.58
Q21. I am looking forward to an economic prosperity in the field of nursing. .719 0.37
Q17. I have a positive attitude toward nursing. .712 0.56
Q29. I am motivated to participate in internships. .360 0.36
Communication Q24. Patient companion reduces my stress. .739 0.47 1.97 8.2
Q26. Understanding my terms by my instructor, reduces my stress .641 0.49
Q25. Cooperation by nurses reduces my stress. .584 0.38
Q23. Having a good communication with attending physicians reduces my stress. .420 0.40
Self-esteem/ evaluation Q5. My instructors trust my judgment in taking care of the patients. .706 0.56 1.53 6.4
Q4. I get support from my instructors. .643 0.38
Q10. I have sufficient confidence in taking care of patients. .344 0.44
Q15. I have adequate knowledge in (science of) nursing. .316 0.29
Self-awareness Q9. I manage the difficulties of my academic years. .825 0.62 1.58 6.6
Q11. I’m not disappointed by the failures during my education. .521 0.45
Q30. I have adequate motivation to participate in theory sessions. .365 0.36
Trustworthiness Q2. I earn my patient’s trust by making a suitable communication. .570 0.48 1.41 5.9
Q1. By strengthening my nursing knowledge, I will do my best to take care of the patient. .470 0.50
Q6. I get support from my family. .439 0.34
Q7. My friends and colleagues support me. .420 .31
Self-regulation Q14. I examine all options to reach my goals. .783 0.43 1.59 6.62
Q22. My attempts are to strive and reach my goals. .461 0.41
Q32. I learn better by executing bedside procedures. .393 .36
Q13. I try to endure the academic hardship. .336 .37

a. Communalities.

2.4.5 Convergent and divergent validity

The criterion of Fornell-Larcker was used to estimate the convergent and divergent validities based on the average variance extracted (AVE) and the maximum shared variance (MSV). Of note, the convergent validity is generated when AVE> 0.5 and divergent validity is confirmed when MSV <AVE [27]. Additionally, Heterotrait-monotrait ratio of correlations (HTMT) criterion was clculated. It was established that all values in the HTMT matrix table should be less than .85 [28].

2.4.6 Reliability, responsiveness, and interpretability

Internal consistency of the NSARI was estimated using coefficients of Cronbach’s alpha, and Omega McDonald [29]. Those values above 0.6 were considered as acceptable [30, 31]. AIC above 0.2–0.4 was acceptable [32]. Construct reliability, which replaced Cronbach’s alpha in the structural equation model, was considered as acceptable in all values above 0.7 [33]. Test-retest reliability was conducted to investigate the questionnaire’s stability, in a way that 36 nursing students were requested to fill the questionnaire twice with a two-week interval. In this study, responsiveness was also determined by the Standard Error of Measurement (SEM) and the Minimal Detectable Change (MDC) score [34]. The MDC less than 30% was acceptable, and below 10% was considered as excellent [35]. To determine the interpretability of the NSARI, the distribution of total scores in the whole samples, floor, and ceiling effects was calculated. It was considered that the floor and ceiling effects are present if more than 20% of respondents attained the lowest or the highest score, respectively [36]. All the statistical analyses were done by SPSS- AMOS25 and SPSS R-Menu v2.0.

2.4.7 Normal distribution, outliers, and missing data

The univariate and multivariate normal distributions of data were investigated by skewness (±3) and kurtosis (±7), respectively [25]. The presence of a multivariate outlier was assessed by Mahalanobis d-squared (p< .001), and multivariate normality was assessed by Mardia coefficient of multivariate kurtosis (< 20) [37]. There was no missing data in this study due to completing the surveys by Porsline. In this online survey software, responders must respond to all questions because following and responding one question depends on answering the previous one.

2.5 Trustworthiness in the mixed-method study

To develop self-reflexivity, after transcribing each one of the interviews, the researchers analyzed the obtained data to uncover their preunderstandings. As well, the researchers consulted with team members on the extracted codes and themes and then described the data analysis process in detail and finally provided clear citations in this regard.

To diminish the threats to the internal and external validities of the mix-method study, the participants with different experiences were selected. As well, none of the samples in the qualitative phase participated in the quantitative phase. Furthermore, designing the item pool was performed based on the main categories and sub-categories extracted in the qualitative phase. Consequently, all the stages of the study were carefully reviewed and verified by the other researchers [19, 38].

2.6 Ethical consideration

This study was approved by the ethics committee of Semnan University of Medical Sciences (Approval Number IR.SEMUMS.REC.1398013) to develop a new valid and reliable tool to measure resilience in nursing students. The researchers included in this study were not working at the same institutions. Therefore, there was no conflict of interest. The researcher referred to the education deputy and received the demographic list of the included students. In several sessions, the students (in different educational semesters) were invited to participate in the study. Thereafter, the aim of this study, data confidentiality, and voluntarily participation were explained to them. In qualitative phase, the obtained informed consent was verbal, because using this way; the participants felt more intimate relationship for participating in their interview sessions. The IRB at this site was inclined to this procedure. Thereafter, in the quantitative phase, surveys were completed through Porsline software. At the beginning of the inventory, written informed consent was attached and the subjects declared their consent by clicking on “I agree to participate”.

3. Results

3.1 Qualitative phase

After condensing the codes extracted from the semantic units, 797 codes were finally obtained. These codes were allocated to three themes (Perceived stress, Protective factor, and Cumulative success), 9 categories (perceived stress: environment, relationship, Social-standing, Burnout, and moral distress; protective factor: personal and social; and cumulative success: Well-being and the enhanced coping /adaptive abilities), and 31 subcategories based on interviews in the field of nursing student and the Stephen’s model. Moreover, an item pool consisting of 93 items was generated to explain the resilience of nursing students based on the directed content analysis. Following discussing with the research team, the number of the items was reduced to 83 items. Table 1 demonstrates how items were generated from the qualitative results.

3.2 Quantitative phase

The clarity of the items in the initial item pool was evaluated by 13 nursing students through qualitative face validity. Afterward, the results of calculating the impact score of each item showed that all the 83 extracted items are suitable for measuring resilience. According to the results of CVR, the items with a numerical value of less than 0.59 were removed, and 52 items remained at last. Thereafter, 11 experts in the fields of instrument development, nursing, and psychology were recruited to assess CVR and CVI. Finally, after removing the items with the kappa index less than 0.74, 45 items were sent to the nursing students for item analysis. Notably, SCVI inventory was obtained as 0.92.

3.2.1 Item analysis

Cronbach’s alpha for 45 NSARI items was 0.88. Intra-class correlation coefficient of the NSARI total score specified a high level of temporal stability (ICC = 0.88, 95% CI: 0.82–0.93). Finally, 13 items were eliminated from the analysis due to their corrected item-total correlation scores were less than 0.3.

3.2.2 Construct validity

Total of 405 participants with the mean age of 2.72± 21.67 years old were recruited for construct validity. The majority of the students were women (N = 258, 63.7%). The adequacy index of sampling was 0.892, and the Bartlett’s test was statistically significant (df = 325, χ2 = 3123.231, P< 0.001).

3.2.2.1. Exploratory factor analysis. During performing exploratory factor analysis, 8 items were removed due to their low factor loading. The remaining 24 items were then loaded on six factors, which finally explained 45.47% of the total variance (Table 2). Correspondingly, the first factor was optimism, which can be defined as people’s positive expectations of what is happening in their lives [39]. In addition, having a positive optimistic attitude can help in more effectively dealing with stress [40]. The second factor was labeled as communication defined as the exchange of information, ideas, and feelings among people who use speech or other means [41]. Self-esteem/ evaluation as the third factor is known as a prime predictor of stress management indicateingthe degree of belief in the ability, importance, success, and individual’s competency [42]. The fourth factor was identified as self-awareness. Accordingly, this psychological component implies awareness of feelings, motivations, self-concept, and personality [43]. Trustworthiness as a worth demanding nurses to foster certain character attitudes and to strength effective task performance [44], was characterized as the fifth factor. Finally, self-regulation as the sixth factor was defined as the student’s attempt to manage learning processes focused on fulfilling goals [45].

3.2.2.2. Confirmatory factor analysis. Table 3 represents the Chi-square test and other fitness indices for the first-order CFA compared to the second-order model (Table 3).

Table 3. Fitness indices in the first and second-order factor analysis.
Indexes Cut-off values First-order Second-order
CMIN/DF < 3 2.11 2.23
P- value ≥ 0.05 <.0001 <.0001
RMSEA ≤ 0.08 0.053 0.055
PCFI ≥ 0.5 0.767 0.783
CFI ≥ 0.95 0.904 0.890
IFI ≥ 0.90 0.906 0.891
AGFI ≥ 0.90 0.885 0.875
PNFI ≥ 0.5 0.708 0.721

CMIN/DF: Minimum Discrepancy Function by degrees of freedom divided; RMSEA: Root mean square error of approximation; PCFI: Parsimonious Comparative Fit Index; CFI Comparative Fit Index; IFI: Incremental fit index; AGFI: Adjusted Good of Fit Index; PNFI: Parsimonious Normed Fit Index.

According to the final factor structure of the NSARI, some correlations between the measurement errors of items 4 and 5, 11 and 30, 6 and7, and 12 and 29 were detected (Fig 1). The second-order factor analysis was conducted to investigate whether all the factors fitted the general concept of “Resilience”. Fig 2 shows the structural model as well as the CFA of the NSARI.

Fig 1. The first-order factor analysis of the NSARI.

Fig 1

Fig 2. The second-order factor analysis of the NSARI.

Fig 2

3.2.3 Convergent and divergent validities and internal consistency

The convergent and divergent validities of the NSARI were not confirmed in the first-order factor analysis due to the presence of a latent factor, which indicated that all the extracted factors were a reflection of the concept called “Resilience”. The results of the second-order factor analysis (AVE = 0.70) indicated the existence of convergent and divergent validities. As well, the value in the HTMT matrix was less than .85, indicating that discriminat validity was estabilished in this study (Table 4).

Table 4. Discriminant validity assessment using the HTMT matrix.
Factor 1 Factor 2 Factor 3 Factor 4 Factor 5 Factor 6
Heterotrait-monotrait ratio of correlations (HTMT) Factor 1
Factor 2 0.525
Factor 3 0.641 0.532
Factor 4 0.639 0.465 0.685
Factor 5 0.754 0.517 0.678 0.614
Factor 6 0.722 0.694 0.629 0.696 0.706

The internal construct reliability was confirmed using cronbach’s alpha coefficients and McDonald omega. The AIC was obtained between 0.33 and 0.45 for all the factors, which was acceptable (Table 5). Moreover, the ICC was calculated as 0.903 (CI .846- .946, P <0.0001) through the test-retest method for the whole inventory.

Table 5. Internal consistency and construct reliability of NSARI.
Factor α AIC Ω CR
Optimism 0.787 0.450 0.806 0.806
Communication 0.678 0.367 0.701 0.700
Self-esteem/evaluation 0.685 0.357 0.691 0.653
Self-awareness 0.631 0.371 0.664 0.700
Trustworthiness 0.647 0.342 0.675 0.653
Self-regulation 0.662 0.330 0666 0.663

CR: Construct Reliability, AIC: Average inter item correlation.

3.2.4 Responsiveness and interpretability

The minimum detectable change percentage was calculated as below ten percent (8.61%) and the standard error of measurement was also determined (3.12). The effect of ceiling and floor on the total inventory scores was estimated to be less than 20%. Additionally, the mean and standard deviation of resilience score was different in students from different gender, with high and low GPA, semester, and different ages. The results of t-test and ANOVA showed that all these variables, except gender and age variables, had a significant difference between resilience scores (Table 6). Tukey post hoc test’s result about semester revealed that there was a significant difference between the second and sixth semesters (P = 0.02).

Table 6. Distribution of resilience scores in nursing students.
Variable Mean± SD Result
Semester 1 31±116.88 F = 3.29; df = 7; p = 0.002
2 16.27±128.31
3 17.29±122.48
4 14.44±122.52
5 11.53±130.28
6 16.16±120.25
7 14.73±133.55
8 16.87±124.79
GPA <17 16.92±123.32 t = -3.10; df = 382; p = 0.002
>17 14.56±130

3.2.5 Scoring items

Each item was rated on a five-point Likert scale (“completely agree”, “agree”, “no idea”, “disagree”, and “completely disagree”). The scores of the inventory were from zero to one hundred, and then the following scores were transformed to standard scores through the linear scoring using the formula stated below:

Transformedscale=(TheobtainedrowscoreThelowestpossiblerawscoreThehighestpossiblerawscoreThelowestpossiblerawscore)*100

Obviously, after converting the scores to the standard values, the higher average score of resilience close to one hundred indicated the higher score of the resilience in nursing students.

4. Discussion

The aim of present study was to develop a new inventory for measuring the resilience in nursing students. Although numerous tools have been designed in different contexts, there is only one study designed in nursing students. The Yang et al.’s study extracted 24 items through literature review and student interviews in two personal and contextual dimensions among Korean nursing. These dimensions were self-confidence, positivity, coping ability, emotional regulation, structured style, relationship, and social support [12]. As shown in this study, resilience is a multidimensional concept, but some other dimensions such as relationship and being able to cope are the core of the resilience. These results of this study support the result of the present study. Moreover, Thomas et al. in their integrative review declared some factors affecting resilience in nursing students that were grouped into the following three themes including support, time, and empowerment [46].

In this study, the NSARI including 24 items was designed. The psychometric of the NSARI showed the validity and reliability of the inventory. Furthermore, its internal consistency detected that all the items could measure resilience. Regarding reproducibility, the result of ICC identified that this inventory can probably catch up with reliable results at different times and places. The Cronbach’s alpha coefficient was obtained to be the range of 0.63 to 0.78. Nunnally et al. [31], and Moss [30] in their studies reported 0.6 as an acceptable value [31].

Based on exploratory factor analysis, six-factors, including optimism, communication, self-esteem/evaluation, self-awareness, trustworthiness, and self-regulation were extracted, which explained 45.47% of the total variance. Similarly, another review literature showed the existence of instability in the factor structure of the resilience scales in different populations [47]. The first-factor extracted in the present study was optimism. Numerous studies have shown the relationship between optimism and students’ ability to adapt, besides their educational performance. Soares et al. declared that a low level of optimism is a predictor of some problems such as maladaptation with the academic environment, the incidence of depressive symptoms, isolating feeling, stress symptoms during the first year of the course, and the reduced academic performance in subsequent years [39]. In another study, Camp showed that the academic optimism is positively correlated with surviving till finals and becoming well-qualified in the field, motivation, and academic achievement [43]. The second factor was communication. Accordingly, having the ability of an effective communication is an essential element for nursing students to feel well-being, which subsequently increases the level of their self-confidence, motivation, and self-esteem [48]. Also, Sheu et al. reported that the inability to communicate with nurses is one of the most important stressors among senior students [49]. Additionally, academic competency is evaluated based on academic achievement, classmate relationship, and social behaviors [50]. Furthermore, Marañón in their study stated that the student-instructor relationship is a determining factor in learning, which makes progress in the learning process, leads to shape students’ identities as forthcoming nursing professionals [51], and increases their motivation for learning [52]. The third extracted factor was self-esteem/evaluation. Having a high-level of self-esteem in managing the needs of nursing students during the practice course, as well as establishing a strong and therapeutic relationship with the patient is crucial [42]. In the present study, the students attempted to achieve self-esteem through knowledge enhancement, and making trust and support. The fourth extracted factor was self-awareness. Accordingly, since self-awareness is a key for preventing unhealthy reaction to stress, so nursing has accepted Maslow’s theory of motivation and Rogers’s view of self-awareness as fundamental issues of professional nursing [53]. This was also mentioned as an antecedent to high-quality nursing care [54], so that awareness of identity as a nurse allows us to be aware of the positive and negative effects of our roles. By being aware of the effects of characteristics such as age, gender, and race on another person, the nurse can better perform her/his job. As well, the “nursing process” is often described as a problem-solving method and the nurse’s self-awareness will help in answering the question what is the problem?. On the other side, by understanding the effects of characteristics such as age, gender, and race on another person, a nurse can better gain the patient’s trust and cooperation to stimulate patients’ active participation [55]. Next, the fifth extracted factor was trustworthiness. The development of resilience in nursing students hinges on a trust-based educational culture, which paves the way for caring. Nursing students can better focus on the needs of the patient in this culture [56]. In a systematic review of qualitative studies, Rørtveit et al. stated that nurses who facilitate the trust relationship, comprehensively engage, listen, and act as patient supporters [57]. In this study, total students tried to meet the patient’s needs by establishing a trust-based relationship through strengthening nursing knowledge. To achieve this goal, they benefited from the support of their family and friends. The last extracted factor was self-regulation. One of the protective factors in resilience is the development of self-regulation (both emotional and behavioral regulations) [50]. Indeed, those students who personally adjust their learning process, will learn more effectively [58]. Self-regulation is a deed that includes determining learning goals, adjusting personal effort, participating in time management, supervision, and evaluating existing performance [59]. In addition, one must be directed to a specific goal or organization to be motivated [60]. In this way, achievement in theoretical courses and becoming an expert in the clinical settings were considered as the goals of nursing students [45]. Therefore, students mostly try to maintain and promote resilience by determining and achieving compeling and task-based goals. In addition, according to the practical identity of nursing, the more the students do clinical procedures, the more expert they become.

Regarding the modification indices, 4 pairs of measurement errors among the measured items of the first, third, fourth, and fifth factors were allowed to co-vary freely, which consequently improved the final model fit noticeably.

According to the final model of NSARI, there was a correlation among the measurement errors of some items. The correlated measurement error occurs in the situation where variables were not recognized apparently or not measured directly. In addition, measurement errors may be resulted from the use of self-report data [61].

Construct validity indices showed the convergent and divergent validities in the final model. Convergent validity exists when the factors of the instrument are close together and explain a large variance. In other words, divergent validity exist when the extracted factors are separated from each other [37].

4.1 Limitations

Despite the validity and reliability of the inventory and the final approval of the factor structure, the present study has some limitations, including the method of data gathering through the self-report method and the sample disproportion regarding gender; however, this is common because nursing is a female-dominated profession [62]. Also, the design of the study was cross-sectional, so therefore to study the effects of time, and individuals’ characteristics, follow-up studies will be valuable to investigate the changes in the resilience factor structure. In addition, the percentage of extractive variance was calculated almost less than 50%, which is accepted by many psychometric studies. Moreover, a number of fit indices were found to be under the recommended cut-off point. To the best of our knowledge, the NSARI is the first inventory to measure resilience in a theoretically driven way that has the potential to track and predict resilience in nursing students, because of evidences of validity and reliability in this population. To ensure that the instrument is psychometrically robust, its psychometric properties should be tested using different statistical methods such as the Rasch model and structural equation modeling, in order to estimate age and gender effects. Further studies are recommended to investigate the conceptual structure of this inventory to gather more evidences regarding the psychometric properties of the inventory study.

Supporting information

S1 Dataset

(SAV)

Acknowledgments

We appreciate all nursing students who participated in this study, and also all the tutor and nurses who helped us to carry out this study.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Pourafzal F, Seyedfatemi N, Inanloo M, Haghani H. Relationship between Perceived Stress with Resilience among Undergraduate Nursing Students. Hayat. 2013;19(1):1–12(Persian). [Google Scholar]
  • 2.Moaddeli Z, Ghazanfari Hesamabadi M. A survey on the students’ exam anxiety in the Fatemeh (PBUH) College of Nursing and Midwifery, Spring 2004. Strides in Development of Medical Education. 2005;1(2):65–72. [Google Scholar]
  • 3.Nikanjam R, Barati M, Bashirian S, Babamiri M, Fattahi A, Soltanian A. Student-Life Stress Level and its Related Factors among Medical Students of Hamadan University of Medical Sciences in 2015. Journal of Education and Community Health. 2016;2(4):57–64. 10.21859/jech-02048. [DOI] [Google Scholar]
  • 4.Stephens TM. Nursing student resilience: a concept clarification. Nursing forum. 2013;48(2):125–33. doi: 10.1111/nuf.12015 [DOI] [PubMed] [Google Scholar]
  • 5.DeMichelis C, Ferrari M. Child and adolescent resilience within medical contexts: Springer; 2016. [Google Scholar]
  • 6.Mealer M, Schmiege SJ, Meek P. The Connor-Davidson Resilience Scale in critical care nurses: a psychometric analysis. Journal of nursing measurement. 2016;24(1):28. doi: 10.1891/1061-3749.24.1.28 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Shean M. Current theories relating to resilience and young people. Victorian Health Promotion Foundation: Melbourne, Australia: [Internet]. 2015. http://evidenceforlearning.org.au/assets/Grant-Round-II-Resilience/Current-theories-relating-to-resilience-and-young-people.pdf. [Google Scholar]
  • 8.Chmitorz A, Kunzler A, Helmreich I, Tüscher O, Kalisch R, Kubiak T, et al. Intervention studies to foster resilience—A systematic review and proposal for a resilience framework in future intervention studies. Clinical Psychology Review. 2018;59:78–100. doi: 10.1016/j.cpr.2017.11.002 [DOI] [PubMed] [Google Scholar]
  • 9.Singh K, Yu X-n. Psychometric evaluation of the Connor-Davidson Resilience Scale (CD-RISC) in a sample of Indian students. Journal of Psychology. 2010;1(1):23–30. [Google Scholar]
  • 10.Lock S, Rees CS, Heritage B. Development and validation of a brief measure of psychological resilience: The state–trait assessment of resilience scale. Australian Psychologist. 2020;55(1):10–25. [Google Scholar]
  • 11.Karaırmak Ö. Establishing the psychometric qualities of the Connor–Davidson Resilience Scale (CD-RISC) using exploratory and confirmatory factor analysis in a trauma survivor sample. Psychiatry Research. 2010;179(3):350–6. doi: 10.1016/j.psychres.2009.09.012 [DOI] [PubMed] [Google Scholar]
  • 12.Yang YH, Kim EM, Yu M, Park S, Lee H. Development of the resilience scale for korean nursing college students. Korean Journal of Adult Nursing. 2015;27(3):337–46. [Google Scholar]
  • 13.Ahern NR, Kiehl EM, Sole ML, Byers J. A review of instruments measuring resilience. Issues in comprehensive pediatric nursing. 2006;29(2):103–25. Epub 2006/06/15. doi: 10.1080/01460860600677643 [DOI] [PubMed] [Google Scholar]
  • 14.Windle G, Bennett KM, Noyes J. A methodological review of resilience measurement scales. Health and quality of life outcomes. 2011;9(1):8. doi: 10.1186/1477-7525-9-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Creswell JW, Creswell JD. Research design: Qualitative, quantitative, and mixed methods approaches: Sage publications; 2017. [Google Scholar]
  • 16.Polit DF, Yang F. Measurement and the measurement of change: a primer for the health professions: Wolters Kluwer Health; 2015. [Google Scholar]
  • 17.Elo S, Kyngäs H. The qualitative content analysis process. Journal of advanced nursing. 2008;62(1):107–15. doi: 10.1111/j.1365-2648.2007.04569.x [DOI] [PubMed] [Google Scholar]
  • 18.Waltz CF, Strickland OL, Lenz ER. Measurement in nursing and health research: Springer publishing company; 2010. [Google Scholar]
  • 19.Lawshe CH. A quantitative approach to content validity. Personnel psychology. 1975; 28(4): 563–575. [Google Scholar]
  • 20.Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in nursing & health. 2007;30(4):459–67. doi: 10.1002/nur.20199 [DOI] [PubMed] [Google Scholar]
  • 21.Cristobal E, Flavian C, Guinaliu M. Perceived e-service quality (PeSQ). Managing service quality: An international journal. 2007. [Google Scholar]
  • 22.Fok D. Development and testing of a Low Vision Product Selection Instrument (LV-PSI): A mixed-methods approach. 2011. [Google Scholar]
  • 23.Munro BH. Statistical methods for health care research: lippincott williams & wilkins; 2005. [Google Scholar]
  • 24.Hahs-Vaughn DL. Applied multivariate statistical concepts: Routledge; 2016. [Google Scholar]
  • 25.Pahlevan Sharif S, Sharif Nia H. Structural equation modeling with AMOS. Tehran: Artin Teb. 2018. [Google Scholar]
  • 26.Gatignon H. Statistical analysis of management data: Springer; 2003. [Google Scholar]
  • 27.Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research. 1981;18(1):39–50. [Google Scholar]
  • 28.Zaiţ A, Bertea P. Methods for testing discriminant validity. Management & Marketing Journal. 2011;9(2):217–24. [Google Scholar]
  • 29.Javali SB, Gudaganavar NV, Raj SM. Effect of varying sample size in estimation of coefficients of internal consistency. 2011. [Google Scholar]
  • 30.Moss S, Prosser H, Costello H, Simpson N, Patel P, Rowe S, et al. Reliability and validity of the PAS-ADD Checklist for detecting psychiatric disorders in adults with intellectual disability. Journal of intellectual disability research. 1998;42(2):173–83. doi: 10.1046/j.1365-2788.1998.00116.x [DOI] [PubMed] [Google Scholar]
  • 31.Nunnally JC, Bernstein I. Psychometric theory. New York: McGraw-Hill; 1994. [Google Scholar]
  • 32.Sharif Nia H, Goudarzian AH, Shahrokhi A, Boyle C, Wilson MS, Hosseinigolafshani SZ. Psychometric properties of End-of-Life Caregiving Experience Appraisal Scale: Iranian critical care nurses. Nursing in Critical Care. 2019. [DOI] [PubMed] [Google Scholar]
  • 33.Hair J, Black W, Babin B, Anderson R. Multivariate data analysis Black William C. 7th ed Harlow: Pearson Education Limited. 2014. [Google Scholar]
  • 34.Huang S-L, Hsieh C-L, Wu R-M, Tai C-H, Lin C-H, Lu W-S. Minimal detectable change of the timed “up & go” test and the dynamic gait index in people with Parkinson disease. Physical therapy. 2011;91(1):114–21. doi: 10.2522/ptj.20090126 [DOI] [PubMed] [Google Scholar]
  • 35.Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Quality of life research. 2010;19(4):539–49. doi: 10.1007/s11136-010-9606-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Yekaninejad M, Mohammadi-Zeidi I, Akaberi A, Golshan A, Pakpour A. Validity and reliability of the kidney disease quality of life-short form (KDQOL-SFTM 1.3) in iranian patients. 2012. [Google Scholar]
  • 37.Ali-Abadi T, Talepasand S, Boyle C, Sharif Nia H. Psychometric properties of The Baruth Protective Factors Inventory among nursing students. PloS one. 2020;15(6):e0233760. doi: 10.1371/journal.pone.0233760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Creswell JW. Research design: qualitative, quantitative, and mixed methods approaches. 4th ed ed. Thousand Oaks, California: SAGE Publications.; 2014. [Google Scholar]
  • 39.Soares MH, Luís MAV, Corradi-Webster CM, Martins JT, Hirata AGP. Psychological concept of optimism and drug use among nursing students. Acta Paul Enferm. 2011;24(3):393–9. [Google Scholar]
  • 40.Singh C, Sharma S, Sharma RK. Level of stress and coping strategies used by nursing interns. Nursing and Midwifery Research Journal. 2011;7(4). [Google Scholar]
  • 41.Kourkouta L, Papathanasiou IV. Communication in nursing practice. Mater Sociomed. 2014;26(1):65–7. Epub 02/20. doi: 10.5455/msm.2014.26.65-67 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Edwards D, Burnard P, Bennett K, Hebden U. A longitudinal study of stress and self-esteem in student nurses. Nurse education today. 2010;30(1):78–84. doi: 10.1016/j.nedt.2009.06.008 [DOI] [PubMed] [Google Scholar]
  • 43.Camp NE. The relationship of a course grade to hope and optimism in nursing students’ academic success: University of Alabama Libraries; 2016. [Google Scholar]
  • 44.Sellman D. The importance of being trustworthy. Nursing Ethics. 2006;13(2):105–15. doi: 10.1191/0969733006ne860oa [DOI] [PubMed] [Google Scholar]
  • 45.Cho M-H, Shen D. Self-regulation in online learning. Distance education. 2013;34(3):290–301. [Google Scholar]
  • 46.Thomas LJ, Revell SH. Resilience in nursing students: An integrative review. Nurse education today. 2016;36:457–62. doi: 10.1016/j.nedt.2015.10.016 [DOI] [PubMed] [Google Scholar]
  • 47.Losoi H, Turunen S, Wäljas M, Helminen M, Öhman J, Julkunen J, et al. Psychometric properties of the finnish version of the resilience scale and its short version. 2013. [Google Scholar]
  • 48.Subke J, Downing C, Kearns I. Practices of caring for nursing students: A clinical learning environment. International Journal of Nursing Sciences. 2020. doi: 10.1016/j.ijnss.2020.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Sheu S, Lin H-S, Hwang S-L. Perceived stress and physio-psycho-social status of nursing students during their initial period of clinical practice: the effect of coping behaviors. International journal of nursing studies. 2002;39(2):165–75. doi: 10.1016/s0020-7489(01)00016-5 [DOI] [PubMed] [Google Scholar]
  • 50.Masten AS, Powell L. A Resilience Framework for Research, Policy. Resilience and vulnerability: Adaptation in the context of childhood adversities. 2003:1. [Google Scholar]
  • 51.Marañón AA, Pera MPI. Theory and practice in the construction of professional identity in nursing students: A qualitative study. Nurse education today. 2015;35(7):859–63. doi: 10.1016/j.nedt.2015.03.014 [DOI] [PubMed] [Google Scholar]
  • 52.Jamshidi N, Molazem Z, Sharif F, Torabizadeh C, Najafi Kalyani M. The challenges of nursing students in the clinical learning environment: A qualitative study. The Scientific World Journal. 2016;2016. doi: 10.1155/2016/1846178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Eckroth-Bucher M. Self-awareness: A review and analysis of a basic nursing concept. Advances in Nursing Science. 2010;33(4):297–309. doi: 10.1097/ANS.0b013e3181fb2e4c [DOI] [PubMed] [Google Scholar]
  • 54.Kirkpatrick AJ, Cantrell MA, Smeltzer SC. Relationships among nursing student palliative care knowledge, experience, self-awareness, and performance: An end-of-life simulation study. Nurse education today. 2019;73:23–30. doi: 10.1016/j.nedt.2018.11.003 [DOI] [PubMed] [Google Scholar]
  • 55.Rawlinson JW. Self awareness: conceptual influences, contribution to nursing, and approaches to attainment. Nurse education today. 1990;10(2):111–7. doi: 10.1016/0260-6917(90)90205-5 [DOI] [PubMed] [Google Scholar]
  • 56.Amsrud KE, Lyberg A, Severinsson E. Development of resilience in nursing students: A systematic qualitative review and thematic synthesis. Nurse education in practice. 2019;41:102621. doi: 10.1016/j.nepr.2019.102621 [DOI] [PubMed] [Google Scholar]
  • 57.Rørtveit K, Hansen BS, Leiknes I, Joa I, Testad I, Severinsson E. Patients’ experiences of trust in the patient-nurse relationship-a systematic review of qualitative studies. 2015. [Google Scholar]
  • 58.Jouhari Z, Haghani F, Changiz T. Factors affecting self-regulated learning in medical students: a qualitative study. Medical education online. 2015;20(1):28694. doi: 10.3402/meo.v20.28694 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Phan HP. Critical thinking as a self-regulatory process component in teaching and learning. Psicothema. 2010;22(2):284–92. [PubMed] [Google Scholar]
  • 60.Raman J. Nursing student success in an associate degree program. Teaching and Learning in Nursing. 2013;8(2):50–8. [Google Scholar]
  • 61.Sharif Nia H, Pahlevan Sharif S, Boyle C, Yaghoobzadeh A, Tahmasbi B, Rassool GH, et al. The Factor Structure of the Spiritual Well-Being Scale in Veterans Experienced Chemical Weapon Exposure. J Relig Health. 2018;57(2):596–608. Epub 2017/07/28. doi: 10.1007/s10943-017-0458-1 . [DOI] [PubMed] [Google Scholar]
  • 62.Tung Y-J, Lo KK, Ho RC, Tam WSW. Prevalence of depression among nursing students: A systematic review and meta-analysis. Nurse education today. 2018;63:119–29. doi: 10.1016/j.nedt.2018.01.009 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Paola Gremigni

14 Jan 2021

PONE-D-20-37513

Development and psychometric properties of the Nursing Student Academic resilience Inventory (NSARI): A Mixed-Method study

PLOS ONE

Dear Dr. ghods,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We encourage the Authors to accomplish the Reviewers' requests and suggestions as much as possible and/or to give reasonable justifications for modifications they consider not suitable to make.

Please submit your revised manuscript by Feb 28 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Paola Gremigni, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include additional information regarding the questionnaires and qualitative guides used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information, or include a citation if it has been published previously.

3.We suggest you thoroughly copyedit your manuscript for language usage, spelling, and grammar. If you do not know anyone who can help you do this, you may wish to consider employing a professional scientific editing service.  

Whilst you may use any professional scientific editing service of your choice, PLOS has partnered with both American Journal Experts (AJE) and Editage to provide discounted services to PLOS authors. Both organizations have experience helping authors meet PLOS guidelines and can provide language editing, translation, manuscript formatting, and figure formatting to ensure your manuscript meets our submission guidelines. To take advantage of our partnership with AJE, visit the AJE website (http://learn.aje.com/plos/) for a 15% discount off AJE services. To take advantage of our partnership with Editage, visit the Editage website (www.editage.com) and enter referral code PLOSEDIT for a 15% discount off Editage services.  If the PLOS editorial team finds any language issues in text that either AJE or Editage has edited, the service provider will re-edit the text for free.

Upon resubmission, please provide the following:

  • The name of the colleague or the details of the professional service that edited your manuscript

  • A copy of your manuscript showing your changes by either highlighting them or using track changes (uploaded as a *supporting information* file)

  • A clean copy of the edited manuscript (uploaded as the new *manuscript* file)

4.Thank you for stating the following financial disclosure:

 "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

At this time, please address the following queries:

  1. Please clarify the sources of funding (financial or material support) for your study. List the grants or organizations that supported your study, including funding received from your institution.

  2. State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

  3. If any authors received a salary from any of your funders, please state which authors and which funders.

  4. If you did not receive any funding for this study, please state: “The authors received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

5. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

6. Please include a separate caption for each figure in your manuscript.

7. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

Additional Editor Comments:

Dear Authors,

Four Reviewers have completed the review of the manuscript. Most of them do not consider the manuscript acceptable in its actual form; however, I encourage the Authors to accomplish as much as possible the Reviewers' requests and suggestions and resubmit a new version of their work.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

Reviewer #4: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: I Don't Know

Reviewer #3: No

Reviewer #4: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Author,

1. It is better to write Sample size same in the abstract (15) and the main study (13).

2. If you write the Abbreviations (minimum) in the study readers can read easily your article.

3. You write the conclusion section in the abstract. It is better to write in the main study although it is optional (journal requirement)

4.Exploratory factor of the NSARI seems very good.

5. in Table 2 better to write abbreviations below the table.

Reviewer #2: Overall:

The topic is an important one; the instrument at face value has promise though there is a lack of discussion about what gaps exist in current instruments that this instrument addresses. Developing the instrument based on a model strengthens validity. It is clear that the authors have done a significant amount of work. The manuscript content covers a large amount of information and the reviewer wonders if this work would better be served by breaking it up into two manuscripts. The reviewer is concerned that, due to word/space limits, study details are not able to be described adequately. There are multiple areas where additional information is needed to fully convey study details and supportive information.

Concerns:

Grammar, word choice & sentence structure issues are barriers to fully comprehending the manuscript content. Most of the manuscript is also written in present/future tense; if the studies are completed, it should all be written in past tense.

There is not enough detail about current instruments and what makes this instrument necessary.

P. 7 lines 150-151: the authors state “There is no missing data in the study due to completing the surveys by an online Survey software (Porsline).” The reviewer does not understand how having surveys completed online assures no missing data.

Description of instrument development is challenging to follow and to comprehend.

A description of the factors comes in the discussion section, but there is lacking a robust description of these in the results section.

The reviewer believes that content in this manuscript was ambitious and likely too much to include in a single manuscript. Ultimately, this detracted significantly from fully comprehending and appreciating the processes of instrument development and the value of this newly developed instrument.

Reviewer #3: Thank you for the hard work on this manuscript. The authors did well by performing different analyses to establish the validity and reliability of the tool. Please attend to the following

1.kindly check the grammar and ensure correct sentence structures

2.You indicated using Stephen's Resilience Model. This is a good model but I don’t see from your writing how this model informed your research.

3.The title and introduction look as if you are developing an entirely new tool. However, the factor structures seem to suggest that you were validating the NSARI tool in the Iranian context. Can you please clarify this?

4.The qualitative results did not indicate which items were generated and how they were elucidated from the qualitative study. It will be good to get a clear path on how items are generated from the interview data before psychometric analysis. At the moment, your qualitative results did not capture that. It is advisable to, at least, state the themes, categories, and sub-categories backed by participant quotes. This will provide evidence on how you arrived at the items that are used in the quantitative phase

5.In line 132, you indicated the inventory was revised by 13 nursing students in the qualitative face validity stage. How were these revisions done because your qualitative methodology only talk about how the items would be developed, and not about revision

6.Under the results in the quantitative phase, Line 209-2016 seems to be talking about method rather than results. Can you move this to the methods section?

7.In line 209-210, you indicated that “In the psychometric evaluation phase, confusing items are revised and duplicate, redundant items are merged and essential items are added based on the results of the face and content validity” How were these revisions and merging done. Where from the ‘essential items”? Face validity, as we know is usually done by experts. Who were the ‘experts’ in your study? Please kindly explain how this was done as it forms an essential aspect of instrument development

8.I am not too conversant with your measurement of convergent and divergent validity. However, I do know that the common, and probably the best, way of determining divergent validity for instance is to measure the focal construct (in this case resilience) and another closely related concept using the same instrument. Divergent validity would be established when the two measures are weakly correlated. This is to ensure that the tool is not measuring other constructs. I know this may not have been your intent but it is worth knowing.

Reviewer #4: Dear Authors,

I had the opportunity to review the manuscript "Development and psychometric properties of the Nursing Student Academic resilience Inventory (NSARI): A Mixed-Method study" for PLOS ONE. In my review of the paper, I will provide suggestions that may be useful for these authors to take into account in future studies and/or revisions of this manuscript.

One of the main comments is related to lack of flow in reading in the methods session. Perhaps creating a specific section for the detailed description of the participants, another session for the details of the procedure, another session for the measurements and finally statistical analysis, could improve the reading considerably.

For construct validity, the authors used a methodological approach that is commonly used in the field; however, the approach assumes a linear relationship between the items and the factor. Also, this methodology assumes a gaussian distribution of the outcome. This approach can be a problem for the construction of domains. Accurate methods for detecting relation between items are relevant for designing and determine the factor distribution. I suggest using Item Response Theory (IRT), specifically Graded Response Model (GRM; Samejima, 1969, 1997), Generalized Partial Credit Model (GPCM; Muraki, 1992) or multidimensional graded response model (MGRM). The IRT models examine the overall response patterns across all the items, while factor analytic methods examine covariances between the individual items. As a consequence of evaluating item response patterns, the parameter estimates provide insight into how the items work. Finally, the IRT estimates constructs assuming nonlinear relationship between latent traits and item responses.

For IRT authors can use mirt package. It’s a powerful package and free tool for psychometric analyses: Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29.

Another suggested approach to construct validity is an exploratory structural equation modeling (see Asparouhov et al., 2009) approach.

Asparouhov, Tihomir, and Bengt Muthén. "Exploratory structural equation modeling." Structural equation modeling: a multidisciplinary journal 16.3 (2009): 397-438.

I’m agreed with authors, it’s necessary to estimate age and sex effect. However, I suggest reviewing the papers related to this issue of Rivera and Wim Van der Elst:

Rivera, D., Olabarrieta-Landa, L., Van der Elst, W., Gonzalez, I., Rodríguez-Agudelo, Y., Aguayo Arelis, A., ... & Arango-Lasprilla, J. C. (2019). Normative data for verbal fluency in healthy Latin American adults: Letter M, and fruits and occupations categories. Neuropsychology, 33(3), 287.

Van der Elst, W., Ouwehand, C., van Rijn, P., Lee, N., Van Boxtel, M., & Jolles, J. (2013). The shortened raven standard progressive matrices: item response theory–based psychometric analyses and normative data. Assessment, 20(1), 48-59.

Please add the exclusion criteria that were used to enroll participants in the study.

Please provide information about how the sample size was calculated in each group.

Provide more information about dace and content validity data analyses technique

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Kristen Abbott-Anderson, PhD, RN, CNE

Reviewer #3: No

Reviewer #4: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Revise PONE-D-20-37513_reviewer.pdf

PLoS One. 2021 Jun 15;16(6):e0252473. doi: 10.1371/journal.pone.0252473.r002

Author response to Decision Letter 0


2 Feb 2021

Dear Editor-in-Chief of PLOS ONE Journal

Dr. Joerg Heber

Response to reviewers

Thank you for your thorough review and consideration of our manuscript “Development and psychometric properties of the Nursing Student Academic resilience Inventory (NSARI): A Mixed-Method study" that was submitted to PLOS ONE Journal.

We believe that the comments and suggestions that were recommended by the reviewers have informed a much improved and more fully developed paper that will offer an important contribution to the field.

Given the word length requirements for clinical research briefs, we are somewhat stymied by the extent of details we can provide, However, and of critical importance, attention has been paid to developing a clearer rationale that addresses the significance of this work. More information has been provided to describe the measures used and data analysis conducted and this revised paper has more clarity about the comments and suggestions the reviewers has proposed.

We have highlighted the changes that were undertaken in response to your comments in the revised manuscript. A response to each of your comments is below.

Please feel free to contact me with any questions and concerns. I look forward to hearing from you regarding the manuscript.

Thanks for your kind attention to the manuscript.

Sincerely, Corresponding author

1. It is better to write Sample size same in the abstract (15) and the main study (13).Due to this study is a mixed method study and has qualitative and quantitative phase , also in quantitative phase has several stage so the number of participants is different in every stage but overall, the number of participants in the qualitative stage was 15 participant and in final stage of psychometric (EFA, CFA) was 405.

P: 2 Methods: individual interviews are conducted with 15 participants

psychometric analysis …….. with a sample size of 405 nursing students.

2. If you write the Abbreviations (minimum) in the study readers can read easily your article.P:7,8,9,13

The abrevation are written, and highlited.

3. You write the conclusion section in the abstract. It is better to write in the main study although it is optional (journal requirement).The abstract was written based on instruction for author.

4.Exploratory factor of the NSARI seems very good.Thank you for your kind comment.

5. in Table 2 better to write abbreviations below the table.P: 12.

It is written , and highlighted

Reviewer2

Grammar, word choice & sentence structure issues are barriers to fully comprehending the manuscript content. Most of the manuscript is also written in present/future tense; if the studies are completed, it should all be written in past tense.The present/future tense has been changed to past tense.

There is not enough detail about current instruments and what makes this instrument necessary.P: 4

Diverse approaches to measuring resilience affected by different nature of potential risk factors and protective processes have led to contradictions [8]. While establishing the resilience concept as a meaningful concept in research and clinical practice, it is inevitable to determine its distinctive factors and measure its factors in a valid and reliable method [9]. Different studies have found different factor structures of resilience tools in different populations and cultures [11, 12]. Even though measuring resilience has done by a number of researchers such as Charney[11], Wagnild[12], Kobasa[13], but researchers and clinicians do not have strong evidences about the choice of resilience measurement tools and may make inappropriate choices in the field of study [13]. Notwithstanding the prevalence of stress and the obligation to design an appropriate tool to assess students' resilience, it is not yet clear which factors measure the resilience in nursing students

P. 7 lines 150-151: the authors state “There is no missing data in the study due to completing the surveys by an online Survey software (Porsline).” The reviewer does not understand how having surveys completed online assures no missing data. In online Survey software responders have to respond all question because of following and responding one question was dependent on answering previous question, so much so,there was no missing data.

A description of the factors comes in the discussion section, but there is lacking a robust description of these in the results section. P:11

Items 12, 20, 21, 17,29 were assumed to mention optimism, items 24, 26,25,and 23 were reflected communication, Self-esteem/ evaluation was attributed to items 5,4,10,15, also items 9,11,30 composed Self-awareness, items 2,1,6,7 formed trustworthiness, and items 14,22,32, and 13 were hypothesized to reflect the Self-regulation (Table 2).

The reviewer believes that content in this manuscript was ambitious and likely too much to include in a single manuscript. Ultimately, this detracted significantly from fully comprehending and appreciating the processes of instrument development and the value of this newly developed instrument.Due to avoiding salami publication, this article has been written as mixed method study.But we are somewhat stymied by the extent of details we can provide, However, and of critical importance, attention has been paid to developing a clearer rationale that addresses the significance of this work.

Reviewer3

1- kindly check the grammar and ensure correct sentence structures. It is done.

2- You indicated using Stephen's Resilience Model. This is a good model but I don’t see from your writing how this model informed your research.P: 3

In this study Stephen's resilience model was used which emphasized the importance of defining the concept of resilience as a process, also was proposed in nursing student setting.

P: 5

Exploratory questions were asked following the main questions that were derived from the Stephen resilience model. The main questions included “explain about the situation experienced stress during nursing education.”, “which protective factors did you apply in these situations?”, and “explain about cumulative success do you have acquired?”.

3-The title and introduction look as if you are developing an entirely new tool. However, the factor structures seem to suggest that you were validating the NSARI tool in the Iranian context. Can you please clarify this?P:5,6

The data in the qualitative phase were collected through semi-structured interviews based on resilience Stephen's model in nursing students. Item generation and developing inventory were done based on the categories extracted from the qualitative phase. Then, psychometric properties were evaluated in the quantitative phase. …….

the first draft of the inventory is developed based on the findings of the directed content analysis.

4- The qualitative results did not indicate which items were generated and how they were elucidated from the qualitative study. It will be good to get a clear path on how items are generated from the interview data before psychometric analysis. At the moment, your qualitative results did not capture that. It is advisable to, at least, state the themes, categories, and sub-categories backed by participant quotes. This will provide evidence on how you arrived at the items that are used in the quantitative phase. P:10

An example of how the data were analyzed is shown in Table1.

P: 9

These codes were allocated to three themes, 9 categories (perceived stress: environment, relationship, Social-standing, Burnout, moral distress; protective factor: personal, social; cumulative success: Well-being, enhanced coping /adaptive abilities), and 31 subcategories based on interviews in the field of nursing student and Stephen’s model.

5- In line 132, you indicated the inventory was revised by 13 nursing students in the qualitative face validity stage. How were these revisions done because your qualitative methodology only talk about how the items would be developed, and not about revision. The psychometric properties (in quantitative phase) includes face validity, content validity, construct validity,and reliability. Face validity is assessed both qualitatively and quantitatively.In the qualitative face validity, participants are asked to read aloud the items, explain what each item means, and determine the problematic or ambiguous words for revision.Then items are revised and rewritten according to their views. Quantitative face validity is performed to determine the importance of each item.

6- Under the results in the quantitative phase, Line 209-2016 seems to be talking about method rather than results. Can you move this to the methods section?This paragraph is related to the result of face and content validity.

7- In line 209-210, you indicated that “In the psychometric evaluation phase, confusing items are revised and duplicate, redundant items are merged and essential items are added based on the results of the face and content validity” How were these revisions and merging done. Where from the ‘essential items”?

Face validity, as we know is usually done by experts. Who were the ‘experts’ in your study? Please kindly explain how this was done as it forms an essential aspect of instrument development. P: 6

Face validity refers only to the appearance of the instrument to the responders; that is, an instrument appears to measure what the test constructor claims it measures and also motivate participants to respond the survey[16]. In terms of qualitative validity, participants were asked to read the items aloud, explain the meaning of each item, and identify problematic or ambiguous words for reconsideration Face validity is not validity in the true sense and refers only to the appearance of the instrument to the layperson; that is, if upon cursory inspection, an instrument appears to measure what

the test constructor claims it measures, it is said to have face validity. ) If an instrument has face validity, the layperson is more apt to be motivated to respond, thus its presence may serve as a factor in increasing response rate. Face validity,

when it is present, however, does not provide evidence for validity, that is, evidence that the instrument actually measures what it purports to measure). Carolyn Feher Waltz, Ora Lea Strickland, Elizabeth R. Lenz, Measurement in Nursing and Health Research. Fourth Edition(

8- I am not too conversant with your measurement of convergent and divergent validity. However, I do know that the common, and probably the best, way of determining divergent validity for instance is to measure the focal construct (in this case resilience) and another closely related concept using the same instrument. Divergent validity would be established when the two measures are weakly correlated. This is to ensure that the tool is not measuring other constructs. I know this may not have been your intent but it is worth knowing. The criterion of Fornell-Larcker was used to estimate the convergent and divergent validity based on the average variance extracted (AVE), the maximum variance (MSV).

(Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research. 1981;18(1):39-50.

Factor Analysis and Discriminant Validity: A Brief Review of Some Practical Issues )

Reviewer4

. Perhaps creating a specific section for the detailed description of the participants, another session for the details of the procedure, another session for the measurements and finally statistical analysis, could improve the reading considerably.P:4

As far as this study is a mixed method study with two phase qualitative and quantitative with their own pariticipants and procedures , therefore the main devision is based on these phases.

For construct validity, the authors used a methodological approach that is commonly used in the field; however, the approach assumes a linear relationship between the items and the factor. Also, this methodology assumes a gaussian distribution of the outcome. This approach can be a problem for the construction of domains. Accurate methods for detecting relation between items are relevant for designing and determine the factor distribution. I suggest using Item Response Theory (IRT), specifically Graded Response Model (GRM; Samejima, 1969, 1997), Generalized Partial Credit Model (GPCM; Muraki, 1992) or multidimensional graded response model (MGRM). The IRT models examine the overall response patterns across all the items, while factor analytic methods examine covariances between the individual items. As a consequence of evaluating item response patterns, the parameter estimates provide insight into how the items work. Finally, the IRT estimates constructs assuming nonlinear relationship between latent traits and item responses.For IRT authors can use mirt package. It’s a powerful package and free tool for psychometric analyses: Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29.Although ther authors believe that test development decisions could be improved by using additional information about item responses, the purpose of this study was development and psychometric properties of instrument, therefore item selection was based on indices of difficulty and discrimination (classic approach). (Introduction to Classical and Modern Test Theory. Linda Crocker, James Aigina)

P: 19 ; Also, in the suggestion section it is suggested:

To ensure that the instrument is psychometrically robust, its psychometric properties should be tested using different statistical methods and among different populations. Therefore, it is suggested that the Rasch model is used to test the NSARI psychometric properties of additional information.

Another suggested approach to construct validity is an exploratory structural equation modeling (see Asparouhov et al., 2009) approach.

Asparouhov, Tihomir, and Bengt Muthén. "Exploratory structural equation modeling." Structural equation modeling: a multidisciplinary journal 16.3 (2009): 397-438.

I’m agreed with authors, it’s necessary to estimate age and sex effect. However, I suggest reviewing the papers related to this issue of Rivera and Wim Van der Elst. The study was a mixed method study that represents an alternative methodological approach to traditional qualitative or quantitative research approaches to develope and psychometric properties of resilienceinstrument, the main purpose was not development of a resilience model, therefore item selection was based on indices of difficulty and discrimination (classic approach).

p:20

In addition the amount of data in the mixed method study is high, due to the word restriction in the article I would suggest in the suggestion section that it is consider in further study.

Please add the exclusion criteria that were used to enroll participants in the study. P:4

The study population includes all bachelor's nursing students who intended to participate in this study. The exclusion criteria was any circumstance that may interfere with study participation

Please provide information about how the sample size was calculated in each group. P: 5; In qualitative research there is not exact sample size and data saturation is importan.

To achieve maximum data diversity students were selected of both gender, different semesters, private and public universities. The interviews were perpetuated until data saturation.

For instruments with less than forty items, samples of 200 were reported to be adequate.( Lin SY, Tseng WT, Hsu MJ, Chiang HY, Tseng HC (2017) A psychometric evaluation of the Chinese version of the nursing home survey on patient safety culture. Journal of clinical nursing 26: 4664-4674.)

Provide more information about face and content validity data analyses technique. P:6

The psychometric properties (in quantitative phase) includes face validity, content validity, construct validity,and reliability. Face validity is assessed both qualitatively and quantitatively.In the qualitative face validity, participants are asked to read aloud the items, explain what each item means, and determine the problematic or ambiguous words for revision.Then items are revised and rewritten according to their views. Quantitative face validity is performed to determine the importance of each item.

Face validity is not validity in the true sense and refers only to the appearance of the instrument to the layperson; that is, if upon cursory inspection, an instrument appears to measure what the test constructor claims it measures, it is said

to have face validity. ) If an instrument has face validity, the layperson is more apt to be motivated to respond, thus its presence may serve as a factor in increasing response rate. Face validity, when it is present, however, does not provide

evidence for validity, that is, evidence that the instrument actually measures what it purports to measure). Carolyn Feher Waltz, Ora Lea Strickland, Elizabeth R. Lenz, Measurement in Nursing and Health Research. Fourth Edition(

p:7

Validity has then been commonly separated into various types—such as construct validity, content validity, onvergent and divergent validity, face validity, and factorial validity. COSMIN defi ned content validity as “the degree to which the content of an instrument is an adequate refl ection of the construct to be measured”.

Attachment

Submitted filename: Response to reviewers.doc

Decision Letter 1

Paola Gremigni

12 Feb 2021

PONE-D-20-37513R1

Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method study

PLOS ONE

Dear Dr. ghods,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The study behind the manuscript has some merits and some limitations; however, the manuscript in its revised form is not still able to clearly underline them. The Authors answered only partially to most of the Reviewers’ concerns; very often they simply reported, in response, exactly what they had already written in the manuscript without any change or explanation when they did not agree. I want to emphasize here that responding appropriately, comprehensively, and convincingly to Reviewers is mandatory for a manuscript to be accepted for publication.

Based on my consideration of some merits of the research, I ask the Authors to further revise their manuscript following my advises listed below as Additional Editor Comments.

Please submit your revised manuscript by Mar 29 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Prof. Paola Gremigni, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments:

1) Introduction. Response to Reviewer #2-second point was not exhaustive. You can cite and synthetize concepts expressed by the review of resilience measures by Windle, Bennet, Noyes (2011 in HQoLO) to justify the necessity of a new scale like your.

2) The issue of missing data raised by Reviewer #2 is of maximum importance in research. It is not a matter of only answering the Reviewer, but to add an explanation in the manuscript for the readers. So, you should report your response statement into the manuscript when you described the methods.

3) As Reviewer #2 observed, a robust description of the factors that emerged is missing in the results section. Your answer to this observation was not convincing; thus, I ask you to move from the Discussion to the Results the definitions of the constructs measured with the 6 factors. Particularly: lines 315-317 for optimism; add a definition of effective communication that is missing; line 334 for self-esteem; line 339 for self-awareness; add a definition for trustworthiness that is missing everywhere; lines 357-361 for self-regulation.

4) The last concern by Reviewer #2 could be answered more effectively. I would like to see a new paragraph named “Study design and Procedures” at the beginning of the Methods. There, you should state that you used an exploratory sequential mixed-method approach, citing a recent reference to this approach (e.g, Creswell and Plano Clark, 2011 or Onwuegbuzie and Combs 2010 or others) and explaining that this approach draws on the strengths of both the qualitative and quantitative methodologies. (This is, indeed, a strength of your study). Followed by lines 103-107.

5) Reviewer’s #3 point 2 should be thoroughly answered. The phrase in lines 75-77 is grammatically incorrect. You can say that in this study, Stephen's resilience model of resilience in nursing students was used. This model emphasizes the importance of defining the concept of resilience as a process based on antecedent/perceived adversities, attributes/protective factors, and consequences/cumulative successes. The proposed model combines perceived adversities with the use of individual protective factors to effectively cope and/or adapt (page 130, Stephens, 2013).

6) To clarify any doubt like Reviewer’s #3 point 3, you should add the word “new” in the Abstract, line 33 “…to develop and validate a theory-driven new inventory labeled …”.and in the Introduction, line 94 “…..to develop and design a new valid and reliable inventory….”

7) Reviewer‘s #3-point 6 request should be accomplished. Lines 229-230 describe the method of the quantitative phase; thus, it is better to move it above after line 135.

8) To come to a compromise between the first request by Reviewer # 4 and your position, I ask you to eliminate the too generic Participants paragraph. Data collection of the qualitative phase should also include indication about recruitment of the participants and a more detailed description of the sample. For example: thirteen bachelor’s nursing students aged 18-25 years (indicate the percentage of gender), one (female?) nurse, and one (male?) trainer were recruited by a convenient sampling approach and participated only in the qualitative phase of the study (if it is true)

9) In the Quantitative phase a Data collection paragraph is totally missing. There, you should report how many independent samples you recruited for this phase and how. For example, suddenly 36 students (line 155) appeared that you had never talked about before. Again 11 experts (line 234) appeared by surprise when you reported the results of content analysis, too late to mention this small sample. Who they were? Experts of what? How and where have been recruited?

You should summarize briefly in this new Data collection paragraph the samples issues: how many samples did you involve in the quantitative phase of the study and where and how they were recruited? For example: you recruited (how?) 36 students for running the calculations for quantitative face validity, item analysis, test for normality and outliers, and test-retest reliability, or not?. You recruited 11 experts (who, where, how?) to calculate content validity indices. You recruited 200 students (where and how?) to run EFA and other 205 students (where and how?) to run the subsequent CFA” Or you calculated all the preliminary quantitative analyses using the answer of the first 13 students? In this case, the power of these calculations could be very low….. I am just guessing because it is not at all clear. Then, you will describe better the characteristics of those samples in the appropriate subsequent paragraphs.

10) The phrase “All the statistical analyses were calculated by SPSS-AMOS25 and SPSS R-Menu v2.0.” should be moved at the end of the quantitative phase, following line 204.

11) Ethical consideration: it is not enough to explain to the participants the volunteering and confidentiality of data, you should also explain the objectives of the study and collect their informed consent to participate in the study.

12) Results line 241: “Finally 13 items were eliminated from the analysis.” You should explain why, based on what criteria?

13) Construct validity line 243: you should report the sample size of the sample used here and percentage of female, besides absolute number.

14) Confirmatory factor analysis line 254. As in the previous paragraph, you should report here the sample size for this part, age and gender.

15) ANOVA results line 290. Why did you not calculate multiple comparisons between subgroups based on semester?

16) Scoring items line 294: you should explain why you gave an indication for obtaining a total (summative) score instead of 6 factors scores, especially because in the Discussion you dedicated a large room to the description of the six constructs.

17) Discussion: you cannot say “The CFA results detected the fitness of the final model”, because a number of fit indices you reported were under the recommended cutoff. Thus, you should underline and comment it.

18) Limitations should be expanded: 1) a probably sample disproportion regarding gender; 2) the use of validity indices based only on the internal structure of the scale. In future studies other methods could be used, like the heterotrait-monotrait (HTMT) ratio rates correlations, or the multitrait–multimethod matrix (MTMM), also correlating the instrument with external comparators (e.g, other measures of resilience); 3) the use of modification indices for fitting CFA results to your own data. This is an object of much disagreement among quantitative methodologists since this is a kind of “post hoc model modification” or a data-driven modification of the original hypothesized model. Other approaches could be used in future study to avoid this issue, like the exploratory structural equation modeling (ESEM) (see Asparouhov et al., 2009) as suggested by Reviewer #4.

Minor issues

A linguistic revision is still needed; a few present tense is still there, and many phrases are not understandable.

[Note: HTML markup is below. Please do not edit.]

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jun 15;16(6):e0252473. doi: 10.1371/journal.pone.0252473.r004

Author response to Decision Letter 1


22 Feb 2021

Dear Editor-in-Chief of PLOS ONE Journal

Dr. Joerg Heber

Response to reviewers

Thank you for your thorough review and consideration of our manuscript “Development and psychometric properties of the Nursing Student Academic resilience Inventory (NSARI): A Mixed-Method study" that was submitted to PLOS ONE Journal.

We believe that the comments and suggestions that were recommended by the reviewers have informed a much improved and more fully developed paper that will offer an important contribution to the field.

Given the word length requirements for clinical research briefs, we are somewhat stymied by the extent of details we can provide, However, and of critical importance, attention has been paid to developing a clearer rationale that addresses the significance of this work. We have carefully reviewed the comments and have revised the manuscript accordingly. Our responses are given in a point-by-point manner below. Please find the revised manuscript that is edited according to reviewers’ and editors’ comments, and all these changes are highlighted.

We hope the revised version is now suitable for publication and look forward to hearing from you in due course.

Please feel free to contact me with any questions and concerns. I look forward to hearing from you regarding the manuscript.

Thanks for your kind attention to the manuscript.

Sincerely, Corresponding author

Reviewer 1 Response

1. It is better to write Sample size same in the abstract (15) and the main study (13).

P: 2

Due to this study is a mixed method study and has qualitative and quantitative phase , also in quantitative phase has several stage so the number of participants is different in every stage but overall, the number of participants in the qualitative stage was 15 participant including 13 nursing students, one nurse and one trainer.

P:5

thirteen bachelor’s nursing students aged between 18 and 25 years old (5 women and 8 men), one female nurse, and one female trainer who had good communication skills and intended to participate in this study, were recruited using purposive sampling approach who have then participated only in the qualitative phase of the study.

2. If you write the Abbreviations (minimum) in the study readers can read easily your article. P:8,9,10

The abrevation are written, and highlited.

3. You write the conclusion section in the abstract. It is better to write in the main study although it is optional (journal requirement) The abstract was written based on instruction for author.

4.Exploratory factor of the NSARI seems very good. Thank you for your kind comment.

5. in Table 2 better to write abbreviations below the table. P: 12.

It is written , and highlighted

Reviewer2 Response

Grammar, word choice & sentence structure issues are barriers to fully comprehending the manuscript content. Most of the manuscript is also written in present/future tense; if the studies are completed, it should all be written in past tense. The manuscript is edited by native English edit and the certificate letter is attached.

There is not enough detail about current instruments and what makes this instrument necessary. P: 4

[6]. However, different studies have found different factor structures of resilience tools in different populations and cultures [7, 8]. Accordingly, it may be due to the reason that despite the prevalence of stress and the obligation to design an appropriate tool to assess students' resilience, it is not yet clear which factors measure the resilience in nursing students. However, it was shown that having an understanding of resilient characteristics and the protective factors that promote resilience in nursing student can enable them to cope with adversity during their education period [9].

These diverse approaches to measure resilience affected by different natures of potential risk factors and protective processes have led to some contradictions [10]. Due to establishing the resilience concept as a meaningful concept in research and clinical practice, it is inevitable to determine its distinctive factors and measure its factors using a valid and reliable method [11]. Notably, the evaluation of designed interventions to promote resilience demands reliable and valid measures[10].

In this way, researchers and clinicians do not have strong evidences regarding the choice of resilience measurement tools, which may make inappropriate choices in the field of study [12]. However, measuring resilience has been done by a number of researchers such as Charney[13], Wagnild[14], Kobasa[15]. Additionally, the mean score of resilience in these studies varies from 83 to 104[16, 17] because of using different generic scales. As a result, this creates difficulties in comparing mean score across studies, even if the nursing student experience similar adversities. In order to address these concerns, this study aimed to develop and design a new valid and reliable inventory for measuring resilience in nursing students.

P. 7 lines 150-151: the authors state “There is no missing data in the study due to completing the surveys by an online Survey software (Porsline).” The reviewer does not understand how having surveys completed online assures no missing data P: 11

There was no missing data in this study due to completing the surveys by Porsline. In this online survey software, responders must respond to all questions because following and responding one question depends on answering the previous one.

A description of the factors comes in the discussion section, but there is lacking a robust description of these in the results section P:13,14

Correspondingly, the first factor was optimism, which can be defined as people's positive expectations of what is happening in their lives [43]. In addition, having a positive optimistic attitude can help in more effectively dealing with stress [44]. The second factor was labeled as communication defined as the exchange of information, ideas, and feelings among people who use speech or other means[45]. Self-esteem/ evaluation as the third factor is known as a prime predictor of stress management indicateingthe degree of belief in the ability, importance, success, and individual’s competency [46]. The fourth factor was identified as self-awareness. Accordingly, this psychological component implies awareness of feelings, motivations, self-concept, and personality [47]. Trustworthiness as a worth demanding nurses to foster certain character attitudes and to strength effective task performance [48], was characterized as the fifth factor. Finally, self-regulation as the sixth factor was defined as the student’s attempt to manage learning processes focused on fulfilling goals [49].

The reviewer believes that content in this manuscript was ambitious and likely too much to include in a single manuscript. Ultimately, this detracted significantly from fully comprehending and appreciating the processes of instrument development and the value of this newly developed instrument. P: 5

Methods

Study design and Procedures

This exploratory sequential mixed-method study[18] was conducted in Iran from May 2019 to August 2020. It is assumed that all methods in this regard have bias and weaknesses, but based on triangulating data sources in this kind of design as well as the collection of both quantitative and qualitative data, the weaknesses of each form of data is neutralized[18]. The data in the qualitative phase were collected through performing semi-structured interviews based on the resilience Stephen's model in nursing students. Item generation and developing inventory were also done based on the categories extracted from the qualitative phase. Finally, psychometric properties were evaluated in the quantitative phase.

Qualitative phase:

Data collection

Data analysis

Quantitative phase:

Data collection

Data analysis

Reviewer3 Response

1- kindly check the grammar and ensure correct sentence structures

The manuscript is edited by native English edit and the certificate letter is attached.

2- You indicated using Stephen's Resilience Model. This is a good model but I don’t see from your writing how this model informed your research. P: 3,4

In this study, in line with different resilience theories, Stephen's resilience model of resilience in nursing students was used. Accordingly, this model emphasizes on the importance of defining the concept of resilience as a process performed based on antecedent/perceived adversities, attributes/protective factors, and consequences/cumulative successes. Moreover, the proposed model combines perceived adversities with the use of individual protective factors to cope and/or be adapted with the difficulties effectively. The cumulative successes of these events would lead to the increased resilience demonstrated by the enhanced coping/adaptive abilities and well-being status” [1].

P: 5,6

The data in the qualitative phase were collected through performing semi-structured interviews based on the resilience Stephen's model in nursing students.

Exploratory questions were asked following asking the main questions derived from the Stephen resilience model. The main questions included “explain about the situation experienced stress during nursing education.”, “which protective factors do you apply in these situations?”, and “explain about cumulative success that you have acquired”.

3-The title and introduction look as if you are developing an entirely new tool. However, the factor structures seem to suggest that you were validating the NSARI tool in the Iranian context. Can you please clarify this? P: 2

This study aimed to develop and validate a new inventory theory-driven labeled Nursing Student Academic Resilience Inventory.

P: 5

this study aimed to develop and design a new valid and reliable inventory for measuring resilience in nursing students.

P:5,6

The data in the qualitative phase were collected through performing semi-structured interviews based on the resilience Stephen's model in nursing students. Item generation and developing inventory were also done based on the categories extracted from the qualitative phase.

P:7

Data from the qualitative phase were used to develop Nursing Student Academic Resilience Inventory (NSARI) for the quantitative phase.

4- The qualitative results did not indicate which items were generated and how they were elucidated from the qualitative study. It will be good to get a clear path on how items are generated from the interview data before psychometric analysis. At the moment, your qualitative results did not capture that. It is advisable to, at least, state the themes, categories, and sub-categories backed by participant quotes. This will provide evidence on how you arrived at the items that are used in the quantitative phase

P:12

An example of how the data were analyzed is shown in Table1.

P: 11,12

These codes were allocated to three themes, 9 categories (perceived stress: environment, relationship, Social-standing, Burnout, moral distress; protective factor: personal, social; cumulative success: Well-being, enhanced coping /adaptive abilities), and 31 subcategories based on interviews in the field of nursing student and Stephen’s model.

5- In line 132, you indicated the inventory was revised by 13 nursing students in the qualitative face validity stage. How were these revisions done because your qualitative methodology only talk about how the items would be developed, and not about revision P: 7

Face validity only refers to the appearance of the instrument to the responders; in other words, an instrument appears to measure what the test constructor intended to measure and also motivates the participants to respond to the survey[21]. Confusing items were revised, duplicate, redundant items were merged, and essential items were added based on the results of the face and content validities. In terms of qualitative face validity, 13 nursing students were requested through convenience sampling to read the items loudly, explain the meaning of each item, and then identify problematic or ambiguous words for reconsideration.

6- Under the results in the quantitative phase, Line 209-2016 seems to be talking about method rather than results. Can you move this to the methods section?

It is moved to the method section.

7- In line 209-210, you indicated that “In the psychometric evaluation phase, confusing items are revised and duplicate, redundant items are merged and essential items are added based on the results of the face and content validity” How were these revisions and merging done. Where from the ‘essential items”?

Face validity, as we know is usually done by experts. Who were the ‘experts’ in your study? Please kindly explain how this was done as it forms an essential aspect of instrument development P: 7

Face validity only refers to the appearance of the instrument to the responders; in other words, an instrument appears to measure what the test constructor intended to measure and also motivates the participants to respond to the survey[21]. Confusing items were revised, duplicate, redundant items were merged, and essential items were added based on the results of the face and content validities. In terms of qualitative face validity, 13 nursing students were requested through convenience sampling to read the items loudly, explain the meaning of each item, and then identify problematic or ambiguous words for reconsideration.

Face validity is not validity in the true sense and refers only to the appearance of the instrument to the layperson; that is, if upon cursory inspection, an instrument appears to measure what the test constructor claims it measures, it is said to have face validity. ) If an instrument has face validity, the layperson is more apt to be motivated to respond, thus its presence may serve as a factor in increasing response rate. Face validity,when it is present, however, does not provide evidence for validity, that is, evidence that the instrument actually measures what it purports to measure). Carolyn Feher Waltz, Ora Lea Strickland, Elizabeth R. Lenz, Measurement in Nursing and Health Research. Fourth Edition(

8- I am not too conversant with your measurement of convergent and divergent validity. However, I do know that the common, and probably the best, way of determining divergent validity for instance is to measure the focal construct (in this case resilience) and another closely related concept using the same instrument. Divergent validity would be established when the two measures are weakly correlated. This is to ensure that the tool is not measuring other constructs. I know this may not have been your intent but it is worth knowing P:9

The criterion of Fornell-Larcker was used to estimate the convergent and divergent validity based on the average variance extracted (AVE), the maximum variance (MSV).

(Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research. 1981;18(1):39-50.).

Factor Analysis and Discriminant Validity: A Brief Review of Some Practical Issues )

P: 9,16

Additionally, Heterotrait-monotrait ratio of correlations (HTMT) criterion was clculated. It was established that all values in the HTMT matrix table should be less than .85[32].

(Table 4).

Reviewer4 Response

. Perhaps creating a specific section for the detailed description of the participants, another session for the details of the procedure, another session for the measurements and finally statistical analysis, could improve the reading considerably. P: 5

Methods

Study design and Procedures

This exploratory sequential mixed-method study[18] was conducted in Iran from May 2019 to August 2020. It is assumed that all methods in this regard have bias and weaknesses, but based on triangulating data sources in this kind of design as well as the collection of both quantitative and qualitative data, the weaknesses of each form of data is neutralized[18]. The data in the qualitative phase were collected through performing semi-structured interviews based on the resilience Stephen's model in nursing students. Item generation and developing inventory were also done based on the categories extracted from the qualitative phase. Finally, psychometric properties were evaluated in the quantitative phase.

Qualitative phase:

Data collection

Data analysis

Quantitative phase:

Data collection

Data analysis

For construct validity, the authors used a methodological approach that is commonly used in the field; however, the approach assumes a linear relationship between the items and the factor. Also, this methodology assumes a gaussian distribution of the outcome. This approach can be a problem for the construction of domains. Accurate methods for detecting relation between items are relevant for designing and determine the factor distribution. I suggest using Item Response Theory (IRT), specifically Graded Response Model (GRM; Samejima, 1969, 1997), Generalized Partial Credit Model (GPCM; Muraki, 1992) or multidimensional graded response model (MGRM). The IRT models examine the overall response patterns across all the items, while factor analytic methods examine covariances between the individual items. As a consequence of evaluating item response patterns, the parameter estimates provide insight into how the items work. Finally, the IRT estimates constructs assuming nonlinear relationship between latent traits and item responses.

For IRT authors can use mirt package. It’s a powerful package and free tool for psychometric analyses: Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29. Although ther authors believe that test development decisions could be improved by using additional information about item responses, the purpose of this study was development and psychometric properties of instrument, therefore item selection was based on indices of difficulty and discrimination (classic approach). (Introduction to Classical and Modern Test Theory. Linda Crocker, James Aigina)

P: 22,

To ensure that the instrument is psychometrically robust, its psychometric properties should be tested using different statistical methods such as the Rasch model and structural equation modeling, in order to estimate age and gender effects.

Another suggested approach to construct validity is an exploratory structural equation modeling (see Asparouhov et al., 2009) approach.

Asparouhov, Tihomir, and Bengt Muthén. "Exploratory structural equation modeling." Structural equation modeling: a multidisciplinary journal 16.3 (2009): 397-438.

I’m agreed with authors, it’s necessary to estimate age and sex effect. However, I suggest reviewing the papers related to this issue of Rivera and Wim Van der Elst The study was a mixed method study that represents an alternative methodological approach to traditional qualitative or quantitative research approaches to develope and psychometric properties of resilienceinstrument, the main purpose was not development of a resilience model, therefore item selection was based on indices of difficulty and discrimination (classic approach).

P:22

it is suggested in limitation section.

Please add the exclusion criteria that were used to enroll participants in the study P:5

The study population includes all bachelor's nursing students who intended to participate in this study. The exclusion criteria was any circumstance that may interfere with study participation

Please provide information about how the sample size was calculated in each group Due to a mixed method study has a multiple phase and in different phase there is different numbers of participant so in every stage the number of participants and the way of selection is written.

P: 6

Qualitative phase

In qualitative research there is not exact sample size and data saturation is important.

To achieve maximum data diversity students were selected of both gender, different semesters, private and public universities. In qualitative studies, sample size cannot be pre-established, so much so the interviews were perpetuated until data saturation[Morse, 2002 #1949].

P: 7,8

Quantitative phase

Data collection

Data from the qualitative phase were used to develop Nursing Student Academic Resilience Inventory (NSARI) for the quantitative phase. Face validity was tested by 13 nursing students. Moreover, 11 experts in instrument development, nursing, and psychology were invited by email to validate this inventory in terms of content validity. All these experts were professors from the college of nursing and psychology and expertise in tool’s validation. Based on the Polit et al.’s study (2015), the size of the expert panel usually is between 3 and 12. For construct validity, those studies with the sample size of 100 or more were considered as “excellent”. Of note, the sample in CFA should be different from the sample used to finalize the instrument using EFA. According to the rule of thumb, a minimum of 200 cases in the analyses was considered to be enough. [19]. Finally, 200 nursing students for EFA as well as 205 nursing students for CFA analysis were recruited in this study.

Face and Content validity

In terms of qualitative face validity, 13 nursing students through convenience sampling were requested to….

CVR and CVI Were done by 11 experts in instrument development, nursing, and psychology to determined

Item Analysis

36 nursing students were selected based on stratified sampling to recognize…

Exploratory Factor Analysis

in a cross‑sectional study, 200 nursing students of private and public universities from 6 different provinces in Iran participated in the study on account of convenience sampling.

Confirmatory Factor Analysis

Confirmatory factor analysis was done on a different sample including 205 nursing students who were selected by convenience sampling to…..

For instruments with less than forty items, samples of 200 were reported to be adequate.( Lin SY, Tseng WT, Hsu MJ, Chiang HY, Tseng HC (2017) A psychometric evaluation of the Chinese version of the nursing home survey on patient safety culture. Journal of clinical nursing 26: 4664-4674.)

P: 9

The Kaiser-Meyer-Olkin (KMO) statistic of sampling adequacy and the Bartlett test of sphericity were calculated to check the suitability of the data for factor analysis.

Provide more information about face and content validity data analyses technique P:7,8

Face and Content validity

Face validity only refers to the appearance of the instrument to the responders; in other words, an instrument appears to measure what the test constructor intended to measure and also motivates the participants to respond to the survey[21]. Confusing items were revised, duplicate, redundant items were merged, and essential items were added based on the results of the face and content validities. In terms of qualitative face validity, 13 nursing students were requested through convenience sampling to read the items loudly, explain the meaning of each item, and then identify problematic or ambiguous words for reconsideration. Following revising the items of the designed inventory according to the comments of the participants, at the qualitative face validity stage, quantitative face validity was assessed using the impact factor method based on the following equation…

Due to the COSMIN definition, content validity is “the degree to which the content of an instrument is an adequate reflection of the construct to be measured”[19]. In this way, content validity ratio (CVR) was done by 11 experts to determine the essential items according to the cut-off point proposed in a study by Lawshe [23].

Additional Editor Comments

Introduction. Response to Reviewer #2-second point was not exhaustive P:4

It is clarified.

The issue of missing data raised by Reviewer #2 is of maximum importance in research. . So, you should report your response statement into the manuscript when you described the methods.

P:11

It is written

As Reviewer #2 observed, a robust description of the factors that emerged is missing in the results section. P: 13,14

It is explained

I would like to see a new paragraph named “Study design and Procedures” at the beginning of the Methods P: 5

It is written.

Reviewer’s #3 point 2 should be thoroughly answered P: 3,4

It is explained in more detailed.

To clarify any doubt like Reviewer’s #3 point 3, you should add the word “new. P:2,5

It is written.

Reviewer‘s #3-point 6 request should be accomplished. Lines 229-230 describe the method of the quantitative phase; thus, it is better to move it above after line 135. P: 7

It is moved

I ask you to eliminate the too generic Participants paragraph. Data collection of the qualitative phase should also include indication about recruitment of the participants and a more detailed description of the sample. P:5,6

It is written

In the Quantitative phase a Data collection paragraph is totally missing P;6,7

The phrase “All the statistical analyses were calculated by SPSS-AMOS25 and SPSS R-Menu v2.0.” should be moved at the end of the quantitative phase, following line 204. P: 10

Ethical consideration: it is not enough to explain to the participants the volunteering and confidentiality of data, you should also explain the objectives of the study and collect their informed consent to participate in the study. P:11

It is explained.

Results line 241: “Finally 13 items were eliminated from the analysis.” You should explain why, based on what criteria? P:13

It explained.

Construct validity line 243: you should report the sample size of the sample used here and percentage of female, besides absolute number.

Confirmatory factor analysis line 254. As in the previous paragraph, you should report here the sample size for this part, age and gender. P:13

It is written.

ANOVA results line 290. Why did you not calculate multiple comparisons between subgroups based on semester?

P:17

It is done and reported.

Scoring items line 294: you should explain why you gave an indication for obtaining a total (summative) score instead of 6 factors scores, especially because in the Discussion you dedicated a large room to the description of the six constructs. Composite measures often involve summing the item values to yield a total score, although sometimes, instrument developers recommend that the total score be the average across items so that the total score is on the same scale as the items.

(Measurement and the Measurement of Change. Polit (2015))

Discussion: you cannot say “The CFA results detected the fitness of the final model”, because a number of fit indices you reported were under the recommended cutoff. Thus, you should underline and comment it.

P: 22

It is declared in limitation.

Limitations should be expanded: a probably sample disproportion regarding gender;

2) the use of validity indices based only on the internal structure of the scale. In future studies other methods could be used, like the heterotrait-monotrait (HTMT) ratio rates correlations, or the multitrait–multimethod matrix (MTMM), also correlating the instrument with external comparators (e.g, other measures of resilience);

3) the use of modification indices for fitting CFA results to your own data. This is an object of much disagreement among quantitative methodologists since this is a kind of “post hoc model modification” or a data-driven modification of the original hypothesized model. Other approaches could be used in future study to avoid this issue, like the exploratory structural equation modeling (ESEM) (see Asparouhov et al., 2009) as suggested by Reviewer #4. P:22

the sample disproportion regarding gender; however, this is common because Nursing is a female-dominated profession [66]

P: 9, 16

2--HTMT is calculated

3- p:9, 21

It is discussed in discussion section.

A linguistic revision is still needed; a few present tense is still there, and many phrases are not understandable. The manuscript is edited by native English edit and the certificate letter is attached.

Attachment

Submitted filename: Response to reviewers.doc

Decision Letter 2

Paola Gremigni

19 Apr 2021

PONE-D-20-37513R2

Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method study

PLOS ONE

Dear Dr. ghods,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. In this second round of revision reviewers are not satisfied with the author's response to their concerns. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 03 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Prof. Paola Gremigni, Ph.D.

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: (No Response)

Reviewer #5: All comments have been addressed

Reviewer #6: (No Response)

Reviewer #7: (No Response)

Reviewer #8: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #5: Yes

Reviewer #6: No

Reviewer #7: Partly

Reviewer #8: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #5: I Don't Know

Reviewer #6: I Don't Know

Reviewer #7: I Don't Know

Reviewer #8: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #5: Yes

Reviewer #6: Yes

Reviewer #7: Yes

Reviewer #8: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: No

Reviewer #5: Yes

Reviewer #6: No

Reviewer #7: No

Reviewer #8: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The reviewer maintains that the topic is an important one; and that the instrument at face value has promise. While there is greater discussion about existing gaps in current instruments that this instrument addresses, this information could be presented more concisely. Developing the instrument based on a model strengthens validity, but what is lacking is a clear conceptualization of “resilience”. Describing the model components is not adequate as a definition of resilience. The reviewer believes this lack is at the core of the ambiguity found in the Introduction. Additionally, the manuscript appears to have been written in two different styles. The background and discussion appear to be much less clear and are in need of refinement. The methods section is much clearer and improved. Again, it is clear that the authors have done a significant amount of work. The manuscript, however, covers a large amount of information from multiple studies in the instrument development process, and the reviewer continues to wonder if this work would better be served by breaking it up into two (or more) manuscripts. Due to the significant amount of description, the extensive work is not appreciated as it could be if the manuscript covered less extensive, but more impactful content.

Reviewer #5: Please, note that I did not examine the statistical analysis. Please, consider statistical analysis elsewhere if not already undertaken.

Reviewer #6: 1. Generally, the paper contains too much textbook statements with reiterations. The paper needs to be organized in clear and parsimonious manner.

2. The paper needs a professional English editorial service.

3. Some statements are not supported with references as exampled, line 77-84. Line 84 has improper quotation mark at the end. Overall, the manuscript needs to be written in scientific writing format including table format.

4. If the aim of the paper is based on the premise of line 86-87 (different studies have found different factor structures of resilience tools in different populations and cultures), this paper seems to serve only for Iranian nursing students. When there are several studies on resilience from various populations and cultures, the next step for study is to try to develop the integrated tool of resilience, rather than to add one more study of a specific population or culture. Or the paper should address the robust rationale on why the development of the resilience specifically for Iranian nursing student population is important in addition to those of previous study samples. Then the findings should compare resilience too variations among various populations and cultures. In fact, there have been many studies on resilience in nursing so far.

5. line 94-96: Due to establishing the resilience concept as a meaningful concept in research and clinical practice, it is inevitable to determine its distinctive factors and measure its factors using a valid and reliable method [11]. It seems a little awkward sentence to me. The concepts of resilience have been established in many research and field.

6. The rationale for the study is not clear to me. On line 102-104: It is written, “Additionally, the mean score of resilience in these studies varies from 83 to 104[16, 17] because of using different generic scales. As a result, this creates difficulties in comparing mean score across studies, even if the nursing student experience similar adversities”. Then this study to develop and design a new valid and reliable inventory for measuring resilience in nursing students, seems to add one more different generic scale which may contribute to create difficulties in comparing mean across studies.

7. The criteria of subject seems still blurred. For example, on line 125, it is written ‘The exclusion criteria were any circumstance that may interfere with study participation.’ That is not the exclusion criteria. The circumstances of exclusion should be specified. As well on line 145, it is written, ‘the samples were selected with maximum variation.’ What does it mean by maximum variation?

8. For ethical considerations, it is extremely important to protect the right of study participants and to maintain their security when they are students and the researchers are professors at same institutions. The circumstances to obtain the consent of participation from them need to be more addressed in terms of the relationship between participants and researchers, who proposed them to participate into the study, the condition of free refusal, no influence to any school activities by the study, etc. The description on line 254-259 is too simple. As well the interview circumstances need to be explained more. The line 125 (interviews were conducted in a quiet room) is not enough.

9. Discussion needs to be focused the comparison of resilience tool among subjects in relation to Stephen’s resilience model based on the premise and aim of the study.

Reviewer #7: Feedback for the manuscript, entitled "Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method study".

This study was focused on development of the nursing student academic resilience inventory (NSARI) and examination of psychometric properties of the NSARI using a combined approach of qualitative and quantitative methods. Overall, the writing of the manuscript is hard for me to follow. As mentioned in the reviews of the previous round, I feel the manuscript still need a further and careful proofread. There are typos and grammatical errors. Many places in the manuscript did not follow the APA. The APA. I would highly recommend the authors carefully re-reading the comments from the previous reviewers. The reviewers’ comments are extremely constructive but were ignored by the authors. Since there is still a need for a major revision, I will provide some broad suggestions listed below.

First, the author may want to develop a section called “Research Purpose and Specific Questions”. The authors only mentioned the purpose in one sentence on page 4. More detailed purpose can be addressed, and specific research questions can be developed. Specific research questions can guide the reader to better understand this study.

Second, the method section should be reorganized. As mentioned by a reviewer in the previous round, the participants section should provide more details regarding participants. Even though there are many phases with different participants, such as participants for interviews, EFA, and CFA. The same principle can be applied “Statistical Analyses”. Further, there are many statistics mentioned in the method, but I could not find any relevant results, such as Mahalanobis d-squared.

Third, in the results any statements should be along with supportive statistics. For instance, on page 11, the authors mentioned that “Finally, 13 items were eliminated from the analysis. Are there any statistics you should report to support your statistics?

Reviewer #8: My comments rotate mostly around Qualitative research and Ethics.

Line 111: I agree with a reviewer that mentioned that there is too much information in this manuscript, agree with their recommendation that the findings can be presented in two separate manuscript. Regarding the justification for combining, which is triangulation to reduce Bias, there are several ways triangulation in several ways. For example, I see in the qualitative methods, there was author triangulation. Very long manuscripts are not reader friendly.

Line 121:The author could try to maintain the language; use of man and woman vs male and female

Line 122:The authors mention that for qualitative Data collection, they considered those with good communication skills- Why, Could this bias the study by excluding the those who had no good communication skills. What is good communication skills- was it at the discretion of the researcher to define good communication skills. Possibility that people with good communication are characteristically different from those with poor communication skills and probably have different resilient mechanisms.

Line 123:The authors use the term intended to participate in the study. Not clear whether participants were consented to participate in the study. I like the fact the authors specify how the participants were selected. However wondering all people contacted participated in the study or there are some who could have decline and the possible reason if any decline

Line 125: What us any circumstances-Could may be cite an example of how any circumstance that may interfere with study participation may look like

Line 146:it is not clear to me If the researcher critically examined their own role,

potential bias and influence during (a) formulation of the research questions (b) data collection, including sample recruitment and choice of location

Line 256:Are you trying to describe verbal consent. other wise am worried that participants did not provide written informed consent. If writing, did it receive a waiver of consent from the REC?

Line 259:This statement is not clear. if you had talked about the consent process here; this would not be necessary;

Electronically, some authors will state that by clicking I agree to participate, is a taken as consent. But have to be given information about the study before accessing the survey

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #5: Yes: Adeniyi Olanrewaju Adeleye

Reviewer #6: No

Reviewer #7: No

Reviewer #8: Yes: Provia Ainembabazi

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jun 15;16(6):e0252473. doi: 10.1371/journal.pone.0252473.r006

Author response to Decision Letter 2


30 Apr 2021

Dear Academic Editor

Prof. Paola Gremigni

Response to reviewers

Thank you for your thorough review and consideration of our manuscript “Development and psychometric properties of the Nursing Student Academic resilience Inventory (NSARI): A Mixed-Method study" that was submitted to PLOS ONE Journal.

We believe that the comments and suggestions that were recommended by the reviewers have informed a much improved and more fully developed paper that will offer an important contribution to the field.

We have carefully reviewed the comments and have revised the manuscript accordingly. Our responses are given in a point-by-point manner below. Please find the revised manuscript that is edited according to reviewers’ comments, and all these changes are highlighted, also the certification of Native English Edit company is uploaded.

We hope the revised version is now suitable for publication and look forward to hearing from you in due course.

Please feel free to contact me with any questions and concerns. I look forward to hearing from you regarding the manuscript.

Thanks for your kind attention to the manuscript.

Sincerely, Corresponding author

Reviewer #2:

What is lacking is a clear conceptualization of “resilience”. Describing the model components is not adequate as a definition of resilience. The reviewer believes this lack is at the core of the ambiguity found in the Introduction: P:3

Resilience evolved in the 1970s to understand why psychopathology was not always the consequences of risky environments in children [DeMichelis, 2016 #2004]. Resilience is described as a characteristic, process or outcome that depends on the theory accepted by the researcher[4]. Resilience’s theories can be outlined to three different models of resilience as “compensatory”, “protective”, or “inoculation/challenge” [DeMichelis, 2016 #2004]

The background and discussion appear to be much less clear and are in need of refinement: The background and discussion are refined

P: 3,4 (Introduction)

P: 19 (discussion)

The aim of present study was to develop a new inventory for measuring the resilience in nursing students. Although numerous tools have been designed in different contexts, there is only one study that was designed in nursing students. Yang et al study (2015) extracted 24 items through literature review and student interviews in two personal and contextual dimensions in Korean nursing. These dimensions included Self-confidence, Positivity, Coping ability, Emotional regulation, Structured style, Relationship, Social support (Yang YH, Kim EM, Yu M, Park S, Lee H. Development of the resilience scale for korean nursing college students. Korean Journal of Adult Nursing 2015; 27: 337-46.). As shown this study, resilience is multidimensional concept but some dimensions are the core of the resilience such as relationship and being able to cope. That was similar to the result of present study.

Reviewer #6:

1-the paper contains too much textbook statements with reiterationsbelow statements omitted and some statement paraphrases by Radan English Edit institute

P: 7

an instrument appears to measure and also motivates the participants to respond to the survey

P:8

Based on the Polit et al.’s study (2015), the size of the expert panel usually is between 3 and 12. For construct validity, those studies with the sample size of 100 or more were considered as “excellent”. Of note, the sample in CFA should be different from the sample used to finalize the instrument using EFA.

P:10

According to the COSMIN standards, besides validity and reliability, interpretability and scoring similarly are considered as important capabilities of a tool

2- The paper needs a professional English editorial service.:: The paper was edited again by www.NativeEnglishEdit.com

London

East End Road 27, N 3 3QT

United Kingdom

3-Some statements are not supported with references as exampled, line 77-84.

Line 84 has improper quotation mark at the end: P: 3

The paragraph mentioned to below reference that is cited: Stephens TM. Nursing student resilience: a concept clarification. Nursing forum. 2013;48(2):125-33.”

The quotation mark is deleted

4- If the aim of the paper is based on the premise of line 86-87 (different studies have found different factor structures of resilience tools in different populations and cultures), this paper seems to serve only for Iranian nursing students. When there are several studies on resilience from various populations and cultures, the next step for study is to try to develop the integrated tool of resilience, rather than to add one more study of a specific population or culture. Or the paper should address the robust rationale on why the development of the resilience specifically for Iranian nursing student population is important in addition to those of previous study samples. Then the findings should compare resilience too variations among various populations and cultures. In fact, there have been many studies on resilience in nursing so far.: P: 3, 4

Previous studies conducted in Iran showed that nursing students are affected by various stressors… Resilience has been suggested as a beneficial solution for better dealing with challenges in nursing students.

The result of a review study yielded by Chmitorz et al. (2018) showed that various resilience scales have been developed [5]. Also, several studies have found different factor structures of resilience in different populations and cultures [6, 7]. In addition, there is only one exploratory study in nursing student setting[8]. Therefore, it is not yet clear which factors measure the resilience in nursing students [9] that seems to be related to different natures of potential risk factors and protective processes which have led to some contradictions while the evaluation of designed interventions to promote resilience demands reliable and valid measures. In this way, researchers and clinicians do not have strong evidences regarding the choice of resilience measurement tools, which may make inappropriate choices in the field of study [10].P: 19

Although numerous tools have been designed in different contexts, there is only one study that was designed in nursing students. Yang et al study (2015) extracted 24 items through literature review and student interviews in two personal and contextual dimensions in Korean nursing. These dimensions included Self-confidence, Positivity, Coping ability, Emotional regulation, Structured style, Relationship, Social support [8]. As shown this study, resilience is multidimensional concept but some dimensions are the core of the resilience such as relationship and being able to cope. These results support the result of present study. Thomas et al (2016 ), also in integrative review declared factors that affect resilience in nursing students were grouped into three themes: support, time, and empowerment .

5- line 94-96: Due to establishing the resilience concept as a meaningful concept in research and clinical practice, it is inevitable to determine its distinctive factors and measure its factors using a valid and reliable method [11]. It seems a little awkward sentence to me. The concepts of resilience have been established in many research and field.: It is deleted.

6- The rationale for the study is not clear to me. On line 102-104: It is written, “Additionally, the mean score of resilience in these studies varies from 83 to 104[16, 17] because of using different generic scales. As a result, this creates difficulties in comparing mean score across studies, even if the nursing student experience similar adversities”. Then this study to develop and design a new valid and reliable inventory for measuring resilience in nursing students, seems to add one more different generic scale which may contribute to create difficulties in comparing mean across studies.:P:4

The result of a review study yielded by Chmitorz et al. (2018) showed that various resilience scales have been developed [6]. because resilience is a multidimensional construct that differes in different context, time, age, and life condition[Singh, 2010 #456]. several studies have found different factor structures of resilience in different populations and cultures [7, 8]. In addition, there is only one exploratory study in nursing student setting [Yang, 2015 #1793]. Therefore, it is not yet clear which factors measure the resilience in nursing students [9] that seems to be related to different natures of potential risk factors and protective processes which have led to some contradictions while the evaluation of designed interventions to promote resilience demands reliable and valid measures. In this way, researchers and clinicians do not have strong evidences regarding the choice of resilience measurement tools, which may make inappropriate choices in the field of study.

The paragraph about mean score is deleted.

7-The criteria of subject seems still blurred. For example, on line 125, it is written ‘The exclusion criteria were any circumstance that may interfere with study participation.’ That is not the exclusion criteria. The circumstances of exclusion should be specified.: P:6

The exclusion criteria were any circumstance that may interfere with study participation such as speech and hearing impairment, having work experience in medical settings.

As well on line 145, it is written, ‘the samples were selected with maximum variation.’ What does it mean by maximum variation?P:7

To assure data credibility, the samples were selected with maximum variation (private and public universities, different semesters, age, sex, and score). Also, to cover the variation of the phenomenon, a small data batch analyzed carefully first and then determined what additional data will be needed ….

8- For ethical considerations, it is extremely important to protect the right of study participants and to maintain their security when they are students and the researchers are professors at same institutions. The circumstances to obtain the consent of participation from them need to be more addressed in terms of the relationship between participants and researchers, who proposed them to participate into the study, the condition of free refusal, no influence to any school activities by the study, etc. The description on line 254-259 is too simple: P: 11

Researchers were not professors at the same institutions. Therefore, there was any conflict of interest. The researcher referred to the education deputy and received the demographic list of students. In several sessions, students (in different educational semesters) invited to participate in the study. The aim of this study, data confidentiality, and voluntarily participation were explained.

As well the interview circumstances need to be explained more. The line 125 (interviews were conducted in a quiet room) is not enough:P: 6

In the qualitative phase, the semi-structured individual interviews were conducted in a quiet room in the university or the educational class of hospital regarding to the student's choice. Students were selected through purposive sampling. The interviews started with asking an icebreaker question in which the individual is allowed to talk openly about the topic. Exploratory questions were asked following asking the main questions derived from the Stephen resilience model .

As well on line 145, it is written, ‘the samples were selected with maximum variation.’ What does it mean by maximum variation?

P:7

the samples were selected with maximum variation (private and public universities, different semesters, age, sex, and score). Also, to cover the variation of the phenomenon, a small data batch analyzed carefully first and then determined what additional data will be needed

9- Discussion needs to be focused the comparison of resilience tool among subjects in relation to Stephen’s resilience model based on the premise and aim of the study: P: 16

Although numerous tools have been designed in different contexts, there is only one study that was designed in nursing students. Yang et al study (2015) extracted 24 items through literature review and student interviews in two personal and contextual dimensions in Korean nursing. These dimensions included Self-confidence, Positivity, Coping ability, Emotional regulation, Structured style, Relationship, Social support (Yang YH, Kim EM, Yu M, Park S, Lee H. Development of the resilience scale for korean nursing college students. Korean Journal of Adult Nursing 2015; 27: 337-46.). As shown this study, resilience is multidimensional concept but some dimensions are the core of the resilience such as relationship and being able to cope. That was similar to the result of present study

Reviewer #7

First, the author may want to develop a section called “Research Purpose and Specific Questions”. The authors only mentioned the purpose in one sentence on page 4. More detailed purpose can be addressed, and specific research questions can be developed. Specific research questions can guide the reader to better understand this study:p: 4

Research Purpose and Specific Questions

To address the explained concerns, and regard to lack of specific resilience tool in nursing students the aim of present study in the first phase was to examine the stress, protective factors and cumulative success that students have acquired. The overall aim of the study was to design a new valid and reliable inventory for measuring resilience in nursing students. To achieve this aim, there were two research questions;

(1) Which factors are considered to be related to the resilience of nursing students?

(2) Which of these factors has statistically significant effect on the resilience of nursing students?

Second, the method section should be reorganized. As mentioned by a reviewer in the previous round, the participants section should provide more details regarding participants. Even though there are many phases with different participants, such as participants for interviews, EFA, and CFA. The same principle can be applied “Statistical Analyses”. :It is reorganized overally.

P:5

2.2 Participants

In the qualitative phase, thirteen under graduated bachelor’s nursing students aged between 18 and 25 years old (5 female and 8 male), one female nurse, and one female trainer who had good communication skills and intended to participate in this study were recruited. Two students were dropout of keeping the education and one student was conditional student.

The quantitative phase included several stages. Face validity was tested by 13 nursing students (7female, 6 male) in different semesters. Moreover, 11 experts in instrument development, nursing, and psychology were invited by email to validate this inventory in terms of content validity. 200 nursing students for EFA as well as 205 nursing students for CFA analysis were recruited from 6 different provinces in Iran (age= 21.70 ±2.50; female=258, male= 147).

Further, there are many statistics mentioned in the method, but I could not find any relevant results, such as Mahalanobis d-squared.

P:7

In the quantitative phase, the psychometric properties of the NSARI were assessed using face, content, and construct validities (exploratory and confirmatory factor analysis).

P:10

The presence of a multivariate outlier was assessed by Mahalanobis d-squared (p< .001),.

The Mahalanobis distance is a well-known criterion which may be used for detecting outliers in multivariate data.( Appropriate Critical Values When Testing for a Single Multivariate Outlier by Using the Mahalanobis Distance. Kay I. Penny. Journal of the Royal Statistical Society. Series C (Applied Statistics) Vol. 45, No. 1 (1996), pp. 73-81 (9 pages) Published By: Wiley)

Third, in the results any statements should be along with supportive statistics. For instance, on page 11, the authors mentioned that “Finally, 13 items were eliminated from the analysis. Are there any statistics you should report to support your statistics? P:8

Using a pilot study, the internal consistency was assessed before the construct validity assessment to recognize potential problems in the NSARI through estimating Cronbach’s alpha and inter‑item correlation. The items whose corrected item-total correlation score was less than 0.3, were then removed from the analysis [18].

P: 13

13 items were eliminated from the analysis due to their corrected item-total correlation scores was less than 0.3 in Item analysis.

Reviewer #8:

Line 111: which is triangulation to reduce Bias, there are several ways triangulation in several ways. For example, I see in the qualitative methods, there was author triangulation: It is true that Validation of post positivist qualitative research relies upon using some strategies such as articulation of the research question., the use of more than one sources of data, providing a clear account of the process of data collection, negative case and triangulation of the findings. In this study all of them have done

P:10.11

2.5 Trustworthiness in the mixed-method study

To develop Self-reflexivity, after transcribing each one of the interviews, the researchers analyzed the obtained data to uncover their preunderstandings. As well, the researchers consulted with team members on the extracted codes and themes and then described the data analysis process in detail and finally provided clear citations in this regard.

To diminish the threats to the internal and external validities of the mix-method study, the participants with different experiences were selected. As well, none of the samples in the qualitative phase participated in the quantitative phase. Furthermore, designing the item pool was performed based on the main categories and sub-categories extracted in the qualitative phase. Consequently, all the stages of the study were carefully reviewed and verified by the other researchers [16, 36].

Line 121:The author could try to maintain the language; use of man and woman vs male and female:It is revised

Line 122:The authors mention that for qualitative Data collection, they considered those with good communication skills- Why, Could this bias the study by excluding the those who had no good communication skills. What is good communication skills- was it at the discretion of the researcher to define good communication skills. Possibility that people with good communication are characteristically different from those with poor communication skills and probably have different resilient mechanisms: Yes, it is true that people with good communication are characteristically different from those with poor communication skills and probably have different resilient mechanisms. Therefore, the researcher also interview with negative cases but the first interviewee was a female who was introduced by education deputy because she had good relationship with others and speak easily so we can reach a lot of data.

P:5 - good communication skills including fluency in Persian language, no hearing or speech problems,

P: 5- Two students were dropout of keeping the education and one student was conditional student.

Line 123: The authors use the term intended to participate in the study. Not clear whether participants were consented to participate in the study. I like the fact the authors specify how the participants were selected. However wondering all people contacted participated in the study or there are some who could have decline and the possible reason if any decline: P: 11- The researcher referred to the education deputy and received the demographic list of students. In several sessions, students ( in different educational semesters) invited to participate in the study. The aim of this study, data confidentiality, and voluntarily participation were explained. In qualitative phase informed consent obtained was verbal due to in this way participants feel more intimate relationship for participating in interview sessions. the IRB at this site was inclined to this procedure.Thereafter, in the quantitative phase, surveys were completed through Porsline software.At the first of survey written informed consent was attached. The participants who did not want to participate were authorized not to complete the surveys.

Line 125: What us any circumstances-Could may be cite an example of how any circumstance that may interfere with study participation may look like: P: 6-The exclusion criteria were any circumstance that may interfere with study participation such as speech and hearing impairment, having work experience in medical settings.

Line 146:it is not clear to me If the researcher critically examined their own role,

potential bias and influence during (a) formulation of the research questions (b) data collection, including sample recruitment and choice of location: P:10, 11

Trustworthiness in the mixed-method study

To develop Self-reflexivity , after transcribing the each interview, the researchers analyses the data to uncover their preunderstandings, also researchers consulted with team members about the extracted codes and themes and described data analysis process in detail and provided clear citations.

To diminish the threats to the internal and external validities of the mix-method study, the participants with different experiences were selected. As well, none of the samples in the qualitative phase participated in the quantitative phase. Furthermore, designing the item pool was performed based on the main categories and sub-categories extracted in the qualitative phase. Consequently, all the stages of the study were carefully reviewed and verified by the other researchers [15, 35].

Line 256:Are you trying to describe verbal consent. other wise am worried that participants did not provide written informed consent. If writing, did it receive a waiver of consent from the REC?P: 11- In qualitative phase informed consent obtained was verbal due to in this way participants feel more intimate relationship for participating in interview sessions. The IRB at this site was inclined to this procedure. Thereafter, in the quantitative phase, surveys were completed through Porsline software. At the beginning of inventory written informed consent was attached.

Line 259:This statement is not clear. if you had talked about the consent process here; this would not be necessary; Electronically, some authors will state that by clicking I agree to participate, is a taken as consent. But have to be given information about the study before accessing the survey: P:11- . At the beginning of the inventory written informed consent was attached and they declared their consent by clicking “I agree to participate”.

Attachment

Submitted filename: response to reviews.docx

Decision Letter 3

Paola Gremigni

6 May 2021

PONE-D-20-37513R3

Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method study

PLOS ONE

Dear Dr. ghods,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

In particular, see below some points raised by this Academic Editor.

1) Line 57 “Previous studies conducted in Iran showed that nursing students are affected by various stressors.” You should cite at least a few examples of such studies.

2) Line 70 “In this study, Stephen's resilience model as protective model was 70 used.” You should cite a reference here where the reader can read about Stephen’s model.

3) Lines 202-204: the issue of the modification indices is a result already reported in the Results paragraph lines 319-320.

4) Please comment the under-threshold values of CFI and AGFI obtained in confirmatory factor analysis.

5) When citing a reference, you should use the square parentheses method: line 79 Chmitorz et al. [5] not Chmitorz et al. (2018). See also citations at lines 365, 371, 386, 389, 397, and 418.

6) English editing is still needed: line 126 “regarding to”; lines 139-140; line 155; line 248; line 288 “participates”; line 370 “These results supported the result of the present study.”

Please submit your revised manuscript by Jun 20 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Paola Gremigni, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Dear Authors,

there are still points to be improved.

1) Line 57 “Previous studies conducted in Iran showed that nursing students are affected by various stressors.” You should cite at least a few examples of such studies.

2) Line 70 “In this study, Stephen's resilience model as protective model was 70 used.” You should cite a reference here where the reader can read about Stephen’s model.

3) Lines 202-204: the issue of the modification indices is a result already reported in the Results paragraph lines 319-320.

4) Please comment the under-threshold values of CFI and AGFI obtained in confirmatory factor analysis.

5) When citing a reference, you should use the square parentheses method: line 79 Chmitorz et al. [5] not "Chmitorz et al. (2018)". See also citations at lines 365, 371, 386, 389, 397, and 418.

6) English editing is still needed: line 126 “regarding to”; lines 139-140; line 155; line 248; line 288 “participates”; line 370 “These results supported the result of the present study.”

[Note: HTML markup is below. Please do not edit.]

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Jun 15;16(6):e0252473. doi: 10.1371/journal.pone.0252473.r008

Author response to Decision Letter 3


12 May 2021

Line 57 “Previous studies conducted in Iran showed that nursing students are affected by various stressors.” You should cite at least a few examples of such studies.

1. Pourafzal F, Seyedfatemi N, Inanloo M, Haghani H. Relationship between Perceived Stress with Resilience among Undergraduate Nursing Students. Hayat. 2013;19(1):1-12(Persian).

2. Moaddeli Z, Ghazanfari Hesamabadi M. A survey on the students’ exam anxiety in the Fatemeh (PBUH) College of Nursing and Midwifery, Spring 2004. Strides in Development of Medical Education. 2005;1(2):65-72.

3. Nikanjam R, Barati M, Bashirian S, Babamiri M, Fattahi A, Soltanian A. Student-Life Stress Level and its Related Factors among Medical Students of Hamadan University of Medical Sciences in 2015. Journal of Education and Community Health. 2016;2(4):57-64. doi: https://doi.org/10.21859/jech-02048.

2) Line 70 “In this study, Stephen's resilience model as protective model was 70 used.” You should cite a reference here where the reader can read about Stephen’s model.P:3

In this study, Stephen's resilience model[4]

3) Lines 202-204: the issue of the modification indices is a result already reported in the Results paragraph lines 319-320.It is deleted from method section:

Regarding the modification indices, 4 pairs of measurement errors among the measured items of the first, third, fourth, and fifth factors were allowed to co-vary freely, which consequently improved the final model fit noticeably

4) Please comment the under-threshold values of CFI and AGFI obtained in confirmatory factor analysis.P:23

Moreover, a number of fit indices were found to be under the recommended cut-off point. To the best of our knowledge, the NSARI is the first inventory to measure resilience in a theoretically driven way that has the potential to track and predict resilience in nursing students, because of evidences of validity and reliability in this population. To ensure that the instrument is psychometrically robust, its psychometric properties should be tested using different statistical methods such as the Rasch model and structural equation modeling, in order to estimate age and gender effects. Further studies are recommended to investigate the conceptual structure of this inventory to gather more evidences regarding the psychometric properties of the inventory study

5) When citing a reference, you should use the square parentheses method: line 79 Chmitorz et al. [5] not Chmitorz et al. (2018). See also citations at lines 365, 371, 386, 389, 397, and 418.They are revised and highlighted.

6) English editing is still needed: line 126 “regarding to”; lines 139-140; line 155; line 248; line 288 “participates”; line 370 “These results supported the result of the present study.”The article is edited again by editors at NativeEnglishEdit.com and highlighted.

Attachment

Submitted filename: response to reviewer.docx

Decision Letter 4

Paola Gremigni

17 May 2021

Development and psychometric properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method study

PONE-D-20-37513R4

Dear Dr. ghods,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Paola Gremigni, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Paola Gremigni

19 May 2021

PONE-D-20-37513R4

Development and Psychometric Properties of the Nursing Student Academic Resilience Inventory (NSARI): A Mixed-Method Study

Dear Dr. Ghods:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Paola Gremigni

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Dataset

    (SAV)

    Attachment

    Submitted filename: Revise PONE-D-20-37513_reviewer.pdf

    Attachment

    Submitted filename: Response to reviewers.doc

    Attachment

    Submitted filename: Response to reviewers.doc

    Attachment

    Submitted filename: response to reviews.docx

    Attachment

    Submitted filename: response to reviewer.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES