Skip to main content
PLOS One logoLink to PLOS One
. 2024 Apr 18;19(4):e0300753. doi: 10.1371/journal.pone.0300753

Comparison of quality and interpretation of newborn ultrasound screening examinations for developmental dysplasia of the hip by basically trained nurses and junior physicians with no previous ultrasound experience

Munkhtulga Ulziibat 1,2,*, Bayalag Munkhuu 2, Raoul Schmid 3, Corinne Wyder 4, Thomas Baumann 5, Stefan Essig 5
Editor: Malgorzata Wojcik6
PMCID: PMC11025947  PMID: 38635681

Abstract

Background

We are obliged to give babies the chance to profit from a nationwide screening of developmental dysplasia of the hip in very rural areas of Mongolia, where trained physicians are scarce. This study aimed to compare the quality and interpretation of hip ultrasound screening examinations performed by nurses and junior physicians.

Methods

A group of 6 nurses and 6 junior physician volunteers with no previous ultrasound experience underwent Graf’s standard training in hands-on practice. Newborns were examined before discharge from the hospital, according to the national guideline. Two standard documentation images of each hip were saved digitally. The groups were compared on the proportion of good quality of sonograms and correct interpretation. Two Swiss supervisors’ agreed diagnosis according to Graf was considered the final reference for the study purposes.

Results

A total of 201 newborns (402 hips or 804 sonograms) were examined in the study, with a mean age of 1.3±0.8 days at examination. Junior physicians examined 100 newborns (200 hips or 400 sonograms), while nurses examined 101 newborns (202 hips or 404 sonograms). The study subjects of the two groups were well balanced for the distribution of baseline characteristics. The study observed no statistically significant difference in the quality of Graf’s standard plane images between the providers. Eventually, 92.0% (92) of the physician group and 89.1% (90) of the nurse group were correctly diagnosed as “Group A” (Graf’s Type 1 hip) or “Non-Group A” hips (p = 0.484). The most common errors among the groups were a missing lower limb, wrong measurement lines, and technical problems.

Conclusion

Our study provides evidence that while there might be a trend of slightly more technical mistakes in the nurse group, the overall diagnosis accuracy is similar to junior physicians after receiving standard training in Graf’s hip ultrasound method. However, after basic training, regular quality control is a must and all participants should receive refresher trainings. More specifically, nurses need training in the identification of anatomical structures.

Introduction

Developmental dysplasia of the hip (DDH) is one of the most common disorders of the osteoarticular system with public health priorities in otherwise healthy children. The reported incidence of DDH are quite variable depending on detection methods, ages and diagnostic criteria [1, 2]. Mongolian studies reported a 1–2% incidence of DDH among neonates by ultrasound with Graf’s technique [3], an incidence comparable to that in European neonates [4, 5]. DDH is a multifactorial disorder. Contributing factors for the development of DDH are genetic and non-genetic factors [6, 7]. Early diagnosis of DDH in neonates is the most critical obligation for achieving the best outcome, using a simple, non-surgical method in the shortest possible time [811]. Delayed diagnosis results in losing the potential to remodel the acetabular roof, lengthening the treatment duration, and may cause lifelong disability [12, 13].

The hip ultrasound, according to Graf, which provides basic information about the biomechanical situation, is widely used in several countries as a gold standard of the primary tool in screening for DDH. Unlike other methods, it is standardized, easy to perform, and reproducible. The non-surgical treatment is usually based on the degree of severity of DDH [3, 14]. Graf’s method has been shown to be sensitive and specific for the early diagnosis of DDH [15]. Studies have also shown that ultrasonographic screening by Graf is cost-effective [16]. The method uses a coronal ultrasound image through the center of the acetabulum (standard plane) and the hip is evaluated by measuring two angles formed by three lines drawn from three landmarks (lower limb or the bottom of the acetabulum, the acetabular labrum and the lateral edge of the acetabulum). Subsequently, the bony roof angle (alpha angle) and the cartilage roof angle (beta angle) are measured and the hip joint is classified (Fig 1).

Fig 1. A hip sonogram.

Fig 1

A. Three landmarks of the standard plane. 1. Standard cut (red arrow), 2. Lower limb or the bottom of the acetabulum (yellow circle), 3. Acetabular labrum and the lateral edge of the acetabulum (blue circle). B. Hip is evaluated by measuring two angles formed by three lines drawn from three landmarks. 1. Basic line (red), 2. Bony roof line (blue), 3. Cartilaginous roof line (yellow).

The introduction of Graf’s method of hip ultrasonography and more effective non-surgical treatment in Mongolia since 2010 changed the policy and time of diagnosis and preventive treatment in children with DDH, resulting in more prevented cases of childhood disabilities [4, 5]. In 2017, the Mongolian Government approved the hip ultrasound screening as a nationwide screening program. This screening program aims to screen every newborn baby using hip ultrasound by Graf’s method and to provide early prevention treatment to eliminate childhood disabilities due to DDH in the country. All major 7 maternity hospitals across Ulaanbaatar, the capital city, and all 21 provincial (aimag) general hospitals are equipped with the necessary equipment and materials; and doctors trained in the method by the Swiss-Mongolian Pediatric Project (SMOPP), a humanitarian aid project. Used Tübingen braces are collected in Switzerland and German-speaking countries and are being reused as a way to help correct the skeletal system.

In Mongolia, a web-based, password-protected platform is used for quality control purpose. The tool enables screeners in all hospitals to upload digital images and annotations exported from the ultrasound machines. Four images (two per hip side; one of them with measured alpha and beta angles according to Graf), a unique identification number, age, sex and diagnosis are required for all examinations. After the upload, quality is controlled by a local expert (a doctor with good knowledge of the Graf method and at least three years of experience of hip ultrasound and treatment at a provincial hospital). This allowes continuous and reliable reviews of all examinations. In addition, Mongolian supervisors (doctors with profound knowledge of the Graf method and more than 10 years of experience of hip ultrasound and treatment in UB) check examinations from all hospitals and promptly send comments to the experts and screeners.

Since 2019, the screening project has been expanded to major sub-provincial (soum) hospitals responsible for deliveries as a primary source of medical care for nomadic rural residents. However, the sub-provincial hospitals face many significant and unique barriers when considering the widespread adoption of newer innovations in health care, such as hip ultrasound screening in newborns. One barrier is a lack of trained physicians capable of performing hip ultrasounds (huge turnover within the doctors’ teams, loss of trained doctors due to high internal and international migrations etc.) like in other developing countries [17]. Therefore, we felt obliged to give the babies in very rural areas the chance to profit from the nationwide screening program. We searched for other possibilities to examine all newborn babies of nomadic families. This study was performed after 3 years of piloting the expansion to rural sub-provincial areas. We aimed to compare the quality and interpretation of newborn hip ultrasound examinations (Graf’s Type 1 versus “Non-type 1”hips) between basically trained nurses with no previous ultrasound experiences and trained junior physicians with no previous ultrasound experience.

Materials and methods

Study design and settings

A prospective cross-sectional study was conducted in 3 hospitals: a referral hospital in Ulaanbaatar, a provincial (aimag) general hospital, and a sub-provincial (soum) hospital from March to December 2021. The Ethics Review Committee of the Ministry of Health of Mongolia (MOH), reviewed and approved the study protocol.

Study participants

A sample of 6 nurses and 6 junior physicians were nurse and junior physician volunteers in the selected hospitals. The only selection criterion was that they had no previous knowledge or experience in ultrasound. The six nurses were all certified with bachelor degree (4 years of undergraduate training) from Nursing school of Mongolian National University of Medical Science and had 3–4 years (4 nurses- 3 years and 2 nurses- 4 years) of experience. The six junior physicians were first-year pediatric resident doctors and all received undergraduate training in medicine (six years) from Mongolian National University of Medical Science. All junior physicians had 1–2 years of clinical experience in primary care.

All consecutive newborns born at the 3 hospitals during the study period were ultrasonographically screened by six nurses (two from each hospital) and six junior physicians (two from each hospital). Exclusion criteria were severe or very severe conditions, congenital anomalies, and refusal of parents through a written informed consent.

Preparatory phase

Nurse- and junior physician- volunteers who consented to participate in the study were trained on using the ultrasound machine through hands-on instruction. Two supervisors with extensive experience in hip sonography and the “ABCD” system facilitated the training. The “ABCD” system is a diagnostic and therapeutic framework based on Graf’s technique [18]. SMOPP established the system as a nationally recognized standard, ensuring it is user-friendly for screeners in maternity hospitals and capable of distinguishing between groups essential for both controls and treatment. The system is entirely based on the method described by Graf and translates his initial differentiation into four groups: Group A includes Graf Type 1; Group B includes Graf Type 2a; Group C includes Graf Types 2c, D and 3; and Group D includes Graf Type 4 (Table 1).

Table 1. Comparison of Graf types and ABCD groups for hip ultrasound.

Graf type Graf angle α (°) Graf angle β (°) Graf therapy ABCD group ABCD angle α (°) ABCD therapy
1a > 60 < 55 None
None
A > 60 None
1b > 55
2a 50–59 Control
Control
B > 50 ≤ 60* Control
2a+
2a- Spreading device/Pavlik C < 50 Tübingen braces
2b
2c stable 43–49 < 77
2c unstable Plaster
D > 77
3a < 43 Extension
3b
4 Operation D Measurement is impossible Tübingen braces/Operation

* Group B hips were defined as angle alpha minus the age in weeks = between 50°-60°

The nurses and junior physicians received training in basic hip sonography, with emphasis on ultrasound principles, macro, and sono-anatomy of the hip joint, obtaining standard images, and “ABCD” system, measurements, tilting errors (inaccuracies due to improper transducer positioning resulting in distortions and misleading images), pitfalls and counseling of parents. The standard week courses (15 hours including practical works) were organized in March in sub-provincial, August in provincial, and September 2021 in Ulaanbaatar hospitals. There was no pre-training test since all participants had no previous knowledge or experience in Graf’s method of hip ultrasound examinations. However, a post-training test was performed and included questions on theoretical and practical (interpretation and handling) knowledge.

Following the standard introductory course, the nurses and junior physicians completed a week of hip sonography screening and SMOPP’s “HipScreen” quality control online platform practice in their hospitals, supervised by the supervisors who provided the training. Each nurse and junior physician undertook 10 newborns’ hip sonograms (2 for each hip, totaling 80 sonograms), focusing on gaining experience and competency in identifying children who require a referral (non-Group A hips) before testing their skills.

Data collection

Newborns were examined on a daily basis before discharge from the hospital (1st or 2nd days after birth) according to the national guideline [19]. Those who met the selection criteria were recruited in the study, and the following procedures were done:

  1. counseling of mothers and brief information about DDH

  2. hip ultrasound examination

  3. information about the next steps according to hip ultrasound examination results.

All eligible newborns were examined using a GE LOGIQ series (C3) ultrasound machine with a 7 to 8-MHz linear-array transducer. The examinations were performed and interpreted according to the national guideline based on the SMOPP’s “ABCD” system [18], the modified Graf’s system by the trained nurses or junior physicians depending on the days (odd days for nurses and even days for the junior physicians). Two standard documentation images of each hip were saved digitally using the HipScreen system. Monthly ultrasound follow-up control until full maturation and management done by both groups, depending on the results of the ultrasounds, followed the national guideline [19].

Two Swiss supervisors checked all the nurses’ and junior physicians’ hip ultrasound images. The two supervisors were blinded to the nurses and doctors. All supervisors are internationally certified and have at least 10 years of experience in Graf’s method of hip ultrasonography. Their final agreed diagnosis was considered the final reference for the study purposes. All supervisors interpreted all examinations (nurses and junior physicians); if discordant, a posterior discussion led to a consensual agreement.

Outcome measurement

  1. The following 4 indicators measured the quality of the newborn hip ultrasound images:
    1. Anatomical identification is “correct” if all anatomical structures, according to Graf [3, 10] are identified in the hip sonogram. If at least one structure is missing, the sonogram is considered “incorrect”.
    2. The standard plane is “correct” if all 3 points according to Graf’s criteria [3, 10] (Lower limb of the bony ilium, Mid-portion of the acetabular roof, and Acetabular labrum) are visible in the hip sonogram. If at least one structure is missing, the sonogram is considered “incorrect”.
    3. Three lines (baseline, bony, and cartilaginous roof lines) are measured “correct” or “incorrect” according to Graf (baseline–a vertical line, parallel to the ossified lateral wall of the ilium; bony roof line–a line drawn from the inferior edge of the osseous acetabulum, the inferior iliac margin, at the triradiate cartilage roof to the most lateral point on the ilium, the superior osseous rim; and cartilaginous roof line–a line traced along the cartilaginous acetabulum’s roof, extending from the acetabulum’s lateral osseous edge to the center of the labrum) [3, 10, 20].
    4. The tilting was measured as “yes” or “no” depending on the absence/presence of any tilting errors according to Graf [3, 10]. In order to get a standard plane sonogram the transducer should be placed vertically on the hip joint. Tilted positions of the transducer can lead to significant examinations errors (usually a mechanical transducer guide prevents tilting errors by reducing the degrees of variability in positioning the transducer).
  2. The correct interpretation: Based on results of hip sonography the nurses and junior physicians were requested to arrive at a final diagnosis, utilizing one of the terms: “Group A” (Graf’s Type 1 hip) or “Non-Group A” (Graf’s non-Type 1 hip). Then it was checked against the reference interpretation performed by the Swiss experts. The interpretation was defined as “correct” or “incorrect”.

Statistical analyses

Statistical analyses were performed using Stata 16 (Stata Corporation) software. Continuous variables were summarized as mean, standard deviation, and non-continuous variables as frequencies and percentages. A comparison of two groups (nurses and junior physicians) was performed using the χ2 test, Fisher’s exact test, and Student’s t-tests depending on the variables, with a significance level probability of 0.05 or less.

Univariate comparison of correct and incorrect diagnosis was performed using Fisher’s exact test. In the main analysis, we used the child and not the hip sonogram (2 sonograms per hip or 4 hip sonograms per child) as the unit of analysis. If a child had hip sonograms with different qualities, we evaluated the child based on the worst quality.

Power calculations indicate that we need to include at least 92 subjects in each group based on the assumptions that 1) the difference in quality of ultrasound is 15%, 2) the alpha level is 0.05, and 3) the required power is 80%.

Results

A group of 6 nurses and 6 junior physician volunteers with no previous ultrasound experience underwent Graf’s standard training in hands-on practice and didactic instruction. The mean age of the junior physicians and nurses was 25±1.4 and 26.3±0.8 years, respectively. All were female. The average score of the post-training test was not significantly different between the two groups.

A total of 201 newborns (402 hips or 804 hip sonograms) were examined in the study, with a male/female ratio of 118/83 and a mean age of 1.3±0.9 days at examination. Junior physicians examined 100 newborns (200 hips or 400 hip sonograms), while nurses examined 101 newborns (202 hips or 404 hip sonograms). The study subjects/newborns were well balanced for the distribution of baseline characteristics, such as mean age, sex, birth weight, and hospitals. (Table 2)

Table 2. Newborn characteristics.

Characteristics All
N = 201
n(%)
Junior physician- performed N = 100
n(%)
Nurse-performed
N = 101
n(%)
P value
Mean age at hip ultrasound examination, days (mean±sd) 1.3±0.9 1.3±0.8 1.2±0.9 0.2877*
Sex 0.711**
 Male 118 (58.7) 60 (60.0) 58 (57.4)
 Female 83 (41.3) 40 (40.0) 43 (42.6)
Hospital 0.078**
 Referral 98 (48.8) 55 (55.0) 43 (42.6)
 Provincial and sub-provincial 103 (51.2) 45 (45.0) 58 (57.4)
Mean birth weight, kg (mean±sd) 3.2±0.2 3.2±0.2 3.2±0.2 0.820*

*t-test

**Chi2 test

As shown in Fig 2, of 100 newborns examined in the junior physician-performed group and 101 newborns examined in the nurse-performed group, the proportion of sufficient quality of hip sonograms was 92.0% and 89.1% (p = 0.484), respectively. In the anatomical identification, 96 (96.0%) and 91 (90.1%) newborns’ hip sonograms in the respective groups were correct (p = 0.100). The incorrect standard plane was recorded in comparatively few proportions in both groups (3.0% in the junior physician’s group vs. 8.9% in the nurse’s group; p = 0.077).

Fig 2. Hip ultrasound examination performance of the nurses’s and junior physicians‘ groups.

Fig 2

The proportion of measurement lines was 78.0% in the junior physician-performed group, while in the nurse-performed group, the proportion was 71.3% (p = 0.274).

Eventually, 92.0% (90) of the junior group and 89.1% (90) of the nurse group (p = 0.484) correctly diagnosed the “Group A” (Graf’s Type 1 hip) or “Non-Group A” (Graf’s non-Type 1 hip) (Fig 2).

A common error among the groups was the tilting of the transducer, which deflects the ultrasound beam and can produce a misleading and incorrect image (17.0% in the junior group vs. 16.8% in the nurse’s group, p = 0.975), followed by the missing of the lower limb (3.0% in the junior group vs. 7.9% in the nurse’s group, p = 0.125) (Fig 2).

Univariate comparisons of demographic and hip ultrasound (Graf method) examination characteristics of “correct” and “incorrect” diagnosis are displayed in Table 3. The incorrect diagnosis was significantly more likely to be associated with smaller birth weight of newborns (p = 0.012), incorrect anatomical identification (p<0.0001), incorrect measurement lines (p<0.0001), missing lower limb and tilting errors (p<0.002).

Table 3. Univariate analysis of demographic and hip ultrasound examination characteristics of correct and incorrect diagnosis.

Characteristics Correct diagnosis
N = 182
Incorrect diagnosis
N = 19
p-value
Age of newborns (CI) 1.3 ± 0.9 (1.2–1.5) 1.3 ± 0.8 (0.7–1.5) 0.989
Mean birth weight (CI) 3.2 ±0.2 (3.2–3.3) 3.1 ± 0.2 (2.9–3.2) 0.012
Hospital 0.275
UB 91 (50.0) 7 (36.8)
rural 91(50.0) 12 (63.2)
Performed by 0.484
junior physician 92 (50.6) 8 (42.1)
nurse 90 (49.4) 11 (57.9)
Anatomical identification <0.0001
correct 182 (100.0) 5 (26.3)
incorrect 0 14 (73.7)
Standard plane cut <0.0001
correct 182 (100.0) 7 (36.8)
incorrect 0 12 (63.2)
Measurement lines <0.0001
correct 148 (81.3) 2 (10.5)
incorrect 34 (18.7) 17 (89.5)
Tilting errors 0.002
yes 26 (14.3) 8 (42.1)
no 156 (85.7) 11 (57.9)
Lower limb missing <0.0001
yes 0 11 (57.9)
no 182 8 (42.1)

*Fisher exact

Discussion

The study provides evidence that nurses could be a practical alternative where suitable hip ultrasound-trained doctors are unavailable. The “Graf’s standard image” quality success high proportion of 92.0% and 89.1% were observed for junior physicians’ and nurses’ groups, respectively. Furthermore, the study revealed similar “Group A” or “Non-Group A” hips’ correct identification rates in both groups. The most common error among the groups were tilting of the transducer and missing of the lower limb.

In developing countries, implementing and sustaining any newborn screening, including newborn hip ultrasound, is challenging due to potential political instability, lack of trained human resources and less developed public health systems, etc [21]. Over the past decade, the humanitarian Swiss-Mongolian Pediatric Project—SMOPP, commissioned by the MOH in Mongolia, has established a newborn ultrasound screening and early conservative treatment program for developmental dysplasia of the hip [4, 5]. The obligation to implement a DDH ultrasound screening program, especially in a country with limited resources, requires plausible, simple structures and straightforward algorithms. These requirements led to two paradigms in the implementation of the SMOPP: a) application of the Graf’s ultrasound method [3, 10] as early as possible in the newborn period in a simplified form with only 4 intervention groups [18], and b) uniform, simple, cost-effective outpatient treatment of all DDH severity levels with a flexion-abduction device performed by the parents under pediatric surveillance [3, 10, 18].

In Mongolia, the Graf’s method is used in a simplified modified ABCD adaptation [18], which combines the Graf types into intervention groups according to therapeutic aspects (A = normal; B = physiologically immature, worthy of control; C = DDH, in need of immediate therapy through flexion-abduction-braces; D = dislocated). Knowing the high maturation potential in the first 3 months of life [22], the strategy must be implemented as early as possible after birth. The feasibility of the concept in Mongolia was proven by a cohort study [4] and subsequent statistical analyses [5]. All cases (n = 107) of DDH discovered in newborns were cured using the Tübingen braces [23]. In addition, the hip ultrasound screening has been well accepted by local newborn hip ultrasound screeners (e.g., neonatologists and pediatricians) even though the screening was comparatively new to the providers. Nevertheless, the screening implementation has not been smooth, especially in prominent sub-provincial hospitals because physicians are not always available when they are on remote emergency calls from remote rural areas.

The need for a possible alternative approach to screen every newborn baby for DDH by ultrasound is obvious when trained doctors are not available, especially in rural areas. To address the challenge of detecting “non-Group A” (Graf’s non-Type 1 hip) cases before discharge from maternity hospital (usually, after birth, newborns stay 1–2 days), it might be wise to train nurses since nurses are a more stable group in terms of higher numbers, mobility or changing workplace in the country [24]. This is especially crucial in rural hospitals where nomadic residents receive maternity and health services. Thus our study aimed to evaluate the feasibility of nurses without prior experience in ultrasonography to obtain the standard plane images of newborn hips. The study observed no statistically significant difference in the high quality of Graf’s standard plane images between the providers: junior physicians and nurses. Nevertheless, the study suggests that the nurses might need more training to correctly identify anatomical structures.

Although the role of nurse-led hip ultrasonography is insufficiently studied, Professor Graf, the founder of the hip ultrasound method, repeatedly mentioned that the nurse-performed hip ultrasound has good accuracy. There is a study that aimed to evaluate healthcare workers’ ability to classify ultrasound images into a Graf system [25]. The study team consisted of 3 physicians and 4 nurses at the infant health care system, with no previous ultrasound experience in the Netherlands. After theoretical and practical training, seven nurses and physicians of the participating infant health centers reported their findings on hip sonograms of 80 children. This was repeated five months later. From the two evaluation moments, the intra-observer agreement and the inter-observer agreement were determined. Based on the study results, the authors concluded that the inter- and intra-observer agreement is comparable to similar studies in which the participants had a professional background in ultrasound examination. The level of agreement of the trainees in the perspective of the screening process was considered sufficient [25]. However, this study addressed only the intra- and inter-observer variability in reading a sonogram. Therefore, the findings of this study and our results cannot be compared.

On the other hand, nurses are key players in the newborn screening program, and their role is crucial in increasing newborn screening coverage [26]. Considered front liners, nurses are usually the first contact with parents in a primary care setting or health facility, allowing them to advocate and educate parents on newborn screening. Besides these advantages recently, several studies have shown that appropriately trained nurses can perform some ultrasound scans [2732]. Although the role of nurse-led hip ultrasonography is poorly studied, it has been described as helpful in the placement of central [27] and peripheral intravenous lines [27, 29] in patients with difficult access, for the focused assessment in emergency situations [31, 33, 34] and patients with urologic [30, 35], obstetric [32, 36], and cardiac diseases [28]. In some countries, such as the United States, ultrasounds are generally performed by sonographers (technologists) and interpreted by physicians.

In the present study, common errors were missing the lower limb in both groups and subsequent measurement bias that led to the wrong diagnosis. It is mandatory to check the usefulness of a hip sonogram according to the Graf method: a) to identify the lower limb of the os ilium, b) the precise middle plane of the acetabulum roof, and c) the labrum (lower limb–plane—labrum); and errors of tilting the ultrasound transducer must be excluded. Such errors may eventually lead to incorrect procedures that may cause unnecessary over or under-treatment for babies without a quality control system [37, 38]. However, in the study, a quality control system allowed reliable review of the diagnosis and treatment of DDH and continuous education of nurses and junior doctors.

The current study has some potential limitations. 1) The generalizability of this study into the whole nurses’ community of different levels of care might be limited because only six nurses and six physicians performed the examinations. However, we tried to have a delegation from different levels of care hospitals, e.g., from referral, provincial and sub-provincial hospitals. Concerning the study’s limitations, the nurses’ or junior physicians’ characteristics might result in variations of skills related to image acquisition and interpretation which could affect the quality of the hip ultrasound scan. 2) The nurses’ and junior physicians’ evaluations of newborns’ hips were not validated against a reference method such as computerized tomography or magnetic resonance imaging. However, Graf’s method of hip ultrasound is standardized, it accepts only a standard plane cut of the acetabulum, and hence it is also reproducible. Our study focused on evaluating whether nurses and junior physicians can obtain the correct plane of the hip sonograms and identify “non-Group A” or “Graf’s non-Type 1” hips. The study did not address the intra- and inter-observer agreement regarding hip sonograms. Nevertheless, the quality and interpretation of the nurse- and junior physician-performed hip ultrasound images were compared. 3) Our detection power is limited based on our power analysis (need ~15% difference to be detected).

Conclusion

Our study provides evidence that while there might be a trend of slightly more technical mistakes in the nurse group, the overall diagnostic accuracy is similar to junior physicians after receiving standard training in Graf’s hip ultrasound method. However, after a basic standard training, regular quality control is a must and all participants should receive refresher trainings. More specifically, nurses need training in the identification of anatomical structures. Despite its limitations, this study seems to confirm that nurses could be authorized to carry out hip ultrasound procedures in order to refer those newborns requiring more specialized treatment to a higher-level health establishment, and potentially be able to reduce the occurrence and prevalence of hip dysplasia and disability in developing countries.

Supporting information

S1 Dataset. Comparison of quality and interpretation of newborn ultrasound screening examinations for developmental dysplasia of the hip by nurses and junior physicians.

(DTA)

pone.0300753.s001.dta (6.4KB, dta)

Acknowledgments

We would like to thank all families, nurses and physicians who participated in this study. We would also like to thank our colleagues who provided expert advice and are members of the Swiss Mongolian Pediatric Project and the Mongolian Society of Developmental Dysplasia of the Hip Prevention.

Data Availability

Data are from the Swiss Mongolian pediatric Project whose authors may be contacted via its website: www.smopp.ch. The authors will submit their anonymized all data file in stata format (.dta).

Funding Statement

The first author received doctoral training support from the Swiss Mongolian Pediatric Project (SMOPP) http://www.sipp.swiss/ and the Swiss Association of Pediatric Ultrasound (SVUPP). Moreover, ultrasound machines and examination cradles were provided by SMOPP free of charge under the governmental national screening program. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Loder RT, Skopelja EN. The epidemiology and demographics of hip dysplasia. ISRN Orthop. 2011; 2011:238607. doi: 10.5402/2011/238607 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Shipman SA, Helfand M, Moyer VA, Yawn BP. Screening for developmental dysplasia of the hip: a systematic literature review for the US preventive services task force. Pediatrics. 2006; 117(3):557–576. doi: 10.1542/peds.2005-1597 [DOI] [PubMed] [Google Scholar]
  • 3.Graf R. Fundamentals of sonographic diagnosis of infant hip dysplasia. J. Pediatr. Orthop. 1984, 4:735–740. doi: 10.1097/01241398-198411000-00015 [DOI] [PubMed] [Google Scholar]
  • 4.Munkhuu B, Essig S, Renchinnyam E, Schmid R, Wilhelm C, et al. Incidence and treatment of developmental hip dysplasia in Mongolia: a prospective cohort study. PLoS One. 2013; 8(10):e79427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ulziibat M, Munkhuu B, Schmid R, Baumann T, Essig S. Implementation of a nationwide universal ultrasound screening programme for developmental dysplasia of the neonatal hip in Mongolia. J Child Orthop. 2020; 14. doi: 10.1302/1863-2548.14.200029 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Carter C, Wilkinson J. Genetic and environmental factors in the etiology of congenital dislocation of the hip. Clin Orthop Relat Res. 1964; 33:119–128. [PubMed] [Google Scholar]
  • 7.Ulziibat M, Munkhuu B, Bataa AE, Schmid R, Baumann T, Essig S. Traditional Mongolian swaddling and developmental dysplasia of the hip: a randomized controlled trial. BMC Pediatr. 2021. Oct 13;21(1):450. doi: 10.1186/s12887-021-02910-x ; PMCID: PMC8513275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Joseph Gerard O’Beirne Konstantinos Chlapoutakis, Alshryda Sattar, et al. international consensus meeting on evaluation of developmental dysplasia of the hip. Ultraschall in Med 2019; 40:454–464. [DOI] [PubMed] [Google Scholar]
  • 9.Thallinger C, Pospischill R, Ganger R, et al. Long term results of a nationwide general ultrasound screening system for developmental disorders of the hip: the Austrian hip screening program. J Child Orthop. 2014; 8:3–10. doi: 10.1007/s11832-014-0555-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Graf R, Baumgartner F, Lercher K, Scott S, Benaroya A. Hip Sonography. Diagnosis and Management of Infant Hip Dysplasia. 2006. Springer ISBN 3-540-30957-8 [Google Scholar]
  • 11.Kotlarsky P, Haber R, Bialik V, Eidelman M. Developmental dysplasia of the hip: What has changed in the last 20 years? World J Orthop. 2015; 6(11):886–901. doi: 10.5312/wjo.v6.i11.886 ; PMCID: PMC4686436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Brdar R, Petronic I, Nikolic D, Lukac M, Cirovic D, Blagojevic T. Walking quality after surgical treatment of developmental dysplasia of the hip in children. Acta Orthop Belg 2013; 79(1):60–63. [PubMed] [Google Scholar]
  • 13.Fujii M, Nakashima Y, Jingushi S, et al. Intraarticular findings in symptomatic developmental dysplasia of the hip. J Pediatr Orthop 2009; 29: 9–13. doi: 10.1097/BPO.0b013e318190a0be [DOI] [PubMed] [Google Scholar]
  • 14.Graf R. The diagnosis of congenital hip-joint dislocation by the ultrasonic compound treatment. Arch Orthop Trauma Surg. 1980; 97:117–133. doi: 10.1007/BF00450934 [DOI] [PubMed] [Google Scholar]
  • 15.Chavoshi M, Mirshahvalad SA, Mahdizadeh M, Zamani F. Diagnostic Accuracy of Ultrasonography Method of Graf in the detection of Developmental Dysplasia of the Hip: A Meta-Analysis and Systematic Review. Arch Bone Jt Surg. 2021. May;9(3):297–305. doi: 10.22038/abjs.2021.55292.2755 ; PMCID: PMC8221445. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Thaler M, Biedermann R, Lair J, Krismer M, Landauer F. Cost-effectiveness of universal ultrasound screening compared with clinical examination alone in the diagnosis and treatment of neonatal hip dysplasia in Austria. J Bone Joint Surg [Br] 2011; 93-B:1126–1130. doi: 10.1302/0301-620X.93B8.25935 [DOI] [PubMed] [Google Scholar]
  • 17.World Health Organization. Regional Office for Europe, European Observatory on Health Systems and Policies, Bolormaa T, Natsagdorj Ts, Tumurbat B. et al. Mongolia: health system review. World Health Organization. Regional Office for Europe. 2007. https://apps.who.int/iris/handle/10665/107845 [Google Scholar]
  • 18.Baumann T, Schmid R, Essig S, et al. ABCD OF DDH. Zumsteg Druck AG. 2017. https://www.thieme-connect.com/products/ejournals/html/10.1055/s-0043-110690. [Google Scholar]
  • 19.Ministry of Health Mongolia. National guideline of newborn ultrasound screening and management for the developmental dysplasia of the hip. Ministry of Health, Mongolia. Ulaanbaatar. 2021 [Google Scholar]
  • 20.Copuroglu C., Ozcan M., Aykac B. et al. Reliability of ultrasonographic measurements in suspected patients of developmental dysplasia of the hip and correlation with the acetabular index. IJOO 45, 553–557 (2011). doi: 10.4103/0019-5413.87131 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Therrell BL,Padilla CD. Barriers to implementing sustainable national newborn screening in developing health systems. International Journal of Pediatrics and Adolescent Medicine. 2014; 1(2):49–60. [Google Scholar]
  • 22.Tschauner C, Klapsch W, Baumgarthner A, Graf R. Maturation curve of the ultrasonographic alpha angle according to Graf’s untreated hip joint in the first year of life. Z Orthop Ihre Grenzgeb 1994; 132:502–504. [DOI] [PubMed] [Google Scholar]
  • 23.Baumann T, Munkhuu B, Chuluunbaatar B, Schmid R. 4-year follow-up of ultrasound-based diagnosis and non-surgical treatment of developmental dysplasia of the hip in Mongolia: a prospective cohort study. Ultraschall in der Medizin. 2016; 37(S 01) doi: 10.1055/s-0036-1587724 https://www.thieme-connect.com/products/ejournals/abstract/10.1055/s-0036-1587724 [DOI] [Google Scholar]
  • 24.International Organization for Migration (IOM). Internal Migration in Mongolia: Situation Analysis Report. IOM, Ulaanbaatar. 2023
  • 25.Ramwadhdoebe S, Sakkers RJ, Uiterwaal CS, Boere-Boonekamp MM, Beek FJ. Evaluation of a training program for general ultrasound screening for developmental dysplasia of the hip in preventive child health care. Pediatr Radiol. 2010; 40:1634–1639. doi: 10.1007/s00247-010-1689-4 Epub 2010 Jun 12. . [DOI] [PubMed] [Google Scholar]
  • 26.DeLuca J, Zanni KL, Bonhomme N, Kemper AR. Implications of newborn screening for nurses. J Nurs Scholarsh. 2013; 45:25–33. doi: 10.1111/jnu.12005 Epub 2013. Jan 31. . [DOI] [PubMed] [Google Scholar]
  • 27.Stokowski G, Steele D, Wilson D. The use of ultrasound to improve practice and reduce complication rates in peripherally inserted central catheter insertions: final report of investigation. J Infus Nurs 2009; 32:145–155. doi: 10.1097/NAN.0b013e3181a1a98f [DOI] [PubMed] [Google Scholar]
  • 28.Colquhoun SM, Carapetis JR, Kado JH, Reeves BM, Remenyi B, May W, et al. Pilot study of nurse-led rheumatic heart disease echocardiography screening in Fiji—a novel approach in a resource-poor setting. Cardiol Young 2013; 23:546–552. doi: 10.1017/S1047951112001321 [DOI] [PubMed] [Google Scholar]
  • 29.Weiner SG, Sarff AR, Esener DE, Shroff SD, Budhram GR, Switkowski KM, et al. Single-operator ultrasound-guided intravenous line placement by Emergency Nurses reduces the need for physician intervention in patients with difficult-to-establish intravenous access. J Emerg Med 2013; 44: 653–660. doi: 10.1016/j.jemermed.2012.08.021 [DOI] [PubMed] [Google Scholar]
  • 30.Paez A, Ju_arez N, Mar_ın M, Del Vigo S, Redondo E, Dur_an M. Concordance analysis of ultrasonographic diagnoses by urology nurses. Arch Esp Urol 2012; 65: 872–878. [PubMed] [Google Scholar]
  • 31.Bowra J, Forrest-Horder S, Caldwell E, Cox M, D’Amours SK. Validation of nurse-performed FAST ultrasound. Injury 2010; 41: 484–487. doi: 10.1016/j.injury.2009.08.009 [DOI] [PubMed] [Google Scholar]
  • 32.Menihan CA. Limited obstetric ultrasound in nursing practice. J Obstet Gynecol Neonatal Nurs. 2000; 29:325–330. doi: 10.1111/j.1552-6909.2000.tb02054.x . [DOI] [PubMed] [Google Scholar]
  • 33.Bloom BA, Gibbons RC. Focused Assessment with Sonography for Trauma. In: StatPearls [Internet]. Treasure Island (FL): Stat Pearls Publishing; 2022. https://www.ncbi.nlm.nih.gov/books/NBK470479/ [PubMed] [Google Scholar]
  • 34.Varndell Wayne, Topacio Michelle, Hagness Carmel, Lemon Hayley, Tracy Deborah. Nurse-performed focused ultrasound in the emergency department: A systematic review. Literature review 2018; 21(4):121–130. doi: 10.1016/j.auec.2018.09.003 [DOI] [PubMed] [Google Scholar]
  • 35.Nandwana SB, Walls DG, Ibraheem O, Murphy F, Tridandapani S, Cox K. Image-Guided Nontargeted Renal Biopsies Performed by Radiology-Trained Nurse Practitioners: A Safe Practice Model. J Am Coll Radiol. 2016; 13(7):819–821. doi: 10.1016/j.jacr.2015.09.037 [DOI] [PubMed] [Google Scholar]
  • 36.Stringer Marilyn, Miesnik Susan R., Brown Linda P., Menei Lynne, Macones George A. Limited Obstetric Ultrasound Examinations: Competency and Cost. Clinical research 2003; 32:307–312. doi: 10.1177/0884217503253452 [DOI] [PubMed] [Google Scholar]
  • 37.Tschauner C, Matthissen H. Hip Sonography with Graf-method in Newborns: Checklists help to avoid mistakes. OUB 2012; 1:7–8. [Google Scholar]
  • 38.Graf R, Mohajer M, Plattner F. Hip sonography update. Quality management, catastrophes—tips and tricks. Med Ultrason 2013; 15:299–303. doi: 10.11152/mu.2013.2066.154.rg2 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Richard Ali

24 Jul 2023

PONE-D-23-02980Comparison of quality and interpretation of hip ultrasound screening examinations by basically trained nurses to junior physicians with no previous ultrasound experiencePLOS ONE

Dear Dr. Ulziibat,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript has been evaluated by five reviewers, and their comments are available below. The reviewers have raised a number of concerns throughout your manuscript that need attention. They recommend additional background information in the Introduction to better introduce the topic. They also feel the Methods section may benefit from further clarification, particularly as it pertains to the education of the trainees, and the inclusion of statistical power calculations which may validate conclusions drawn from your study. It is also suggested to include additional images which may enhance presentation for the reader. Could you please revise the manuscript to carefully address the concerns raised?

Please submit your revised manuscript by Sep 04 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Richard Ali, PhD

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

3. Please update your submission to use the PLOS LaTeX template. The template and more information on our requirements for LaTeX submissions can be found at http://journals.plos.org/plosone/s/latex.

4. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Additional Editor Comments:

The manuscript has important value for dissemination, given the needs at the primary care level in many countries. The study and results are well designed and explained. However, perhaps from the language and writing parts there are several unclear expressions that may confuse the readers. Thus, I have made several suggestions so that you and authors can review, revise, correct and then re-submit. Thank you.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

Reviewer #4: Partly

Reviewer #5: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: No

Reviewer #5: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: There are several issues in this manuscript. Please see the attached PDF sent with the review, where I place several suggestions to improve the data analysis and manuscript writing, for better understanding and integrity.

Reviewer #2: The study designed is to provide an alternative to trained doctors when are not available in detecting DDH in newborns. It needs more clarification and efficient interpretation. The data depicted is not convincing enough. The title should be modified to more clear aim and should specify the 'newborns'. The introduction lacks the critical relevance of DDH, its diagnosis, factors, epidemiological reasons and basic information. The information regarding 'ABCD' system should be mentioned in material sand methods and well defined to the new readers. Overall, the aim of the authors to give untrained nurses to diagnose newly Borns with DDH seems a bit risky and not a reliable approach.

Reviewer #3: Dear Authors

I would like to express my appreciation for the thoroughness and quality of your work. Your research is both significant and compelling. I was impressed by the clarity of your methodology, the validity of your findings, and the overall organization of your paper.

With my acknowledgement to the strength of your results, I think that your research should include relevant figures, charts, or graphs to visually present your findings and enhance the overall presentation of the results section.

Reviewer #4: Overall promising paper. Work can be strengthened by clarification in technique/methods (more in depth description of the doctors/nurses training, handling of hips vs patients), better presentation organization, and better statistical consideration. In particular, the numbers shown suggest there may be some decrease in quality of the exam in nurses compared to doctors that might reach significance if n is increased (see below in conclusion). Power analysis is definitely needed any time a "no difference" in result is proposed.

Title:

-Might want to include what is being screened for (developmental hip dysplasia).

Article information:

-The funding information is incomplete. Need which author received the fund, and/or grant number.

Abstract:

-Base on the data, would not say “can obtain… sonograms… with equal quality.” See below in conclusion.

Introduction:

-Line 75: “drainage” of knowledge ?

Methods:

-What is the background of training of the nurses (what kind of schooling)? And of the junior physicians? What kind of physicians are they? Years of experience?

-The nurses and junior doctors completed 1 week of introductory courses and 1 week of supervised ultrasound screening. How many hours of courses were there? How many patients (approximately) were screened while supervised? You said 10-20 were “intended,” but how many were actually done?

-Was power analysis done?

-Were the right and hips treated as separate subjects? 201 newborns were screened… were the data treated as 201 subjects or 402 hips in the calculations?

-Would remove the multivariate modeling. The information in Table 4 (univariate analysis) is sufficiently clear to show the patients prone to have errors and likely source of error. The multivariate analysis does not add much, and doesn’t make sense to combined demographic and exam characteristic factors.

Results:

-The division of Table 2 and Table 3 do not make sense. Table 2 (quality of images) included diagnosis (not a quality metric) and anatomical identification (interpretative metric), but not the factors in Table 3 (tilting and missing lower limb- factors of image quality).

Conclusion:

-The numbers presented 96% correct anatomical identification for doctors vs 90% for nurses, 97% correct standard plane vs 91% for nurses nearly reach statistical significance (p = 0.077-0.10). Without power analyses, the conclusion that they are equal in quality is not justified. Would consider possibly rephrasing to say that while there might be a trend of slightly more incorrect technical factors in the nurses group, the overall diagnosis accuracy is similar.

Reviewer #5: This is an interesting topic. I have questions regarding methods.

1. Line 81 states basically trained nurses and trained junior physicians. Are they all graduated from certified medical schools? Can they represent the current nurse or junior physician population in the country?

2. Line 105 states the standard week courses. Could you specify how many hours in total? During the course, were a pretraining test and a post-training test performed? If did, how about performance?

3. Line 110 to 113 states around 10 to 20 sonograms. Is there any correlation between the training sonogram number and the final performance of each nurse and physician in the study?

4. Table 1. Why did you combine provincial and subprovincial groups? Since your paper tried to convince us that standard training could help rural regions. The subprovincial group performance is more important and better to make a point. Could you explain why you combined two groups?

5. Table 2. There are two numbers 0.245 and 0.100, on the line of Anatomical identification. Could you please explain it?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Mysara Rumman

Reviewer #4: Yes: Anderson H. Kuo

Reviewer #5: No

**********

&nbsp

Attachment

Submitted filename: PONE-D-23-02980-AF.pdf

pone.0300753.s002.pdf (693.2KB, pdf)
Attachment

Submitted filename: comments.docx

pone.0300753.s003.docx (13.9KB, docx)
PLoS One. 2024 Apr 18;19(4):e0300753. doi: 10.1371/journal.pone.0300753.r002

Author response to Decision Letter 0


21 Sep 2023

Editor Comments

The manuscript has been evaluated by five reviewers, and their comments are available below. The reviewers have raised a number of concerns throughout your manuscript that need attention. They recommend additional background information in the Introduction to better introduce the topic. They also feel the Methods section may benefit from further clarification, particularly as it pertains to the education of the trainees, and the inclusion of statistical power calculations which may validate conclusions drawn from your study. It is also suggested to include additional images which may enhance presentation for the reader. Could you please revise the manuscript to carefully address the concerns raised?

Response: Thank you and the reviewers very much for the opportunity to submit a revision of our manuscript. We added additional background information, information on the education of the trainees and statistical power calculations, as well as images. Below, we respond to each point raised by the reviewers. If we can provide any additional information or make any other changes, please do not hesitate to let us know.

The manuscript has important value for dissemination, given the needs at the primary care level in many countries. The study and results are well designed and explained. However, perhaps from the language and writing parts there are several unclear expressions that may confuse the readers. Thus, I have made several suggestions so that you and authors can review, revise, correct and then re-submit. Thank you.

Response: Thank you for your support. We are not sure which suggestions came from you as the comments of you and the reviewers were submitted in three parts (text in the e-mail, PDF and Word file). We respond to each point from all three parts below and carefully address the concerns raised.

Attachment

Submitted filename: Response to reviewers.docx

pone.0300753.s004.docx (36.9KB, docx)

Decision Letter 1

Marianne Clemence

20 Feb 2024

PONE-D-23-02980R1Comparison of quality and interpretation of hip ultrasound screening examinations by basically trained nurses to junior physicians with no previous ultrasound experiencePLOS ONE

Dear Dr. Ulziibat,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 Please submit your revised manuscript by Apr 05 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Marianne Clemence

Staff Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Thank you for revising your manuscript according to the reviewers' concerns. The reviewers have a few additional minor requests to improve the quality of the language and clarity of the explanations outline below and attached. I note that you modified your title in the manuscript file - please ensure you have also updated the title in the online submission form.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

Reviewer #4: (No Response)

Reviewer #5: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #3: Yes

Reviewer #4: Yes

Reviewer #5: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This version of the manuscript contains more accurate and explanatory statements that help the reader make good sense of the important study and results. However, there are still a few very small but key additions/explanations required, again for the benefit of the reader and so there is no confusion over methods and results. Please review my accompanying PDF file, where I suggest some of these edits, and make sure somebody with good English language skill makes a final review of the manuscript, in order for it to be published.

Reviewer #3: Through my reading this manuscript, I found a clear, correct, and unambiguous language. Moreover, in this review, all the previous grammatical errors were also corrected.

Therefore, I accept this paper for publication.

Reviewer #4: Thank you for revising your manuscript and clarifying the previously noted points. The manuscript is improved and more clear. A few remaining points worth considering.

INTRODUCTION

Line 64: standard PLANE instead of plain? Might want to rephrase as "The method uses a coronal ultrasound image through the center of the acetabulum..."

Line 88, 91 Instead of "profound knowledge," would consider "good knowledge," "experienced in," or "proficient in"

METHODS

Line 119 "Other criteria ... " Would remove this sentence. It is confusing and does not add additional information.

Line 219 Would combine (1) and (2) into "difference in quality of ultrasound of 15%.

RESULT

Line 249 "the incorrect diagnosis was significantly more likely to be 'ASSOCIATED WITH' smaller birth weight of newborns..." Correlation and causation are not the same.

DISCUSSION

Would acknowledge that your detection power is limited based on your power analysis (need ~15% difference to be detected).

It might be worth noting that in some places in the world, such as the US, ultrasounds are generally performed by sonographers (technologists) and interpreted by physicians.

TABLE

Table 3: Incorrect diagnosis total should be 19, not 9

FIGURE

Figure 1A and 1B: Image in 1A is too zoomed in, making it difficult to see the position of the femoral head and worsening image quality.

Reviewer #5: Could you please correct the contradictory between line 60 and line 37? Ultrasound is an examiner-dependent modality. That is why examiners should be very trained and certified.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr. Alfredo L. Fort

Reviewer #3: Yes: Mysara Rumman

Reviewer #4: Yes: Anderson H. Kuo

Reviewer #5: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: comment_1.docx

pone.0300753.s005.docx (12.3KB, docx)
Attachment

Submitted filename: PONE-D-23-02980_R1_AFreviewer.pdf

pone.0300753.s006.pdf (2.4MB, pdf)
PLoS One. 2024 Apr 18;19(4):e0300753. doi: 10.1371/journal.pone.0300753.r004

Author response to Decision Letter 1


23 Feb 2024

Journal Requirements

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response: The reference list was re-checked and corrected: two mistakenly retracted papers were removed and replaced them with relevant current references (Ref 15- line: 413-417 and Ref 24: lines: 446-447), one paper was added due to additional explanations in the text (Ref 20- lines: 431-434).

Additional Editor Comments

Thank you for revising your manuscript according to the reviewers' concerns. The reviewers have a few additional minor requests to improve the quality of the language and clarity of the explanations outline below and attached. I note that you modified your title in the manuscript file - please ensure you have also updated the title in the online submission form.

Response: Thank you very much for the opportunity to submit a revision of our manuscript. We now updated the title in the online submission form. We will respond to the points raised by the reviewers below.

Attachment

Submitted filename: Nurse_PONE_ point by point answers_2_SE.docx

pone.0300753.s007.docx (44.6KB, docx)

Decision Letter 2

Malgorzata Wojcik

5 Mar 2024

Comparison of quality and interpretation of newborn ultrasound screening examinations for developmental dysplasia of the hip by basically trained nurses and junior physicians with no previous ultrasound experience

PONE-D-23-02980R2

Dear Dr. Munkhtulga U{lziibat,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Malgorzata Wojcik, Ph.D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Dear Authors,

Congratulations, you have received acceptance after major and minor revision.

best wishes

Małgorzata Wójcik

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: All comments have been addressed

Reviewer #4: All comments have been addressed

Reviewer #5: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #3: Yes

Reviewer #4: (No Response)

Reviewer #5: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: Yes

Reviewer #4: (No Response)

Reviewer #5: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: Yes

Reviewer #4: (No Response)

Reviewer #5: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

Reviewer #4: (No Response)

Reviewer #5: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: The manuscript is ready to publish, no further revision needed.

I have reviewed the original manuscript and then the revised version, and decided to accept it.

Reviewer #4: (No Response)

Reviewer #5: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: Yes: Mysara Rumman

Reviewer #4: Yes: Anderson H. Kuo

Reviewer #5: No

**********

Acceptance letter

Malgorzata Wojcik

8 Apr 2024

PONE-D-23-02980R2

PLOS ONE

Dear Dr. Ulziibat,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Malgorzata Wojcik

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Dataset. Comparison of quality and interpretation of newborn ultrasound screening examinations for developmental dysplasia of the hip by nurses and junior physicians.

    (DTA)

    pone.0300753.s001.dta (6.4KB, dta)
    Attachment

    Submitted filename: PONE-D-23-02980-AF.pdf

    pone.0300753.s002.pdf (693.2KB, pdf)
    Attachment

    Submitted filename: comments.docx

    pone.0300753.s003.docx (13.9KB, docx)
    Attachment

    Submitted filename: Response to reviewers.docx

    pone.0300753.s004.docx (36.9KB, docx)
    Attachment

    Submitted filename: comment_1.docx

    pone.0300753.s005.docx (12.3KB, docx)
    Attachment

    Submitted filename: PONE-D-23-02980_R1_AFreviewer.pdf

    pone.0300753.s006.pdf (2.4MB, pdf)
    Attachment

    Submitted filename: Nurse_PONE_ point by point answers_2_SE.docx

    pone.0300753.s007.docx (44.6KB, docx)

    Data Availability Statement

    Data are from the Swiss Mongolian pediatric Project whose authors may be contacted via its website: www.smopp.ch. The authors will submit their anonymized all data file in stata format (.dta).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES