Skip to main content
Springer logoLink to Springer
. 2022 Feb 24;37(6):1586–1598. doi: 10.1007/s00455-022-10413-9

Translating Ultrasound into Clinical Practice for the Assessment of Swallowing and Laryngeal Function: A Speech and Language Pathology-Led Consensus Study

Jodi E Allen 1,, Gemma Clunie 2, Joan K-Y Ma 3, Margaret Coffey 2, Katharina Winiker 4, Sally Richmond 5, Soren Y Lowell 6, Anna Volkmer 7,
PMCID: PMC8867131  PMID: 35201387

Abstract

Ultrasound (US) has an emerging evidence base for the assessment of swallowing and laryngeal function. Accessibility and technological advances support the use of US as a clinical assessment tool; however, there is insufficient evidence to support its translation into clinical practice. This study aimed to establish consensus on the priorities for translation of US into clinical practice for the assessment of swallowing and laryngeal function. Nominal Group Technique (NGT) was used as a formal method of consensus development. Clinicians and academics, all members of an international US working group, were invited to participate in the study. Two NGT meetings were held, where participants silently generated and then shared ideas. Participants anonymously ranked items. Rankings were aggregated before participants re-ranked items in order of priority. Discussions regarding rankings were recorded and transcribed to inform analysis. Member-checking with participants informed the final analysis. Participants (n = 15) were speech and language pathologists, physiotherapists and sonographers representing six countries. Fifteen items were identified and prioritised 1–13 (including two equally ranked items). Reliability, validity and normative data emerged as key areas for research while development of training protocols and engagement with stakeholders were considered vital to progressing US into practice. Analysis revealed common themes that might be addressed together in research, in addition to the ranked priority. A measured approach to the translation of US into clinical practice will enable effective implementation of this tool. Priorities may evolve as clinical and professional contexts shift, but this study provides a framework to advance research and clinical practice in this field.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00455-022-10413-9.

Keywords: Ultrasound, Assessment, Dysphagia, Swallowing, Laryngeal function

Introduction

Ultrasound (US) has an emerging evidence base for the assessment of swallowing and laryngeal function [1]. Early research identified the ease with which anatomical landmarks and soft tissues of the upper aerodigestive tract could be identified using US [2]. Since then, US has been validated as a tool to assess the size and structure of the muscles involved in swallowing [35], offering an opportunity to assess impairment at an anatomical level. It has also been applied to the evaluation of swallowing and laryngeal kinematics, in particular the assessment of vocal fold movement [6, 7], tongue and posterior pharyngeal wall movement [8, 9], opening of the upper oesophageal sphincter [10], displacement of the hyoid [1115] and thyrohyoid approximation [16, 17].

The advantages offered by ultrasound for the assessment of swallowing and laryngeal function include its accessibility, portability, lack of radiation and low levels of patient invasion which make it suitable for prolonged or repeat examinations, as well as hard-to-reach patient groups [18]. Recent research exploring manual versus automatic tracking of swallowing-related movements indicates potential for more efficient analysis of US images and improved clinical utility [19]. The emerging evidence that supports the use of US to detect bolus residue and aspiration may also extend its range of potential applications in the clinical setting [2022]. Technological advances in US imaging quality [23], and increasing accessibility and portability of US devices [24, 25], further support the rationale to determine the optimal approaches for effective implementation of US into clinical practice that are sustainable and evidence-based.

The application of US as a diagnostic tool to guide therapeutic swallowing and laryngeal intervention remains underexplored. A recent rapid review in this area [1] indicated the need for further research prior to translation of US into clinical practice for this purpose. Other professional groups have started to translate US as a clinical evaluation tool [2628] but a lack of sufficient evidence has hindered implementation [29]. Parallels can also be drawn within the dysphagia community when reflecting on the implementation of existing clinical instrumental evaluation tools, specifically Endoscopic Evaluation of the Larynx (EEL), Flexible Endoscopic Evaluation of Swallowing (FEES) and Videofluoroscopic Swallowing Studies (VFSS). Despite being the tool(s) of choice for dysphagia evaluation [30, 31], heterogeneity of protocols, outcome measures and lack of reliability have beleaguered clinical practice and impacted patient care [32]. More recent development of standardised and validated protocols for FEES and VFSS has enabled clinicians to become more effective in formulating clinical management plans [3335]. A systematic approach to translation of US into dysphagia assessment practices acknowledges these limitations and will assist with the implementation of US in a logical and appropriate way.

Translating US into Clinical Practice

Implementation science [36] represents one possible approach to facilitating integration of US into clinical practice. It offers a rigorous, structured and evidence-based methodology to implement a technique into regular use by clinicians, as well as taking into account elements that may limit its acceptance [37]. This balance between research and practice encourages the consideration of facilitators and mitigation of barriers which may be key to the implementation of US for the purpose of swallowing and laryngeal assessment. This is particularly relevant due to the complex and heterogeneous environments in which clinicians work, including different policy contexts, organisational systems, and professional domains.

Normalisation Process Theory (NPT) is a theory of implementation science, offering a structured approach to the normalisation of US as an evidence-based clinical assessment tool [38]. NPT considers clinical contexts, clinicians and practices to understand the translational gap between evidence, policy and practice, and is often used in healthcare settings [39, 40]. Prior to normalisation of US as an evidence-based clinical assessment tool, there are a broad range of topics (or items) that require further investigation [1, 18]. Even though many such understudied US topics have been identified, there is little guidance as to which are the most important or necessary. Without this information, the translational gap between evidence and practice cannot be understood. Consensus methods can help prioritise work to support systematic translation of US into clinical practice [41].

The development of prioritised agendas is highly relevant to healthcare research. The World Health Organization and groups such as the James Lind Alliance provide opportunities for patients, clinicians and researchers to come together to identify evidence uncertainties and generate research priorities across many aspects of healthcare [42, 43]. Prioritised agendas have been applied to the development of a research programme by people with aphasia [44] and the identification of a core outcome set for researchers working in this area [45]. Consensus-building informs research commissioning and ensures that funders are aware of the issues that matter most to the people to whom the research applies. A prioritised agenda enables us to do the “most good” with limited resources. It does not introduce new information but quantifies the level of uncertainty of the topics that are priority-ranked [46].

The International US Working Group

In response to the translational gap between evidence and practice, a group of clinicians and researchers identified a need to develop a prioritised research agenda to support the translation of US into clinical practice for the assessment of swallowing and laryngeal function. This international working group formed in Spring 2020 when restrictions related to the novel coronavirus Sars-Cov-2 limited access to more established clinical imaging tools due to infection risk [47]. Members of the group have a mutual interest in the clinical utility of US for the assessment of swallowing and laryngeal function. The group’s objective is to motivate further research via collaboration between clinicians and researchers. They identified a need to undertake this consensus study to inform the prioritised research agenda for the implementation of US into clinical practice.

Methods

Study Design

To gain a comprehensive understanding of the relevant needs associated with translating US into clinical practice, a qualitative research method was identified as appropriate. Nominal Group Technique (NGT) is a structured method of generating ideas, devising solutions and producing recommendations for best practice [48, 49]. It encourages equal contribution from participants and enables collaboration between a mix of professional groups. It has been extensively reported in the healthcare literature as a method of synthesising expert opinion, particularly in the absence of published data relating to a subject [41, 50]. NGT has successfully been used to enable clinicians, researchers and patients to work collaboratively to develop a prioritised agenda to drive profession-specific research in health [51]. NGT methods were specifically selected to provide equity in participants’ contributions, enabling people to contribute in a structured and systematic way [49].

The study was given ethical approvals by the Human Ethics Committee, University of Canterbury, New Zealand (Ref HEC 2021/12/LR-PS). Work undertaken for this study has been reported using the Consolidated Criteria for Reporting Qualitative Research (COREQ) [52].

Participants

A purposive sampling strategy was used, whereby participants were recruited from the international US working group of experts who represented multidisciplinary clinical professionals with an interest in US, and who identified the research gaps. The group was established in April 2020 and formed through practical and/or theoretical interest in US. The group comprises eighteen members from four professional groups and seven different countries. A core aim of the group has been to collaboratively advance an US prioritisation agenda with structure and rigour. All group members were invited verbally and via email to participate in the NGT process if they considered their own experience and ability to respond to the research question as appropriate. The invitation was not extended outside of the international group as the group size and range of expertise were considered sufficient to meet the research aims and requirements of NGT methodology. NGT participants provided written consent and demographic details pertaining to their profession and highest academic qualification, years of clinical and dysphagia practice, practical experience of US, patient cohort and country of work.

Developing the Research Question

The rapid review [1] helped to identify broad target areas for future research. With this in mind, a subgroup of the international US group refined the research question to ensure it met the study aim and was clear and well-defined for the purpose of the NGT process [53].

Once the question had been agreed by the subgroup, it was refined by the wider membership and agreed on a-priori 1 month before embarking on the NGT process. The final question was sent out to participants 2 weeks before stage one of the NGT process. Participants were instructed to spend time thinking about the research question but not research or generate any written responses in advance of the meeting.

The question was designed to encompass both swallowing and laryngeal function as it was hypothesised that those areas share the same requirements for translation into clinical practice (Fig. 1).

Fig. 1.

Fig. 1

NGT research question

Nominal Group Technique Process

The NGT process comprised a two-stage ranking process commencing with a 90-minute online group session (stage one), followed by email consultation (stage two). Participants were divided into two groups (A & B) for stage one to allow people across different time zones to participate. Each meeting lasted 90 minutes and was held on a video conferencing platform (Zoom). Groups were facilitated by a researcher experienced in NGT processes in line with guidelines for conducting NGT meetings [54]. The central topic guide was agreed in advance by the research team (see supplementary file 1). All meetings were recorded. A third stage was added, whereby member checking included the co-development of a visual representation of the study results. Figure 2 provides an overview of the NGT process.

Fig. 2.

Fig. 2

Nominal group technique process for US consensus recommendations

Stage one: Item Generation and Initial Ranking

At the start of the session, participants were reminded of the NGT process by the facilitator. The research question was presented (see Fig. 1) and participants were given 10 minutes to silently generate written ideas in response. In line with NGT methods, each participant in turn was asked to present an item from their list of ideas, using a ‘round robin’ approach, until all lists had been exhausted. Generated items were captured on a shared PowerPoint slide. Participants were then provided 10 minutes to silently identify and rank the eight items they considered most important by placing a number from 1 to 8 to reflect which is most important (8) and least important (1). Participants emailed their ranked items to the facilitator to maintain anonymity and reduce bias during the ranking process. Participants were invited to provide written justification for their ranking, plus any additional comments.

Following the online meeting, scores were aggregated by the facilitator to generate a list of items per group. The list provided information on scores and the group mean ranking for each item. As per guidelines, items describing the same ideas from the two groups were merged and scores combined, following discussion and agreement between two topic experts [54].

Stage Two: Re-Ranking to Generate Consensus Recommendations

The ranked list from stage one was emailed to all participants 5 days after the completion of stage one. Participants were asked to review the list and identify and rank the eight items they considered to be of most (8) to least (1) importance to the research question. To maintain anonymity within the international group, participants were asked to return their responses to the independent facilitator by email.

The facilitator again aggregated scores to generate the final priority list of the sum scores. The list was presented to the participants at a consequent group meeting for member checking [55]. These discussions were recorded and transcribed by the lead author for review. Any data relating to NGT rankings were extracted from the transcription and used to define each NGT item. Comments and reflections on the ranking process were also extracted. During this discussion participants identified items they felt had been represented more than once, but that represented the same concept. Participants discussed and unanimously agreed on the subsequent merging of items.

Stage Three: Co-Development of a Visual Representation of NGT Items

Items were grouped into categories and presented to NGT participants by the lead author. Six different diagrammatic representations demonstrating the relationships between items and their categories were also presented. All participants were invited to critique these diagrams and co-develop a final figure.

Results

Participants

Of the 18 members of the international group invited to participate in the study, 15 were able to take part. One did not feel they met the inclusion criteria and two withdrew from the study due to personal circumstances.

Group A comprised seven participants, all speech and language pathologists (SLPs). Group B comprised eight participants, six SLPs, one respiratory physiotherapist and one head and neck sonographer. Professional affiliation, country of practice and qualifications of the group are presented in Table 1.

Table 1.

Demographics of NGT group (n = 15)

Participants (n = 15)
Professional background
 SLP 13
 Respiratory PT 1
 H&N sonographer 1
Country of current practice
 England 9
 Scotland 1
 Netherlands 1
 Switzerland 1
 New Zealand 2
 United States of America 1
Professional qualification
 PhD 5
 MSc/MRes 5
 PGDip 2
 BSc 3

All but one participant specialised in adult care. Clinical experience of the group ranged from 6.5 to 41 years, median 16 years. Years of dysphagia practice among SLP participants ranged from 5 to 39 years, median 15 years. The sonographer and physiotherapist had no experience in dysphagia management. All but one member of the group had practical experience of US.

NGT Rankings

In stage one, Group A generated 23 items and Group B 36 items for individual ranking. Following the ranking process and merging of similar items the initial list comprised 28 items. A list of all generated items from each group can be viewed in supplementary file 2.

After the re-ranking process in stage two, the list comprised a total of 21 items. Of these, 10 items were merged resulting in a final list of 15 items, ranked 1–13 with two items having received equal ranking. These final rankings are presented in Table 2.

Table 2.

Items required to translate the use of US into SLP practice for the purpose of laryngeal and swallowing assessment

Rank Item
1 Reliability
2 Normative values
3 Discriminant validity
4 Criterion validity
5 Training protocols and competencies
6 Measurement and interpretation
7 Standardised assessment protocols
8 Equipment specifications and settings
9 Understanding of swallowing movements in an US image
10 Evidence to support clinical utilisation
 = 11 Resourcing
 = 11 Infrastructure and ‘buy-in’
 = 12 Recognition and guidance from professional bodies
 = 12 Multi-professional input
13 Patient and public involvement

 = represents items of equal ranking

The following descriptions summarise the discussions of study participants in relation to each item.

Reliability (Rank 1)

The highest ranked item related to the theme of reliability under which a range of items were raised, specifically, the establishment of test–retest reliability and inter- and intra-rater reliability in data acquisition including scanning, image selection and measurement. Participants noted the need for reliability among online and offline measurements as well as automated and manual measurements. Participants acknowledged that reliability may differ depending on the population sample and therefore expressed the need to establish reliability in both healthy and patient groups.

Normative Values (Rank 2)

Establishment of ‘normal’ values for the biomarkers representing swallowing and laryngeal function was described as requiring the acquisition and measurement of biomarkers in healthy participants to generate normative data. These data will need to capture the variation in normal function with age and across different swallowing conditions (e.g. bolus’ of different size and texture) and will serve as a reference value from which to judge disordered function. Participants recognised that some measurements may not be significantly different in patient and healthy populations, as normal values can have a broad distribution. The ability to detect differences between normal and disordered function also relates to discriminant validity (item 3). It was also acknowledged that, for patient groups, deviation from ‘normal’ values may carry greater clinical risk due to associated health issues. The importance of understanding the clinical significance of abnormalities was highlighted. Participants also commented on the potential for disconnect between measurements used for research versus clinical practice and noted the need for US measurements to be practical and achievable in the clinical setting.

Discriminant Validity (Rank 3)

Discriminant validity was defined as an understanding of the sensitivity and specificity of US measurements for detecting the conditions of concern, for example, the ability to accurately diagnose the presence versus absence of aspiration, disordered vocal fold movement or (subtype of) dysphagia. Participants also felt it important to understand the smallest unit of difference that US can measure to capture changes in swallowing or laryngeal function. These changes may relate to function pre- and post-intervention or progression of a condition over time. Participants recognised that the establishment of discriminant validity related to the reliability of image acquisition and measurement (item 1) and will also support the selection of biomarkers (item 2) for swallowing and laryngeal assessment. Discriminant validity will also help to define the selection of patient populations in which US assessment can be used. Participants also stated that establishment of discriminant validity will enable decisions about how US can be used in clinical practice, for example as a diagnostic, screening or monitoring tool.

Criterion Validity (Rank 4)

Criterion validity was defined as the need to understand if and to what extent US provides similar information to existing instruments of choice. The group agreed that the existing tools for comparison are VFSS and FEES for swallowing assessment and EEL for evaluation of laryngeal function.

Training Protocols and Competencies (Rank 5)

Several items were proposed for possible inclusion into training protocols, with the aim of ensuring safety and governance. These included:

  • a statement on the operator’s scope of practice

  • a description of the knowledge and skills required to perform US for the purpose of swallowing and laryngeal assessment

  • minimum standards for competence

  • guidance on who delivers the training (including the skill-level of the trainer and trainee)

Participants agreed that training should provide an understanding of US technology (see item nine) and the possibility of including material to support documentation of the above was also raised.

Measurement and Interpretation (Rank 6)

Current variation in approaches to measurement (and interpretation) challenge measurement reliability (item 1) and the establishment of standard measurement. The approach to measurement or interpretation depends on the purpose for which US is used. For example, muscle US requires different measurement approaches to those used for measurement of swallowing biomechanics or symptoms. Measurement and interpretation of images directly relates to discriminant validity (item 3). It was acknowledged that biomarkers (e.g. vocal fold or hyoid movement) could be interpreted by the operator without measurement; however, more refined assessment requires measurement. Even with measurement, the information will require contextualising and interpreting (see discussion under item 2). Participants suggested that practice should be standardised via the introduction of protocols, rating tools or measurement algorithms. Participants discussed that such protocols would make US time-efficient for clinical practice but acknowledged the need for further research in this area.

Standardised Assessment Protocols (Rank 7)

Standardised assessment protocols may include descriptions of patient criteria and rationale for the US assessment, as well as selection of equipment (see item 8). Specification of probe position and bolus types for assessment was also considered important, as was the need to specify the recording parameters for each aspect of swallowing or laryngeal function.

NGT participants recognised that the protocols for US assessment may differ according to the setting requirements (e.g. clinical versus research settings). As per item 2 (normative values), the need for a practical and accessible protocol in the clinical setting was highlighted, including the need for the protocol to be applicable to as many patient populations as possible.

Equipment Specification and Settings (Rank 8)

Specification of the minimum technical requirements and recommendations for sufficient US image quality was suggested as one possible approach to enabling US operators to make appropriate selection of US devices and settings. These specifications should include a description of which device, probe, and settings to use. There was acknowledgement that this would vary depending on the purpose of use. For example, assessment of muscle and soft tissue structures for swallowing will require a device where image optimisation could be turned off and probes could be hand-held or placed in a headset. The need for further research to understand and guide the practicalities of image set-up and acquisition (see item7) was acknowledged by participants.

Understanding of Swallowing Movements in an US Image (Rank 9)

To translate the use of US into clinical practice, there needs to be a greater understanding of how to read and interpret US images of head, neck and swallowing anatomy and physiology. There is overlap in scope between this and previous items, particularly training and competency development (item 5), since this item would need to include training to understand US technology, devices, and settings.

Evidence to support clinical utilisation (Rank 10)

Evidence to support the use of US in clinical practice for swallowing and laryngeal assessment is necessary. One suggestion for generation of such evidence included research focussed on clinical translation, such as understanding the clinical environment in which US can be used and the limitations and benefits of US when used for this purpose. Another suggestion included the development of a clinical database of images to enhance practice-based evidence. Participants also suggested development of a core outcome set to help establish the impact of clinical implementation, which would enable clinicians to assess the impact of introducing US within their service. Participants raised the need to keep up to date with the latest ‘good practice’ in those clinical specialities already using US to help inform implementation and innovation for this unique purpose.

Resourcing (Rank 11)

Resourcing includes support from managers and service providers, including health organisations (see item 12). Examples of resources generated by the group included equipment and consumables such as US devices, servicing contracts, physical space and funding. This item was ranked jointly with infrastructure and buy-in (below).

Infrastructure and Buy-In (Rank 11)

The specific requirement for buy-in from managers and commissioners was identified as a separate but equally ranked item to resources. Examples of ‘buy-in’ generated by participants included authorisation from the relevant clinical department to develop a business case for the use of US. This will also require implementation support and recognition within the wider organisation. Participants commented that research projects demonstrating the utility of US (item 10) will support business cases.

Recognition and Guidance from Professional Bodies (Rank 12)

The involvement of professional bodies to ensure that the extended scope of practice for operators using US for the purpose of swallowing and laryngeal assessment was recognised by participants and ranked in jointly with multi-professional input (below). This is consistent with the approach taken when other swallowing and laryngeal assessment tools, such as FEES and laryngoscopy, were adopted into clinical practice.

Multi-Professional Input (Rank 12)

The roles and responsibilities of different multidisciplinary professionals involved in using US to assess swallowing and laryngeal function was raised by participants as an item that needed elucidation to support the translation of US into clinical practice. Along with SLPs, participants defined other key professional groups as including engineers and radiologists. They also raised the need to decide whether US assessment can be conducted by uni-disciplinary professionals or required interdisciplinary skills. Participants highlighted that the level and combination of skill(s) required by the US operator needed to be determined to clarify the scope of practice for SLPs (see item 5).

Patient and Public Involvement (PPI) (Rank 13)

During the member checking process, it was agreed by consensus to use the INVOLVE definition of PPI [56].The statement focusses on the key values of PPI: respect, support, transparency, responsiveness, fairness of opportunity and accountability which were all considered foundational for the translation of US into clinical practice. The group acknowledged while PPI was ranked in the final position, this did not reflect the overarching necessity of patient-public engagement to the success of US implementation.

Below is a representation of the results which depicts the overarching themes and relationships between NGT items. The co-developed figure represents the three main categories of work that the NGT items can be considered within. These categories are stakeholder engagement (blue band), training and protocols (yellow band), and evidence base and metrics (green band). Each item is represented by a rectangle within these categories. The shape(s) within the rectangle represent the relationships between items. The cross represents links between reliability, discriminant validity, criterion validity and standardised protocols. The diamond represents the links between discriminant validity and measurement and interpretation. The star represents links between standardised protocols and evidence to support clinical use of US. The circle represents the links between training protocols, understanding the US and multi-professional input. Numbers in brackets represent the original ranking of each item (Fig. 3).

Fig. 3.

Fig. 3

Visual representation of NGT results

Discussion

The aim of this study was to identify the elements required to translate the use of US into clinical practice for the purpose of laryngeal and swallowing assessment. Participants identified a high-priority need to establish reliability and validity of US data acquisition and measurement, plus establish normative values to serve as a reference from which to diagnose disordered function. These items are not stand-alone and relationships between items are not linear. For example, reliability and validity of laryngeal and swallowing assessment may be viewed as interdependent issues. While US data acquisition may be reliable without being valid, validity requires that measures are acquired consistently [5759]. Thus, studies may explore both validity and reliability at the same time. Further, reliable and valid assessment is related to assessment protocols and equipment selection; for example, reliability and validity may be impacted by the choice of US device. While there are some data to suggest that standard-sized US equipment may provide reliable and valid swallowing measures [5, 12, 16], this could not be confirmed for pocket-sized technology [24, 60]. The method of data acquisition, such as the use of hand-held versus fixed transducers, may further affect reliability [61, 62]; as might variability between different data collection settings, for example, data collected in the clinical versus research environment. The relationships between reliability, validity and the assessment protocol are reciprocal. An increased understanding of both reliability and validity is required to clarify which data acquisition procedures are most accurate for the assessment of laryngeal function and swallowing parameters. This needs to be combined with robust reproducibility between operators to enable clinicians to use US accurately and consistently.

The necessity for adequate reliability also relates to discriminant validity. For example, binary assessment of vocal fold function (i.e. presence versus absence of movement) is most often used to diagnose vocal fold palsy [1, 6]. When a linear probe with an appropriate range of frequencies is used, US shows reasonable sensitivity and good specificity for this purpose. However, binary assessment is not sufficient to develop tailored swallowing or voice therapy programmes. To derive meaning from the assessment of swallowing or laryngeal function, a greater range of quantitative information is required. Potential biomarkers for vocal fold movement include measurement of the inter-arytenoid distance, the glottic area, or glottic angle at the point of full vocal fold abduction and adduction [63, 64]. While preliminary data exist for the healthy pediatric and young adult (< 30 years) populations with respect to muscle thickness and echo intensity of the submental and tongue muscles [3, 65], and hyoid bone movement in healthy young [66] and ageing adults [15], no normative data exist to support the assessment using the vocal fold biomarkers described above. An essential requirement for using US as a diagnostic, rather than a screening or biofeedback tool, is its ability to discriminate between clinically significant changes. Discriminant validity is therefore important to define the boundaries for reliability and relies on the existence of normative data for comparison.

A link between reliability assessment and development of training protocols was also identified as part of the NGT process. Intra- and inter-operator reliability is dependent on the expertise and experience of the US operator. Operator training has shown to improve the reliability in the measurement of static images [67] and an association between reliability and operator skills has been documented for procedures including VFSS [68], high-resolution manometry [69] and muscle US data acquisition by physiotherapists [70]. The relationship between reliability and training is, however, reciprocal, and reliability data are required to determine the necessity and content of training protocols [60].

Translating NGT Items into Clinical Practice

The items in this study represent priorities related to both primary research and clinical practice. This ‘bench to bedside’ continuum provoked debate among NGT participants and discussions ensued as to whether the research and clinical practice components should be separated. The research question was developed with the expectation that ideas would be generated across the research and clinical continuum, therefore a decision was made to preserve the original rankings since this is a true representation of the translational research continuum [71]. A close relationship between clinicians and researchers has proven to enhance the potential for translation into practice [72]; however, implementation needs to be robust and systematic.

Implementation science methodology, such as NPT, offers a structured approach to the normalisation of US as an evidence-based clinical assessment tool [73] and is a feasible next step towards progressing US as a tool for clinical swallowing and laryngeal assessment. To be successful, it will require a thorough evaluation of the barriers and enablers [74] but the grounding provided by this priority-setting exercise gives clear direction towards the next steps in the process. In the context of NPT, the NGT prioritisation exercise fulfils the initial step of sense-making (coherence) [38]. The NGT exercise and previous rapid review have laid the groundwork in defining the intervention (US) and the context (clinical practice) where implementation is required.

A practical way of progressing the implementation of US using the NPT approach would be to begin training cohorts of SLPs in the applied aspects of US technology to acquire images of anatomical structures in the head and neck. This would allow SLPs to develop practical skills (item 5) without focussing on the more complex competencies of biomechanical assessment and diagnosis while capturing practice-based data to fulfil items 1–4 of the NGT process. Qualitative research such as focus groups or interviews could be conducted in parallel with clinician-training to determine the opinions of dysphagia practitioners and other stakeholders about the barriers and facilitators to using US in clinical practice. This process of action, alongside in-depth appraisal of the intervention would allow the “implementation potential” of US to be fully explored and maximise its chances for successful translation into practice to benefit clinicians, researchers and patients [38].

NPT offers an alternative approach to implementation used by other professional groups such as physiotherapists who have taken a more applied approach to the implementation of US for clinical assessment purposes. For example, the focus in thoracic US has been to develop practice-based evidence, prior to the advancement of psychometric data. This has led to enthusiastic adoption of US into critical care and respiratory physiotherapy services [7577]; however, the lack of formal research evidence is now considered a barrier to implementation and acceptance of US for this purpose [29]. There is an opportunity to avoid this conflict by implementing swallowing and laryngeal US into clinical practice in a systematic and evidence-based way, using lessons learned from other professional groups and previous implementation of assessment tools in the SLP profession.

The implementation process can be expedited using the knowledge and understanding gleaned from this study. More specifically, the work needed to address the ranked items in this study does not always need to be undertaken in chronological order. Completing aspects either in parallel or via a cyclical approach will advance the translation of US into practice as quickly as practicable. For example, results emphasise the importance of having assessment and analysis protocols (items 6–8), particularly for equipment and settings. Establishing such procedural aspects will, in turn, improve inter-and intra-operator reliability (item 1) [78, 79]. A better understanding of the clinical environment in which US will be used (item 10) will also facilitate an understanding of gaps that may exist between reliable assessment in the research setting versus the clinical setting. This will support the development of clinically realistic and achievable protocols (items 6 & 7). Implementation of US as a swallowing or laryngeal biofeedback (therapy) tool may mitigate the requirement for diagnostic values [80]. This alternative use may also enable US to be transitioned into clinical practice sooner, while primary research continues. The precedent for this has already been established in the field of US and developmental speech disorders [81].

Study Limitations

There is an inherent risk of bias in any priority-setting process driven by expert consensus. Study participants had differing levels of familiarity and experience which could have led to, for example, bias due to more experienced experts taking the lead in priority setting [82]. The use of NGT methodology minimised bias that would have arisen from a less structured approach and has enabled efficient and rigorous development of a prioritised agenda [83].To minimise facilitator-driven bias, an NGT facilitator with no prior knowledge of the US topic was recruited. This lack of topic knowledge resulted in NGT participants merging items from groups one and two after stage one of the NGT process. Bias was minimised via agreement of merged items with a second participant. The facilitator did not take field notes during the NGT process though evidence to support understanding was provided by meeting transcripts and email responses from participants to the facilitator. Member-checking enabled greater richness of perspectives and ensured that results reflected participants’ views as closely as possible. Participants were only recruited from the international working group. Since the inception of this group, members have been recruited via a snowball approach to ensure wide representation. The inclusion of an experienced head and neck sonographer and US physiotherapist ensured the inclusion of perspectives from non-dysphagia trained professionals with more advanced skills in US practice. It is possible that representation from dysphagia-practitioners outside of SLP, such as gastroenterologists and otolaryngologists, may have generated additional items and increased the applicability of this study.

It is not the remit of NGT methodology to benchmark ranked elements with the existing evidence base. Reviews of current evidence are readily available in the published literature [1, 18, 84]. The decision to combine the assessment of swallowing with laryngeal function was based on the premise that the elements required to translate this assessment tool into clinical practice for both purposes would be comparable. Assessment of swallowing using endoluminal sonography was not included. The evidence base for each ranked item may diverge depending on the exact purpose of use. This includes the use for non-assessment purposes, such as for education or biofeedback. Further work is required to align the ranked elements with the existing evidence base to establish the gaps in the literature for each item.

Future Directions

The interest in US as a swallowing and laryngeal assessment tool has gathered momentum in the past 18 months [1, 18]. This could lead to rapid application of US into clinical practice without developing the requisite evidence base and therefore compromise patient care. The findings of this study will equip clinicians and researchers with the knowledge and understanding to support a measured approach to the implementation of US for clinical assessment of swallowing and laryngeal function with efficacy and sustainability.

There is a need for primary research in the validation and reliability of US for assessment purposes which can be conjointly addressed with a practical, skill-based approach to implementation to support the development of assessment protocols and training packages. While these priorities may evolve as clinical and professional contexts shift, this study provides the context for further swallowing and laryngeal-focussed US research and clinical activity in this field.

Supplementary Information

Below is the link to the electronic supplementary material.

Acknowledgements

The authors would like to thank the members of the international ultrasound group who participated in this project: Jemma Haines (UK), Becca Hammond (NZ), Lisa Hayward (UK), Professor Maggie-Lee Huckabee (New Zealand), Marloes Lagarde (Netherlands), Corinne Mossey-Gaston (UK), Claire Slinger (UK) and Sarah Wallace (UK).

Biographies

Jodi E Allen

MMedSci, MRes

Gemma Clunie

MSc

Joan K-Y Ma

PhD

Margaret Coffey

PhD

Katharina Winiker

PhD

Sally Richmond

PGDip

Soren Y. Lowell

PhD

Anna Volkmer

PhD

Funding

Jodi Allen receives part-funding from the National Institute of Health Research (NIHR) Pre-Clinical Academic Fellowship Award. Gemma Clunie receives funding from the National Institute for Health Research (NIHR) Integrated Clinical Academic Clinical Doctoral Fellowship Programme and acknowledges the support and infrastructure provided by the NIHR Imperial Biomedical Research Centre. Anna Volkmer receives funding from the NIHR via a Development and Skills Award. Soren Lowell receives funding from the National Institute of Health (NIH) Research Enhancement Award (R15).

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Jodi E. Allen, Email: Jodi.allen@nhs.net

Anna Volkmer, Email: a.volkmer.15@ucl.ac.uk.

References

  • 1.Allen JE, Clunie GM, Slinger C, Haines J, Mossey-Gaston C, Zaga CJ, et al. Utility of ultrasound in the assessment of swallowing and laryngeal function: a rapid review and critical appraisal of the literature. Int J Lang Commun Disord. 2021;56:174–204. [Google Scholar]
  • 2.Sonies BC, Chi-Fishman G, Miller JL. Ultrasound Imaging and Swallowing. In: Jones B, editor. Normal and Abnormal Swallowing [Internet]. New York, NY: Springer New York; 2003. p. 119–138. http://link.springer.com/10.1007/978-0-387-22434-3_8
  • 3.Engel-Hoek LVD, Van Alfen N, De Swart BJM, De Groot IJM, Pillen S. Quantitative ultrasound of the tongue and submental muscles in children and young adults. Muscle Nerve. 2012;46:31–37. doi: 10.1002/mus.23277. [DOI] [PubMed] [Google Scholar]
  • 4.Van Den Engel-Hoek L, Lagarde M, Van Alfen N. Ultrasound of oral and masticatory muscles: why every neuromuscular swallow team should have an ultrasound machine: ultrasound of oral and masticatory muscles. Clin Anat. 2017;30:183–193. doi: 10.1002/ca.22818. [DOI] [PubMed] [Google Scholar]
  • 5.Macrae PR, Jones RD, Myall DJ, Melzer TR, Huckabee M-L. Cross-sectional area of the anterior belly of the digastric muscle: comparison of MRI and ultrasound measures. Dysphagia. 2013;28:375–380. doi: 10.1007/s00455-012-9443-8. [DOI] [PubMed] [Google Scholar]
  • 6.da Costa BOI, de Rodrigues SBD, Santos AS, Pernambuco L. Transcutaneous laryngeal ultrasonography for the assessment of laryngeal function after thyroidectomy: a review. Ear Nose Throat J. 2021;100:439–446. doi: 10.1177/0145561319870487. [DOI] [PubMed] [Google Scholar]
  • 7.Noel JE, Orloff LA, Sung K. Laryngeal evaluation during the COVID-19 pandemic: transcervical laryngeal ultrasonography. Otolaryngol Head Neck Surg. 2020;163:51–53. doi: 10.1177/0194599820922984. [DOI] [PubMed] [Google Scholar]
  • 8.Peng CL, Jost-Brinkmann PG, Miethke RR, Lin CT. Ultrasonographic measurement of tongue movement during swallowing. J Ultrasound Med. 2000;19:15–20. doi: 10.7863/jum.2000.19.1.15. [DOI] [PubMed] [Google Scholar]
  • 9.Kim J-H, Kim M-S. Lateral pharyngeal wall motion analysis using ultrasonography in stroke patients with dysphagia. Ultrasound Med Biol. 2012;38:2058–2064. doi: 10.1016/j.ultrasmedbio.2012.07.028. [DOI] [PubMed] [Google Scholar]
  • 10.Morinière S, Hammoudi K, Marmouset F, Bakhos D, Beutter P, Patat F. Ultrasound analysis of the upper esophageal sphincter during swallowing in the healthy subject. Eur Ann Otorhinolaryngol Head Neck Dis. 2013;130:321–325. doi: 10.1016/j.anorl.2012.01.008. [DOI] [PubMed] [Google Scholar]
  • 11.da Costa BOI, de Rodrigues SBD, de Magalhães DDD, Santos AS, Santos RV, Azevedo EHM, et al. Quantitative ultrasound assessment of hyoid bone displacement during swallowing following thyroidectomy. Dysphagia. 2021;36:659–669. doi: 10.1007/s00455-020-10180-5. [DOI] [PubMed] [Google Scholar]
  • 12.Hsiao M-Y, Chang Y-C, Chen W-S, Chang H-Y, Wang T-G. Application of ultrasonography in assessing oropharyngeal dysphagia in stroke patients. Ultrasound Med Biol. 2012;38:1522–1528. doi: 10.1016/j.ultrasmedbio.2012.04.017. [DOI] [PubMed] [Google Scholar]
  • 13.Chen Y-C, Hsiao M-Y, Wang Y-C, Fu C-P, Wang T-G. Reliability of ultrasonography in evaluating hyoid bone movement. J Med Ultrasound. 2017;25:90–95. doi: 10.1016/j.jmu.2017.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lee YS, Lee KE, Kang Y, Yi TI, Kim JS. Usefulness of submental ultrasonographic evaluation for dysphagia patients. Ann Rehabil Med. 2016;40:197. doi: 10.5535/arm.2016.40.2.197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Yabunaka K, Sanada H, Sanada S, Konishi H, Hashimoto T, Yatake H, et al. Sonographic assessment of hyoid bone movement during swallowing: a study of normal adults with advancing age. Radiol Phys Technol. 2011;4:73–77. doi: 10.1007/s12194-010-0107-9. [DOI] [PubMed] [Google Scholar]
  • 16.Huang Y-L, Hsieh S-F, Chang Y-C, Chen H-C, Wang T-G. Ultrasonographic evaluation of hyoid-larynx approximation in dysphagic stroke patients. Ultrasound Med Biol. 2009;35:1103–1108. doi: 10.1016/j.ultrasmedbio.2009.02.006. [DOI] [PubMed] [Google Scholar]
  • 17.Kuhl V, Eicke BM, Dieterich M, Urban PP. Sonographic analysis of laryngeal elevation during swallowing. J Neurol. 2003;250:333–337. doi: 10.1007/s00415-003-1007-2. [DOI] [PubMed] [Google Scholar]
  • 18.Allen JE, Clunie GM, Winiker K. Ultrasound: an emerging modality for the dysphagia assessment toolkit? Curr Opin Otolaryngol Head Neck Surg. 2021;29:213–218. doi: 10.1097/MOO.0000000000000708. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Feng S, Shea Q-T-K, Ng K-Y, Tang C-N, Kwong E, Zheng Y. Automatic hyoid bone tracking in real-time ultrasound swallowing videos using deep learning based and correlation filter based trackers. Sensors. 2021;21:3712. doi: 10.3390/s21113712. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Miura Y, Nakagami G, Yabunaka K, Tohara H, Hara K, Noguchi H, et al. Detecting pharyngeal post-swallow residue by ultrasound examination: a case series. Med Ultrason. 2016;18:288. doi: 10.11152/mu.2013.2066.183.yuk. [DOI] [PubMed] [Google Scholar]
  • 21.Miura Y, Nakagami G, Yabunaka K, Tohara H, Noguchi H, Mori T, et al. A randomized controlled trial to investigate the effectiveness of the prevention of aspiration pneumonia using recommendations for swallowing care guided by ultrasound examination. Healthcare. 2018;6:15. doi: 10.3390/healthcare6010015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Miura Y, Yabunaka K, Karube M, Tsutaoka T, Yoshida M, Matsumoto M, et al. Establishing a methodology for ultrasound evaluation of pharyngeal residue in the pyriform sinus and epiglottic vallecula. Respir Care. 2020;65:304–313. doi: 10.4187/respcare.07002. [DOI] [PubMed] [Google Scholar]
  • 23.Beale T, Twigg VM, Horta M, Morley S. High-resolution laryngeal us: imaging technique, normal anatomy, and spectrum of disease. Radiographics. 2020;40:775–790. doi: 10.1148/rg.2020190160. [DOI] [PubMed] [Google Scholar]
  • 24.Winiker K, Burnip E, Gozdzikowska K, Guiu Hernandez E, Hammond R, Macrae P, et al. Ultrasound: validity of a pocket-sized system in the assessment of swallowing. Dysphagia. 2021 doi: 10.1007/s00455-020-10232-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.European Society of Radiology (ESR). ESR statement on portable ultrasound devices. Insights Imaging. 2019;10:89. [DOI] [PMC free article] [PubMed]
  • 26.Hayward S, Smith M, Innes S. Diagnostic thoracic ultrasound imaging: an exploration of respiratory physiotherapists’ interest and use in clinical practice: a national survey. Ultrasound. 2020;28:14–22. doi: 10.1177/1742271X19861131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Innes S, Jackson J. Musculoskeletal ultrasound imaging: an exploration of physiotherapists’ interests and use in practice. Musculoskelet Sci Pract. 2019;44:102068. doi: 10.1016/j.msksp.2019.102068. [DOI] [PubMed] [Google Scholar]
  • 28.Pradeep Albert, Martin Wendelken, Kenneth Meisler, Ramy Elattal. Diagnostic ultrasound in the modern podiatric practice. Podiatry Management. 2017;79–90.
  • 29.Hayward S, Innes S, Smith M. Challenges and opportunities in point-of-care ultrasound: a qualitative exploration of respiratory physiotherapists’ experiences of lung ultrasound training and its adoption in critical care. Ultrasound. 2021;1742271X2110341. [DOI] [PMC free article] [PubMed]
  • 30.Martin-Harris B, Jones B. The videofluorographic swallowing study. Phys Med Rehabil Clin N Am. 2008;19:769–785. doi: 10.1016/j.pmr.2008.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Pisegna JM, Langmore SE. Parameters of instrumental swallowing evaluations: describing a diagnostic dilemma. Dysphagia. 2016;31:462–472. doi: 10.1007/s00455-016-9700-3. [DOI] [PubMed] [Google Scholar]
  • 32.Swan K, Cordier R, Brown T, Speyer R. Psychometric properties of visuoperceptual measures of videofluoroscopic and fibre-endoscopic evaluations of swallowing: a systematic review. Dysphagia. 2019;34:2–33. doi: 10.1007/s00455-018-9918-3. [DOI] [PubMed] [Google Scholar]
  • 33.Curtis JA, Borders JC, Perry SE, Dakin AE, Seikaly ZN, Troche MS. Visual analysis of swallowing efficiency and safety (VASES): a standardized approach to rating pharyngeal residue, penetration, and aspiration during FEES. Dysphagia. 2021 doi: 10.1007/s00455-021-10293-5. [DOI] [PubMed] [Google Scholar]
  • 34.Martin-Harris B, Brodsky MB, Michel Y, Castell DO, Schleicher M, Sandidge J, et al. MBS measurement tool for swallow impairment—MBSImp: establishing a standard. Dysphagia. 2008;23:392–405. doi: 10.1007/s00455-008-9185-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Miller CK, Schroeder JW, Langmore S. Fiberoptic endoscopic evaluation of swallowing across the age spectrum. Am J Speech Lang Pathol. 2020;29:967–978. doi: 10.1044/2019_AJSLP-19-00072. [DOI] [PubMed] [Google Scholar]
  • 36.Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;3:32. doi: 10.1186/s40359-015-0089-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Bauer MS, Kirchner J. Implementation science: what is it and why should I care? Psychiatry Res. 2020;283:112376. doi: 10.1016/j.psychres.2019.04.025. [DOI] [PubMed] [Google Scholar]
  • 38.Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63. doi: 10.1186/1741-7015-8-63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Huddlestone L, Turner J, Eborall H, Hudson N, Davies M, Martin G. Application of normalisation process theory in understanding implementation processes in primary care settings in the UK: a systematic review. BMC Fam Pract. 2020;21:52. doi: 10.1186/s12875-020-01107-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, et al. using normalization process theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implement Sci. 2018;13:80. doi: 10.1186/s13012-018-0758-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Jones J, Hunter D. Qualitative research: consensus methods for medical and health services research. BMJ. 1995;311:376–380. doi: 10.1136/bmj.311.7001.376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Partridge N, Scadding J. The james lind alliance: patients and clinicians should jointly identify their priorities for clinical trials. Lancet. 2004;364:1923–1924. doi: 10.1016/S0140-6736(04)17494-1. [DOI] [PubMed] [Google Scholar]
  • 43.World Health Organization. Patient engagement [Internet]. Geneva: World Health Organization; 2016. https://apps.who.int/iris/handle/10665/252269
  • 44.Hinckley J, Boyle E, Lombard D, Bartels-Tobin L. Towards a consumer-informed research agenda for aphasia: preliminary work. Disabil Rehabil. 2014;36:1042–1050. doi: 10.3109/09638288.2013.829528. [DOI] [PubMed] [Google Scholar]
  • 45.Wallace SJ, Worrall L, Rose T, Le Dorze G. Which treatment outcomes are most important to aphasia clinicians and managers? An international e-Delphi consensus study. Aphasiology. 2017;31:643–673. [Google Scholar]
  • 46.Greaves H, MacAskill W, O’Keeffe-O’Donovan R, Trammell P. A research agenda for the global prioritise institute [Internet]. Universit of Oxford, Global Priorities Institute; 2019. https://globalprioritiesinstitute.org/wp-content/uploads/gpi-research-agenda.pdf
  • 47.Bolton L, Mills C, Wallace S, Brady MC, Royal College of Speech and Language Therapists (RCSLT) COVID‐19 Advisory Group Aerosol generating procedures, dysphagia assessment and COVID-19: a rapid review. Int J Lang Commun Disorders. 2020;55:629–636. doi: 10.1111/1460-6984.12544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Delbecq A, Ven A, Gustafson D. Group techniques for program planning: a guide to nominal group and delphi processes. J Appl Behav Sci. 1976;12:581–581. [Google Scholar]
  • 49.McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016 doi: 10.1007/s11096-016-0257-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Harvey N, Holmes CA. Nominal group technique: an effective method for obtaining group consensus: application of nominal group technique. Int J Nurs Pract. 2012;18:188–194. doi: 10.1111/j.1440-172X.2012.02017.x. [DOI] [PubMed] [Google Scholar]
  • 51.Finch E, Ward EC, Brown B, Cornwell P, Hill AE, Hill A, et al. Setting a prioritized agenda to drive speech–language therapy research in health. Int J Lang Commun Disord. 2021;56:768–783. doi: 10.1111/1460-6984.12626. [DOI] [PubMed] [Google Scholar]
  • 52.Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19:349–357. doi: 10.1093/intqhc/mzm042. [DOI] [PubMed] [Google Scholar]
  • 53.Tuffrey-Wijne I, Bernal J, Butler G, Hollins S, Curfs L. Using nominal group technique to investigate the views of people with intellectual disabilities on end-of-life care provision. J Adv Nurs. 2007;58:80–89. doi: 10.1111/j.1365-2648.2007.04227.x. [DOI] [PubMed] [Google Scholar]
  • 54.Van de Ven AH, Delbecq AL. The nominal group as a research instrument for exploratory health studies. Am J Public Health. 1972;62:337–342. doi: 10.2105/ajph.62.3.337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Candela A. Exploring the function of member checking. Qualitat Rep. 2019;24:619–628. [Google Scholar]
  • 56.INVOLVE. Public involvement in research: values and principles framework [Internet]. Nation Institute for Health Research; 2015. https://www.invo.org.uk/wp-content/uploads/2017/08/Values-Principles-framework-Jan2016.pdf
  • 57.Field A, Miles J, Field Z. Discovering statistics using R. London: Sage; 2012. [Google Scholar]
  • 58.Portney L, Watkins M. Foundations of clinical research: applications to practice. Pearson/Prentice Hall; 2009.
  • 59.George K, Batterham A, Sullivan I. Validity in clinical research: a review of basic concepts and definitions. Phys Ther Sport. 2000;1:19–27. [Google Scholar]
  • 60.Winiker K, Burnip E, Gozdzikowska K, Hernandez EG, Hammond R, Macrae P, et al. Ultrasound: reliability of a pocket-sized system in the assessment of swallowing. J Speech Lang Hear Res. 2021;64:2928–2940. doi: 10.1044/2021_JSLHR-21-00026. [DOI] [PubMed] [Google Scholar]
  • 61.Perry SE, Winkelman CJ, Huckabee M-L. Variability in ultrasound measurement of hyoid bone displacement and submental muscle size using 2 methods of data acquisition. Folia Phoniatr Logop. 2016;68:205–210. doi: 10.1159/000473876. [DOI] [PubMed] [Google Scholar]
  • 62.Pucher M, Klingler N, Luttenberger J, Spreafico L. Accuracy, recording interference, and articulatory quality of headsets for ultrasound recordings. Speech Commun. 2020;123:83–97. [Google Scholar]
  • 63.Nasser HM, Askoura A, Hussein A. Ultrasonography diagnostic validity in structural and functional laryngeal disorders. Egypt J Radiol Nucl Med. 2020;51:219. [Google Scholar]
  • 64.Wang LM, Zhu Q, Ma T, Li JP, Hu R, Rong XY, et al. Value of ultrasonography in diagnosis of pediatric vocal fold paralysis. Int J Pediatr Otorhinolaryngol. 2011;75:1186–1190. doi: 10.1016/j.ijporl.2011.06.017. [DOI] [PubMed] [Google Scholar]
  • 65.Lagarde MLJ, van den Engel-Hoek L. Quantitative ultrasound of orofacial muscles in infants from 6 months to 5 years: collecting normal values. CMIR; 2017. http://www.eurekaselect.com/144281/article
  • 66.Feng X, Cartwright MS, Walker FO, Bargoil JH, Hu Y, Butler SG. Ultrasonographic evaluation of geniohyoid muscle and hyoid bone during swallowing in young adults: ultrasound during swallowing. Laryngoscope. 2015;125:1886–1891. doi: 10.1002/lary.25224. [DOI] [PubMed] [Google Scholar]
  • 67.Garcia-Santibanez R, Dietz AR, Bucelli RC, Zaidman CM. Nerve ultrasound reliability of upper limbs: effects of examiner training: reliability in ultrasound training. Muscle Nerve. 2018;57:189–192. doi: 10.1002/mus.25980. [DOI] [PubMed] [Google Scholar]
  • 68.Nordin NA, Miles A, Allen J. Measuring competency development in objective evaluation of videofluoroscopic swallowing studies. Dysphagia. 2017;32:427–436. doi: 10.1007/s00455-016-9776-9. [DOI] [PubMed] [Google Scholar]
  • 69.Jones CA, Hoffman MR, Geng Z, Abdelhalim SM, Jiang JJ, McCulloch TM. Reliability of an automated high-resolution manometry analysis program across expert users, novice users, and speech-language pathologists. J Speech Lang Hear Res. 2014;57:831–836. doi: 10.1044/2014_JSLHR-S-13-0101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Mateos González M, de Casasola G, Sánchez G, Muñoz FJT, Proud K, Lourdo D, Sander J-V, et al. Comparison of lung ultrasound versus chest x-ray for detection of pulmonary infiltrates in COVID-19. Diagnostics. 2021;2021(11):373. doi: 10.3390/diagnostics11020373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Drolet BC, Lorenzi NM. Translational research: understanding the continuum from bench to bedside. Transl Res. 2011;157:1–5. doi: 10.1016/j.trsl.2010.10.002. [DOI] [PubMed] [Google Scholar]
  • 72.Doorenbos AZ, Kato Y. Pragmatic clinical trials: Increasing the rate of translating nursing research into practice †. Jpn J Nurs Sci. 2020 doi: 10.1111/jjns.12350. [DOI] [PubMed] [Google Scholar]
  • 73.May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43:535–554. [Google Scholar]
  • 74.Bradshaw A, Santarelli M, Mulderrig M, Khamis A, Sartain K, Boland JW, et al. Implementing person-centred outcome measures in palliative care: an exploratory qualitative study using normalisation process theory to understand processes and context. Palliat Med. 2021;35:397–407. doi: 10.1177/0269216320972049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.See KC, Ong V, Tan YL, Sahagun J, Taculod J. Chest radiography versus lung ultrasound for identification of acute respiratory distress syndrome: a retrospective observational study. Crit Care. 2018;22:203. doi: 10.1186/s13054-018-2105-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Hayward SA, Janssen J. Use of thoracic ultrasound by physiotherapists: a scoping review of the literature. Physiotherapy. 2018;104:367–375. doi: 10.1016/j.physio.2018.01.001. [DOI] [PubMed] [Google Scholar]
  • 77.Karthika M, Wong D, Nair SG, Pillai LV, Mathew CS. Lung ultrasound: the emerging role of respiratory therapists. Respir Care. 2019;64:217–229. doi: 10.4187/respcare.06179. [DOI] [PubMed] [Google Scholar]
  • 78.Martin-Harris B, Canon CL, Bonilha HS, Murray J, Davidson K, Lefton-Greif MA. Best practices in modified barium swallow studies. Am J Speech Lang Pathol. 2020;29:1078–1093. doi: 10.1044/2020_AJSLP-19-00189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Swan K, Cordier R, Brown T, Speyer R. Visuoperceptual analysis of the videofluoroscopic study of swallowing: an international delphi study. Dysphagia. 2021;36:595–613. doi: 10.1007/s00455-020-10174-3. [DOI] [PubMed] [Google Scholar]
  • 80.Kwong E, Ng K-WK, Leung M-T, Zheng Y-P. Application of ultrasound biofeedback to the learning of the mendelsohn maneuver in non-dysphagic adults: a pilot study. Dysphagia. 2021;36:650–658. doi: 10.1007/s00455-020-10179-y. [DOI] [PubMed] [Google Scholar]
  • 81.Cleland J, Scobbie JM, Wrench AA. Using ultrasound visual biofeedback to treat persistent primary speech sound disorders. Clin Linguist Phon. 2015;29:575–597. doi: 10.3109/02699206.2015.1016188. [DOI] [PubMed] [Google Scholar]
  • 82.Dror IE. Cognitive and human factors in expert decision making: six fallacies and the eight sources of bias. Anal Chem. 2020;92:7998–8004. doi: 10.1021/acs.analchem.0c00704. [DOI] [PubMed] [Google Scholar]
  • 83.Tuffrey-Wijne I, Wicki M, Heslop P, McCarron M, Todd S, Oliver D, et al. Developing research priorities for palliative care of people with intellectual disabilities in Europe: a consultation process using nominal group technique. BMC Palliat Care. 2016;15:36. doi: 10.1186/s12904-016-0108-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Su E, Hamilton C, Tawfik DS, Mariano K, Ginsburg S, Conlon T, et al. Laryngeal ultrasound detects vocal fold immobility in adults: a systematic review. J Ultrasound Med. 2021;jum.15884. [DOI] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from Dysphagia are provided here courtesy of Springer

RESOURCES