Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2020 Nov 10;17(22):8308. doi: 10.3390/ijerph17228308

The Routines-Based Model Internationally Implemented

R A McWilliam 1,*, Tânia Boavida 2,, Kerry Bull 3, Margarita Cañadas 4, Ai-Wen Hwang 5, Natalia Józefacka 6, Hong Huay Lim 7, Marisú Pedernera 8, Tamara Sergnese 9, Julia Woodward 10
PMCID: PMC7697325  PMID: 33182740

Abstract

Professionals from 10 countries are implementing practices from the Routines-Based Model, which has three main components: needs assessment and intervention planning, a consultative approach, and a method for running classrooms. Its hallmark practices are the Routines-Based Interview, support-based visits with families, and a focus on child engagement. Implementers were interested in actual practices for putting philosophy and theory into action in their systems and cultures. We describe implementation challenges and successes and conclude that (a) models have to be adaptable, (b) some principles and practices are indeed universal, (c) we can shape excellent practices for international use, and (d) leadership is vital.

Keywords: routines, intervention planning, collaborative consultation, international, implementation

1. Introduction

In Minga Guazú, in the hot eastern side of Paraguay, where many of the families in early intervention (birth–6 years of age) are indigenous Guaraní, a young occupational therapist (OT) welcomes a family to the early intervention center. The center is for children with physical disabilities. This OT has been trained in the Routines-Based Model (RBM) and, today, she will talk to the family about 2 or 3 of the 12 goals on the child’s and family’s intervention plan.

Meanwhile, in Lisbon, a physical therapist (PT) is going on a home visit. The family has 10 goals, and this PT will talk to the family about, perhaps, 3 of these goals. In one of them, she will ask the family whether they would like to show her what they have been doing, and she will guide them through some strategies that, together, they have decided might help the child participate meaningfully in breakfast time.

In Cieszyn, Poland, workers are still hammering nails, as a dorm on a university campus is being remodeled to become a preschool (“kindergarten” in Polish parlance) following the Engagement Classroom Model. This model demonstration site will show how you can run a classroom to promote child engagement.

In this article, we discuss the Routines-Based Model—how it became of interest internationally, what practices implementers adopted, what challenges they faced, what successes they had, and our conclusions about what has to happen to improve early intervention around the world.

2. The Model

McWilliam and colleagues developed the Routines-Based Model over many years [1,2]. The model has three main components: needs assessment and intervention planning, a consultative approach, and a method for running classrooms. The model focuses on children’s functioning in everyday routines and on family needs, strengths, and capacities. Figure 1 shows the flow of major components of the model.

Figure 1.

Figure 1

Flow of the Routines-Based Model. RBI: Routines-Based Interview, PSP: primary service provider, CSP: comprehensive service provider, FQoL: family quality of life, EISR: Engagement, Independence, and Social Relationships, ECM: Engagement Classroom Model, CC2CC: collaborative consultation to children’s classrooms.

2.1. Needs Assessment and Intervention Plan Development

In the RBM, nothing good can happen unless we have a list of goals meaningful to the family and other caregivers spending time with the child [3]. To develop an intervention plan, which goes by different names in different countries, we conduct an ecomap and a Routines-Based Interview (RBI), from which the family chooses functional goals and family goals. This RBI is the assessment of needs upon which the entire goal plan rests.

Ecomap. The ecomap is a picture of the family’s ecology [4]. The professional draws the ecomap by asking the family questions about the frequency of their contact with friends, extended family, and neighbors and how much they like the professionals and agencies they work with. Along with formal supports, it identifies the family’s informal supports, which is most important. Most early intervention services do no find out about the informal supports the family might be able to count on for support before resorting to formal supports.

Routines-Based Interview. The Routines-Based Interview (RBI) is the best known component of the RBM, but it is only one of the components [5]. An early interventionist interviews the family about the details of child and family functioning in daily routines, and the family chooses functional child goals/outcomes and family goals. In New Zealand [6], they try to avoid “interview,” because some people thought it was a formal 2-h bombardment of the family with questions [7]. From an implementation and branding perspective, however, we encourage implementers to keep using the Routines-Based Interview because of its name recognition.

Functional goals. Goals for child functioning are written to emphasize the child’s participation in routines, such as “Jared will participate in breakfast time, hanging out time, and outside time by using single words” [8]. Furthermore, we write the goals with criteria for acquisition, generalization, and maintenance, such as “We will know he can do this when he uses five different single words, in two of these three times of day in one day, over four consecutive days.”

Family goals. As a result of the RBI, the family chooses goals for themselves and siblings of the child but not of adults not present at the RBI. The most common goal is time for oneself, such as “Diane will have two hours for herself every two weeks, for 10 consecutive weeks.”

2.2. Consultative Approach to Early Intervention

A principle of the RBM is that the intervention occurs between visits, so the point of visits with caregivers is to build their capacity to meet child and family needs when the professional is gone (i.e., during all the other hours of the week).

Family consultation. Family consultation involves the professional, usually a home visitor in the U.S. and other countries, working with the family to identify (a) why a child is not doing something, (b) what might be a viable solution, and (c) whether the strategy worked. This involves the professional asking many questions to find out what has being going on so far before making a suggestion [9,10,11]. He or she also asks the family whether they would like to try it out during the session and whether they think it is feasible.

Collaborative consultation to children’s classrooms (CC2CC). Similarly, when professionals see “a child” in child care or preschool, they actually go to visit the teaching staff. Again, they jointly decide why a child is not doing something, what the strategy might be, and whether it has worked. This practice is based on seven years of research on “integrated therapy” [10].

2.3. Engagement Classroom Model

The RBM includes procedures for running classrooms to promote child engagement, which we have dubbed the Engagement Classroom Model [12]. Implementers focus on five components:

  1. Conducting an RBI to establish functional, routines-based goals;

  2. Incidental teaching to address all goals in all routines, by following the child’s lead and eliciting higher-order functioning;

  3. Integrated therapy, meaning specialists work with teachers in the classroom and never pull the child out;

  4. Zone defense schedule to arrange the room in zones, to organize the adults, and to decrease non-engagement time during transitions between activities;

  5. Incorporating Reggio Emilia concepts to promote children’s exploration, to encourage creativity in art, and to make the environment “provocative” and beautiful.

2.4. How the Model Became of Interest, Internationally

The profile of implementation of the RBM, globally, is shown in Table 1. Each country has had its experiences with the exploration stage of implementation, the installation stage, the extent of implementation, systemic or cultural barriers or enhancers, and leadership.

Table 1.

Stages of Implementation by Locations.

Location Exploration/Introduction Installation/Implementation Planning Extent of Implementation Systemic/Cultural Barriers or Enhancers Leadership
Australia Presentations at national conference Systematic planning at Melbourne/Canberra agency 1 large agency in Melbourne and Canberra; sole trainer in Perth. Limited to RBI. National Disability Insurance Scheme poses challenges; system already implementing PSP (key worker). Agency head and key employees in Melbourne/Canberra. Individual PT in Perth. Both closely affiliated with national professional assoc. for early childhood intervention.
Canada Presentations at Ontario mental health/early intervention conference Systematic planning in York Region Full model being implemented with dedicated coach. Separate staff for home-based services from itinerant services, with different funding sources. Regional leaders committed resources to certification of trainers.
New Zealand Presentations followed by more intensive training sessions, primarily on RBI Commitment by the Ministry of Education to implement the model Whole model implemented but lapse in fidelity measures. Coaches initially assigned, then withdrawn, now reinstated. Initially, one of four regions, then national leadership.
Paraguay Spanish leader in RBM implementation introduced large rehab agency to the model After visits from the purveyor, the agency committed to implementation and sent a staff member to study with the purveyor Implementing the RBI, without fidelity checks, and routines-based clinic visits. Planning home visits. Rehab center philosophy, historically. Many families are rural, extremely poor, with domestic violence. Leaders of the agency have invested in the model. Currently, one coach carries the load.
Poland Shared platform at international conference led to presentation at university conference Decision to found a preschool classroom using the Engagement Classroom Model (ECM) Classroom built to accommodate the ECM, which includes RBI. Highly therapy-focused approach to EI 0-6. Heavy governmental involvement in curriculum. Owner, directors, faculty member, and coach all part of tight-knit group making decisions with the purveyor
Portugal Purveyor had been teaching classes in Porto for years Students wrote grant to study engagement National professional organization wrote manual based largely on RBM and offered training Whole model is endorsed, although fidelity of implementation is unknown. Two key players in implementation have died within one year. Difficult to achieve national consensus on approach to EI. First country outside U.S. to adopt practices. Historically, very senior faculty member, then his acolytes and their students pushed implementation. Three leaders remain who could energize implementation.
Singapore One developmental pediatrician invited purveyor to present
Other agencies became interested
Three agencies showed interest in in-depth implementation and developed separate plans Different agencies have committed to different amounts of the model. Service historically have been in group sessions with therapists. Caregivers are often domestic workers. Culturally, education is formal, not play based. In each of the three major agencies, leaders have pushed for continued professional development
Spain Purveyor asked to consult and present in Valencia and for national audience University-affiliated EI program adopted RBI. ECM not as successful Training now occurring in some states, primarily on RBI. Confederation of agencies endorsed the model. Confusion between the “family-centered model” and RBM has slowed implementation. Historically, EI provided in centers. University faculty have led the charge, establishing model demonstration projects, conducting research, providing training to master’s students, and training programs.
Taiwan Purveyor asked to make long presentations Core group, primarily of PTs, interested in adopting and studying practices Interest began with routines-based visits, then Engagement Classroom Model. One model demonstration preschool opened in Taichung. Services have traditionally been hospital based. Demonstration preschool very different from most preschools. Taiwanese professional org. for EI involved, researcher has led the way, PT leaders critical, core group of 7 trained in the RBI.
USA The model was developed here and has increasingly become known through workshops, presentations, and certification institutes Implementation plans have been developed in Multnomah County, OR; Maine, Missouri, Alabama, Colorado, Montana, etc. Currently, Maine is the flagship implementer. Multnomah County, Alabama, and Mississippi are currently being trained to implement the full model. History of year-by-year planning for personnel development has not led to a culture of implementation. Loathing of endorsing a model has resulted in stunted practice development. Culture of going after the latest bright, shiny object has meant little multi-year commitment. Key individuals can be identified in each of the strong implementation sites. Always, the top person needs to be on board, if not the leader. Often, someone just under the leader is the flag bearer. Those flag bearers are more successful when they have co-conspirators.

RBI: Routines-Based Interview, PSP: the primary service provider, EI: early intervention.

When we talk about global implementation, we need to remember that U.S. implementation counts too. The RBM is implemented, to one extent or another, in many places in the U.S. The RBI specifically or the RBM as a whole are the most frequently cited strategies for improving federal child or family outcomes in state systemic improvement plans (SSIPs) [13]. Some states, such as Alabama, Maine, and Mississippi, have adopted the model and are at different stages of implementation. Other states—four that we know of—were strong implementers but have waned in recent years, which is a lesson in implementation, specifically sustainability. Siskin Children’s Institute, where McWilliam used to work, still demonstrates most of both the home- and community-based components of the model as well as the Engagement Classroom Model, under the leadership of Deidra Love (director of the home- and community-based early intervention program) and Julie Mickel (director of the classroom programs), respectively. Community-based components are visits to children’s child care centers or preschools. In addition, the Multnomah Early Childhood Program (MECP) in Portland, Oregon, is adopting the needs assessment, intervention planning, and home- and community-based practices in a large metropolitan environment, under the leadership of Cami Stevenson (assistant administrator). MECP is the mothership demonstration site of the model.

Implementation data have come from leaders in each of the implementation countries. [FIRST AUTHOR] has collected data from individual states and ECTA. Key informants from U.S. states and other countries have been participants in the action research involved in this implementation science. These key informants are the authors and their colleagues. Data collection has ranged from anecdotal reports to checklist data on individual practitioners.

The first non-U.S. country to show an interest in implementation of the RBM was Portugal, because McWilliam had been working intensively with the University of Porto (under the leadership of Professor Joaquim Bairrão, psychology professor) [14,15]. Eventually, the national association for early intervention adopted the model, wrote a manual, and provided sporadic training around the country [16]. Meanwhile, students McWilliam had worked with, such as Cecília Aguiar and Tânia Boavida (faculty members at ISCTE), began their own leadership in Lisbon.

Spain followed suit, when Marga Cañadas (director of an early intervention program at the Catholic University of Valencia, UCV) became an indefatigable ambassador for the approach. Within countries, the spread of the model is something that we try to keep track of. In Spain, for example, implementation sites are gradually growing and, even within comunidades autónomas (states) such as Castilla-La Mancha, officials are documenting the extent to which the RBM is being adopted. Currently, Pau García Grau, also on the faculty of UCV, is training professionals there on the RBI, and Catalina Morales Murillo (on faculty at La Universidad de la Rioja) has also trained Manchegos and Manchegas in RBM practices. Some Canadians were interested, in particular Kamal Haffar, who worked to spread the word in Ontario. In Taiwan, Ai-Wen Hwang went about conducting research on the model in Taiwan, and she has produced the only randomized control trial on the RBM [17]. This study showed that the RBM (called Routines-Based Early Intervention then) group had a faster progress rate in self-care functions and independence in social functions in the first 3 months of intervention and at the 6 month follow up than the traditional home-visiting group. Traditional home visiting was not more effective on any outcomes measured.

In Singapore, Lim Hong Huay led Project ECHO, which used the model for classroom practices. In New Zealand, Julia Woodward and colleagues at the Ministry of Education decided that all children and families receiving early intervention through their system would receive practices under the RBM. In Australia, a program in Victoria and Canberra, Noah’s Ark, under the leadership of John Forster and his lieutenant, Kerry Bull, implemented the model. Meanwhile, in Western Australia, Denise Luscombe was also using many of the model’s practices in her training and consultation to others in the Perth area. Through connections Cañadas had made, a large agency serving children with physical disabilities, Teletón Paraguay, adopted the model. This agency is one of a number in Oritel, a federation of Teletones, meaning that we might have the opportunity for implementation throughout Central and South America. The most recent implementer has been an agency in Silesia, in Poland, which has constructed classrooms expressly designed to implement the Engagement Classroom Model, under the leadership of Krystian Kroczek, Lucyna Legierska, Sylwia Wrona, and, formerly, Natalia Józefacka.

2.5. Why International Implementers Were Interested

International implementers were interested, first, because the model provides actual practices for implementing a family-centered approach. As professionals around the world began to hear and think about family-centered practices, they were intrigued and motivated [18,19]. However, they needed to know what to do. The perspectives and experiences reported here come from the reports of key informants—the leaders and implementers in these different countries: they are represented in the authors. For example, Portuguese early interventionists had difficulty implementing family-centered practices; they could not figure out how to implement these practices with the families they were working with. The RBM provided concrete professional practices in assessment, intervention planning, making decisions about services, and providing services in a family-centered way. Taiwanese experts were interested in the implementation stages of the RBM, which provided a guide and tools for early interventionists to follow. In Paraguay, they were interested in identifying families’ informal and formal supports, their concerns about their child’s functioning, and how to build the family’s capacity to improve child functioning.

In New Zealand, similarly, the Ministry of Education wanted practical tools and a step-by-step process to implement family-centered principles. In particular, in New Zealand, the Ministry’s early intervention leaders wanted a way to strengthen how they worked with their indigenous Māori people to fulfill their Treaty of Waitangi obligations: to promote partnership, protection, and participation and Tino Rangatiratanga—Māori control over Māori affairs. They also wanted to reduce reliance on professionals, to target support at families’ day-to-day needs, to ensure everyone was clear that it is between visits that the intervention occurs, and to motivate adults around the child with useful intervention plans, rather than having plans sitting in filing cabinets not being implemented.

Experts in Spain saw the need for a different approach when, in 15 comunidades autónomas, an average of 75% of the visit (range = 51–95%) was reported to be in direct service to the child [20,21]. Spanish implementers said the model gave methods to put into everyday practice each of the DEC recommended practices [21]. This is noteworthy, because the RBM was developed before these recommended practices were chosen but perhaps it provides some informal validation for the model.

Second, as the International Classification of Functioning, Disability, and Health (ICF) hones its methods for using subsets of the ICF for Youth and Children (ICF-CY), the RBM has proceeded to develop functional profiles [22,23,24]. In the Measure of Engagement, Independence and Social Relationships Manual, the alignment of ICF-CY and the Measure of Engagement, Independence, and Social Relationships (MEISR) is presented [25]. Implementers have found that the model has resulted in more professional attention to the child’s engagement, independence, and social relationships within routines—our definition of functioning. Polish implementers were attracted by the practice of following the child’s lead (i.e., incidental teaching) and the precision of the zone defense schedule, in terms of every adult in the classroom having a role at every time of day [26]. For Singaporeans, one appeal of the RBM was to move services towards a more social-inclusion approach to early intervention service delivery. Five of the 10 early childhood intervention service providers in Singapore are using selected components of the RBM. One agency has developed an implementation plan for the whole model, and another is embarking on training RBI coaches with a view to their training the staff in the RBI.

Third, many of our tools are available in languages other than English. The most common translations are into Spanish, Portuguese, traditional Chinese, and Polish. Other languages for some tools are Arabic and Slovene. Professionals have found the translations of Routines-Based Early Intervention [9] (Chinese, Portuguese, Korean), Engagement of Every Child in the Preschool Classroom [12] (Chinese), and Working With Families of Young Children With Disabilities [27] (Portuguese, Korean) particularly helpful.

2.6. Adopted Practices

What are the most commonly implemented practices from the RBM? Many implementers, such as MECP, have adopted the whole model, albeit with adaptations. In McWilliam’s experience, southern Europeans love tools. Not surprisingly, therefore, in Spain, implementers use the numerous performance-based checklists defining the major practices of the model, the MEISR [25], the Families in Natural Environments Scale of Service Evaluation (FINESSE) [28,29,30], and the Scale for Teachers’ Assessment of Routines Engagement (STARE); Casey and McWilliam, 2007). Now, owing to García-Grau’s landmark dissertation study, the Families in Early Intervention Quality of Life (FEIQoL) scale [31] is increasingly used. One characteristic of successful model adoption is when adopters consider the model their own [32]. Noah’s Ark, Teletón Paraguay, and Singaporean agencies have developed their own model, incorporating parts of the RBM that fit their cultural and organizational contexts. In Singapore, four of the organizations implementing RBM practices are part of the Thye Hua Kwan (THK) Early Intervention Program for Infants and Children (EIPIC) centers, with the others being the AWWA Ltd., Singapore. Early Intervention Centre, SPD’s (SPD was formerly known as the Society for the Physically Disabled) Building Bridges EIPIC centers, Fei Yue Community Services EIPIC centers, and Rainbow Centre Early Intervention Programme. SPD is the agency with an implementation plan, and AWWA is the one pursuing certification of coaches.

2.7. RBI Plus

The RBM has a cohesive set of practices for developing a functional, family-chosen set of goals. All implementers have chosen to adopt the Routines-Based Interview (RBI), which is accompanied by an ecomap (depicting a family’s informal, intermediate, and formal supports), participation-based goals for children, and family goals for siblings and parents [33]. These three practices constitute the RBI Plus. The RBI is a needs assessment and typically results in 10–12 goals/outcomes. This long, meaty list of family-chosen goals is one of the hallmarks of the model.

Since 2009, Portugal has had legislation establishing the National Early Childhood Intervention System, but it does not define specific procedures. In 2016, the national association for early intervention produced a manual, which contained much of the RBM but also other practices, which has diluted the effect of the RBM [34]. This mixing of models is a two-edged sword: it purports to bring the best of different models together but it might diminish the effects of any one model.

Implementers in Taiwan began with RBI Plus and moved on to the Engagement Classroom Model. New Zealand adopted the intervention planning practices and Routines-Based Home Visits and they are working towards the primary service provider (PSP) (called a keyworker in Australia and New Zealand) [35], CC2CC, and the Engagement Classroom Model (ECM). In one of the Singapore agencies, the ecomap and RBI are the most widely adopted components of the RBM.

In Australia, Noah’s Ark adopted the RBI to fully understand the family environment, conduct a functional assessment of child and family needs, and develop clear, specific, measurable goals that directly address the family’s priorities and help children develop skills relevant to everyday life. Noah’s Ark implemented the RBI by sending a staff member to be certified by Robin McWilliam, having that staff member and colleagues develop an implementation plan for 150 staff working with over 2000 families. McWilliam provided a 4 day boot camp in Melbourne to train 18 additional trainers.

2.8. Family and Collaborative Consultation

A second set of practices that implementers often choose are those related to a consultative approach. In particular, York Region, in Ontario, Canada, for example, felt the RBM would assist them in moving from an expert model to a collaborative approach with caregivers, ensuring the family were the primary decision makers. International adopters of the model also implement family consultation, which is the collaborative-consultation method we have developed, giving families opportunity to be partners in selecting strategies for them to use with their children [36]. When professionals visit classrooms, within the RBM, they work with teachers, using collaborative consultation, rather than working directly with children. In both support-based home visits and collaborative consultation to children’s classrooms (CC2CC), caregivers might demonstrate what they or the child does, or the early interventionist might demonstrate a strategy the caregiver is interested in.

2.9. Engagement Classroom Model

A less commonly implemented set of practices is the Engagement Classroom Model (ECM), although the Słonezna Kraina and the University of Silesia at Katowice (Cieszyn campus) are implementing the ECM [12]. It includes the RBI, integrated therapy, incidental teaching, the zone defense schedule, and Reggio Emilia features. One of our American sites, MECP in Portland, is working with Head Start programs and other preschools where suspension and expulsion of children with disabilities occurs at a high rate. Implementation of the ECM would reduce, if not eliminate, suspension and expulsion, because the practices include ways to keep children engaged and include effective behavior management strategies for those occasions when prevention of behavior problems has not worked.

Taiwanese implementers are using goal-attainment scaling (GAS), the Teaching Styles Rating Scale (TSRS) [37,38], the STARE [30], and the Vanderbilt Ecological Congruence of Teaching Opportunities in Routines (VECTOR) [39] to determine the interaction of the STARE and VECTOR with the TSRS.

Across implementation sites, therefore, RBI Plus (the needs assessment and intervention-planning practices), our consultative-service-delivery approach, and the ECM have been implemented. This constitutes the whole model, but the whole model is not implemented by any one program. Plans are under way to add ECM to MECP in Portland, which would make that site the most comprehensive adopter of the RBM.

3. Implementation Challenges

Implementation of new practices can be exciting but it involves change. We highlight here seven areas that have been the most challenging in international implementation of the RBM. A common implementation challenge, from the perspective of the purveyor, is professionals’ claiming they are implementing a model when, in fact, they are not. Their claims are usually based on an honest belief they are doing what they understand to be the practices in the model.

3.1. Natural Environments

In Spain, Marga Cañadas and McWilliam tried for 4 years to persuade early intervention programs to leave their clinics (“centers”) and go into homes and communities to implement the RBM. The two main reasons for the attachment to centers were control and money. In their rooms in their centers, professionals are in control of the session. In their centers, they can see eight clients a day, whereas, visiting natural environments, they would be able to see only four or five children and families. When it was clear professionals could not be budged out of their clinics, McWilliam made a huge concession and developed procedures for routines-based clinic visits. By the same means that home visits can be performed in a clinical fashion, clinic visits can be performed in a family-centered fashion, with obvious limitations. Taiwan [40] and Paraguay have also found it difficult to use the model in natural environments. Poland would also find it difficult, but they are focusing on the Engagement Classroom Model rather than the home- and community-based practices in the model.

What about our “churches”? In working on international implementation, we came across the phenomenon of the importance of the building [2]. When agencies erect or modify buildings to house their early intervention programs, they are proud of them and want to get the most out of them. You can sense an almost religious devotion to the building. McWilliam first realized this at the Asunción center of Teletón Paraguay-the flagship center. It is a beautiful, modern, spacious building, with a remarkable curved wood-slat ceiling over the therapeutic swimming pool. Why would they not use this lovely space?

3.2. Primary Service Provider

A second challenge in implementing the RBM is the use of a primary service provider (PSP), rather than having a host of different providers from different disciplines working with the child [35,41]. Many early intervention cultures, worldwide, are very discipline driven, with a view that more is better. In Poland, for example, sensory integration therapists are separate from occupational therapists, and, in most other countries, psychologists play a much bigger role in early intervention than they do in the U.S. In Spain, they have psychometricians, a discipline that does not even exist in some other countries. In Paraguay, they have “early intervention professionals” who are different from teachers, therapists, and so on. So, when implementers try to organize a PSP approach, they meet much resistance. When a primary service provider cannot be used, one provider serves as the comprehensive service provider, attending to all child and family needs [42].

3.3. Relinquishing Control to Families

A central tenet of the RBM is that families make meaningful decisions [2]. For example, they decide on the functional needs of (goals for) the child and family, they decide on what to work on between visits, and they decide on what to focus on, in each visit. For many international implementers (and American implementers), giving families this amount of control is unusual and therefore uncomfortable. The medical or psychological model, which is common across the globe, places much control in the professional’s hands.

In Singapore, a cultural challenge is that many middle-class families have a “foreign domestic helper” in the home. This young woman from Indonesia or Malaysia might care for the child for 8–14 h a day, yet she has little decision-making power. The parents participate in the needs assessment (i.e., the RBI), yet they might know little about their child’s functioning in everyday routines. Furthermore, the domestic helper would be the person caring for the child, yet she has little say in the needs or the goals. The RBM has been described as a paradigm shift in disability services in Singapore, which, before the model, had adopted the special-education and medical-therapeutic approach. The model challenges teachers and therapists to listen reflectively and to use motivational interviewing techniques. It also challenges social workers in early intervention services to improve their child development knowledge and collaborate effectively as a team with therapists and teachers. In Singapore, social workers play a prominent role, as in Europe psychologists do. In the U.S., these disciplines are less frequently represented in early intervention programs.

In Taiwan, families and professionals alike are used to professionals giving suggestions, especially on the first visit, such as a visit to the doctor. Furthermore, the time it takes to conduct an RBI is considered a barrier in Taiwan, as it is elsewhere. In some situations, professionals (and families) think professionals should provide suggestions on the first visit: in the RBM, we do not provide suggestions during the RBI or until the family has chosen goals. Recently, the Taiwan government and early intervention professionals have promoted family-centered approaches and the ECM [40].

In Paraguay, the biggest challenges have been (a) abandoning a clinical approach and moving to a family-centered approach (including a flattening of the hierarchy between professional and family) and (b) broadening professionals’ scope beyond their formal training. In many countries outside the U.S., both professionals and families expect the former to tell the latter what to do.

3.4. Lack of Follow through

In implementation planning, we encourage adopters to realize that, after intensive training, they need to keep monitoring and supporting professionals. In Portugal, for example, teams were well trained initially but poorly supervised afterwards. In New Zealand, supervision and ongoing professional development varied across early intervention sites. In Australia (Noah’s Ark), the most significant challenge has been in supporting newly inducted team leaders and subsequent key workers in reaching fidelity to the model in a timely way. York Region, Ontario, listed resources required for ongoing training as a challenge.

3.5. Organization and Reorganization

The geographic and administrative organization of services-especially change in organization-can wreak havoc on implementation of the RBM. For example, Portuguese early intervention is overseen by three ministries, which is extremely challenging. Mississippi moved from nine regions to three. A change like that requires much energy and time, distracting from implementation. In New Zealand, the national practice support network, which had been active early in implementation, was disestablished, reducing the amount and quality of communication among districts.

3.6. Checklists

Implementation of the model over time requires people to observe and provide feedback—actual training and maintenance. This presents a challenge in terms of who is available and of scheduling. In Poland and New Zealand, for example, they are concerned about who will have the time to make all the checklist-based observations. Implementers, such as York Region and our Portland, OR, site, have found it difficult to find the time to ensure interobserver agreement.

3.7. You Are Doing It Wrong

Popular on the internet are articles about what we are doing wrong, from parenting to cutting cucumbers to facing the future. With the RBM, some experts and practitioners believe that they are using the model when they are not. We see this challenge all over the place. This phenomenon is known as the Dunning–Kruger effect, where implementers with little knowledge of the details of the model have much confidence in their ability to execute the practices (see Figure 2) [43]. It is particularly difficult because the believers see no reason to change, and it is bad for the model: people see bad practices and hear they are part of the RBM. We often have to be clear about what does not constitute the RBM.

Figure 2.

Figure 2

The Dunning–Kruger effect [44]. Reproduced with permission from Stanford Brown, retrieved from https://stanfordbrown.com.au/finance-101-the-dunning-kruger-effect/.

In Spain, we have been concerned that professionals obtain some of the increasingly available materials and tools and use them with no training. For example, professionals have been known, not only in Spain, to conduct an ecomap and then file it away, never to use it in supporting the family.

In general, change is often difficult. For some professionals, the change is welcome: they get to do what they instinctively would do or they have a structure for what they were doing. For others, it is simply a change, and accommodating to new ways of doing things is inherently difficult. For yet others, the focus on child functioning in routines and the empowerment of families is not what they believe early intervention should be about. For them, the change is the hardest. It does not help when some families want the expert approach [45].

4. Implementation Successes

International implementers of the RBM report successes in a number of outcomes.

4.1. Professionals Feeling Useful

When professionals use the RBM, they feel more useful than before they adopted the model. They feel they make a difference in the areas of child and family functioning that matter to families. Before, they were focused on what they or their assessment procedures identified as deficits in child development. With the RBM, they focus on children’s meaningful participation in everyday routines and on things that families care about. In Portugal, we actually saw improved goals, in terms of functionality and measurability, improved team functioning, and more collaborative consultation [46]. Similarly, in New Zealand and Ontario, goals became more functional and not arbitrary. In Singapore, professionals report parents’ finding goals now easier to understand, leading to better “family engagement.” Professionals also find the goals more functional and meaningful in the lives of children and families and more easily attained, which has led to greater work satisfaction.

In Taiwan, 218 professionals attended training on the RBM. The outcomes were based on McWilliam’s 12 mental shifts (www.naturalenvironemnts.blogspot.com) and 10 mistakes in early intervention [47]. Professionals with less experience shifted their mindsets more than did those with more experience (p < 0.05) [48]. Those who had ever attended any presentations on the RBM or who had read anything about the model were more aware of the practices at pretest (p < 0.05) compared to those who had not. Those who received job-embedded professional development were more likely to have shifted mindsets compared to those who received other forms of professional development (r = 0.56–0.82). High interrater agreement on the mental-shifts scale was reported.

In Paraguay and Singapore, professionals report listening more to families’ concerns and needs; constructing interventions in partnership with families, building on their strengths; collaborating more with each other; seeing progress using goal-attainment scaling. In Singapore, the RBI, specifically, resulted in parent engagement and empowerment as well as professionals’ feeling empowered to understand and empathize with families. Paraguayan, Australian, and New Zealand professionals have found the model works well in aligning early intervention with indigenous ways of perceiving the family system (whānau in Māori). In Paraguay, implementers are using a smiley-face version of goal-attainment scaling with Guaraní families who do not read.

In New Zealand, the well-being of staff improved, because they did not have to have all the answers. In addition, professional support has become more purposeful and focused. Our colleagues in New Zealand also reported an outcome we have seen in different parts of the world, including the U.S.: Principles of the model have been adopted in other areas of the agency’s or district’s work.

In Poland and Singapore, they have begun to see the value of really listening to parents, rather than simply giving them instructions. Furthermore, they have seen a shift in professionals’ mentality towards supporting families rather than “repairing” children. York Region reports child care staff and families more engaged and feeling they are an integral part of the team.

4.2. Families Feeling Confident

Across implementation sites, families feel confident about meeting children’s and families’ needs (e.g., in Ontario and Singapore). We now have an instrument assessing this confidence. In Paraguay, families are more empowered and confident, can identify their formal and informal supports, and now have their own needs addressed, rather than professionals’ priorities for the child. In New Zealand, some families are running transition (to school) meetings, which did not happen before the RBM was implemented.

Noah’s Ark (Australia) conducted semi-structured telephone interviews with 14 families participating in the RBI bootcamp training. The families said it was cathartic, beneficial, and relaxing. They highlighted the positive impact of having a professional who was warm, caring, and personable really listen to them. Many parents indicated that developing functional goals was the most valuable part of the process. Parents commented that the two-hour interview was long, but that it went by quickly. Similar results were seen in Singapore. Not all parents were thrilled about every part of the RBI, but the interviewers were new to the RBI with fidelity, and we have not matched comments to the fidelity checks. In association with The University of Alabama, Noah’s Ark has been studying the impact of the RBI on goal functionality and found that, now, goals are largely participation based, observable, and functional.

4.3. Children Functioning in Routines

When professionals implement the model, children function well in routines [49]. Although routines vary somewhat across cultures, families generally want their children to participate meaningfully in the different times of day. In Portugal, professionals report that implementation has led to higher family engagement, higher implementation by families of strategies, better family well-being, families’ feeling more competent, and quicker development in children. Results from Taiwan show the ECM has positive effects on child functioning [48]. Implementers such as York Region have seen children making progress based on what is important-building on engagement, independence, and social relationships rather than developmental skills in isolation that might not promote inclusion in their community.

Implementation successes, therefore, have been that professionals feel useful, families feel confident, and children are functioning in their routines. In Singapore, as an example, implementation of the RBM has brought about a paradigm shift in early intervention towards more family centeredness and a focus on functionality. It has paved the road to actualizing developmentally appropriate practices and inclusion principles.

5. Conclusions

The remarkable extent of implementation of the RBM, globally but not universally, can point to four general conclusions: models must be adaptable, some principles and practices are indeed universal, some experts do think globally about practices, and leadership is needed for successful implementation. Finally, we use our experiences with global implementation of the RBM to propose framework for the relationships among evidence, public policy, and adoption of best practices.

5.1. Models Have to Be Adaptable

Some implementers have looked for ways to work with different cultures and countries. Baumann and colleagues [50] conducted a systematic review of the literature for four evidence-based parent-training interventions, involving 610 articles. Only eight reported a cultural adaptation, and only two tested the efficacy with rigorous research methods. In addition to needing more implementation studies, we need to include cultural adaptations, especially for models used internationally. Practices developed in one country inevitably have to be adapted for implementation in other countries. With the current rigid approach to implementation fidelity, we can expect little international replication. Seeking the balance is the key.

Obsession with evidence is an American preoccupation, and the RBM is no exception [51,52,53]. One of our tenets in the model is to eschew non-evidence-based practices, which means we have to discard bogus practices overseas (which abound) and in the U.S. [54].

However adaptable a model is to local customs and preferences, implementers might still move on to other models. Many implementers have trouble with sticking with a model over a 5 year implementation plan and having the courage to stay away from other bright shiny objects that come along and divert attention and resources from the model.

5.2. Some Principles and Practices Are Indeed Universal

The principles undergirding the RBM appear to be universal: we want children to function well in their natural routines, we want families to have the confidence to teach their children through their natural parenting, we want professionals to build caregivers’ capacity, and we want supervisors and trainers to use observation and feedback. Practitioners and administrators no longer want to hear about rhetoric, theory, advocacy, and esoteric research, such as “recommended practices” [21] or a “family-centered model” [55]: They want to hear about specific, evidence-based ways of doing things.

With respect to natural environments, specifically, when professionals concentrate on what happens during the visit more than where it occurs, they can truly build the caregiver’s capacity and end up with more intervention for the child than a hands-on approach. If purveyors insist on supports being provided in natural environments, they will not be implemented at scale overseas. Portugal, however, did pass legislation and provided training, so early interventionists do make home and community visits.

5.3. Promoting a Global Perspective on Excellent Practices

Some American-developed models are designed to address American contexts and are difficult to implement outside the U.S. Early intervention in the U.S. can be considered somewhat ethnocentric. Many professionals assume the early intervention landscape internationally is like the U.S. one. However, U.S. perspectives can be international: for example, the headquarters of the International Society on Early Intervention is in Seattle, because that’s where its founder and president, Michael Guralnick, works. Further, the scholarly journal Infants and Young Children under the editorship of Mary Beth Bruder, deliberately publishes international research and perspectives and even has an international editor (self-disclosure: it is McWilliam).

Many practitioners overseas and in the U.S. are impressed with entertrainment, but we need to focus on specific practices and models. Entertrainment is a portmanteau of entertainment and training and refers to an appealing presentation with few practical strategies and no provision for follow-up observation and feedback (i.e., real training). Implementation can only happen if implementers commit to serious, long-term, job-embedded professional development [56].

5.4. Leadership

The purveyor must be in control and has to relinquish control. The purveyor (in this case, Robin McWilliam) has to be the arbiter of what constitutes fidelity to the model [57]. The purveyor has to protect and promote this fidelity for two reasons. One is that any evidence on which the model is based involved specific practices, so deviation can render the practice no longer evidence based. The second reason is a branding and credibility one: If people are saying they are using a model or its practices, when in fact they are not, any success or failure of their efforts will not really reflect the model.

Local leadership is the key [58]. In every successful implementation of the RBM, one or more local leaders have gone through the stages of implementation to explore options, decide on the RBM as a solution to needs they saw, shepherded the initial implementation, and planned for full implementation. Some of our sites are well into implementation and others are near the beginning, but the role of key players, many of whom are authors of this article, cannot be underestimated.

Because this model was developed in the U.S., one might think the implementation over the past 15 years has been one way. Actually, as we have mentioned a number of times, to make it truly a global model, we have had to make modifications. Implementers from different countries have learned from each other. For example, Marisú Pedernera, the bright young linchpin for the Paraguayan implementation, corresponds with a colleague in Taiwan, with Cami Stevenson in Portland, Oregon, and with colleagues in Spain. Many implementers and other international professionals interested in the RBM are members of The RAM Group, a community of practice dedicated to the exchange of information about the model (www.ramgroup.info).

5.5. Framework Regarding Evidence, Policy, and Implementation

The role of the government, through policies or legislation, in early intervention varies greatly. In most countries, its primary concern has been the provision of services, ensuring services are available to young children with disabilities. Not all governments have been involved with the quality of services. The United States has provisions built in, such as the requirement that services be provided in natural or least restrictive environments. Different state systems of early intervention or preschool special education have varying levels of interest in the quality of services. Some, such as Alabama and Maine, have invested heavily in improving and maintaining high quality services. Outside the U.S., Portuguese law deals with the establishment of the system for managing early intervention, with a nod to quality by requiring the International Classification of Functioning, Health, and Disability be used in assessment [22,59]. In Australia, the government has established the National Disability Insurance Scheme, ostensibly to provide consumer choice, yet the scheme challenges family-centered practices and promotes a multidisciplinary approach to early childhood intervention [60].

As shown in Figure 3, the provision of services comes largely from the impetus of government policies and from legislation. To some extent, we have seen that the face value of RBM practices and the theories underpinning it have had some impact on systems. Those systems concerned about the quality of services have invested in training on, for example, the RBM. New Zealand’s Ministry of Education adopted the RBI initially in one region, then spread it to the other three regions, and now uses other aspects of the RBM. They, like Australia, had a leg up because they were already using keyworkers, who are like primary service providers in the RBM. We see that the common sense of the RBM, the family-centered principles, and the theories about child functioning have had more impact on impact by agencies and governmental agencies than has the empirical evidence. However, the RBM’s face value has credibility because of its basis in evidence-based practices.

Figure 3.

Figure 3

Relationships among government, evidence, and implementation. AL: Alabama: ME: Maine, NZ: New Zealand. RBM: Routines-Based Interview.

Agencies in various international implementation sites have had a key role. To some extent, they might influence governmental agencies, and, certainly, they are influenced by the governments (i.e., they usually exist within the constraints of governmental regulations). In Australia, we have see Noah’s Ark, in Melbourne and Canberra, embrace high-quality supports to children and families-not only with the RBM but also other philosophically and empirically sound models. They have been vocal in warning the National Disability Insurance Scheme about challenges to quality. In Poland, the implementation site for the Engagement Classroom Model, Słonezna Kraina, repudiated the traditional Polish concepts of quality early intervention approaches and boldly adopted the RBM. Teletón Paraguay, similarly, broke with cultural traditions to reimagine quality, moving from a rehabilitation approach to a functional, family-centered approach. These agencies and others were influenced primarily by the logic and values of the RBM.

An interest in quality, therefore, has been the driving force behind implementation of best practices. Circling back to governmental input, we have seen that some actions by governmental agencies have enhanced implementation of the RBM. For example, in the U.S., 24% of the states have included practices from the RBM in their state systemic improvement plans, which are required, annually [61]. In these improvement plans, most often states have included the RBI in their assessment procedures. Finally, governmental agencies have invested in training in the RBM. For example, various U.S. states such as Alabama, Kentucky, Maine, Mississippi, Montana, and Nebraska have funded professional development in the RBM. Outside the U.S., governmental investment has been restricted largely to New Zealand. In Spain, some states (comunidades autónomas), such as Castilla la Mancha, have funded training in the model.

The interaction among governmental interest, research, and implementation is, therefore, a complicated and fascinating one. Pragmatists would like to find the perfect solution. Descriptivists, however, are content with admiring the phenomenon.

We end with three inferences. First, working with implementers in a caring, respectful, and honest way leads to appropriate modifications of the model. Second, sustaining an innovation is harder than implementing it: things change (funding mechanism, geographical organization, leadership), and carrying out the innovation with fidelity to the model is shaken. Third, some practices are good for young children with disabilities and their families, wherever they are. These practices might be that early intervention and parenting should help children participate in their lives meaningfully, that early intervention should support families to be the caregivers they want to be, and that early intervention professionals should know what they are doing. International implementation of the RBM has, therefore, provided a prototype for how to work across cultures, countries, and customs.

Acknowledgments

We acknowledge, with gratitude, contributions from Stacey Hodgson, Becky Hoo, Iris Lin, Low Hwee San, Agatha Tan, Tan Peng Chian, Sze Wee Tan, and Marla Teicher.

Author Contributions

Conceptualization, R.A.M.; methodology, R.A.M.; writing—original draft preparation, R.A.M.; investigation, resources and writing—review and editing: R.A.M., T.B., K.B., M.C., A.-W.H., N.J., H.H.L., M.P., T.S., J.W.; visualization, R.A.M.; supervision, R.A.M.; project administration, R.A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

Authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.McWilliam R.A., Trivette C.M., Dunst C.J. Behavior engagement as a measure of the efficacy of early intervention. Anal. Int. Dev. Disabil. 1985;5:59–71. doi: 10.1016/S0270-4684(85)80006-9. [DOI] [Google Scholar]
  • 2.McWilliam R.A. Metanoia in early intervention: Transformation to a family-centered approach. Rev. Latinoam. Educ. Inclusiva. 2016;10:155–173. [Google Scholar]
  • 3.Idol L., Nevin A., Paolucci-Whitcomb P. Collaborative Consultation. 2nd ed. PRO-ED; Austin, TX, USA: 1994. [Google Scholar]
  • 4.Jung L.A. Identifying families’ supports and other resources. In: McWilliam R.A., editor. Working with Families of Young Children with Special Needs. Brookes Publishing; Baltimore, MD, USA: 2010. pp. 9–26. [Google Scholar]
  • 5.McWilliam R.A. The Routines-Based Model for supporting speech and langauge. Logop. Foniatr. Audiol. 2016;36:178–184. doi: 10.1016/j.rlfa.2016.07.005. [DOI] [Google Scholar]
  • 6.Locke E., Latham G. Goal-setting theory. In: Miner J.B., editor. Organizational Behavior 1: Essential Theories of Motivation and Leadership. Routledge; New York, NY, USA: 1994. pp. 159–183. [Google Scholar]
  • 7.Woods J.J., Lindeman D.P. Gathering and giving information with families. Infants Young Child. 2008;21:272–284. doi: 10.1097/01.IYC.0000336540.60250.f2. [DOI] [Google Scholar]
  • 8.Fleming J.L., Sawyer L.B., Campbell P.H. Early intervention providers’ perspectives about implementing participation-based practices. Top. Early Child. Spec. Educ. 2011;30:233–244. doi: 10.1177/0271121410371986. [DOI] [Google Scholar]
  • 9.McWilliam R.A. Routines-Based Early Intervention. Brookes Publishing Co.; Baltimore, MD, USA: 2010. [Google Scholar]
  • 10.McWilliam R.A. Integration of therapy and consultative special education: A continuum in early intervention. Infants Young Child. 1995;7:29–38. doi: 10.1097/00001163-199504000-00006. [DOI] [Google Scholar]
  • 11.McWilliam R.A., Wolery M., Odom S.L. Instructional perspectives in inclusive preschool classrooms. In: Guralnick M.J., editor. Early Childhood Inclusion: Focus on Change. Brookes Publishing; Baltimore, MD, USA: 2001. pp. 503–530. [Google Scholar]
  • 12.McWilliam R.A., Casey A.M. Engagement of Every Child in the Preschool Classroom. Paul H. Brookes Co.; Baltimore, MD, USA: 2008. [Google Scholar]
  • 13.Early Childhood Technical Assistance Center Idea Part C Profiles. [(accessed on 17 July 2020)];2014 Available online: https://osep.grads360.org/#program/idea-part-c-profiles.
  • 14.Grande C., Pinto A.I. Estilos interactivos de educadoras do Ensino Especial em contexto de educação-de-infância. Psicol. Teor. Pesqui. 2009;25:547–559. doi: 10.1590/S0102-37722009000400010. [DOI] [Google Scholar]
  • 15.Pessanha M., Pinto A.I., Barros S. Influência da qualidade dos contextos familiar e de creche no envolvimento e no desenvolvimento da criança. Psicologia. 2009;23:55–71. doi: 10.17575/rpsicol.v23i2.327. [DOI] [Google Scholar]
  • 16.Serrano A.M., Pereira A.P., Carvalho M.L. Oportunidades de aprendizagem para a crianca nos seus contextos de vida: Familia e comunidade/Child’s learning opportunities in natural environments: Family and community. Psicol. Rev. Assoc. Port. Psicol. 2003;17:65–80. [Google Scholar]
  • 17.Hwang A.-W., Chao M., Liu S. A randomized controlled trial of routines-based early intervention for children with or at risk for developmental delay. Res. Dev. Disabil. 2013;34:3112–3123. doi: 10.1016/j.ridd.2013.06.037. [DOI] [PubMed] [Google Scholar]
  • 18.Dunst C.J., Johanson C., Trivette C.M., Hamby D.W. Family-oriented early intervention policies and practices: Family-centered or not? Except. Child. 1991;58:115–126. doi: 10.1177/001440299105800203. [DOI] [PubMed] [Google Scholar]
  • 19.McWilliam R.A. Family-Centered Intervention Planning: A Routines-Based Approach. Communication Skill Builders; Tucson, AZ, USA: 1992. [Google Scholar]
  • 20.Cabrerizo de Diago R., López Pisón P., Navarro Callau L. La Realidad Actual de la Atención Temprana en España. Real Patronato sobre Discapacidad; Madrid, Spain: 2012. [Google Scholar]
  • 21.Division for Early Childhood DEC Recommended Practices in Early Intervention/Early Childhood Special Education. [(accessed on 16 July 2020)];2014 Available online: http://www.dec-sped.org/recommendedpractices.
  • 22.World Health Organization . International Classification of Functioning, Disability, and Health: Children & Youth Version: ICF-CY. World Health Organization; Geneva, Switzerland: 2007. [Google Scholar]
  • 23.Hwang A.-W., Liao H.-F., Granlund M., Simeonsson R.J., Kang L.-J., Pan Y.-L. Linkage of ICF-CY codes with environmental factors in studies of developmental outcomes of infants and toddlers with or at risk for motor delays. Disabil. Rehabil. 2013;36:89–104. doi: 10.3109/09638288.2013.777805. [DOI] [PubMed] [Google Scholar]
  • 24.Pan Y.-L., Hwang A.-W., Simeonsson R.J., Lu L., Liao H.-F. Utility of the early delay and disabilities code set for exploring the linkage between ICF-CY and assessment reports for children with developmental delay. Infants Young Child. 2019;32:215–227. doi: 10.1097/IYC.0000000000000144. [DOI] [Google Scholar]
  • 25.McWilliam R.A., Younggren N. Measure of Engagement, Independece, and Social Relationships (MEISR™), Research Edition, Manual. Paul H. Brookes Publishing Co.; Baltimore, MD, USA: 2019. [Google Scholar]
  • 26.Casey A.M., McWilliam R.A. The impact of checklist-based training on teachers’ use of the zone defense schedule. J. Appl. Behav. Anal. 2011;44:397–401. doi: 10.1901/jaba.2011.44-397. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.McWilliam R.A., editor. Working with Families of Young Children with Special Needs. Guilford Press; New York, NY, USA: 2010. [Google Scholar]
  • 28.McWilliam R.A. Families in Natural Environments Scale of Service Evaluation (FINESSE) In: McWilliam R.A., editor. Routines-Based Early Intervention: Supporting Young Children and Their Families. Paul H. Brookes Publishing Co.; Baltimore, MD, USA: 2010. pp. 212–220. [Google Scholar]
  • 29.McWilliam R.A. Families in Natural Environments Scale of Service Evaluation (FINESSE II) University of North Carolina; Chapel Hill, NC, USA: 2000. [Google Scholar]
  • 30.Casey A.M., McWilliam R.A. The STARE: Data collection without the scare. Young Except. Child. 2007;11:2–15. doi: 10.1177/109625060701100101. [DOI] [Google Scholar]
  • 31.McWilliam R.A., García Grau P. Families in Early Intervention Quality of Life. The University of Alabama; Tuscaloosa, AL, USA: 2017. [Google Scholar]
  • 32.Evidence-Based Intervention (EBI) Work Group Theories of change and adoption of innovations: The evolving evidence-based intervention and practice movement in school psychology. Psychol. Sch. 2005;42:475–494. doi: 10.1002/pits.20086. [DOI] [Google Scholar]
  • 33.McWilliam R.A. Assessing families’ needs with the routines-based interview. In: McWilliam R.A., editor. Working with Families of Young Children with Special Needs. Guilford; New York, NY, USA: 2010. pp. 27–59. [Google Scholar]
  • 34.Associação Nacional de Intervenção Precoce . Práticas Recomendadas em Intervenção Precoce na Infância: Um Guia para Profissionais. Associação Nacional de Intervenção Precoce; Coimbra, Portugal: 2018. [Google Scholar]
  • 35.McWilliam R.A. The primary-service-provider model for home- and community-based services. Psicol. Rev. Assoc. Port. Psicol. 2003;17:115–135. [Google Scholar]
  • 36.Woods J.J., Wilcox M.J., Friedman M., Murch T. Collaborative consultation in natural environments: Strategies to enhance family-centered supports and services. Lang. Speech Hear. Serv. Sch. 2011;42:379–392. doi: 10.1044/0161-1461(2011/10-0016). [DOI] [PubMed] [Google Scholar]
  • 37.McWilliam R.A., Scarborough A.A., Kim H. Adult interactions and child engagement. Early Educ. Dev. 2003;14:7–27. doi: 10.1207/s15566935eed1401_2. [DOI] [Google Scholar]
  • 38.McWilliam R.A., Scarborough A.A., Bagby J.H., Sweeney A.L. Teaching Styles Rating Scale. Frank Porter Graham Child Development Center. University of North Carolina at Chapel Hill; Chapel Hill, NC, USA: 1998. [Google Scholar]
  • 39.Casey A.M., Freund P.J., McWilliam R.A. Vanderbilt Ecological Congruence of Teaching Opportunities in Routines (VECTOR) Classroom Version. Vanderbilt Center for Child Development; Nashville, TN, USA: 2004. [Google Scholar]
  • 40.Liao H.-F., Wu P.-F. Early childhood inclusion in Taiwan. InfantsYoung Child. 2017;30:320–327. doi: 10.1097/IYC.0000000000000102. [DOI] [Google Scholar]
  • 41.Shelden M.L., Rush D.D. The Early Intervention Teaming Handbook: The Primary Service Provider Approach. Paul H. Brookes; Baltimore, MD, USA: 2013. [Google Scholar]
  • 42.McWilliam R.A., Garcia Grau P. Towards Implementation of an early intervention model by a Paraguayan organization. Educação. 2020;43:e35700. doi: 10.15448/1981-2582.2020.1.35700. [DOI] [Google Scholar]
  • 43.Dunning D. The Dunning-Kruger effect: On being ignorant of one’s own ignorance. In: Olson J.M., Zanna M.P., editors. Advances in Experimental Social Psychology. Volume 44. Academic Press; Cambridge, MA, USA: 2011. pp. 247–296. [DOI] [Google Scholar]
  • 44.Dargahwala I. The Dunning Kruger Effect. [(accessed on 15 July 2020)];2019 Available online: https://dev.to/theiyd/the-dunning-kruger-effect-3cj2.
  • 45.McWilliam R.A., Casey A.M. More is Not Always Better: Research Findings. Division for Early Childhood of the Council for Exceptional Children; Los Angeles, CA, USA: 2004. Presented at the International Conferene on Early Childhood (Division for Early Childhood of the Council for Exceptional Children), Chicago, IL, USA, 2004. [Google Scholar]
  • 46.Boavida T., Aguiar C., McWilliam R.A., Correia N. Effects of an in-service training program using the routines-based interview. Top. Early Child. Spec. Educ. 2016;36:67–77. doi: 10.1177/0271121415604327. [DOI] [Google Scholar]
  • 47.McWilliam R.A. The top 10 mistakes in early intervention—And the solutions. Zero Three. 2011;31:11. [Google Scholar]
  • 48.Hwang A.-W. The Long-Term Effectiveness of Implementing a Participation-Based Early Intervention Program for Children with Developmental Delay: A Cluster-Randomized Controlled Trial. Ministry of Science and Technology; Taipei, Taiwan: 2017. [Google Scholar]
  • 49.Garcia Grau P., McWilliam R.A., Martínez-Rico G., Grau Sevilla M.D. Factorial structure and internal conistency of a Spanish version of the Family Quality of Life (FaQoL) Scale. Appl. Res. Qual. Life. 2018;13:385–398. doi: 10.1007/s11482-017-9530-y. [DOI] [Google Scholar]
  • 50.Baumann A.A., Powell B.J., Kohl P.L., Tabak R.G., Penalba V., Proctor E.K., Domenech-Rodriguez M.M., Cabassa L.J. Cultural adaptation and implementation of evidence-based parent-training: A systematic review and critique of guiding evidence. Child. Youth Serv. Rev. 2015;53:113–120. doi: 10.1016/j.childyouth.2015.03.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Dunst C.J., Trivette C.M. Using research evidence to inform and evaluate early childhood intervention practices. Top. Early Child. Spec. Educ. 2008;29:40–52. doi: 10.1177/0271121408329227. [DOI] [Google Scholar]
  • 52.Odom S.L. The tie that binds evidence-based practice, implementation science, and outcomes for children. Top. Early Child. Spec. Educ. 2009;29:53–61. doi: 10.1177/0271121408329171. [DOI] [Google Scholar]
  • 53.Cook B.G., Cook S.C. Thinking and Communicating Clearly about Evidence-Based Practices in Special Education. Division for Research, Council for Exceptional Children; Reston, VA, USA: 2011. [Google Scholar]
  • 54.McWilliam R.A. Controversial practices: The need for a reacculturation of early intervention fields. Top. Early Child. Spec. Educ. 1999;19:177–188. doi: 10.1177/027112149901900310. [DOI] [Google Scholar]
  • 55.Dalmau M., Balcells-Balcells A., Giné C., Cañadas M., Casas O., Salat Y., Farré V., Calaf N. How to implement the family-centered model in early intervention. An. Psicol. 2017;33:641–651. [Google Scholar]
  • 56.Dunst C.J., Trivette C.M. Let’s be PALS: An evidence-based approach to professional development. Infants Young Child. 2009;22:164–176. doi: 10.1097/IYC.0b013e3181abe169. [DOI] [Google Scholar]
  • 57.Halle T., Metz A., Martinez-Beck I. Applying Implementation Science in Early Childhood Programs and Systems. Paul H. Brookes Publishing Company; Baltimore, MD, USA: 2013. [Google Scholar]
  • 58.Ploeg J., Davies B., Edwards N., Gifford W., Miller P.E. Factors influencing best-practice guideline implementation: Lessons learned from administrators, nursing staff, and project leaders. Worldviews Evid. Based Nurs. 2007;4:210–219. doi: 10.1111/j.1741-6787.2007.00106.x. [DOI] [PubMed] [Google Scholar]
  • 59.Pinto A.I., Grande C., Aguiar C., de Almeida I.C., Felgueiras I., Pimentel J.S., Serrano A.M., Carvalho L., Brandão M.T., Boavida T., et al. Early childhood intervention in Portugal: An overview based on the developmental systems model. Infants Young Child. 2012;25:310–322. doi: 10.1097/IYC.0b013e3182673e2b. [DOI] [Google Scholar]
  • 60.Marchbank A.M. The National Disability Insurance Scheme: Administrators’ Perspectives of Agency Transition to ‘User Pay’ for Early Intervention Service Delivery. Australas. J. Early Child. 2017;42:46–53. doi: 10.23965/AJEC.42.3.06. [DOI] [Google Scholar]
  • 61.Early Childhood Technical Assistance Center SSIP Phase III, Year 3 Analysis: Data. [(accessed on 18 July 2020)];2019 Available online: https://ectacenter.org/topics/ssip/ssip_p3.asp.

Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES