Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Sep 1.
Published in final edited form as: J Dev Behav Pediatr. 2019 Sep;40(7):511–518. doi: 10.1097/DBP.0000000000000695

Quantitative evaluation of content and age concordance across developmental milestone checklists

Carol L Wilkinson a, M Jackson Wilkinson, Jennifer Lucarelli b, Jason Fogler a, Ronald E Becker a, Noelle Huntington c
PMCID: PMC6731149  NIHMSID: NIHMS1527960  PMID: 31169653

Abstract

Objective:

Clinicians and caregivers rely on milestone checklists as tools for tracking a child’s development. In addition, medical students and residents use milestone checklists to learn about normal child development. However, there are multiple published milestone checklists that vary qualitatively in structure and content, hindering their effective use in developmental surveillance and medical education. This project systematically evaluated the consistency and variability between commonly used milestone checklists.

Methods:

A team of child psychologists and developmental pediatricians reviewed a total of 1,094 milestones derived from four published checklists (two developed for providers, two developed for caregivers) in order to create a comprehensive set of 728 discrete developmental observations, with each observation mapped to corresponding milestones. This observation-milestone relational database was then used to determine the degree of content overlap and milestone age-range concordance across milestone checklists.

Results:

Of the 728 discrete developmental observations, 40 (5.5%) mapped to milestones in all four milestone checklists, and an additional 90 (12.4%) mapped to three checklists. Among these 40 “universal” observations, most (42.5%) were in the motor domain. Of those 130 observations mapped to milestones in at least 3 of the 4 checklists, 26.9% (35/130) mapped to milestones that were discordant in their associated age range.

Conclusions:

Four commonly used developmental milestone checklists were found to have limited overlap in content and those that overlapped were inconsistent in their associated age-ranges. The resulting observation-milestone relational database could be used to further validate age-estimates of milestones and facilitate milestone surveillance through the electronic health record.

Keywords: Growth/Developmental Milestones, Developmental Surveillance, Developmental/Behavioral Issues, Community Pediatrics

INTRODUCTION

Identification of developmental delays in young children is the first step in referral to early intervention and improving developmental and behavioral outcomes. As such, the American Academy of Pediatrics (AAP) recommends ongoing developmental surveillance at all health supervision visits, and developmental screening using evidence-based tools at 9-, 18-, and 24- or 30-month visits.1 However, adoption of developmental screening in the primary care setting has been challenging due to a variety of issues including administration time and cost2,3, lack of a gold-standard screening tool, and concern over the effectiveness of available tools. Despite AAP recommendations for screening, fewer than half of primary care physicians surveyed 3 years after this recommendation use a validated screening tool.4 More recently, an analysis from the 2016 National Survey of Children’s Health found fewer than 40% of parents with children between 9 and 35 months reported being asked about their child’s learning, development, or behavior by their health care provider with large differences between states.5 Interestingly, integration of developmental surveillance and screening into the electronic health record (EHR) through computerized clinical decision support systems have shown promise in improving rates of screening6, however integration of such tools is not widespread across EHR platforms.

Developmental surveillance is defined as a “flexible, longitudinal, continuous, and cumulative process where by health care professionals identify children who may have developmental delays”.1 It is informed by several factors including (1) eliciting and attending to parents’ concerns about their child’s development, (2) documenting and maintaining a developmental history, (3) observing a child’s abilities, (4) identifying risk and protective factors, and (5) maintaining a record of the above findings.1 Developmental milestone checklists are commonly used by health professional as tools for tracking and documenting development as part of developmental surveillance.2 In addition, in order to improve parents’ knowledge of typical development, both the AAP7 and the Centers for Disease Control and Prevention (CDC)8 have developed milestone checklists and mobile apps, aimed at caregivers, encouraging parents to act early if they have concerns about their child’s development. Finally, milestone checklists are also used in medical and resident education to teach typical development, and memorization of milestones is tested on Board examinations. However, several limitations have also been raised regarding the quality and utility of milestone checklists4,9:

Variability:

There are multiple sources for developmental milestones available to both providers and caregivers, however they vary considerably in their specificity, structure, and timelines. For example, the majority of sources present milestones associated with their mean age of acquisition (50th percentile)911, while others report the 75th or 90th percentile, and others no information at all.12 In addition, milestone checklists are often organized into different age groups. For example, Bright Futures10, a checklist developed for providers, presents milestones associated with timing of well child visits, while HealthyChildren.org7, a website for parents from the AAP, reports milestones for longer age ranges—grouping together all milestones between 1–2 years of age. Such variability can lead to confusion for both providers and parents on when to have concerns and in turn, when to refer.

Unclear validity:

Many of the original sources for developmental milestone checklists are from studies of either small sample sizes or of limited diversity9,13,14. Studies investigating the longitudinal development of milestones across cultures, socioeconomic status, and geography are lacking. Indeed, evidence suggests that surveillance alone, compared to screening, leads to delayed identification of and referral for developmental delay15. Despite this, the validity of screening tools have also been questioned, as both the US Preventative Service Task Force and Canadian Task Force on Preventative Health Care have found insufficient evidence to support developmental screening in children1618, although surveillance using developmental milestones is still recommended.

Given the apparent disconnect between promotion, adoption, and consistency amongst milestone checklists, this study aimed to systematically evaluate the consistency and variability between four common developmental milestones checklists, used either by physicians (Bright Futures, 3rd edition10 and those recurrently published in Pediatrics in Review11,1921), or caregivers (CDC: Learn the Signs. Act Early8 and Healthy Children: Ages and Stages7). In order to overcome variability in the language and organization of the milestone checklists, a comprehensive list of developmental observations were developed and individual milestones were mapped to these observations. We examined how consistent these checklists were with respect to the milestones covered, as well as the expected age for milestones present across checklists.

METHODS

Relational Database Development

Given the broad audience for milestone checklists, two checklists aimed at caregivers and two checklists aimed at providers were chosen from respected organizations. A team of expert developmental specialists came to group consensus on the checklists chosen based on the following criteria: wide-spread use, age range covered at least 0–5 years, overlapping primary sources (in order to increase likelihood of consensus), and inclusion of milestones in at least four domains (motor, language, cognitive, and social-emotional). Table 1 describes characteristics for each of these milestone checklists, including their primary sources.

Table 1:

Characteristic of Analyzed Milestone Checklists

Characteristic CDC: Learn the Signs. Act Early. Healthy Children: Ages and Stages Bright Futures 3rd Edition Pediatrics in Review Article (Scharf et. al)
Aimed Audience Caregiver Caregiver Physician Physician
Total # of milestones 214 183 171 525
Target ages for milestones 2, 4, 6, 9, 12, 18, 24, 36, 48, 60 1, 3, 7, 12, 24, 48, 60 <1, 1, 2, 4, 6, 9, 12, 15, 18, 24, 30, 36, 48, 72 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18, 20, 22, 24, 28, 30, 33, 36, 48, 60, 72
Categories Language/Communication
Cognitive
Movement/Physical Development
Social/Emotional
Movement
Visual and Hearing
Smell and Touch
Social and Emotional
Language
Cognitive
Social-Emotional
Communicative
Cognitive
Physical
Gross Motor
Fine Motor
Self-Help
Problem-solving
Social/Emotional
Receptive Language
Expressive Language
Sources cited by system Caring for your baby and young child: Birth to Age 5, 5th Edition12
Bright Futures, 3rd Edition9
Caring for your baby and young child: Birth to Age 5, 5th Edition12 Early Language Milestone Scale. 2nd Edition23
DENVER II Training Manual24
Johnson, C. AAP Council on Children with Disabilities.
Contributions from Glascoe, FP, Robertshaw, N, and Trimm, F.
CDC: Learn the Signs. Act Early8
National Institute for Literacy/Reach Out and Read
Brigance Diagnostic Inventory of Early Development25

The team was composed of child psychologists and developmental-behavioral pediatricians – three faculty members (1 MD, 2 PhD) in Developmental-Behavioral-Pediatrics at Boston Children’s Hospital with an average of 16.7 years of experience, and two MD fellows in Developmental-Behavioral-Pediatrics. Observations were created or rewritten from existing milestones in order to be 1) unambiguous, 2) discrete, and 3) objectively observable behaviors or skills that could be mapped to one or more milestones. Given that the milestone table presented in the 2016 Pediatrics in Review paper19 had the most extensive list of milestones, and a large majority of these were already in the form of a discrete observation, these were first used to create the master list of observations. Working in pairs, team members then reviewed milestones from the three remaining checklists and either matched them with the appropriate existing observation(s) or created new observations when appropriate. Discrepancies warranting further discussion were tagged. Each observation and its corresponding milestones were then reviewed in-person by the full team. During these meetings, observation-milestone associations, and the wording of observations were finalized using expert group consensus (See Table 2 for examples). This resulted in the creation of an observation-milestone relational database which was further analyzed. A list of all the observations with links to their corresponding milestones is available at www.idob.info.

Table 2:

Examples of common discrepancies between milestone checklists. Target age is provided next to each milestone.

Observation CDC Healthy Children Bright Futures Peds in Review
Examples of numeric milestone discrepancies
Draws a 2-part person Draws person with two to four body parts (48) Draws person with two to four body parts (48) Draws a person with 2 body parts (head and one other part) (36) Draws a two-to-three-part person (36)
Draws a 3-part person Draws person with two to four body parts (48) Draws person with two to four body parts (48) Draws a person with 3 parts (48) Draws a two-to-three-part person (36)
Draws a 4-part person Draws person with two to four body parts (48) Draws person with two to four body parts (48) Draws a four-to-six-part person (48)
Examples of inconsistent description of skills
Uses simple gestures Uses simple gestures, like shaking head “no” or waving “bye-bye” (12)
Says and shakes head “no” (18)
Uses simple gestures, such as shaking head for “no” (12) Waves “bye-bye” (12) Shakes head for “no”. (8)
Wave “bye-bye” (10)
Engages in pretend play with other people (eg. tea party, birthday party) Plays simple make believe games (24) Begins make-believe play (24) Play is starting to include other children to an increasing degree, such as play tea parties or chase games (30) Engages in pretend play with other people (eg, tea party, birthday party) (18)

Common Discrepancies

During the above process, several common conflicts between milestone sources were observed. Below we describe each of these conflicts and how they were aligned.

Numeric milestones:

Many of the milestone sources used different ranges of numbers to describe a skill. For example: “Draws a two-to-three-part person” versus “Draws person with 2 to 4 body parts.” For these cases the milestone was matched to multiple observations, each specific to the discrete observable number (Table 2).

Inconsistent description of skills:

Different milestone sources often describe the same skill in different ways. In some cases milestones describe a very specific observation that is likely meant to represent a larger skill set. These differences were discussed as a team and a single observation was created using wording that was both specific and comprehensive. For example, milestones “Shakes head “no” and “Waves “bye-bye”” were associated with the single observations – “Uses simple gestures”. In other cases, milestones are quite broad, especially when compared to similar, but more detailed milestones – “throws ball overhand” vs “throws ball overhand 10 feet”. In these cases multiple specific observations were created with broad milestones matching to multiple observations.

Conglomerates:

Milestones were often composed of two related but discrete skills. For example: “Says and shakes head ‘no’” or “May walk up steps and run”. These milestones may be confusing if a child has mastered only one of the two skills listed. From these milestones, two observations were created with the same milestone associated with each. In some cases, it was difficult to discern whether booleans like “and” and “or” were to be taken strictly. For these purposes, we considered all conjunctions to be a non-exclusive “or.”

Target age differences:

Milestones matched to the same observation were often noted to have different target ages. For example, “Throws ball overhand” has a target age of 24-months in the CDC: Learn the Signs, Act Early checklist and 48-months in the Healthy Children: Ages and Stages checklist. Given this, an analysis of age concordance (described below) was performed.

Analysis of observation-milestone relational database

A total of 728 unique observations were created, mapping to 1094 milestones from across all four milestone checklists. As shown in Table 1, each checklist varied in the age range of milestones covered, as well as the number of milestones included. Given the variability in age ranges covered, analyses were limited to milestones targeted at 72 months or younger. Additionally, the analysis excluded inverse-type milestones used by some checklists, where a negative observation (“Can’t hold head steady”) is listed at a certain age as cause for concern.

Age concordance analysis:

Since each of the four milestone checklists use different target ages, the following analysis was developed to determine whether milestones associated with a common observation also shared a similar target age (Figure 1). Target ages across checklists were defined as concordant if they either (1) matched exactly or (2) the target age from one checklist (eg. 18 months, CDC) was adjacent to the target age from another checklist (eg. 12 and 24 months from Healthy Children; 15 and 24 months from Bright Futures; 16 and 20 months from Pediatrics in Review). Using this method, a 5-month milestone in Pediatrics in Review, would be age-concordant with CDC and Bright Futures milestones at 4 and 6 months, Healthy Children’s milestones at 3 and 7 months, but not milestones in those checklists at 9 or 12 months. Using this analysis, age concordance for an observation was defined as the maximum number of age-concordant associated milestones (Figure 1 for examples).

Figure 1:

Figure 1:

1A – An example visualization of analysis determining age concordance among all four systems for a single observation. Solid lines represent paths finding successful agreement between milestones, while dashed lines show attempted but failed paths. Colored blocks show the target age at which the observation is represented by a milestone in the correspondingly- colored system. In an effort to be permissive, the analysis determines the final level of agreement based on the highest number of concordant systems. Figure 1B – An example visualization of analysis showing age concordance among three systems for a single observation.

RESULTS

Variability between Milestone Checklists

In order to assess the variability in types of milestones included the checklists analyzed, we determined the number of milestones within each checklist that referenced developmental observations shared by other milestone checklists. Surprisingly, there was low overlap between milestone checklists. While all milestones checklists had at least 170 individual milestones, on average only 40 milestones within a checklist were shared with the other three checklists (Table 3).

Table 3:

Content overlap between Milestone Checklists

Milestone Checklist Total No overlap 1 other checklist 2 other checklists 3 other checklists
CDC 214 22 (10.3%) 68 (31.8%) 80 (37.4%) 44 (20.6%)
Healthy Children 183 33 (18.0%) 57 (31.1%) 57 (31.1%) 36 (19.7%)
Bright Futures 171 40 (23.4%) 60 (35.1%) 33 (19.3%) 38 (22.2%)
Peds in Review 525 303 (57.7%) 91 (17.3%) 87 (16.6%) 45 (8.6%)

As shown in Table 3, the Pediatrics in Review checklist had over twice as many milestones, and therefore had many milestones that did not overlap with other systems. Many of these milestones covered progressive abilities at developmental timepoints not covered by other systems (eg. “Transfers objects hand-mouth-hand at 5-months), or covered academic and social milestones at the older age ranges that were not included in other checklists (eg. Reads 25 words; Apologizes for mistakes; Responds to “why” questions”).

Universal Observations

We next set out to determine which developmental observations mapped onto all four milestone checklists. 40 of the 728 observations (5.5%) were associated with milestones from all four checklists. Table 4 shows a list of these 40 “universal” observations. Among the 40 universal observations, over 40% (17 of 40) were in the motor domain. In addition, of the 160 milestones associated with these 40 universal observations, 130 (81.3%) represented skills that occurred at 36 months or younger (Figure 2A).

Table 4:

Universal observations, referenced by all four analyzed checklists

Motor/Physical Development
  • Chest up in prone position (1–3m)

  • Supports upper body with arms when lying on stomach (2–4m)

  • Sits without support steadily (6–9m)

  • Moves easily on hands and knees (9–12m)

  • Pulls to stand (9–12m)

  • Walks well (14–24m)

  • Throws ball overhand in specific direction (24–48m)

  • Throws overhand (24–48m)

  • Throws ball overhand 10 feet (24–48m)

  • Kicks ball with demonstration (22v24m)

  • Skips (60–72m)

  • Walks up stairs with support, putting both feet on each step (16–24m)

  • Walks up stairs with support, alternating feet (18–36m)

  • Walks up stairs without support, alternating feet (36–48m)

  • Walks down stairs with support, putting both feet on each step (20–24m)

  • Balances on one foot for 10 seconds (60–72m)

  • Hops on one foot 15 times (60–72m)

Language/Communication
  • Makes sounds to show joy and displeasure (4–7m)

  • Begins to respond to name (5–7m)

  • Produces immature jargoning (12–13m)

  • Produces reduplicative babble with consonants (eg. “ma-ma-ma”, “wa-wa-wa) (6–9m)

  • Copies gestures (eg. waving bye bye) (9–15m)

  • Uses simple gestures (8–18m)

  • Follows one-step command with gesture (12–16m)

  • Follows two-step command (24–36m)

  • Follows three-step command (36–72m)

  • Speaks two-word sentence (noun with verb) (24m)

  • Is understandable 75% of the time to unfamiliar listeners (36–48m)

  • Uses pronouns correctly (36–72m)

Social/Emotional
  • Dresses and undresses without assistance (36–60m)

  • Imitates activities of adults and older children (24–36m)

  • Has separation anxiety (9–12m)

  • Shy of anxious with strangers (6–12m)

  • Engages in pretend play with other people (eg. Tea party, birthday party) (18–30m)

Cognitive
  • Bangs two cubes together (9–12m)

  • Puts objects into container (12–15m)

  • Scribbles spontaneously (15–24m)

  • Draws a 2-part person (36–48m)

  • Draws a 3-part person (36–48m)

  • Copies triangle (60–72m)

Figure 2: Histograms of age distribution for milestones.

Figure 2:

A: A total of 160 milestones were associated with the 40 universal observations found in all 4 systems. 130 of those milestones represent skills between 0 and 36 months of age. B: A total of 418 milestones were associated with the 130 observations found in at least 3 of the 4 systems. 322 of those milestones represent skills between 0 and 36 months of age.

Given the small number of universal observations, we next determined which observations were associated with milestones across three of four checklists. 90 (12.4%) additional observations were identified. We then used these set of observations to analyze the degree of content consensus across checklists. Of these 90 observations, each checklist contributed to varying degrees, with Bright Futures contributing to the fewest observations: CDC 83/90 (92%); Pediatrics in Review 81/90 (90%); Healthy Children 64/90 (71%), Bright Futures 38/90 (42%).

Age Concordance

Variability in milestones sources has been previously observed, but not specifically analyzed in a data driven manner. During the development of the observation-milestone relational database (see methods) we frequently noted that the target age for milestones differed between checklists.

Using the finalized observation-milestone relational database, we were able to formally assess the degree of these age discrepancies (see methods for description of analysis, Figure 1).

Of those 130 observations mapped to milestones in at least 3 of the 4 checklists, 26.9% (35/130) mapped to milestones that were discordant in their associated age range. Within the 40 universal observations, just over half (22) had age concordance between all four checklists, while the majority (36) had age concordance between milestones from three checklists. For the 130 observations covered by at least three milestone checklists, 73.1% (95/130) had age concordance between at least 3 checklists, while 98.5% (128/130) had age concordance between at least two checklists. Table 5 shows the list of 22 milestones that were both present in all four milestone checklists and had consistent expected ages in all four checklists.

Table 5:

Universally-agreed observations and their expected ages

Observation CDC Healthy Children Bright Futures Peds in Review
Supports upper body with arms when lying on stomach 4 3 2 3
Makes sounds to show joy and displeasure 6 7 4 5
Begins to respond to name 6 7 6 5
Sits without support steadily 6, 9 7 6 7
Moves easily on hands and knees 9 12 9 10
Pulls to stand 9 12 9 9
Copies gestures (like waving bye bye) 9, 12 12 12, 15 10
Immature jargoning: inflection without real words 12 12 12 13
Uses simple gestures 12, 18 12 12 8, 10
Puts objects into container 12 12 15 15
Follows one-step command with gesture 12 12 12, 15 12
Walks up stairs with support, putting both feet on each step 18 24 18, 24 18, 22
Walks down stairs with support, putting both feet on each step 24 24 24 20, 24
Kicks ball with demonstration 24 24 24 22
Two-word sentence (noun + verb) 24 24 24 24
Follows two-step instruction 24, 36 24 24 24
Walks up stairs without support, alternating feet 36 48 36 36
Is understandable to others 75% of the time by unfamiliar listeners 36 48 36 36
Skips 60 60 72 60
Copies triangle 60 60 72 60
Balances on one foot for 10 seconds 60 60 72 60
Hops on one foot 15 times 60 60 72 60

DISCUSSION

Developmental surveillance is an ongoing process in which providers both elicit caregiver concerns about their child’s development and systematically track their developmental progress in order to identify risk of delays. Combined ongoing surveillance and periodic screening is recommended by the AAP, and improves identification of developmental delays than either strategy used alone22. Here we report that the milestone checklists clinicians and caregivers often rely on as part of developmental surveillance can be vague, surprisingly inconsistent in content, and are often biased toward skills occurring between 0–36 months, as well as gross motor skills. The results from this study also highlight inconsistencies in information provided about expected ages for milestone achievement. It should be noted that while the milestone checklists analyzed were aimed at different audiences (providers vs. caregivers), the cited sources for these checklists have considerable overlap. Despite this, there was surprisingly low overlap in content, and only 40 developmental observations were present in all four checklists. Of the 90 developmental observations associated with milestones from at least three checklists, three systems had strong concordance, while Bright Futures did not, contributing to less than half of the 90 observations.

Content of milestones was also skewed toward specific developmental domains. Over 40% of these 40 universal milestones fell in the motor domain, while only 10% fell in the social-emotional domain, perhaps reflecting the dearth of research in typical social-emotional development. This also highlights the need for more comprehensive and validated social-emotional milestones that may improve earlier identification of related disorders such autism spectrum disorders or mood disorders, such as anxiety.

Furthermore expected age concordance between milestones from different checklists was low. Of the 130 observations mapped to milestones in at least 3 of the 4 checklists, over 25% were associated with milestones with discordant target ages. Some of this discordance is likely explained by variability in whether milestone checklists report expected ages that correspond to the 50th percentile. Of the four checklists analyzed in this study, the Pediatrics in Review article and Bright Futures specifically state they report the 50th percentile, while CDC: Learn the Signs. Act Early and Healthy Children: Ages and Stages do not provide details. Knowing that this variability would be present, we developed an age-concordance analysis which accepted liberal differences between checklists. Despite this, many milestones greatly disagreed in their expected ages. Another likely reason for poor age-concordance is the vaguely defined nature of many of the milestones. For example, the CDC milestone “Dresses and undresses self” versus the Healthy Children’s milestone “Dresses and undresses without assistance” seem similar in description, however the CDC target age is 36 months and the Healthy Children’s target age is 60 months. Dressing independently requires increasing ability depending on the type of clothing (eg. buttons, zippers), and therefore could be accomplished at a variety of ages. To improve consistency amongst milestones and their target ages, milestones need to be written to both reduce ambiguity, but also acknowledge that the targeted skill may be demonstrated in multiple ways.

The results from this study raise questions around the effectiveness of using milestones checklists as part of ongoing developmental surveillance, and emphasize the importance of using validated screening tools with defined age-norms in order to identify children with delays. This study also demonstrates the need for significantly more research and review of developmental milestones to improve consistency, and in turn usability by clinicians, caregivers, and researchers.

Limitations

There are many milestone checklists available to providers and caregivers. This analysis only considered four of these checklists. Therefore, it is possible that other checklists could be more closely matched. However, we attempted to reduce variability between checklists by using checklists with common references. Notably, three of the four checklists included in this analysis are published by the American Association of Pediatrics, and the 4th checklist, the CDC: Learn the Signs. Act Early, uses overlapping references based on Bright Futures 3rd Edition and Healthy Children.

Future Directions

The results of this study highlight the need for objectively defined and accurately normed milestones. This will require large scale monitoring of milestones across a geographically, racially, and socioeconomically diverse population. The electronic health record (EHR) is an ideal platform for such large scale data collection and has the potential to provide rich data sets that would allow for further analysis of what milestones predict later neurodevelopmental diagnoses. EHRs have also been identified as a vehicle to improve rates of developmental surveillance and screening6,23. However there has been slow implementation of developmental milestones into EHR platforms. Variability in the format, terminology, and public domain availability of developmental surveillance and screening tools make integration of developmental milestones into EHR systems challenging.9,23. With strong support from the AAP, Health Level Seven International, an international standards organization that produces standards for transfer of clinical and administrative data between software systems, recently published standards for how developmental screening should be incorporated into EHRs.24 However, while these standards would require EHRs to prompt providers to complete developmental surveillance and screening, they fall short of requiring full integration of developmental milestone checklists or selected developmental screeners.

Virtually every aspect of the pediatric health record has a standardized coding system. There are systems for diagnoses (Systematized Nomenclature of Medicine Clinical Terms- SNOMED CT25, International Classification of Disease, 10th Revision - ICD1026), as well as for medications (RxNorm27), procedures (Current Procedural Terminology - CPT28), and labs (Logical Observation Identifiers Names and Codes - LOINC29,30). While many of these systems are used for billing purposes, they also provide a universal language across electronic health records (EHRs) allowing for robust large-scale biomedical research. Creation of a standardized coding system for developmental milestones is the first step in integrating milestone documentation and potentially integrating milestone-based validated developmental screeners into the EHR. Improved and more efficient tracking of milestones may allow providers to focus their time on other aspects of developmental surveillance, including eliciting parental concerns and assessing for other risk factors that may affect development. Finally, successful integration of developmental milestones into an EHR would facilitate much needed population-based research allowing for more accurate estimates of when developmental skills are accomplished in both the general population but also in within specific neurodevelopmental disorders.

To aid in the development of a standardized coding system, we are sharing the ontology of developmental observations and associated milestones we created as part of this project. Called the Index of Developmental Observations (IDOB – idob.info), it is freely available as a resource for researchers, EHR vendors, and the producers of milestones and developmental screeners to standardize the production or analysis of developmental data.

CONCLUSION

Systematic development and evaluation of a developmental observation-milestone relational database uncovered variability and inconsistency across four commonly used milestone checklists. Reducing inconsistency and creating a standardized system for tracking developmental milestones are crucial steps toward increasing the rate of developmental surveillance and screening in the primary care setting.

Funding Sources:

CLW was supported by The National Institutes of Health (1T32MH112510)

Abbreviations:

AAP

American Academy of Pediatrics

BF

Bright Futures

CDC

Center for Disease Control

CPT

Current Procedural Terminology

EHR

Electronic Health Record

HC

Healthy Children

ICD10

International Statistical Classification of Diseases and Related Health Problems

IDOB

Index of Developmental Observations

LOINC

Logical Observation Identifiers Names and Codes

PIR

Pediatrics in Review

SNOMED CT

Systematized Nomenclature of Medicine Clinical Terms

Footnotes

Financial Disclosure: All authors have indicated they have no financial relationships relevant to this article to disclose.

Conflict of Interest: The authors have indicated they have no potential conflicts of interest to disclose.

REFERENCES

RESOURCES