Abstract
Strengthening systems of care to meet the needs of individuals with autism spectrum disorder (ASD) is of growing importance. Administrative data provide advantages for research and planning purposes, including large sample sizes and the ability to identify enrollment in insurance coverage and service utilization of individuals with ASD. Researchers have employed varying strategies to identify individuals with ASD in administrative data. Differences in these strategies can limit the comparability of results across studies. This review describes implications of the varying strategies that have been employed to identify individuals with ASD in US claims databases, with consideration of the strengths and limitations of each approach.
Keywords: Health services research, Claims data, Autism spectrum disorder, Case-finding algorithms
Autism spectrum disorder (ASD) is a developmental disability defined by deficits in social communication and social interaction and the presence of restricted, repetitive patterns of behavior, interests, or activities. These symptoms can persist with varying degrees throughout life. ASD is also often referred to as pervasive developmental disorder (PDD). The fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) combines what in the fourth edition, DSM-IV, were classified as four independent diagnoses—autistic disorder, Asperger syndrome, pervasive developmental disorder-not otherwise specified and childhood disintegrative disorder—into a single diagnostic category, ASD (American Psychiatric Association, 1994, 2013).
Administrative databases with person-level information on diagnoses, services received, and provider charges or payments have increasingly been used for health services research due to their ready availability, low cost, and the opportunity to assess real-world treatment patterns for large numbers of individuals with chronic or acute disorders (Riley, 2009; Vaughan Sarrazin & Rosenthal, 2012). The two major types of US administrative healthcare data are hospital discharge databases, which report hospital-based encounters that typically cannot be linked to unique patients, and insurance claims databases that track services received by individuals across inpatient and outpatient settings, including prescription medications (Grosse et al., 2020; Riley, 2009). Hospital discharge databases have the advantage of representing the entire population whereas claims databases are restricted to individuals covered by health plans that contribute data. Our focus in this review is analyses of US health insurance databases, which contain billing claims but not certified medical diagnoses.
Researchers who analyze US health administrative data for conditions, such as ASD, generally use diagnosis codes developed for billing purposes as proxies for medical diagnoses. However, methodological nuances and challenges in the application of diagnosis codes in administrative data can hinder the accurate ascertainment of individuals with the conditions of interest (Hinds et al., 2016; McPheeters et al., 2013a; Vaughan Sarrazin & Rosenthal, 2012). The sensitivity and specificity of billing codes are variable, depending on both the condition of interest (Quan et al., 2008; Rector et al., 2004) and the setting of care. Inpatient coding is typically highly specific, since hospitals have trained coders and standardized quality assurance processes for billing claims, whereas diagnosis codes in outpatient claims are more likely to be false-positives due to coding errors (Andrade et al., 2013; McPheeters et al., 2013b; Metcalfe et al., 2014; Mullooly et al., 2008; Ronald et al., 2017; Sickbert-Bennett et al., 2011; Worth & Mytinger, 1996). In the US context, such differences can also result from inpatient diagnosis codes receiving closer scrutiny from payers because they affect reimbursements, whereas reimbursements for outpatient claims are influenced by procedure codes and not by diagnosis codes (Lanes et al., 2015). In addition, false-positive diagnosis codes can represent “rule-out” billing codes for evaluation visits, laboratory tests or imaging procedures.
To improve specificity, researchers who analyze claims data often require more than one outpatient claim on different days. For example, the positive predictive value (PPV) for a single outpatient claim with a code for muscular dystrophy in one study was 22.6%, but an algorithm with one inpatient claim or two or more outpatient claims at least 30 days apart with specified diagnosis codes had a PPV of 59.3% (Smith et al., 2017). The Center for Medicare and Medicaid Services (CMS) Chronic Conditions Data Warehouse lists case-finding algorithms for 66 chronic or potentially disabling conditions (including ASD since 2013), most of which require the presence of a diagnosis code on either one inpatient claim or two or more non-inpatient or non-drug claims within a 2-year reference period (Centers for Medicare and Medicaid Services, 2019). For sickle cell disease, most researchers require the presence of diagnosis codes in either one inpatient claim or two or more outpatient claims on separate days or three or more claims in any setting on separate days (Grosse et al., 2020).
Algorithms can also miss individuals (false-negative diagnoses) for at least one of the following reasons: (1) the individual had no encounters during the study period or the encounter was billed to a separate insurance type; (2) the individual received a diagnosis, but it was not included in medical charts; (3) the diagnosis was included in medical charts but not listed on a claim during the study period; (4) the diagnosis was listed on a claim, but it was not recorded in the billing database; or (5) the individual received a diagnosis, but it was incorrectly recorded in the billing database.
Claims databases may include records of encounters for individuals enrolled in both fee-for-service (FFS) and managed care plans. Technically, FFS records represent claims for reimbursement, whereas managed care plans include records for encounters with diagnosis codes and imputed payments. However, the completeness of records from managed care plans varies, since payers may insert the imputed capitated rate or average service experience of all enrollees instead of the unique service experience of individuals. In addition, some health plans “carve out” behavioral health services that are paid under separate contracts (Frank & Garfield, 2007); consequently claims data for such plans may miss important information on services for children with ASD.
Although there are inherent limitations in the use of administrative claims data, the proportion of individuals correctly classified using case-finding algorithms in claims data can vary based on a number of decisions made by the research team, such as the choice of diagnosis codes included, the number of claims required (e.g., at least one vs. two or more), dates on which claims occur, the age range, enrollment criteria, health plan type, and coding quality.
In this paper, we review the approaches that have been used with US administrative claims and encounters data to classify children as having ASD. Specifically, we review studies that used International Classification of Diseases, Ninth Revision, Clinical Modifications (ICD-9-CM) diagnosis codes. The Center for Medicare and Medicaid Services (CMS) required that US healthcare providers use ICD-9-CM codes through September 30, 2015 or International Classification of Diseases, Tenth Revision, Clinical Modifications (ICD-10-CM) codes beginning on October 1, 2015. The 299.x ICD-9-CM diagnosis codes for ASD and the 330.8 code for Rett syndrome and the corresponding F84.x ICD-10-CM codes are shown in Table 1. Rett syndrome is not included in the DSM-5 case definition for ASD but can be used as a genetic specifier for a case of ASD that also meets diagnostic criteria for Rett syndrome (American Psychiatric Association, 2013; Reichow et al., 2015).
Table 1.
Condition | ICD-9-CM codesa | ICD-10-CM codesa |
---|---|---|
Autistic disorder | 299.00, 299.01 | F84.1 |
Childhood disintegrative disorder | 299.10, 299.11 | F84.3 |
Rett syndrome | 330.8 | F84.2 |
Asperger’s syndrome | 299.80, 299.81 | F84.5 |
Other pervasive developmental disorders | 299.80, 299.81 | F84.8 |
Pervasive developmental disorder, unspecified | 299.90, 299.91 | F84.9 |
ICD-9-CM International Classification of Diseases, Ninth Revision, Clinical Modifications, ICD-10-CM International Classification of Diseases, Tenth Revision, Clinical Modifications
ICD-9-CM recommended for use by US healthcare providers through September 30, 2015
ICD-10-CM recommended for use by US healthcare providers starting October 1, 2015
These codes are consistent with the definition of autism spectrum disorder in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders
In the Discussion section, we briefly summarize results from six published validation studies that have used record linkages of administrative healthcare data with ASD diagnosis codes to clinical data used to identify confirmed or probable ASD cases (Bickford et al., 2020; Burke et al., 2014; Coleman et al., 2015; Coo et al., 2018; Dodds et al., 2009; Rotem et al., 2020). The ultimate purpose of this review is to facilitate researchers’ ability to assess the potential implications of the choice of claims-based algorithms for ASD.
Case-Finding Algorithms for Autism Spectrum Disorder
We conducted a scoping review of US studies indexed in PubMed from January 2006 through February 2020 that examined claims with ICD-9-CM diagnosis codes in healthcare administrative databases, including claims with both outpatient and inpatient encounters in their analyses, in order to identify individuals with suspected or presumed ASD or PDD. A scoping review provides for the structured capturing of relevant literature but does not include an assessment of the quality of each research article. Searches on terms included in either article titles or abstracts are listed in supplemental Table S1, which yielded a total of 1,503 publications. Two authors reviewed all article titles and abstracts and reached consensus about articles that met the study criteria.
We excluded studies that did not use US data or may have used ICD-9-CM codes but also relied on other types of data for case ascertainment, such as survey or surveillance data. Likewise, studies that combined administrative healthcare data with other types of data, such as medical records or school records, were not included in our primary review. Electronic health records were not included because they include diagnoses obtained from both encounters and patient problem lists. We also excluded studies that used claims data to identify possible cases for subsequent confirmation or subsets of cases of individuals with ASD based on use of specific types of services (e.g., behavioral health services) or specific procedure codes or co-occurring diagnoses, such as anxiety and depression. We excluded two studies that identified individuals with ASD as a subset of individuals with a broader group of diagnoses of intellectual or developmental disabilities (McDermott et al., 2018; Phillips et al., 2019). Finally, we excluded studies that attempted to identify incident rather than prevalent cases of ASD.
The inclusion and exclusion criteria and definition were established to minimize bias from studies that selected only a subset of individuals with ASD. Studies that combined administrative healthcare data with other sources, such as school records, were excluded since ASD diagnoses in education records may have greater predictive accuracy than those in healthcare administrative data (Coo et al., 2018). From the list of studies identified, the title, authors, PubMed ID, and year of publication were extracted and classified as either meeting the inclusion criteria or categorized by which exclusion criteria each article met. A total of 63 studies that met our inclusion and exclusion criteria are summarized in Table 2.
Table 2.
Study | ICD-9/10-CM codes used to include or exclude ASD cases (exclusion criteria in parentheses) | Type of algorithma | Years of data used for case ascertainment | Continuous enrollment requirement (months) | Age range (years) | Type of health plans or data source |
---|---|---|---|---|---|---|
Barry et al. (2017) | 299.xx | B1 | 2008–2012, all years used | None | 0 to 21 | Private |
Barry et al. (2019) | 299.xx | C1 | 2008–2012, all years used | None | 0 to 21 | Private |
Bishop-Fitzpatrick and Rubenstein (2019) | 299.0x, 299.8x, and 299.9x | B1 | 2012–2015, all years used | None | 40 and older | Fee-for-service Medicaid |
Burke et al. (2014) | 299.0x, 299.8x, and 299.9x (excluded cases with 299.1x or 300.8) | B1 | 2001–2009, all years used | 12 (6 months before and after claim | 2 to 20 | Private |
Candon et al. (2018) | 299.xx | B1 | 2008–2012, all years used | None | 0 to 21 | Private |
Candon et al. (2019) | 299.xx | B1 | 2008–2012, all years used | None | < 20 | Private |
Chi et al. (2016) | 299.xx | A1 | 2003–2011, all years used | 11–12 | 3 to 17 | Medicaid |
Cidav et al. (2013) | 299.xx | C2 | 2005 | 12 | 3 to 20 | Fee-for-service Medicaid |
Cidav et al. (2014) | 299.xx | C2 | 2005 | 0 to 20 | Fee-for-service Medicaid | |
Cidav et al. (2018) | 299.00, 299.8, 299.9 | C1 | 2001–2007, all years used | 6 months | 2 to 17 | Medicaid |
Cohrs and Leslie (2017) | 299.0x, 299.8x, and 299.9x | B1 | 2011 | None | 1 to 17 | Private |
Coleman et al. (2015) | 299.0x, 299.8x, and 299.9x | B1 | 1995–2010, all years used | None | Under 18 in 2010 | Mental Health Research Network |
Croen et al. (2006) | 299.0x and 299.8x | A1 | 2003–2004, 12 months | 12 | 2 to 18 | HMO |
Cummings et al. (2016) | 299.0x, 299.8x, and 299.9x | B1 | 2009–2010, all years used | 10 | 3 to 17 | Mental Health Research Network |
Daniels and Mandell (2013) | 299.0x or 299 | C2 | 2001–2005, all years used | 10 months each year from birth to ASD diagnosis | Born in 2001 | Medicaid |
Flanders et al. (2006) | 299.0x, 299.1x, 299.9x and 330.8 | A1 | January 2001–June 2003, all years used | 90 days before & 180 days after diagnosis | 3 to 17 | Private |
Flanders et al. (2007) | 299.0x, 299.1x, and 299.8x | A1 | 1996–2002, annual | 90 days before & 180 days after diagnosis | 3 to 17 | Medicaid |
Heifert et al. (2016) | 299.0x, 299.8x, and 299.9x | B1 | October 2000–September 2013, all years used | Enrollment required 6 months pre- and post-diagnosis | 2 to 18 | Military Health System |
Hisle-Gorman et al. (2018) | 299.0x, 299.8x, and 299.9x, (excluded cases with 299.1x or 330.8) | B1 | October 2000–September 2013, all years used | None | 2 to 18 | Military Health System |
House et al. (2016) | 299.xx | A1 | 2007–2010, all years used | None | 0 to 17 | Private |
Houghton et al. (2017) | 299.0x, 299.8x, and 299.9x | B1 | 2014 | None | 3 to ≥ 50 | Private and Medicaid |
Jain et al. (2014) | 299.0x, 299.8x, and 299.9x (excluded cases with 299.1x or 300.8x) | B1 | 2001–2009, all years used | 6 | 0 to 20 | Private |
Jain et al. (2015) | 299.0x, 299.8x, and 299.9x | B1 | 2001–2012, all years used | 60 | Cumulative to ages 5–11 | Private |
Jariwala-Parikh et al. (2019) | 299.xx | A1 | 2006–2008, all years used | Continuous | 18 to 64 | Medicaid |
Kalb et al. (2019) | 299.xx | B1 | 2010–2013, all years used | 12 | 12 to 17 | Private |
Kang-Yi et al. (2016) | 299.xx | B2 | October 2008–September 2009 | None | 5 to 17 | Medicaid |
Kennedy-Hendricks et al. (2018) | 299.xx | B1 | 2008–2012, all years used | None | 10 to 21 | Private |
Khanna et al. (2013) | 299.xx | A1 | 2007 | 12 | Under 65 | Fee-for-service Medicaid |
Lee et al. (2018) | 299.0x, 299.8x, and 299.9x (excluded cases with 299.1x or 300.8) | B1 | 2000–2013, all years used | 12 | 2 to 18 | Military Health System |
Leslie and Martin (2007) | 299.xx | A1 | 2000–2004, annual | None | 0 to 17 | Private |
Liu et al. (2017) | 299.0x and 299.8x | B1 | 2005–2013, all years used | None | 12 to 21 | Private |
Liu et al. (2019) | 299.0x and 299.8x | B1 | 2005–2013, all years used | None | 12 to 21 | Private |
Mandell et al. (2006) | 299.xx | B1 | 1994–1999, annual | None | 0 to 21 | Fee-for-service Medicaid |
Mandell et al. (2008) | 299.00, 299.8, and 299.9 | A1 | 2001 | None | 0 to 21 | Medicaid |
Mandell et al. (2010) | 299, 299.0x, 299.1x, and 299.8x | C1 | 2004 | 9 | 0 to 21 | Medicaid |
Mandell et al. (2012) | 299.0x, 299.8x, and 299.9x | B2 | May 2003–October 2003 | None | 5 to 21 | Medicaid |
Mandell et al. (2016) | 299.xx | A1 | 2008–2012, all years used (monthly prevalence estimates) | None | 0 to 21 | Private |
Mandell et al. (2019) | 299.xx | B1 | 2008–2012, all years used | None | 0 to 21 | Private |
Matone et al. (2012) | 299.xx | A1 | 2002–2007, all years used | 10 | 3 to 18 | Medicaid |
McDermott et al. (2008) | 299.0x, 299.8x, and 299.9x | A1 | 2003 | 12 | 1 to 17 | Medicaid |
Nathenson and Zablotsky (2017) | 299.x | C2 | 2000–2013, all years used | 12 | 16 to 23 | Private |
Oswald and Sonenklar (2007) | 299.xx | A1 | 2002 | None | 0 to 20 | Private |
Peacock et al. (2012) | 299.0x and 299.8x | C3 | 2003–2005, all years used | 11 | 1 to 17 | Medicaid |
Peng et al. (2009) | 299.xx and 330.8 | A1 | 1998–2004, all years used | None | 0 to 20 | Medicaid |
Rubenstein and Bishop (2019) | 299.0x, 299.8x, 299.9x, F84.0, F84.5, and F84.9 | B1 | 2008–2018, all years used | None | ≥ 21 | Medicaid |
Rubin et al. (2009) | 299.0x, 299.8x, and 299.9x | A1 | 2001 | None | 3 to 18 | Medicaid |
Saloner and Barry (2019) | 299.xx | B3 | 2009–2013, all years used | None | 0 to 18 | Private & state employee PPO plans |
ASD autism spectrum disorder, HMO health maintenance organization, ICD-9-CM International Classification of Diseases, Ninth Revision, Clinical Modifications, ICD-10-CM International Classification of Diseases, Tenth Revision, Clinical Modifications
Type of algorithm: (A1) No second claim needed; first claim in any position, (A2) At least one claim in a primary diagnosis field is required, (B1) 2 or more claims, separate days/encounters, (B2) 2 or more claims, separate days/encounters, both in first field, (B3) 2 or more claims, separate days/encounters, at least one in first field, (C1) 2 or more claims on separate days/encounters or 1 inpatient claim, (C2) 2 or more claims in first position on separate days/encounters or 1 inpatient claim
ICD-9-CM Codes
The 63 studies used the presence of either 3-digit ICD-9-CM diagnosis code 299 or a subset of 4- or 5-digit ASD coded billing claims to identify potential ASD/PDD cases. The four 4-digit ICD-9-CM codes used for ASD, along with the DSM-IV and ICD-9-CM definitions, are 299.0 for autistic disorder (DSM-IV) or infantile autism (ICD-9-CM), 299.1 for childhood disintegrative disorder (DSM-IV) or disintegrative psychosis (ICD-9-CM), 299.8 for Asperger’s disorder and other specified PDD (DSM-IV) or other specified early childhood psychoses (ICD-9-CM), and 299.9 for unspecified PDD (ICD-9-CM) (American Psychological Association, 2002). Each 4-digit ICD-9 code has two 5-digit codes, ending in either 0 for “current or active state” or 1 for “residual state,” a distinction in DSM-III that was dropped from DSM-IV (Volkmar, 2013). One of the 63 studies used both the ICD-9-CM 299.x codes and the corresponding ICD-10-CM codes of F84.x (Rubenstein & Bishop, 2019). Given that the level of specificity of the 5-digit ICD-9-CM codes was no longer considered clinically meaningful after the 1994 publication of DSM-IV, from hereon we refer to 4-digit ICD-9-CM codes unless otherwise specified.
The claims-based ASD algorithms used in these 63 studies differ based on the selection of diagnosis codes. Almost half of the included studies (n = 29) used all 299.x ICD-9-CM codes to ascertain presumed ASD/PDD cases (Barry et al., 2017, 2019; Candon et al., 2018, 2019; Chi et al., 2016; Cidav et al., 2013, 2014; House et al., 2016; Jariwala-Parikh et al., 2019; Kalb et al., 2019; Kang-Yi et al., 2016; Kennedy-Hendricks et al., 2018; Khanna et al., 2013; Leslie & Martin, 2007; Mandell et al., 2006, 2010, 2016; Matone et al., 2012; Nathenson & Zablotsky, 2017; Oswald & Sonenklar, 2007; Peng et al., 2009; Saloner & Barry, 2019; Shea et al., 2014, 2018; Stuart et al., 2017; Vohra et al., 2016, 2017; Wang et al., 2019; Williams et al., 2012). One of the 29 studies additionally listed a diagnosis code of 330.8 for Rett syndrome as an inclusion criterion for ASD (Peng et al., 2009).
The remaining 34 studies excluded one or more of the 299.x codes. Most of those studies (n = 22) excluded the 299.1 code for childhood disintegrative disorder from the codes used to identify ASD cases but used all other codes, 299.0, 299.8, and 299.9 (Bishop-Fitzpatrick & Rubenstein, 2019; Burke et al., 2014; Cidav et al., 2018; Cohrs & Leslie, 2017; Coleman et al., 2015; Cummings et al., 2016; Heifert et al., 2016; Hisle-Gorman et al., 2018; Houghton et al., 2017; Jain et al., 2014, 2015; Lee et al., 2018; Mandell et al., 2008, 2012; McDermott et al., 2008; Rubenstein & Bishop, 2019; Rubin et al., 2009; Shedlock et al., 2016; Sigmon et al., 2019; Spencer et al., 2013; Vargason et al., 2019; Wang & Leslie, 2010). Eight of those 22 studies also excluded from their ASD case definition any child who had claims with codes of 299.1 or 330.8 associated with either childhood disintegrative disorder or Rett syndrome even if they also had claims with codes of 299.0, 299.8, or 299.9 (Burke et al., 2014; Hisle-Gorman et al., 2018; Jain et al., 2014; Lee et al., 2018; Shedlock et al., 2016; Sigmon et al., 2019; Spencer et al., 2013; Vargason et al., 2019).
Twelve studies used other combinations of ICD-9-CM codes. Six used just the 299.0 and 299.8 codes, excluding both 299.1 and 299.9 codes (Croen et al., 2006; Liu et al., 2017, 2019; Peacock et al., 2012; Shimabukuro et al., 2008; Wang et al., 2013). Five studies used the combination of 299.0, 299.1, and 299.8 codes, excluding just 299.9 (Flanders et al., 2006, 2007; Mandell et al., 2010; Schubart et al., 2014; Stein et al., 2012). One of those studies additionally listed a diagnosis code of 330.8 for Rett syndrome as an inclusion criterion for ASD (Flanders et al., 2006). Finally, one study was restricted to claims with a 299.0 code for autistic disorder or a 299 3-digit code without a modifier (Daniels & Mandell, 2013).
Numbers of Claims
Algorithms also differ in the minimum number of claims on separate dates and whether they treat claims differentially based on care setting (inpatient vs. outpatient), or diagnosis field (principal vs. other). The primary distinction is between studies that required just one ASD claim and studies that required two or more ASD claims on separate dates to establish presumptive diagnosis of ASD.
We found 19 studies that considered a claim with the presence of a single ASD diagnosis code in any setting to be sufficient to identify someone with ASD. Of the 19 studies that required just one code, 17 did not specify diagnosis field (Chi et al., 2016; Croen et al., 2006; Flanders et al., 2006, 2007; House et al., 2016; Jariwala-Parikh et al., 2019; Khanna et al., 2013; Leslie & Martin, 2007; Mandell et al., 2008, 2016; Matone et al., 2012; McDermott et al., 2008; Oswald & Sonenklar, 2007; Rubin et al., 2009; Shimabukuro et al., 2008; Wang & Leslie, 2010; Williams et al., 2012). Two studies required a claim with an ASD code as the first-listed diagnosis code (Stein et al., 2012; Stuart et al., 2017).
Of the 44 other studies listed in Table 2, 31 required two claims with ASD codes on separate dates in any setting, either in any diagnosis field (Barry et al., 2017; Bishop-Fitzpatrick & Rubenstein, 2019; Burke et al., 2014; Candon et al., 2018, 2019; Cohrs & Leslie, 2017; Coleman et al., 2015; Cummings et al., 2016; Heifert et al., 2016; Hisle-Gorman et al., 2018; Houghton et al., 2017; Jain et al., 2014, 2015; Kalb et al., 2019; Kennedy-Hendricks et al., 2018; Lee et al., 2018; Liu et al., 2017, 2019; Mandell et al., 2006, 2019; Peng et al., 2009; Rubenstein & Bishop, 2019; Shea et al., 2018; Shedlock et al., 2016; Sigmon et al., 2019; Spencer et al., 2013; Vargason et al., 2019; Wang et al., 2019) or in a first-listed diagnosis field (Kang-Yi et al., 2016; Mandell et al., 2012; Saloner & Barry, 2019). The remaining 13 studies treated one ASD claim in an inpatient setting as equivalent in presumed validity to two outpatient ASD claims on separate dates, either in any diagnosis field (n = 9) (Barry et al., 2019; Cidav et al., 2018; Mandell et al., 2010; Peacock et al., 2012; Schubart et al., 2014; Shea et al., 2014; Vohra et al., 2016, 2017; Wang et al., 2013) or in a principal diagnosis field (n = 4) (Cidav et al., 2013, 2014; Daniels & Mandell, 2013; Nathenson & Zablotsky, 2017). One of the 13 studies required outpatient claims for ASD to be separated by at least 30 days (Peacock et al., 2012).
Reference Period
Another dimension that might affect the predictive power of an algorithm for ASD case ascertainment as well as the characteristics of identified cases is the length of time over which claims are assessed, which varied greatly. The reference period over which administrative data were searched to ascertain ASD cases was not necessarily the total number of years of data analyzed. In addition, studies did not necessarily require continuous enrollment throughout the reference period. The length of the reference period was 6 months in one study (Mandell et al., 2012) and 1 year in 21 other studies (Cidav et al., 2013, 2014; Cohrs & Leslie, 2017; Croen et al., 2006; Flanders et al., 2007; Houghton et al., 2017; Kang-Yi et al., 2016; Khanna et al., 2013; Leslie & Martin, 2007; Mandell et al., 2006, 2008, 2010; McDermott et al., 2008; Oswald & Sonenklar, 2007; Rubin et al., 2009; Schubart et al., 2014; Shea et al., 2014, 2018; Stein et al., 2012; Wang & Leslie, 2010; Wang et al., 2013). Many of those studies included multiple years of claims data, with repeated cross-sections of annual data used to identify cases in specific years.
The reference period for case ascertainment was 2–3 years in four studies (Cummings et al., 2016; Flanders et al., 2006; Jariwala-Parikh et al., 2019; Peacock et al., 2012), 4–5 years in 13 studies (Barry et al., 2017, 2019; Bishop-Fitzpatrick & Rubenstein, 2019; Candon et al., 2018, 2019; Daniels & Mandell, 2013; House et al., 2016; Kalb et al., 2019; Kennedy-Hendricks et al., 2018; Mandell et al., 2016, 2019; Saloner & Barry, 2019; Williams et al., 2012) and 6–7 years in five studies (Cidav et al., 2018; Matone et al., 2012; Peng et al., 2009; Stuart et al., 2017; Wang et al., 2019). Finally, 19 studies searched 9 or more years of data to identify ASD cases (Burke et al., 2014; Chi et al., 2016; Coleman et al., 2015; Heifert et al., 2016; Hisle-Gorman et al., 2018; Jain et al., 2014, 2015; Lee et al., 2018; Liu et al., 2017, 2019; Nathenson & Zablotsky, 2017; Rubenstein & Bishop, 2019; Shedlock et al., 2016; Shimabukuro et al., 2008; Sigmon et al., 2019; Spencer et al., 2013; Vargason et al., 2019; Vohra et al., 2016, 2017). One of the latter studies reported a primary analysis that searched 11 years of claims data (1993–2003) for ASD codes and a secondary analysis restricted to 1 year of data, 2003, to identify current-year ASD cases (Shimabukuro et al., 2008).
Discussion
Of the 63 studies that met our inclusion criteria (Table 2), 29 included all four 4-digit 299.x ICD-9-CM codes for ASD. Of 34 studies that used subsets of those codes, most (n = 27) excluded the 299.1 code for childhood disintegrative disorder. The DSM-5 in 2013 explicitly classified ASD as encompassing childhood disintegrative disorder. However, the DSM-5 excluded Rett syndrome from ASD, although if another qualifying diagnosis of ASD was made a child with a diagnosis of Rett syndrome (ICD-9-CM code 330.8; ICD-10 code F84.2) should not be excluded (Reichow et al., 2015). The two studies that listed 330.8 as an inclusion criterion were published in 2006 and 2009. All 10 studies that excluded individuals with a 330.8 code, regardless of the presence of ASD diagnosis codes, were published in 2013 or later, even though that exclusion is inconsistent with the DSM-5 protocol.
The minimum number of claims with ASD diagnosis codes, either overall or by setting type (inpatient or outpatient), also varied. Of the three main approaches, 19 studies required a minimum of one ASD claim in any setting, 31 required two or more ASD claims in any setting, and 13 required the presence of an ASD code in either one inpatient claim or two or more outpatient claims. Until recently, the presence of one claim for a clinical encounter with an ASD diagnosis code was commonly considered sufficient to establish a presumptive diagnosis of ASD. Among 23 studies published prior to 2014, 15 required a minimum of one claim with an ASD diagnosis code (Croen et al., 2006; Flanders et al., 2006, 2007; Khanna et al., 2013; Leslie & Martin, 2007; Mandell et al., 2008; Matone et al., 2012; McDermott et al., 2008; Oswald & Sonenklar, 2007; Peng et al., 2009; Rubin et al., 2009; Shimabukuro et al., 2008; Stein et al., 2012; Wang & Leslie, 2010; Williams et al., 2012). In contrast, among 40 studies published since 2014, just five had the same minimal requirement (Chi et al., 2016; House et al., 2016; Jariwala-Parikh et al., 2019; Mandell et al., 2016; Stuart et al., 2017).
The increasingly common pattern of case-finding algorithms for ASD requiring multiple outpatient claims on separate days with ASD codes may have been influenced by a widely cited 2014 publication of a validation study (Burke et al., 2014). Burke et al. found a high PPV (87%) relative to an expert clinical assessment of confirmed or probable ASD case status for an algorithm requiring an ASD code in two or more encounters in any setting in 8 years of records from a large health plan. Three subsequent validation studies from the United States and Canada similarly reported PPVs of 87–89% for algorithms requiring ≥ 2 claims or encounters with ASD diagnosis codes on separate dates, using 14–15 years of data (Bickford et al., 2020; Coleman et al., 2015; Coo et al., 2018).
Published analyses that cite these validation studies may not necessarily adhere to the recommendations of those studies. For example, many studies that cited the predictive value of the study by Burke et al. did not use the same diagnosis codes to identify presumed ASD cases that were used in that study. A recently published analysis of private health insurance data that required ≥ 3 ASD codes on separate encounters during a 6-year period cited Coleman et al. (2015) as their justification (Feroe et al., 2021), even though that validation study did not assess such an algorithm. The requirement of ≥ 3 diagnosis codes on separate encounters over 5 years of data has, however, been endorsed for use in identifying cases of sickle cell disease (Grosse et al., 2020).
On the other hand, requiring the presence of multiple claims with ASD diagnosis codes almost inevitably results in the exclusion of individuals with ASD. All five North American validation studies found that most children with ≥ 1 ASD-related claim were confirmed or probable ASD cases (Bickford et al., 2020; Burke et al., 2014; Coleman et al., 2015; Coo et al., 2018; Dodds et al., 2009). Indeed, one US study found that the majority of children with just 1 ASD claim had confirmed ASD diagnoses, although that study oversampled records from specialists, whose coding was more accurate (Burke et al., 2014). A recent study from Israel reported that among children with ≥ 1 ASD-related insurance claims, most were confirmed to have ASD through participation in a publicly funded program, and that chart reviews for the remaining children found that almost half met diagnostic criteria for ASD (Rotem et al., 2020).
A reasonable argument can be made for using the less restrictive case definition of ≥ 1 ASD-related claim or healthcare encounter, depending on the study purpose if maximizing sensitivity is considered more important than maximizing specificity. The first published validation study of ASD diagnosis codes suggested that maximizing sensitivity was most important and recommended that Canadian researchers use the presence of even 1 ASD diagnosis code in any administrative healthcare database (inpatient, outpatient physician, or outpatient mental health) be used to assign ASD case status (Dodds et al., 2009).
The choice of reference period over which claims are assessed for ASD codes also varied widely, from 1 year or less to more than 10 years. Most studies (n = 37) used 4 or more years of claims data as a reference period to ascertain ASD case status. Only five of those 37 studies were published prior to 2014, compared with 18 of 26 studies that used shorter reference periods. Some recent publications have used relatively short reference periods (e.g., 1 year) whether due to restricted data availability, logistical factors, or a desire to conduct trend analyses using 1 calendar year as the unit of observation. As previously noted, studies did not generally require continuous enrollment throughout multi-year reference periods. Requiring continuous enrollment for several years would greatly reduce the sample size, particularly for children in younger age groups, and could introduce selection bias based on factors that influence long-term participation in healthcare databases.
Of the 13 included studies that required either one inpatient claim or two or more outpatient claims with ASD codes, none cited the CMS Chronic Conditions Data Warehouse as justification for the choice of that algorithm. Moreover, none of those studies chose to use the 2-year reference period recommended in that source (Centers for Medicare and Medicaid Services, 2019). Similarly, a National Academies report in 2015 that analyzed Medicaid Analytic eXtract data for mental disorders in children required either one inpatient claim or two or more outpatient claims with ASD codes within a single calendar year of data (National Academies of Sciences, 2015).
The completeness of coding may differ between FFS and managed care plans. In CMS Medicaid Analytic eXtract data, the completeness of managed care encounters is reported to have increased over time with large gaps across states (Byrd & Dodd, 2012, 2015). Many studies have used only FFS Medicaid claims data (Bishop-Fitzpatrick & Rubenstein, 2019; Khanna et al., 2013; Leslie & Martin, 2007; Mandell et al., 2006; Schubart et al., 2014; Vohra et al., 2016, 2017; Wang et al., 2013), including individuals enrolled in managed care plans with mental health services paid through FFS (Cidav et al., 2013, 2014; Shea et al., 2018).
It is unclear how the accuracy of ASD case-finding algorithms might differ by age group. Since validation studies have been focused on younger children, little information is available on the accuracy of claims data for identifying adolescents and adults with ASD. Differences across age groups in recorded ASD prevalence or healthcare use in administrative data might reflect both true differences and differences in sensitivity and specificity of the case-finding algorithms. A growing number of health services research studies using administrative data have focused on transition-age youth with ASD (Kalb et al., 2019; Liu et al., 2017; Nathenson & Zablotsky, 2017; Shea et al., 2018).
Analyses of claims data from other countries also vary in ASD case finding algorithms, and this variability in coding practices could affect the comparability of published estimates. For example, studies using Taiwan’s National Health Insurance Research Database (NHIRD) have also applied different ASD case-finding algorithms using ICD-9 299 codes for ASD, e.g., ≥ 1 claim in any setting (Chan et al., 2021), either ≥ 1 inpatient or ≥ 2 outpatient ASD claims (Yu et al., 2021), or either ≥ 1 (Tsao et al., 2017), ≥ 2 (Lee et al., 2016), or ≥ 3 outpatient physician visits (Dai et al., 2019; Huang et al., 2021; Hung et al., 2021). Some analyses of Taiwan NHIRD data have required the presence of ASD ICD-9 diagnosis codes for encounters with a board-certified psychiatrist (Dai et al., 2019; Lee et al., 2016; Tsao et al., 2017) or a pediatric psychiatrist, psychologist, or neurologist (Hung et al., 2021). The National Insurance Institute of Israel maintains a national claims database that, since 2007, has confirmed ASD claims based on a diagnostic evaluation by a pediatric psychiatrist, pediatric neurologist, a pediatrician with at least 3 years of experience in a certified child development center in addition to an assessment by a developmental or clinical psychologist (Pinto & Raz, 2021; Raz et al., 2015).
Conclusions
The lack of standardization in ASD case algorithms for identifying cases in administrative claims data could pose a challenge to the synthesis of evidence from epidemiologic and health services research studies. Such limitations are not unique to administrative data; ASD diagnoses reported by respondents in the Medical Expenditure Panel Survey were recorded using ICD-9-CM codes (Cidav et al., 2012; Kalb et al., 2019; Lavelle et al., 2014; Liptak et al., 2006; Zuvekas et al., 2021). Additionally, state governments and other agencies often use administrative data to track and report service use and needs. An evidence-based standardized approach could facilitate comparisons in healthcare use and service needs across states and other entities and over time. However, standardization might require additional evidence from validation studies conducted using broader age ranges and representativeness of validation cohorts.
It could be helpful if researchers were to report results on how outcome measures, such as healthcare use or expenditures, vary depending on the data source, case definition, and the number of years of data used to ascertain ASD cases (Zuvekas et al., 2021). Children who meet a case-finding algorithm requiring multiple claims within 1 calendar year typically use more healthcare resources on average than other children who only meet the same case-finding algorithm using multiple years of data (Amendah et al., 2010). An analysis of claims data has reported that 0.56% of children aged 3–7 years in 2011 had ≥ 2 claims with ASD diagnosis codes during 2011 and 1.33% of the same group of children had ≥ 2 such claims at any point during 2011–2015, with mean spending during 2011 (in 2017 dollars) of $13,198 and $8,685, respectively (Grosse et al., 2021).
The optimal case-finding algorithm for ASD may vary with the purpose of a study. For studies of risk factors for ASD, a high PPV is likely to be the most important criterion (Burke et al., 2014). Similarly, since inclusion of false-positive cases in analyses of healthcare utilization and expenditures can result in underestimation of costs for children with ASD, an algorithm with relatively few false-positives may be preferred. Studies that set a low bar of just one ASD diagnosis code are likely to include substantial numbers of individuals who do not meet diagnostic criteria for ASD, and such misclassification error is likely to bias estimates of associations with risk factors or incremental use of healthcare services associated with ASD to the null.
A longer time window (multiple years of data) used to identify ASD cases may improve sensitivity, including individuals who have relatively few formal healthcare encounters or have disruptions in healthcare coverage. That has important implications for analyses of economic impact since use of a single calendar year of data to identify case status, although useful for analyses of trends, can substantially overstate estimates of mean healthcare use and expenditures (Grosse et al., 2021). On the other hand, analyses of claims data to estimate administrative prevalence of ASD as a complement to population-based surveillance methods might consider adopting a relatively broad case-finding algorithm, explicitly trading off more false positives to reduce the number of false negatives. Epidemiologic modeling of data from validation studies could help in assessing the potential algorithms from that perspective. Validation studies have reported that the majority of children with a single ASD claim during a multi-year period are either definite or probable ASD cases (Burke et al., 2014; Coo et al., 2018; Dodds et al., 2009; Rotem et al., 2020).
In summary, although much progress in identifying appropriate ASD case-finding algorithms for health services research has been made in recent years, additional validation studies may help researchers choose among case-finding algorithms.
Supplementary Material
Acknowledgements
The authors acknowledge Katherine Verstreate, MPH and Kaitlin Koffer Miller, MPH from the Policy and Analytics Center at the A.J. Drexel Autism Institute at Drexel University for their support in identifying search terms for the scoping review. The authors acknowledge Mary Cogswell, Patricia Dietz, Stuart Shapira, and Lisa Wiggins for helpful comments on earlier versions of the manuscript.
Funding
The authors have no financial relationships relevant to this article to disclose. No funding was secured for this commentary.
Abbreviations
- ASD
Autism spectrum disorder
- CMS
Center for Medicare and Medicaid Services
- DSM-5
Diagnostic and Statistical Manual of Mental Disorders, fifth edition
- DSM-IV
Diagnostic and Statistical Manual of Mental Disorders, fourth edition
- FFS
Fee-for-service
- ICD-9-CM
International Classification of Diseases, Ninth Revision, Clinical Modification
- ICD-10-CM
International Classification of Diseases, Tenth Revision, Clinical Modification
- PDD
Pervasive developmental disorder
- PPV
Positive predictive value
Footnotes
Supplementary Information The online version contains supplementary material available at https://doi.org/10.1007/s10803-021-05269-1.
Conflict of interest The authors have no financial relationships relevant to this article to disclose.
References
- Amendah DD, Mvundura M, Kavanagh PL, Sprinz PG, & Grosse SD (2010). Sickle cell disease–related pediatric medical expenditures in the US. American Journal of Preventive Medicine, 38, S550–556. [DOI] [PubMed] [Google Scholar]
- American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (DSM-IV). Atlanta: American Psychiatric Pub. [Google Scholar]
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). Atlanta: American Psychiatric Pub. [Google Scholar]
- American Psychological Association. (2002). Covered diagnoses & crosswalk of DSM-IV codes to ICD-9-CM codes. Washington: American Psychological Association. [Google Scholar]
- Andrade SE, et al. (2013). Validity of health plan and birth certificate data for pregnancy research. Pharmacoepidemiology and Drug Safety, 22, 7–15. 10.1002/pds.3319 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barry CL, et al. (2017). Effects of state insurance mandates on health care use and spending for autism spectrum disorder. Health Affairs (millwood), 36, 1754–1761. 10.1377/hlthaff.2017.0515 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barry CL, Kennedy-Hendricks A, Mandell D, Epstein AJ, Candon M, & Eisenberg M (2019). State mandate laws for autism coverage and high-deductible health plans. Pediatrics. 10.1542/peds.2018-2391 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickford CD, et al. (2020). Identification of pediatric autism spectrum disorder cases using health administrative data. Autism Research, 13, 456–463. 10.1002/aur.2252 [DOI] [PubMed] [Google Scholar]
- Bishop-Fitzpatrick L, & Rubenstein E (2019). The physical and mental health of middle aged and older adults on the autism spectrum and the impact of intellectual disability. Research in Autism Spectrum Disorder, 63, 34–41. 10.1016/j.rasd.2019.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke JP, et al. (2014). Does a claims diagnosis of autism mean a true case? Autism, 18, 321–330. 10.1177/1362361312467709 [DOI] [PubMed] [Google Scholar]
- Byrd VL, & Dodd AH (2012). Assessing the usability of encounter data for enrollees in comprehensive managed care across MAX 2007–2009 Medicaid Policy Brief. Mathematical Policy Research: Princeton. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Byrd VL, & Dodd AH (2015). Assessing the usability of encounter data for enrollees in comprehensive managed care 2010–2011 Medicaid Policy Brief. Mathematica Policy Research: Princeton. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Candon MK, et al. (2018). The differential effects of insurance mandates on health care spending for children’s autism spectrum disorder. Medical Care, 56, 228–232. 10.1097/MLR.0000000000000863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Candon MK, et al. (2019). Insurance mandates and out-of-pocket spending for children with autism spectrum disorder. Pediatrics. 10.1542/peds.2018-0654 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Centers for Medicare and Medicaid Services. (2019). Chronic Conditions Data Warehouse Condition Categories. Retrieved February 18, 2019, from https://www.ccwdata.org/web/guest/condition-categories.
- Chan HL, et al. (2021). Lower risk of burn injury in children and adolescents with autism spectrum disorder: A nationwide population-based study. Journal of Autism and Developmental Disorders. 10.1007/s10803-020-04859-9 [DOI] [PubMed] [Google Scholar]
- Chi DL, Momany ET, Mancl LA, Lindgren SD, Zinner SH, & Steinman KJ (2016). Dental homes for children with autism: A longitudinal analysis of Iowa Medicaid’s I-Smile program. American Journal of Preventive Medicine, 50, 609–615. 10.1016/j.amepre.2015.08.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cidav Z, Lawer L, Marcus SC, & Mandell DS (2013). Age-related variation in health service use and associated expenditures among children with autism. Journal of Autism and Developmental Disorders, 43, 924–931. 10.1007/s10803-012-1637-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cidav Z, Marcus SC, & Mandell DS (2012). Implications of childhood autism for parental employment and earnings. Pediatrics, 129, 617–623. 10.1542/peds.2011-2700 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cidav Z, Marcus SC, & Mandell DS (2014). Home- and community-based waivers for children with autism: Effects on service use and costs. Intellectual and Developmental Disabilities, 52, 239–248. 10.1352/1934-9556-52.4.239 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cidav Z, Xie M, & Mandell DS (2018). Foster care involvement among Medicaid-enrolled children with autism. Journal of Autism and Developmental Disorders, 48, 176–183. 10.1007/s10803-017-3311-1 [DOI] [PubMed] [Google Scholar]
- Cohrs AC, & Leslie DL (2017). Depression in parents of children diagnosed with autism spectrum disorder: A claims-based analysis. Journal of Autism and Developmental Disorders, 47, 1416–1422. 10.1007/s10803-017-3063-y [DOI] [PubMed] [Google Scholar]
- Coleman KJ, et al. (2015). Validation of autism spectrum disorder diagnoses in large healthcare systems with electronic medical records. Journal of Autism and Developmental Disorders, 45, 1989–1996. 10.1007/s10803-015-2358-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coo H, Ouellette-Kuntz H, Brownell M, Shooshtari S, & Hanlon-Dearman A (2018). Validating an administrative data-based case definition for identifying children and youth with autism spectrum disorder for surveillance purposes. Canadian Journal of Public Health, 108, e530–e538. 10.17269/cjph.108.5963 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Croen LA, Najjar DV, Ray GT, Lotspeich L, & Bernal P (2006). A comparison of health care utilization and costs of children with and without autism spectrum disorders in a large group-model health plan. Pediatrics, 118, e1203–e1211. 10.1542/peds.2006-0127 [DOI] [PubMed] [Google Scholar]
- Cummings JR, et al. (2016). Health services utilization among children with and without autism spectrum disorders. Journal of Autism and Developmental Disorders, 46, 910–920. 10.1007/s10803-015-2634-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dai YX, Tai YH, Chang YT, Chen TJ, & Chen MH (2019). Increased risk of atopic diseases in the siblings of patients with autism spectrum disorder: A nationwide population-based cohort study. Journal of Autism and Developmental Disorders, 49, 4626–4633. 10.1007/s10803-019-04184-w [DOI] [PubMed] [Google Scholar]
- Daniels AM, & Mandell DS (2013). Children’s compliance with American Academy of Pediatrics’ well-child care visit guidelines and the early detection of autism. Journal of Autism and Developmental Disorders, 43, 2844–2854. 10.1007/s10803-013-1831-x [DOI] [PubMed] [Google Scholar]
- Dodds L, et al. (2009). Validity of autism diagnoses using administrative health data. Chronic Diseases in Canada, 29, 102–107. [PMC free article] [PubMed] [Google Scholar]
- Feroe AG, et al. (2021). Medication use in the management of comorbidities among individuals with autism spectrum disorder from a large nationwide insurance database. JAMA Pediatrics. 10.1001/jamapediatrics.2021.1329 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flanders SC, Engelhart L, Pandina GJ, & McCracken JT (2007). Direct health care costs for children with pervasive developmental disorders: 1996–2002. Administration and Policy in Mental Health, 34, 213–220. 10.1007/s10488-006-0098-3 [DOI] [PubMed] [Google Scholar]
- Flanders SC, Engelhart L, Whitworth J, Hussein MA, Vanderpoel DR, & Sandman T (2006). The economic burden of pervasive developmental disorders in a privately insured population. Managed Care Interface, 19, 39–45. [PubMed] [Google Scholar]
- Frank RG, & Garfield RL (2007). Managed behavioral health care carve-outs: Past performance and future prospects. Annual Review of Public Health, 28, 303–320. [DOI] [PubMed] [Google Scholar]
- Grosse SD, Green NS, & Reeves SL (2020). Administrative data identify sickle cell disease: A critical review of approaches in US health services research. Pediatric Blood & Cancer, 67, e28703. 10.1002/pbc.28703 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grosse SD, Ji X, Nichols P, Zuvekas SH, Rice CE, & Yeargin-Allsopp M (2021). Spending for young children with autism spectrum disorder in employer-sponsored plans, 2011–2017. Psychiatric Services (washington, D. C.), 72, 16–22. 10.1176/appi.ps.202000099 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heifert TA, et al. (2016). Feeding disorders in children with autism spectrum disorders are associated with eosinophilic esophagitis. Journal of Pediatric Gastroenterology and Nutrition, 63, e69–e73. 10.1097/MPG.0000000000001282 [DOI] [PubMed] [Google Scholar]
- Hinds A, Lix LM, Smith M, Quan H, & Sanmartin C (2016). Quality of administrative health databases in Canada: A scoping review. Canadian Journal of Public Health, 107, e56–e61. 10.17269/cjph.107.5244 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hisle-Gorman E, Susi A, Stokes T, Gorman G, Erdie-Lalena C, & Nylund CM (2018). Prenatal, perinatal, and neonatal risk factors of autism spectrum disorder. Pediatric Research, 84, 190–198. 10.1038/pr.2018.23 [DOI] [PubMed] [Google Scholar]
- Houghton R, Ong RC, & Bolognani F (2017). Psychiatric comorbidities and use of psychotropic medications in people with autism spectrum disorder in the United States. Autism Research, 10, 2037–2047. [DOI] [PubMed] [Google Scholar]
- House SA, Goodman DC, Weinstein SJ, Chang CH, Wasserman JR, & Morden NE (2016). Prescription use among children with autism spectrum disorders in northern New England: Intensity and small area variation. Journal of Pediatrics, 169, 277–283. 10.1016/j.jpeds.2015.10.027 [DOI] [PubMed] [Google Scholar]
- Huang JS, et al. (2021). Risk of substance use disorder and its associations with comorbidities and psychotropic agents in patients with autism. JAMA Pediatrics, 175, e205371. 10.1001/jamapediatrics.2020.5371 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hung TW, Tsai JD, Pan HH, Chen HJ, Liao PF, & Sheu JN (2021). Is neonatal hyperbilirubinemia exposure associated with a risk of autism spectrum disorder? A nationwide cohort study. American Journal of Perinatology. 10.1055/s-0040-1708033 [DOI] [PubMed] [Google Scholar]
- Jain A, et al. (2014). Injuries among children with autism spectrum disorder. Academic Pediatric, 14, 390–397. 10.1016/j.acap.2014.03.012 [DOI] [PubMed] [Google Scholar]
- Jain A, Marshall J, Buikema A, Bancroft T, Kelly JP, & Newschaffer CJ (2015). Autism occurrence by MMR vaccine status among US children with older siblings with and without autism. JAMA, 313, 1534–1540. 10.1001/jama.2015.3077 [DOI] [PubMed] [Google Scholar]
- Jariwala-Parikh K, et al. (2019). Autism prevalence in the Medicaid program and healthcare utilization and costs among adult enrollees diagnosed with autism. Administration and Policy in Mental Health, 46, 768–776. 10.1007/s10488-019-00960-z [DOI] [PubMed] [Google Scholar]
- Kalb LG, Stuart EA, & Vasa RA (2019). Characteristics of psychiatric emergency department use among privately insured adolescents with autism spectrum disorder. Autism, 23, 566–573. 10.1177/1362361317749951 [DOI] [PubMed] [Google Scholar]
- Kang-Yi CD, Locke J, Marcus SC, Hadley TR, & Mandell DS (2016). School-based behavioral health service use and expenditures for children with autism and children with other disorders. Psychiatric Services (washington, D. C.), 67, 101–106. 10.1176/appi.ps.201400505 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kennedy-Hendricks A, et al. (2018). Effects of state autism mandate age caps on health service use and spending among Adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 57, 125–131. 10.1016/j.jaac.2017.10.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khanna R, Jariwala K, & West-Strum D (2013). Use and cost of psychotropic drugs among recipients with autism in a state Medicaid fee-for-service programme. Journal of Intellectual Disability Research, 57, 161–171. 10.1111/j.1365-2788.2012.01563.x [DOI] [PubMed] [Google Scholar]
- Lanes S, Brown JS, Haynes K, Pollack MF, & Walker AM (2015). Identifying health outcomes in healthcare databases. Pharmacoepidemiology and Drug Safety, 24, 1009–1016. 10.1002/pds.3856 [DOI] [PubMed] [Google Scholar]
- Lavelle TA, Weinstein MC, Newhouse JP, Munir K, Kuhlthau KA, & Prosser LA (2014). Economic burden of childhood autism spectrum disorders. Pediatrics, 133, e520–e529. 10.1542/peds.2013-0763 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee CY, et al. (2016). Longitudinal association between early atopic dermatitis and subsequent attention-deficit or autistic disorder: A population-based case–control study. Medicine (baltimore), 95, e5005. 10.1097/MD.0000000000005005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee M, et al. (2018). Association of autism spectrum disorders and inflammatory bowel disease. Journal of Autism and Developmental Disorders, 48, 1523–1529. 10.1007/s10803-017-3409-5 [DOI] [PubMed] [Google Scholar]
- Leslie DL, & Martin A (2007). Health care expenditures associated with autism spectrum disorders. Archives of Pediatrics and Adolescent Medicine, 161, 350–355. 10.1001/archpedi.161.4.350 [DOI] [PubMed] [Google Scholar]
- Liptak GS, Stuart T, & Auinger P (2006). Health care utilization and expenditures for children with autism: Data from U.S. national samples. Journal of Autism and Developmental Disorders, 36, 871–879. 10.1007/s10803-006-0119-9 [DOI] [PubMed] [Google Scholar]
- Liu G, et al. (2019). Risk factors for emergency department utilization among adolescents with autism spectrum disorder. Journal of Autism and Developmental Disorders, 49, 4455–4467. 10.1007/s10803-019-04166-y [DOI] [PubMed] [Google Scholar]
- Liu G, Pearl AM, Kong L, Leslie DL, & Murray MJ (2017). A profile on emergency department utilization in adolescents and young adults with autism spectrum disorders. Journal of Autism and Developmental Disorders, 47, 347–358. 10.1007/s10803-016-2953-8 [DOI] [PubMed] [Google Scholar]
- Mandell DS, et al. (2016). Effects of autism spectrum disorder insurance mandates on the treated prevalence of autism spectrum disorder. JAMA Pediatrics, 170, 887–893. 10.1001/jamapediatrics.2016.1049 [DOI] [PubMed] [Google Scholar]
- Mandell DS, et al. (2019). Effect of outpatient service utilization on hospitalizations and emergency visits among youths with autism spectrum disorder. Psychiatric Services (washington, D. C.), 70, 888–893. 10.1176/appi.ps.201800290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mandell DS, Cao J, Ittenbach R, & Pinto-Martin J (2006). Medicaid expenditures for children with autistic spectrum disorders: 1994 to 1999. Journal of Autism and Developmental Disorders, 36, 475–485. 10.1007/s10803-006-0088-z [DOI] [PubMed] [Google Scholar]
- Mandell DS, Morales KH, Marcus SC, Stahmer AC, Doshi J, & Polsky DE (2008). Psychotropic medication use among Medicaid-enrolled children with autism spectrum disorders. Pediatrics, 121, e441–e448. 10.1542/peds.2007-0984 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mandell DS, Morales KH, Xie M, Polsky D, Stahmer A, & Marcus SC (2010). County-level variation in the prevalence of Medicaid-enrolled children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 40, 1241–1246. 10.1007/s10803-010-0982-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mandell DS, Xie M, Morales KH, Lawer L, McCarthy M, & Marcus SC (2012). The interplay of outpatient services and psychiatric hospitalization among Medicaid-enrolled children with autism spectrum disorders. Archives of Pediatrics and Adolescent Medicine, 166, 68–73. 10.1001/archpediatrics.2011.714 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Matone M, Localio R, Huang YS, dosReis S, Feudtner C, & Rubin D (2012). The relationship between mental health diagnosis and treatment with second-generation antipsychotics over time: A national study of U.S. Medicaid-Enrolled Children. Health Services Research, 47, 1836–1860. 10.1111/j.1475-6773.2012.01461.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- McDermott S, et al. (2018). Using Medicaid data to characterize persons with intellectual and developmental disabilities in five U.S. states. American Journal on Intellectual and Developmental Disabilities, 123, 371–381. 10.1352/1944-7558-123.4.371 [DOI] [PubMed] [Google Scholar]
- McDermott S, Zhou L, & Mann J (2008). Injury treatment among children with autism or pervasive developmental disorder. Journal of Autism and Developmental Disorders, 38, 626–633. [DOI] [PubMed] [Google Scholar]
- McPheeters ML, Sathe NA, Jerome RN, & Carnahan RM (2013a). Methods for systematic reviews of administrative database studies capturing health outcomes of interest. Vaccine, 31(Suppl 10), K2–K6. 10.1016/j.vaccine.2013.06.048 [DOI] [PubMed] [Google Scholar]
- Metcalfe A, Sibbald B, Lowry RB, Tough S, & Bernier FP (2014). Validation of congenital anomaly coding in Canada’s administrative databases compared with a congenital anomaly registry. Birth Defects Research. Part A, Clinical and Molecular Teratology, 100, 59–66. 10.1002/bdra.23206 [DOI] [PubMed] [Google Scholar]
- Mullooly JP, Donahue JG, DeStefano F, Baggs J, & Eriksen E (2008). Predictive value of ICD-9-CM codes used in vaccine safety research. Methods of Information in Medicine, 47, 328–335. [PubMed] [Google Scholar]
- Nathenson RA, & Zablotsky B (2017). The transition to the adult health care system among youths with autism spectrum disorder. Psychiatric Services (washington, D. C.), 68, 735–738. 10.1176/appi.ps.201600239 [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Academies of Sciences, E., and Medicine. (2015). Medicaid analytic extract study. In Boat TF & Wu JT (Eds.), Mental disorders and disabilities among low-income children (pp. 315–347). Washington, D.C.: National Academies Press. [PubMed] [Google Scholar]
- Oswald DP, & Sonenklar NA (2007). Medication use among children with autism spectrum disorders. Journal of Child and Adolescent Psychopharmacology, 17, 348–355. 10.1089/cap.2006.17303 [DOI] [PubMed] [Google Scholar]
- Peacock G, Amendah D, Ouyang L, & Grosse SD (2012). Autism spectrum disorders and health care expenditures: The effects of co-occurring conditions. Journal of Developmental and Behavioral Pediatrics, 33, 2–8. [DOI] [PubMed] [Google Scholar]
- Peng CZ, Hatlestad P, Klug MG, Kerbeshian J, & Burd L (2009). Health care costs and utilization rates for children with pervasive developmental disorders in North Dakota from 1998 to 2004: Impact on Medicaid. Journal of Child Neurology, 24, 140–147. 10.1177/0883073808321059 [DOI] [PubMed] [Google Scholar]
- Phillips KG, Houtenville AJ, & Reichard A (2019). Using all-payer claims data for health surveillance of people with intellectual and developmental disabilities. Journal of Intellectual Disability Research, 63, 327–337. 10.1111/jir.12578 [DOI] [PubMed] [Google Scholar]
- Pinto OY, & Raz R (2021). Employment outcomes after a birth of a child with a developmental disability: A national nested case–control study. Journal of Autism and Developmental Disorders, 51, 697–703. 10.1007/s10803-020-04581-6 [DOI] [PubMed] [Google Scholar]
- Quan H, et al. (2008). Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Services Research, 43, 1424–1441. 10.1111/j.1475-6773.2007.00822.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raz R, Weisskopf MG, Davidovitch M, Pinto O, & Levine H (2015). Differences in autism spectrum disorders incidence by sub-populations in Israel 1992–2009: A total population study. Journal of Autism and Developmental Disorders, 45, 1062–1069. 10.1007/s10803-014-2262-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rector TS, et al. (2004). Specificity and sensitivity of claims-based algorithms for identifying members of Medicare+Choice health plans that have chronic medical conditions. Health Services Research, 39, 1839–1857. 10.1111/j.1475-6773.2004.00321.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reichow B, George-Puskar A, Lutz T, Smith IC, & Volkmar FR (2015). Brief report: Systematic review of Rett syndrome in males. Journal of Autism and Developmental Disorders, 45, 3377–3383. [DOI] [PubMed] [Google Scholar]
- Riley GF (2009). Administrative and claims records as sources of health care cost data. Medical Care, 47, S51–S55. 10.1097/MLR.0b013e31819c95aa [DOI] [PubMed] [Google Scholar]
- Ronald LA, et al. (2017). Validated methods for identifying tuberculosis patients in health administrative databases: Systematic review. The International Journal of Tuberculosis and Lung Disease, 21, 517–522. 10.5588/ijtld.16.0588 [DOI] [PubMed] [Google Scholar]
- Rotem RS, et al. (2020). Maternal thyroid disorders and risk of autism spectrum disorder in progeny. Epidemiology, 31, 409–417. 10.1097/EDE.0000000000001174 [DOI] [PubMed] [Google Scholar]
- Rubenstein E, & Bishop L (2019). Is the autism boom headed for Medicaid? Patterns in the enrollment of autistic adults in Wisconsin Medicaid, 2008–2018. Autism Research, 12, 1541–1550. 10.1002/aur.2173 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rubin DM, Feudtner C, Localio R, & Mandell DS (2009). State variation in psychotropic medication use by foster care children with autism spectrum disorder. Pediatrics, 124, e305–e312. 10.1542/peds.2008-3713 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saloner B, & Barry CL (2019). Changes in spending and service use after a state autism insurance mandate. Autism, 23, 167–174. 10.1177/1362361317728205 [DOI] [PubMed] [Google Scholar]
- Schubart JR, Camacho F, & Leslie D (2014). Psychotropic medication trends among children and adolescents with autism spectrum disorder in the Medicaid program. Autism, 18, 631–637. 10.1177/1362361313497537 [DOI] [PubMed] [Google Scholar]
- Shea LL, et al. (2018). Brief report: Service use and associated expenditures among adolescents with autism spectrum disorder transitioning to adulthood. Journal of Autism and Developmental Disorders, 48, 3223–3227. 10.1007/s10803-018-3563-4 [DOI] [PubMed] [Google Scholar]
- Shea L, Newschaffer CJ, Xie M, Myers SM, & Mandell DS (2014). Genetic testing and genetic counseling among Medicaid-enrolled children with autism spectrum disorder in 2001 and 2007. Human Genetics, 133, 111–116. 10.1007/s00439-013-1362-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shedlock K, Susi A, Gorman GH, Hisle-Gorman E, Erdie-Lalena CR, & Nylund CM (2016). Autism spectrum disorders and metabolic complications of obesity. Journal of Pediatrics, 178(183–187), e1. 10.1016/j.jpeds.2016.07.055 [DOI] [PubMed] [Google Scholar]
- Shimabukuro TT, Grosse SD, & Rice C (2008). Medical expenditures for children with an autism spectrum disorder in a privately insured population. Journal of Autism and Developmental Disorders, 38, 546–552. 10.1007/s10803-007-0424-y [DOI] [PubMed] [Google Scholar]
- Sickbert-Bennett EE, Weber DJ, Poole C, MacDonald PD, & Maillard JM (2011). Completeness of communicable disease reporting, North Carolina, USA, 1995–1997 and 2000–2006. Emerging Infectious Diseases, 17, 23–29. 10.3201/eid1701.100660 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sigmon ER, Kelleman M, Susi A, Nylund CM, & Oster ME (2019). Congenital heart disease and autism: A case–control study. Pediatrics, 144, e20184114. 10.1542/peds.2018-4114 [DOI] [PubMed] [Google Scholar]
- Smith MG, Royer J, Mann JR, & McDermott S (2017). Using administrative data to ascertain true cases of muscular dystrophy: Rare disease surveillance. JMIR Public Health and Surveillance, 3, e2. 10.2196/publichealth.6720 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spencer D, et al. (2013). Psychotropic medication use and polypharmacy in children with autism spectrum disorders. Pediatrics, 132, 833–840. 10.1542/peds.2012-3774 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stein BD, Sorbero MJ, Goswami U, Schuster J, & Leslie DL (2012). Impact of a private health insurance mandate on public sector autism service use in Pennsylvania. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 771–779. 10.1016/j.jaac.2012.06.006 [DOI] [PubMed] [Google Scholar]
- Stuart EA, et al. (2017). Increased service use among children with autism spectrum disorder associated with mental health parity law. Health Affairs (millwood), 36, 337–345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tsao PC, et al. (2017). Additive effect of congenital heart disease and early developmental disorders on attention-deficit/hyperactivity disorder and autism spectrum disorder: A nationwide population-based longitudinal study. European Child and Adolescent Psychiatry, 26, 1351–1359. 10.1007/s00787-017-0989-8 [DOI] [PubMed] [Google Scholar]
- Vargason T, Frye RE, McGuinness DL, & Hahn J (2019). Clustering of co-occurring conditions in autism spectrum disorder during early childhood: A retrospective analysis of medical claims data. Autism Research, 12, 1272–1285. 10.1002/aur.2128 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaughan Sarrazin MS, & Rosenthal GE (2012). Finding pure and simple truths with administrative data. JAMA, 307, 1433–1435. 10.1001/jama.2012.404 [DOI] [PubMed] [Google Scholar]
- Vohra R, et al. (2016). Prescription drug use and polypharmacy among Medicaid-enrolled adults with autism: A retrospective cross-sectional analysis. Drugs Real World Outcomes, 3, 409–425. 10.1007/s40801-016-0096-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vohra R, Madhavan S, & Sambamoorthi U (2017). Comorbidity prevalence, healthcare utilization, and expenditures of Medicaid enrolled adults with autism spectrum disorders. Autism, 21, 995–1009. 10.1177/1362361316665222 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Volkmar FR (2013). Residual autism. In Volkmar FR (Ed.), Encyclopedia of autism spectrum disorders (pp. 2571–2571). New York, NY: Springer. [Google Scholar]
- Wang L, et al. (2019). Changes in healthcare expenditures after the autism insurance mandate. Research in Autism Spectrum Disorder, 57, 97–104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang L, & Leslie DL (2010). Health care expenditures for children with autism spectrum disorders in Medicaid. Journal of the American Academy of Child and Adolescent Psychiatry, 49, 1165–1171. 10.1016/j.jaac.2010.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang L, Mandell DS, Lawer L, Cidav Z, & Leslie DL (2013). Healthcare service use and costs for autism spectrum disorder: A comparison between Medicaid and private insurance. Journal of Autism and Developmental Disorders, 43, 1057–1064. 10.1007/s10803-012-1649-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams PG, Woods C, Stevenson M, Davis DW, Radmacher P, & Smith M (2012). Psychotropic medication use in children with autism in the Kentucky Medicaid population. Clinical Pediatrics (phila), 51, 923–927. 10.1177/0009922812440837 [DOI] [PubMed] [Google Scholar]
- Worth RM, & Mytinger RE (1996). Medical insurance claims as a source of data for research: Accuracy of diagnostic coding. Hawaii Medical Journal, 55, 9–11. [PubMed] [Google Scholar]
- Yu T, Lien YJ, Liang FW, & Kuo PL (2021). Parental socioeconomic status and autism spectrum disorder in offspring: A population-based cohort study in Taiwan. American Journal of Epidemiology. 10.1093/aje/kwaa241 [DOI] [PubMed] [Google Scholar]
- Zuvekas SH, Grosse SD, Lavelle TA, Maenner MJ, Dietz P, & Ji X (2021). Healthcare costs of pediatric autism spectrum disorder in the United States, 2003–2015. Journal of Autism and Developmental Disorders, 51, 2950–2958. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.