Abstract
Artificial intelligence (AI) has begun to affect nearly every aspect of our daily lives and nearly every industry and profession. Many readers of this journal likely work in one or more areas of behavioral health. For readers who work in behavioral health and who are interested in AI, the purpose of this article is to highlight the pervasiveness of AI research being conducted around many facets of behavioral health service delivery. To do this, we first provide a brief overview of some of the areas within AI and the types of problems each area of AI attempts to solve. We then outline the prototypical client journey in behavioral healthcare beginning with diagnosis/assessment and ending with intervention withdrawal or ongoing monitoring. Next, for each stage in the client journey, we highlight several areas that parallel existing behavior analytic practice where researchers have begun to use AI, often to improve the efficiency of service delivery or to learn new things that improve the effectiveness of behavioral health services. Finally, for those whose appetite has been whet for getting involved with AI, we close by describing three roles they might consider trying out and that parallel the three main domains of behavior analysis. These three roles are an AI tool designer (akin to EAB), AI tool implementer (akin to ABA), or AI tool supporter (akin to practice).
Keywords: Artificial intelligence, Behavioral health, Data science, Quality of life
Behavioral health is a term used to describe patterns of behaviors that have a known effect on the health and well-being of an individual. As a broad and general term, the behaviors targeted with a behavioral health intervention may span many areas of human behavior such as stress, depression, anxiety, interpersonal relationships, grief, addiction, learning disabilities, mood disorders, chronic disease management, diet, physical activity, and the use or misuse of substances (see Marsch et al., 2015, for a broad range of applications). Professionals working in the behavioral health realm may have education and training spanning many disciplines such as counseling, psychology, nursing, medicine, life coaching, and behavior analysis (Marsch et al., 2015). And, interventions may consist of a variety of methods and procedures such as behavioral therapy, counseling, and medication (Marsch et al., 2015).
As a profession, behavior analytic practitioners have worked and published in many areas and with many populations within the realm of “behavioral health.” Arguably, the use of applied behavior analysis (ABA) for individuals with autism spectrum disorders (ASD) and developmental disabilities (DD) would fall within the above definition of behavioral health and is the most common area where board certified behavior analysts (BCBAs) work (Behavior Analyst Certification Board [BACB], n.d.). However, a smaller set of behavior analysts have also published and worked in areas spanning diet, physical activity, substance abuse and misuse, chronic disease management, and mental health (e.g., BACB, n.d.; Heward et al., 2022). Central to all areas of behavior analytic practice is the observation, measurement, and subsequent use of data collected on behavior-environment relations.
Behavior analysts working with individuals with ASD and DD have demonstrated how data collection on environment–behavior relations and the resulting functionally informed intervention for 20+ hr per week can lead to significant and socially important behavior change (e.g., Eldevik et al., 2009; Linstead et al., 2017). But, practitioners working in areas outside of ASD and DD are unlikely to get that same amount of direct 1:1 contact with their clients. Here, behavioral health practitioners may get 15–60 min with a client on a good week and, even then, those minutes are likely spent talking with one another rather than in direct observation and collection of data on behavior–environment relations. Thus, approaches to data collection, analysis, and functionally derived interventions practically have to look different than ABA interventions for individuals with ASD and DD.
One method whereby data collection, analysis, and intervention with behavioral health can more easily scale is through technology. For example, researchers have shown how technology allows practitioners and researchers to collect moment-by-moment data on the responses that people emit throughout their daily lives (e.g., Asch et al., 2012; Mehta et al., 2019). Further, researchers have also shown how technology can be used to collect data on the environment surrounding those responses at a similar moment-by-moment temporal scale (e.g., Bertz et al., 2018; Epstein et al., 2014; Kwan et al., 2018). As a result, behavioral health practitioners and researchers now have the ability to collect data on behavior–environment relations that span similar (or greater) proportions of time throughout the clients’ day as ABA practitioners working with individuals with ASD or DD.
Using technology to collect data, however, requires that the researcher or practitioner can practically and efficiently access and analyze the data collected by that technology. Accessing and analyzing data collected by a technology is not always straightforward for a single technological device (e.g., FitBit, Apple Watch). As the number of data collection modalities increases, it becomes even more difficult to combine and display data in a single location so that the behavior analyst can analyze behavior–environment relations and effectively communicate with the client or patient. Further, large streams of data on many different variables requires the ability to sift through those variables, identify variables that are functionally related to behavior, sort out the probable degree of influence, and present the relations visually in a manner easily interpretable by the behavior analyst and client. One analytic approach increasingly being used by scientists to make sense of large datasets in this way is artificial intelligence (AI).
The purpose of this article is to provide examples for how AI is being used to help behavioral health practitioners and researchers better help their clients and patients. To do so, we begin with a high-level primer on some of the subdomains of AI. We then step through the prototypical patient journey from diagnosis through treatment and discharge. At each step, we provide examples of how researchers have introduced AI to help them better provide services for their clients. Here, it also seems helpful to discuss what this manuscript is not. First, this manuscript is not an in-depth overview of how AI works. Covering the nuts and bolts of the many different areas of AI discussed in this article would require a book long treatment. Second, this article does not provide a comprehensive review of all past research at each stage in the client journey because that likewise would require a book long treatment. Rather, we hope to show behavioral health scientists and practitioners how their peers currently use AI so they can learn how adding AI as a tool might improve the work they do. For the interested, we close by highlighting three broad roles behavioral health scientists and practitioners can take if they are interested in getting started with AI.
Relevant Areas of Artificial Intelligence
AI is a broad branch of computer science whose goal is often to create nonbiological systems that can mimic intelligent behavior, often the behavior of humans.1 Whereas humans are decent at learning patterns in data that involve two and three dimensions (e.g., Vanderveldt et al., 2015), computers can learn patterns in data that involve hundreds or thousands of dimensions. Computers can also efficiently complete complex mathematical computations well beyond the average human’s ability. This ability allows computers to efficiently analyze large, multidimensional datasets to identify patterns, detect relationships, and make predictions far beyond what humans are capable of.
Table 1 shows a high-level overview of some of the many subdomains that comprise AI and organized around the human ability they attempt to mimic (e.g., Ramesh, 2017). For example, many humans use their eyes to differentially respond to stimuli within their visual field. The branch of AI that creates systems that mimic this ability is called computer vision. Humans can also move through their environment without running into things and getting injured. The branch of AI that attempts to mimic this ability is called robotics. Robotics and computer vision have historically advanced by improving how these systems learn the shapes and features of objects in two- and three-dimensional arrays. This approach can be called symbolic learning because the computer systems are learning about the environment by encoding a symbolic representation of the environment with which it then interacts (although nonsymbolic approaches to robotics and computer vision also exist and, arguably, currently dominate this landscape).
Table 1.
High-level overview of the subdomains of AI
| Human Ability Attempting to Mimic | Subdomain of AI |
|---|---|
| Use eyes to differentially respond to stimuli | Computer Vision |
| Move around environment without running into things | Robotics |
| Emit and respond to vocal-verbal behavior | Speech Recognition |
| Read and write text; Behavior influenced by textual symbols | Natural Language Processing |
| Respond to symbolic representation of the world | Symbolic Learning |
| Emit responses based on learned relations among large sets of varied stimuli | Machine Learning |
| Emit response via networks of neurons firing | Deep Learning; Neural Networks |
Machine learning is an alternative approach to symbolic learning that teaches computer systems to mimic human behavior by learning associations in data (Table 1). In the supervised machine learning approach, researchers feed the computer system a lot of data and provide feedback following its predictions so that it learns spatial and temporal associations between the variables in the dataset. In the unsupervised machine learning approach, researchers feed the computer system a lot of data and then review the associations and groupings identified in the dataset. One popular way that machine learning is being used is with verbal behavior. For example, humans can emit and respond to vocal-verbal behavior. AI systems that focus on this area fall within the field of speech recognition and are present in many of the devices you likely have around your house (e.g., Amazon’s Alexa) or carry in your pocket (e.g., Apple’s Siri). Humans can also read and write text from a given language and those textual symbols can influence the behavior of the reader. The branch of AI that attempts to mimic this ability is called natural language processing (NLP). Finally, humans can engage in complex tasks involving response chains, problem solving, and sophisticated verbal relations. Though many traditional machine learning algorithms have been successful in this domain, recent advances in deep learning and neural networks allow computer systems to make complex conditional discriminations and to engage in complex chains of behavior well beyond the average human.
In sum, the areas of AI noted above and that are relevant below all attempt to identify patterns in datasets so that computer systems can mimic the behavior of humans. Many humans use their eyes to see and their body to subsequently move around their environment. Many humans are able to respond to the verbal behavior that contacts their senses through a variety of stimulus modalities. And, many humans are able to make sense of the plethora of current and past stimuli–environment–behavior relations to behave effectively within their daily lives. In what follows, we provide examples for how researchers and practitioners are leveraging computer vision, robotics, speech recognition, NLP, deep learning, and machine learning to improve the set of behaviors labeled within the broad area of behavioral health.
AI along the Patient Journey
Figure 1 provides a simplified overview of the prototypical client journey within behavioral health systems. To begin, an individual often has some inclination that something is not quite right with their overall health and well-being. The individual then has a conversation with a behavioral health professional (BHP) and that something might get a label (i.e., a diagnosis). The BHP likely conducts an assessment to determine exactly what is going on and potential areas that can be targeted for improvement. Using the assessment information along with client input, the BHP will likely design an intervention to improve those areas for the client and, once consent or assent is attained, deliver that intervention. For some period of time, that intervention is implemented, monitored, and modified based on the effect the intervention has on the client’s overall health and well-being. For chronic conditions, this step may last indefinitely. For some, however, formal intervention within a client-practitioner relationship may come to an end and the intervention as monitored by the BHP is withdrawn. Lastly, wrapping around all steps within this chain, are a series of administrative systems and processes that may involve data collection, analysis, record updating and review, report writing, billing for services, and so on. In this second section, we provide several examples of how AI is touching every stage of the prototypical patient journey (see Table 2 for a summary).
Fig. 1.
High-level overview of the prototypical client journey in behavioral health
Table 2.
Overview of AI use cases relevant to behavioral health practitioners and the prototypical patient experience
| Area | Use Case |
|---|---|
| Diagnosis & Assessment | Biological Conditions / Diseased Organs |
| Clinically Significant Patterns of Behavior | |
| Improve Assessment Design/Implementation | |
| Predicting Low-Rate, High-Intensity Behavior | |
| Generating Diagnostic Reports | |
| Intervention Design | Predicting Response-to-Intervention |
| Efficient Use of Resources | |
| Patient-Provider Matching | |
| Implement Intervention | Patient Engagement & Adherence |
| Analysis of Intervention Effects / Response-to-Intervention | |
| Predict and Analyze Clinical Decision Making | |
| Analyzing Behavior During Sessions | |
| Intervention Withdrawal & Monitoring | Automated Hovering, Ambient Intelligence |
| Use Diagnosis & Assessment Tools to Predict or Prevent Relapse | |
| Administrative Systems & Processes | Decision Aides via Research Literature Summarization |
| Improving Patient Experience while Maintaining or Reducing Cost | |
| Staff Scheduling | |
| Performance Management for Practitioners |
AI to Improve Diagnosis and Assessment
Diagnosing Diseased Organs
As AI is used in healthcare right now, diagnosis and assessment are often interwoven. For example, the research that often grabs headlines involves using computer vision to analyze images and detect the presence or absence of diseased organs such as cancer (e.g., Erickson et al., 2017; Giger, 2018; Suzuki, 2017). This research often gets attention because the algorithms and resulting technologies repeatedly outperform medical experts in the diagnosis of diseased organs from medical images. It should be noted, however, that these are in proscribed instances of diagnosis. An AI tool that is great at identifying cancerous lung cells is unlikely to automatically be good at identifying cancerous heart cells, cancerous brain cells, or predicting pneumonia.
Diagnosing ASD
More directly in the behavioral health realm and specific to many practicing behavior analysts, researchers have begun to develop AI-based tools to diagnose ASD (e.g., Erden et al., 2021; Song et al., 2019). To reduce assessment time, machine learning has been used to identify which assessment questions are the greatest predictors of ASD (e.g., Choi et al., 2020; Kosmicki et al., 2015). In turn, shorter assessment durations may increase the rate at which assessments can be completed and increase overall access to care. Researchers have also evaluated the efficacy of machine learning to analyze motor movements that are indicators of ASD (e.g., Crippa et al., 2015). These two strategies have been combined in mobile apps that include an abbreviated assessment and video recording of the child (Abbas et al., 2020; Duda et al., 2016). Yet the most advanced use of AI in diagnosis can be seen in Autism AI (Shahamiri & Thabtah, 2020), a screening tool that uses deep learning algorithms that take data from users to inform predictions, as opposed to static algorithms based on assessment items.
Functional Assessment of Behavior
As another example relatable to many practicing behavior analysts, researchers have used wearable sensors and video cameras placed in heavily outfitted therapy rooms to collect data on multiple people’s movement within a room over time (e.g., Plotz et al., 2012). Once these data on the behavior and the environment have been collected, AI can be used to automatically detect and quantify behavior (Plotz et al., 2012). Specific to diagnosis and assessment, Cantin-Garside et al. (2020) used AI to detect and classify types of self-injurious behavior (SIB). Overall, these researchers were able to detect the occurrence of SIB with high accuracy. However, accuracy varied substantially when attempting to classify the type of SIB with hair pulling being classified most accurately (97.2%) and pulling teeth with an object being classified least accurately (74.8%). AI has also been used to detect motor (Fasching et al., 2013) and vocal stereotypy (Dufour et al., 2020); and to inform conditions to include in functional analyses (Bailey et al., 2021). If embedded into clinical contexts, such technologies could reduce the burden of manual data collection by humans. In turn, automated data collection could free up their attention to respond to other clinical behaviors, reduce errors from manual data collection, and provide more accurate and immediate detection and assessment of ongoing behavior leading to more immediate intervention.
Analyzing Patterns of Health Behavior
Many health behaviors and choices involve physical activity and movement throughout environments humans have built. In this article, AI has been used to analyze patterns in streaming physiological and behavior data via wearable technologies (Asch et al., 2012; Ed-daoudy & Maalmi, 2018; Jones et al., 2011; Nair et al., 2018). Baseline data can be gathered on physiological behavior (e.g., heart rate, skin conductance), operant behavior (e.g., daily steps, posture while seated at work, diet logs, CO submissions as proxy for cigarettes smoked), and environmental conditions contacted (e.g., neighborhoods traversed). For clients presenting with a pattern of health behavior they would like to change, these data may allow for a direct functional assessment of the time of day and environmental conditions that predict unhealthy and healthy behavior. For individuals without current concern for their behavioral health, deviations from typical patterns of baseline behavior might suggest a medical or behavioral issue in need of attention. Once identified or predicted, the individual or their BHP can be alerted so that appropriate action can be taken. Because AI can incorporate hundreds or thousands of variables with relative ease, predictive time-series analytics can be accomplished that are well above traditional visual analysis involving one, or perhaps a few, independent variables.
Predicting Low-Rate, High-Intensity Behavior
Another common challenge in the assessment of behavioral health are low-rate high-intensity responses (e.g., heart attack, suicide). Researchers working in preventive medicine or preventive behavioral health have begun to use AI to tackle the challenge of predicting and preventing these responses. For example, researchers have leveraged machine learning techniques on physiological data and data from other electronic healthcare records (EHRs) to predict one of the most common causes of death globally: heart attacks (e.g., Nasrabadi & Haddadnia, 2016; Srinivas et al., 2010). Such systems could be used by BHPs to proactively identify when interventions need to be inserted or modified as the risk of heart attack increases, and subsequently scaled back as risks decreased. In another example, AI has been used to predict suicidal behaviors (Carson et al., 2019; Ji et al., 2019; Walsh et al., 2017, 2018). Here, predictions were made via machine learning that analyzed EHR data, clinical notes, social media posts, the videos people had watched on the Internet, and peoples’ search history. Facebook and Twitter already monitor their users’ posts for suicidal thoughts with the aim to prevent attempts (Coppersmith et al., 2018; Ji et al., 2019). BHPs could similarly use those same data streams and analytic methods to focus on other health behaviors.
Generating Diagnostic Reports
Once a diagnosis has been made or an assessment completed, BHPs often need to write up their findings for several audiences. These audiences include the client or patient, the third-party payor likely to reimburse for the assessment and fund subsequent intervention, and other BHPs who may prefer detail and jargon outside what the client or payor wants to read. Here, AI can be used to reduce this administrative burden by automatically generating diagnostic reports where the content is specific to the client, the insurance company, and other BHPs (e.g., Luh et al., 2019). Further, when these reports use the diagnosis or assessment results produced via computer vision or machine learning algorithms, the confidence of a correct diagnosis can be precisely quantified—a feature that humans are unlikely to be able to accomplish with similar precision. In turn, the confidence and probabilities of various diagnoses and biobehavioral mechanisms that contribute to the behavioral health condition can be used to inform intervention design.
AI to Improve Intervention Design
Continuing along the prototypical patient journey (Fig. 1), once an assessment has been conducted, BHPs will then use that information to create an individualized therapeutic program. This program is typically tailored to the patient to maximize the probability that they obtain the best possible outcome as determined by evidence-based practice (Slocum et al., 2014) and the patient’s own definition of health and well-being. In medicine, this is sometimes referred to as precision medicine, or the idea of tailoring an intervention to each unique individual based on the totality of presenting facts (Food & Drug Administration, 2018). Tailoring interventions is not novel for behavior analytic practitioners. However, AI offers the possibility to automate the tailoring process using a greater number of variables. For example, researchers have combined all available biological information about cancerous tissue and data about the individual’s genetic makeup to identify the most advantageous treatment combination of which drugs to use and what dosage is likely to optimally treat the cancer (Adir et al., 2019).
Predicting Response-to-Intervention
Within the behavioral health realm, researchers have begun to use machine learning to predict a patient’s response to intervention. For example, Cox et al. (2021) used NLP to numerically describe patients’ written descriptions of their experience during a psychedelic-assisted therapeutic event. The output of these models was then used with a second set of machine learning algorithms to predict the degree to which the individuals successfully reduced or quit using alcohol, cannabis, opioids, or stimulants. More directly related to ABA for individuals with ASD, Linstead et al. (2015) used AI to predict goal mastery as a function of treatment hours, age, and gender.
NLP could likewise be used at the onset and throughout behavioral interventions to provide useful information to BHPs. For example, NLP could be used to analyze patient intake interviews that could suggest treatment parameters (e.g., intensity, format) to a clinician. NLP could also be used to analyze clinical session notes. These data could be used to predict client performance or staff training needs. For example, if a RBT notes the client “did not sleep the night before,” a notification could be sent to the team that there may be an increase in problem behavior or decreased performance during skill acquisition. NLP of session notes may also provide predictions of staff behavior. The words used or structure of sentences may indicate additional training is warranted. For example, notes that describe the client as “mad” may suggest a review of functions of behavior and/or operational definitions would be useful. If a note describes the client “didn’t want to,” the BCBA could be notified the client may be due for updated preference and reinforcer assessments, or the team might benefit from reviewing motivating operations.
Efficient Use of Resources
All healthcare practitioners have constraints to what they can do because of time, money, limits to human learning or physiological adaptability, or other resource limitations. In turn, by understanding how many different behaviors group together functionally, BHPs can use this information to determine exactly how they will allocate their limited clinical resources to maximize the therapeutic effects of their intervention. Here, researchers have begun to use machine learning to identify how different behaviors group together functionally (Cox et al., 2019). Once the similarity between responses or response classes are identified, BHPs can better determine how allocating clinical resources is likely to have the greatest impact and to design their intervention accordingly. As a question, if a practitioner can only focus their intervention on five things, which five things give them the greatest net impact to someone’s behavioral repertoire?
Patient–Provider Matching
Human interactions are dynamic, socially nuanced, and include a host of variables that are not always observed or measured. That is, a behavioral or educational intervention delivered by one practitioner or teacher might look different than the same behavioral or educational intervention implemented by another person. Based on these differences, researchers can use AI to optimize the patients that are assigned to a healthcare practitioner based on the clients’ presenting symptomatology and the doctors’ demonstrated skill in treating different medical conditions or implementing different interventions (e.g., Field & Caetano, 2010; Zilcha-Mano et al., 2022). Optimizing a BHP’s clinical caseload is likely to maximize their abilities to help their patients and also prevent burnout (e.g., Anderson et al., 2022; Hassanzadeh et al., 2022). On the flip side of that interaction, AI has also been used to match patients with a team of healthcare providers that are best suited to the totality of their presenting health concerns, their cultural background, and any other dimension along which the researchers have patient and provider data (Nie et al., 2017). Together, these allow optimal patient caseloads to be built for individual BHPs, and the optimal treatment team to be built for individual patients.
AI to Improve Intervention Implementation
Patient Engagement and Adherence
The third phase of the prototypical patient journey (Fig. 1) is the implementation of the designed intervention. One significant impediment to maximizing treatment outcomes stems from BHPs’ struggle to keep clients engaged in an effective intervention and to maintain treatment fidelity once an intervention has begun. Patient engagement and adherence is important because the more patients proactively participate in their own well-being and care and the more likely patients are to adhere to recommended interventions, the better the health-care outcomes and the patient’s overall experience (Davenport & Kalakota, 2019). As a result, AI has been used to provide real-time delivery of intervention-related content or intervention-related support that has been adapted or tailored based on the data collected from that individual. For example, these just-in-time-adaptive interventions (JITAIs) have been used to increase physical activity, improve dietary patterns and food consumption, and to improve health-related decision making in everyday environments (e.g., Hardeman et al., 2019; Rabbi et al., 2015; Van Dantzig et al., 2013; Van Dantzig et al., 2018). In this same area, AI has been used to provide individualized prompts to refill and take prescribed medication as well as prompts to make healthier decisions that decrease incidence of diseases such as cancer (Misawa et al., 2020), and to reduce addiction-related behaviors such as drug abuse and gambling (e.g., Carpenter et al., 2020).
Analysis of Intervention Effects
An important part of intervention delivery is the ongoing analysis of intervention effects. In this article, AI has been used to automatically analyze single-case intervention data with error rates lower than the best structured decision criteria (Lanovaz et al., 2020). At present, these tools might best be considered as supplemental aides to the visual analysis of data (Lanovaz & Hranchuk, 2021). However, if the models that result from these algorithms continue to improve and BHPs learn to use them well, AI with single-case intervention graphs could allow BHPs to automate routine clinical decisions across clients on their caseload. In turn, this would free up BHPs to spend more time on more difficult decisions or more challenging cases or to increase the overall number of client programs they supervise at any one point in time.
The analysis of within-subject time-series data could also benefit from AI through the inclusion of more variables. For example, data plotted over time is the primary method that many different industries use to think about and analyze their data. Adding AI to this mix would allow BHPs the ability to incorporate a greater number of biological, environment, and behavioral variables into their analyses to predict the multiple control of complex behavior over time (e.g., Cox, 2023). Behavior analysts that embrace computational techniques to analyze data over time are a short step away from powerful tools that can help them to better understand the complexity of multiply controlled and dynamic behavior change. And, the tools and computational techniques are often open source (i.e., free to use) that places like Facebook, Amazon, and Google make freely available for analyzing these types of data.
Analyzing Behavior during Clinical Sessions
AI has also been used in areas more directly related to working one-on-one with someone with ASD or DD. One exciting area uses speech recognition devices that help individuals with speech disabilities communicate vocally and more clearly (Hawley et al., 2013). With skilled behavior analysts, these tools could be combined with simple shaping and chaining procedures to shift these tools from vocal amplification devices to therapeutic devices that increase the intelligibility and comprehensibility of someone’s vocal speech.
Another really exciting area where AI is used in intervention implementation is facial recognition software. Researchers here are using AI to identify the emotions that someone displays in real-time (Flynn et al., 2020). Behavioral practitioners could use this technology in several ways. One way would be to help individuals learn to recognize the emotions that other people display—perhaps in a phone app or through augmented reality. In addition, this technology could be used to give a learner immediate biofeedback on the emotions they might be displaying and to help them better associate their facial expressions with their private events.
In total, AI is already being used to deliver or to improve the implementation of behavior-related interventions or to improve the efficiency of clinical decisions that are made relative to behavioral interventions. Several low-hanging AI fruits seem to exist in the areas of speech recognition and facial-emotion recognition. Both of which could seemingly be added as tools to improve existing verbal behavior or emotion-based intervention programs.
AI to Improve Intervention Withdrawal or Monitoring
At some point in time, some patients or clients may fade out their contact with intensive interventions. This may occur because an acute condition has gone into remission or because a chronic condition can be successfully self-managed. The majority of the work in this area has used some version of automated hovering or ambient intelligence to collect ongoing data about the person in many of the same ways we discussed in previous sections (e.g., Aziz et al., 2009; Jerez-Aragones et al., 2003; Salleh et al., 2017).
Automated Hovering and Ambient Intelligence
Automated hovering and ambient intelligence often involve wearable technology (e.g., FitBit, Apple watch) or environmental sensors and cameras. These devices are then used to collect data that allows researchers or BHPs to track and analyze patterns in what people are doing, where they are going, and their physiological state. In turn, these data can be used with AI to predict: if and when people will relapse to using drugs after they successfully quit (e.g., Asch et al., 2012; Budney et al., 2019; Dallery et al., 2015), when someone might experience a relapse of cancer following successful treatment and remission (e.g., Good et al., 2018), or when someone might relapse to severe depression and be at-risk of suicide following a successful behavioral intervention (e.g., Carson et al., 2019; Ji et al., 2019; Walsh et al., 2017, 2018). Of note, much of this work has been accomplished without the collaboration of BHPs or researchers who have a robust understanding of the behavioral processes likely to control the recurrence of clinical levels of physiological or behavioral phenomena (e.g., Greer & Shahan, 2019; Liggett et al., 2018; Muething et al., 2022). It is not hard to imagine how powerful these technologies might become if BHPs were to increase their collaboration with researchers on these technologies.
Prediction and Prevention of Relapse
Treatment withdrawal and avoiding relapse have arguably been considered a distinct piece of the intervention puzzle. However, when viewed through a different lens, it is hard to know whether someone is an ex-client or patient, a future client or patient, or whether these labels are being trivially applied. When viewed through this lens, the research and work related to intervention withdrawal and monitoring can be thought of similarly to the research and use cases described above relative to diagnosis and assessment. The main difference here being that the BHP or researcher would have much more baseline data about the individual as to the function of their behavior and what intervention components are likely to successfully lead to behavior change. In particular, using AI with automated hovering and ambient intelligence allows BHPs and researchers to take a more holistic view of this cycle as opposed to thinking about treatment as a linear pipeline with a clear beginning and end.
AI to Improve Administrative Systems and Process
Creating Decision Aides via AI Summaries of Research Literature
Wrapping around the entire prototypical client experience and treatment pipeline are a host of administrative systems and processes to support each of these steps. Here researchers are helping BHPs by using machine learning to automatically extract and synthesize the massive amounts of research literature that are being published (e.g., Marshall & Wallace, 2019). This condensed research can then be provided to BHPs in the form of easily accessible resources to aid their decision making and so that they can stay abreast of the literature. Also in this area, researchers have begun to use AI to try to predict the next major discoveries within different fields and to guide scientific researchers toward fruitful and powerful research topics (e.g., Rzhetsky et al., 2015). When spun toward behavioral health research, this same strategy could be used to summarize the published behavior analytic literature and to identify opportunities to enhance the clinical services BHPs deliver (e.g., Sosine & Cox, 2023).
Improving Patient Experience while Reducing Cost
AI has also been used to improve the patient experience with the healthcare system. For example, researchers have used AI to analyze patient flows through hospital administrative processes (e.g., Ellahham & Ellahham, 2019). Patient flow refers to how people move through a healthcare facility related to medical care, contact and use of physical resources, and the internal systems needed to move patients from admission to discharge (NEJM Catalyst, 2018). For example, AI has been used to optimize patient and staff scheduling based on forecasts of the times, days, and weeks when people are more likely to seek services (e.g., Jones et al., 2008). When combined with knowledge about staff availability, ideal schedules, and patterns of resource use, researchers can use such forecasts to improve service use and reduce cost (e.g., Tenhunen et al., 2018).
Improving Direct Staff Schedules
Researchers studying the logistics of moving goods around the country have used AI to find optimal solutions to the traveling salesman problem (e.g., Karaboga & Gorkemli, 2019; Xing et al., 2008). That is, planning the optimal route to go from one location to another when certain stops must be made along the way. Combined with staff availability, these tools could be of tremendous help for ABA agencies trying to coordinate peoples’ work and personal schedules with client session times to reduce the amount of time and distance their RBTs must travel each day. In fact, CentralReach has already incorporated AI in their scheduling system (CentralReach, 2020).
Feedback and Prompts for Providers
Researchers within the area of behavioral economics have demonstrated repeatedly that humans, including healthcare providers, do not always make the best decisions (e.g., Bickel et al., 2020; Makary & Daniel, 2016; Thompson et al., 2013). To help healthcare providers make better decisions, researchers have used AI to analyze and predict the clinical decisions that healthcare practitioners make (e.g., Ninness et al., 2021) to then determine the optimal intervention strategies based on the unique symptoms and backgrounds of different patients and their unique conditions (Komorowski et al., 2018).
Administratively, such research and tools could be used to help manage the performance of providers in at least two ways. First, once a likely optimal intervention path is known and the requisite systems built out, clinical decision-making aids can be created that prompt BHPs proactively on what decision is likely best. Second, where real-time prompts are unavailable, ad hoc analyses could be conducted to determine what would have been the best decision to make and the resulting feedback could be provided to the healthcare providers to improve the interventions they deliver.
Lastly, many of the use cases described above are applicable to administrative use of AI tools. Administrative processes are often aimed at improving the efficient use of available resources while maximizing patient outcomes and the overall satisfaction of patients and employees. Many previously discussed topics relate to these objectives such as optimizing caseloads for a single healthcare provider, matching patients with the ideal provider, and automating report generation that are unique to distinct audiences. BHPs do not operate in a vacuum. They are embedded in larger, complex, and dynamic organizational systems. Organizational systems collect and use data to improve efficiencies. And, AI can or is being used to improve many of these areas of administrative systems and processes.
Finding a Role
To this point in the manuscript, we have described the many areas along the prototypical behavioral health patient journey wherein AI has been researched or successfully deployed. We hope many readers found at least one area interesting and directly applicable to their everyday work settings. We also hope that at least some of those readers are interested in learning how they might start to bring AI to behavioral health more broadly. In this final section we describe three potential roles that readers might take to begin working toward the inclusion of AI in behavioral health. We refer to these three potential different paths as the designer, the implementer, and the supporter (Fig. 2).
Fig. 2.
Potential roles to get started with AI
The Designer
The designer is someone who wants to bring AI to an area that is not currently represented or easily accessible, or who wants AI to play a primary role in their career. The designer would be someone who is interested in designing and building some portion of the data pipeline spanning data collection, data storage and transformation, data analysis via AI, and model deployment. Within behavior analysis, this role might be akin to the area of the experimental analysis of behavior (EAB) where the researcher is interested in basic questions about how things work and how they might translate that understanding for a specific research question or goal.
Readers of this journal who are interested in this role will likely have to learn some new skills. Depending on the area of the total data pipeline that they are interested in, the designer will likely have to improve (or dust off) their skills in mathematics, statistics, computer programming, and computer science. Readers interested in this path can do a quick internet search to find degree programs related to the job titles of data engineer, data scientist, data analyst, and machine learning engineer. Obtaining a formal degree in this area certainly would carry many benefits. However, aside from a formal degree, there are many opportunities to develop the same list of skills outlined in the degree programs through free courses and online tutorials, such as Coursera (https://www.coursera.org) and freeCodeCamp (https://www.freecodecamp.org). Readers who opt for this free course route would do well to find a mentor in this area as they develop their professional repertoire. There are also some related resources created specifically for behavior analysts. For example, Turgeon and Lanovaz (2020) wrote a step-by-step tutorial for using machine learning as it applies to behavioral research.
The Implementer
Another potential role readers might take would be as an implementer of AI solutions in their practice or research. That is, rather than focusing on the technical aspects of how to build data pipelines and analyze the data, the implementer would focus on how to use the AI tool effectively to improve patient outcomes. In loose analogy, the relationship between the designer and the implementer might be similar to the relationship between researchers pairing up from EAB and ABA. The designer is likely to spend more of their time developing their skills to perfect the AI tool. Whereas the implementer is likely to spend more of their time developing their skills to perfect the use of the tool within novel areas of service delivery.
Readers of this journal who are interested in this role will likely have to learn to think differently about their data and the delivery of behavioral health services. As noted above, AI technologies use a broad and large amount of data to improve the efficiency of systems and to identify novel patterns in datasets. Here, critical questions that the implementer would need to solve surround what data are and are not currently being collected, the best level to collect the data at based on a robust understanding of behavioral function and the data needed to describe it well, and how the efficiencies or insights gained from the use of the AI tool can be practically worked into the day-to-day behaviors of the practicing BHP.
The Supporter
As an alternative, behavior analysts may prefer to serve the role of the supporter. This role is likely best for those who may not be interested in learning new skills or figuring out how to implement AI tools within their practice, but who are interested in the promises and possibilities that AI as a tool has to improve behavioral healthcare. For these readers, there are at least three ways they can support the work of designers and implementers. One way to support designers and implementers is by providing data. AI tools require a lot of labeled data to build models of sufficient accuracy and generalizability to be used outside of the often highly circumscribed research settings. Data are expensive to collect and curate. Practicing behavior analysts as a field, however, collect massive amounts of labeled data on a daily basis. Potential supporters are sitting on troves of data that could be leveraged for many variations of AI research.
A second way to support designers and implementers is to help beta test AI tools and products outside of their development environments. Every instance of generalizing an AI tool with new people or to new situations is going to involve mistakes and errors that need to be corrected. Beta testing these tools as they are being developed helps the designer and implementers fix these bugs. This also carries the bonus that the supporter gets access to cutting-edge technological tools that are not yet widely available.
A final way to support designers and implementers is to provide feedback and specific use cases around their “pain points” where AI tools would lead to the greatest impact. Everyone has strengths and blind spots. The designers and implementers described above are likely to be people who have found a job where they can dedicate 40+ hr per week to thinking about, experimenting with, and solving practical problems related to the design and implementation of a specific AI tool. It seems likely that at least some of these individuals will not be adept at running ABA businesses, will not understand the practical constraints and logistics of implementing new technologies in a larger behavioral health clinical-business context, nor have a pulse on what areas of the behavioral healthcare could benefit most from improved efficiency and insight. Thus, potential supporters could play a significant role in helping to shape or guide what designers and implementers focus their efforts on.
For those interested in being a supporter, the next step would be to find and connect with a designer or implementer. This might be accomplished via a few relevant special interest groups through the Association for Behavior Analysis International such as Behavior Analysis and Technology or Behavior Analysis and Selectionist Robotics. Another community of behavior analysts interested in the relationship between computer science and behavior science is Behavior Analysts Who Code. Lastly, it seems apropos to point to additional guidance for developing competence in a new area such as that by LeBlanc et al. (2012) and Brodhead et al. (2018).
Conclusion
AI involves providing instructions to computers so they learn about patterns in datasets. Many of the behaviors, decisions, systems, and processes that BHPs engage in on a daily basis are being touched by AI. Many of these systems result in improved speed, accuracy, efficiency, reach, and scalability of access to high quality behavioral healthcare services. And, researchers have begun to demonstrate how AI can lead to improvements in all aspects of the prototypical client journey. Behavioral health providers and their employing organizations that learn to practically adopt AI will likely gain significant advantages in terms of improved patient outcomes and more cost-effective business operations. For those that are interested in helping to shape how AI will be used in ABA more specifically, several possible paths exist. These include working as a designer of AI systems, learning the most effective and practical way to implement AI systems in existing clinical processes and workflows, or in supporting designers and implementers by providing access to quality data, beta-testing AI tools, or helping to guide what the AI systems focus on to maximize the benefit gained from such efforts. In the modified words of William Gibson, AI for behavioral health is already here, it is just not very distributed (National Public Radio [NPR], 2018). We hope you join us in figuring out how to take advantage of the promises and possibilities of AI for ABA.
Funding
None.
Data Availability
No datasets were generated or analyzed during the current study.
Declarations
Conflicts of Interest
The authors have no conflicts of interest to disclose.
IRB Note
N/A.
Footnotes
Like behavior analysis, artificial intelligence (AI) is comprised of a broad set of behaviors implemented by many different people and toward many different applications. Thus, no section in a single article is likely to fully encompass all methods, approaches, applications, and technical specifications required to fully define AI; especially considering that the definition of what counts as “intelligent” is currently debated. Compounding this complexity is that building and deploying AI systems is often highly interdisciplinary further making it difficult to comprehensively define the totality of what “counts as AI.” Readers interested in diving more into the technical details are encouraged to read Müller and Guido (2016), Everitt et al. (2011), Goodfellow et al. (2016), and Sutton and Barto (1998).
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Abbas H, Garberson F, Liu-Mayo S, Glover E, Wall DP. Multi-modular AI approach to streamline autism diagnosis in young children. Scientific Reports. 2020;10(1):1–8. doi: 10.1038/s41598-020-61213-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Adir O, Poley M, Chen G, Froim S, Krinsky N, Shklover J, Shainsky-Roitman J, Lammers T, Schroeder A. Integrating artificial intelligence and nanotechnology for precision cancer medicine. Advanced Materials. 2019;32(13):1901989. doi: 10.1002/adma.201901989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Anderson, D., Bjarnadottir, M. V., & Nenova, Z. (2022). Machine learning in healthcare: Operational and financial impact. In V. Babich, J. R. Birge, & G. Hilary (Eds.), Innovative technology at the interface of finance and operations. Springer Series in Supply Chain Management (vol. 11, pp. 153–174). Springer. 10.1007/978-3-030-75729-8_5
- Asch DA, Muller RW, Volpp KG. Automated hovering in health care—Watching over the 5000 hours. New England Journal of Medicine. 2012;367(1):1–3. doi: 10.1056/NEJMp1203869. [DOI] [PubMed] [Google Scholar]
- Aziz, A. A., Klein, M. C. A., & Treur, J. (2009). Modeling an ambient agent to support depression relapse prevention. 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence & Intelligent Agent Technology. 10.1109/WIIAT.2009.296
- Bailey JD, Baker JC, Rzeszutek MJ, Lanovaz MJ. Machine learning for supplementing behavioral assessment. Perspectives on Behavior Science. 2021;44:605–619. doi: 10.1007/s40614-020-00273-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Behavioral Analysis Certification Board. (n.d.). About behavior analysis. https://www.bacb.com/about-behavior-analysis/
- Bertz JW, Epstein DH, Preston KL. Combining ecological momentary assessment with objective, ambulatory measures of behavior and physiology in substance-use research. Addictive Behaviors. 2018;83:5–17. doi: 10.1016/j.addbeh.2017.11.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel, W. K., Athamneh, L. N., Snider, S. E., Craft, W. H., DeHart, W. B., Kaplan, B. A., & Basso, J. C. (2020). Reinforcer pathology: Implications for substance abuse intervention. In H. de Wit, & J. D. Jentsch (Eds.), Recent advances in research on impulsivity and impulsive behaviors. Current Topics in Behavioral Neurosciences (vol. 47, pp. 139–162). Springer. 10.1007/7854_2020_145 [DOI] [PubMed]
- Brodhead MT, Quigley SP, Wilczynski SM. A call for discussion about scope of competence in behavior analysis. Behavior Analysis in Practice. 2018;11(4):424–435. doi: 10.1007/s40617-018-00303-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Budney, A. J., Borodovsky, J. T., Marsch, L. A., & Lord, S. E. (2019). Technological innovations in addiction treatment. In I. Danovitch & L. J. Mooney (Eds.), The assessment and treatment of addiction (pp. 75–90). Elsevier. 10.1016/B978-0-323-54856-4.00005-5
- Cantin-Garside KD, Kong Z, White SW, Antezana L, Kim S, Nussbaum MA. Detecting and classifying self-injurious behavior in autism spectrum disorder using machine learning techniques. Journal of Autism & Developmental Disorders. 2020;50(11):4039–4052. doi: 10.1007/s10803-020-04463-x. [DOI] [PubMed] [Google Scholar]
- Carpenter SM, Menictas M, Nahum-Shani I, Wetter DW, Murphy SA. Developments in mobile health just-in-time adaptive interventions for addiction science. Current Addiction Reports. 2020;7:280–290. doi: 10.1007/s40429-020-00322-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carson NJ, Mullin B, Sanzhez MJ, Lu F, Yang K, Menezes M, Cook BL. Identification of suicidal behavior among psychiatrically hospitalized adolescents using natural language processing and machine learning of electronic health records. PLoS ONE. 2019;14(2):e0211116. doi: 10.1371/journal.pone.0211116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- CentralReach. (2020). CentralReach acquires AI-based scheduling algorithm to automate scheduling operations for autism and ABA care delivery.https://centralreach.com/centralreach-acquires-ai-based-scheduling-algorithm-to-automate-scheduling-operations-for-autism-aba-care-delivery/
- Choi ES, Yoo HJ, Kang MS, Kim SA. Applying artificial intelligence for diagnostic classification of Korean autism spectrum disorder. Psychiatry Investigation. 2020;17(11):1090–1095. doi: 10.30773/pi.2020.0211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coppersmith G, Leary R, Crutchley P, Fine A. Natural language processing of social media as screening for suicide risk. Biomedical Informatics Insights. 2018;10:1–11. doi: 10.1177/1178222618792860. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cox, D. J. (2023). Models, the matrix, and the complex multiple control of behavior. Perspectives on Behavior Science.
- Cox, D. J., Johnson, P. S., & Johnson, M. W. (2019). Using quantitative models and machine learning to describe discounting across amounts, signs, and commodities. Association for Behavior Analysis International (ABAI) Annual Convention. Chicago, IL.
- Cox DJ, Garcia-Romeu A, Johnson MW. Predicting changes in substance use following psychedelic experiences: Natural language processing of psychedelic session narratives. American Journal of Drug & Alcohol Abuse. 2021;47(4):444–454. doi: 10.1080/00952990.2021.1910830. [DOI] [PubMed] [Google Scholar]
- Crippa A, Salvatore C, Perego P, Forti S, Nobile M, Molteni M, Castiglioni I. Use of machine learning to identify children with autism and their motor abnormalities. Journal of Autism & Developmental Disorders. 2015;45(7):2146–2156. doi: 10.1007/s10803-015-2379-8. [DOI] [PubMed] [Google Scholar]
- Dallery J, Kurti A, Erb PA. New frontier: Integrating behavioral and digital technology to promote health behavior. The Behavior Analyst. 2015;38:19–49. doi: 10.1007/s40614-014-0017-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthcare Journal. 2019;6(2):94–98. doi: 10.7861/futurehosp.6-2-94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duda M, Daniels J, Wall D. Clinical evaluation of a novel and mobile autism risk assessment. Journal of Autism & Developmental Disorders. 2016;46(6):1953–1961. doi: 10.1007/s10803-016-2718-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dufour MM, Lanovaz MJ, Cardinal P. Artificial intelligence for the measurement of vocal stereotypy. Journal of the Experimental Analysis of Behavior. 2020;114(3):368–380. doi: 10.1002/jeab.636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ed-daoudy, A., & Maalmi, K. (2018). Application of machine learning model on streaming health data event in real-time to predict health status using spark. International Symposium on Advanced Electrical & Communication Technologies (ISAECT), 1–4. 10.1109/ISAECT.2018.8618860
- Eldevik S, Hastings R, Hughes JC, Jahr E, Eikeseth S, Cross S. Meta-analysis of early intensive behavioral intervention for children with autism. Journal of Clinical Child & Adolescent Psychology. 2009;38(3):439–450. doi: 10.1080/15374410902851739. [DOI] [PubMed] [Google Scholar]
- Ellahham S, Ellahham N. Use of artificial intelligence for improving patient flow and healthcare delivery. Journal of Computer Science & Systems Biology. 2019;12(3):1000303. [Google Scholar]
- Epstein DH, Tyburski M, Craig IM, Phllips KA, Jobes ML, Vahabzadeh M, Mezghanni M, Lin J-L, Furr-Holden CDM, Preston KL. Real-time tracking of neighborhood surroundings and mood in urban drug misusers: Application of a new method to study behavior in its geographical context. Drug & Alcohol Dependence. 2014;134:22–29. doi: 10.1016/j.drugalcdep.2013.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erden YJ, Hummerstone H, Rainey S. Automating autism assessment: What AI can bring to the diagnostic process. Journal of Evaluation in Clinical Practice. 2021;27(3):485–490. doi: 10.1111/jep.13527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erickson BJ, Korfiatis P, Akkus Z, Kline TL. Machine learning for medical imaging. RadioGraphics. 2017;37(2):505–515. doi: 10.1148/rg.2017160130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Everitt B, Landau S, Leese M, Stahl D. Cluster analysis. 5. Wiley; 2011. [Google Scholar]
- Fasching, J., Walczak, N., Toczyski, W. D., Cullen, K., Sapiro, G., Morellas, V., & Papanikolopoulos, N. (2013). Assisted labeling of motor stereotypies in video. [Poster presentation]. American Academy of Child & Adolescent Psychiatry 60th Annual Meeting, Orlando, FL, USA.
- Field C, Caetano R. The role of ethnic matching between patient and provider on the effectiveness of brief alcohol interventions with Hispanics. Alcoholism: Clinical & Experimental Research. 2010;34(2):262–271. doi: 10.1111/j.1530-0277.2009.01089.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flynn M, Effraimidis D, Angelopoulou A, Kapetanios E, Williams D, Hemanth J, Towell T. Assessing the effectiveness of automated emotion recognition in adults and children for clinical investigation. Frontiers in Human Neuroscience. 2020;14:70. doi: 10.3389/fnum.2020.00070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Food & Drug Administration. (2018). Precision medicine.https://www.fda.gov/medical-devices/in-vitro-diagnostics/precision-medicine
- Giger ML. Machine learning in medical imaging. Journal of the American College of Radiology. 2018;15(3):512–520. doi: 10.1016/j.jacr.2017.12.028. [DOI] [PubMed] [Google Scholar]
- Good Z, Sarno J, Jager A, Samusik N, Aghaeepour N, Simonds EF, White L, Lacayo NJ, Fantl WJ, Fazio G, Gaipa G, Biondi A, Tibshirani R, Bendall SC, Nolan GP, Davis KL. Single-cell developmental classification of B cell precursor acute lymphoblastic leukemia at diagnosis reveals predictors of relapse. Nature Medicine. 2018;24:474–483. doi: 10.1038/nm.4505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goodfellow I, Bengio Y, Courville A. Deep learning. MIT Press; 2016. [Google Scholar]
- Greer BD, Shahan TA. Resurgence as choice: Implications for promoting durable behavior change. Journal of Applied Behavior Analysis. 2019;52(3):816–846. doi: 10.1002/jaba.573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hardeman W, Houghton J, Lane K, Jones A, Naughton F. A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity. International Journal of Behavioral Nutrition & Physical Activity. 2019;16:31–51. doi: 10.1186/s12966-019-0792-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hassanzadeh H, Boyle J, Khanna S, Biki B, Syed F. Daily surgery caseload prediction: Towards improving operating theatre efficiency. BMC Medical Informatics and Decision Making. 2022;22:151–166. doi: 10.1186/s12911-022-01893-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hawley MS, Cunningham SP, Green PD, Enderby P, Palmer R, Sehgal S, O’Neill P. A voice-input voice-output communication aid for people with severe speech impairment. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2013;21:23–31. doi: 10.1109/TNSRE.2012.2209678. [DOI] [PubMed] [Google Scholar]
- Heward WL, Critchfield TS, Reed DD, Dietrich R, Kimball JW. ABA from a to z: Behavior science applied to 350 domains of socially significant behavior. Perspectives on Behavior Science. 2022;45:327–359. doi: 10.1007/s40614-022-00336-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jerez-Aragones JM, Gomez-Ruiz JA, Ramos-Jimenez G, Munoz-Perez J, Alba-Conejo E. A combined neural network and decision trees model for prognosis of breast cancer relapse. Artificial Intelligence in Medicine. 2003;27(1):45–63. doi: 10.1016/S0933-3657(02)00086-6. [DOI] [PubMed] [Google Scholar]
- Ji S, Pan S, Li X, Cambria E, Long G, Huang Z. Suicidal ideation detection: A review of machine learning methods and applications. IEEE Transactions on Computational Social Systems. 2019;8(1):214–226. doi: 10.48550/arXiv.1910.12611. [DOI] [Google Scholar]
- Jones SS, Thomas A, Evans RS, Welch SJ, Haug PJ, Snow GL. Forecasting daily patient volumes in the emergency department. Academic Emergency Medicine. 2008;15(2):159–170. doi: 10.1111/j.1553-2712.2007.00032.x. [DOI] [PubMed] [Google Scholar]
- Jones, V. M., Mendes Batista, R. J., Bults, R. G. A., op den Akker, H., Widya, I. A., Hermens, H. J., Huis in ‘t Veld, Tonis, T. M., & Vollenbroek-Hutten, M. R (2011). Interpreting streaming biosignals: in search of best approaches to augmenting mobile health monitoring with machine learning for adaptive clinical decision support. Paper presented .at Workshop on Learning from Medical Data Streams, LEMEDS 2011, Bled, Slovenia.
- Karaboga D, Gorkemli B. Solving traveling salesman problem by using combinatorial artificial bee colony algorithms. International Journal on Artificial Intelligence Tools. 2019;28(1):195004. doi: 10.1142/S0218213019500040. [DOI] [Google Scholar]
- Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nature Medicine. 2018;24(11):1716–1720. doi: 10.1038/s41591-018-0213-5. [DOI] [PubMed] [Google Scholar]
- Kosmicki JA, Sochat V, Duda M, Wall DP. Searching for a minimal set of behaviors for autism detection through feature selection-based machine learning. Translational Psychiatry. 2015;5:e514. doi: 10.1038/tp.2015.7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kwan M, Wang J, Tyburski M, Epstein DH, Kowalczyk WJ, Preston KL. Uncertainties in the geographic context of health behaviors: A study of substance users exposure to psychosocial stress using GPS data. International Journal of Geographical Information Science. 2018;6:1176–1195. doi: 10.1080/13658816.2018.1503276. [DOI] [Google Scholar]
- Lanovaz MJ, Hranchuk K. Machine learning to analyze single-case graphs: A comparison to visual inspection. Journal of Applied Behavior Analysis. 2021;54(4):1541–1552. doi: 10.1002/jaba.863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lanovaz MJ, Giannakakos AR, Destras O. Machine learning to analyze single-case data: A proof of concept. Perspectives on Behavior Science. 2020;43(1):21–38. doi: 10.1007/s40614-020-00244-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LeBlanc LA, Heinicke MR, Baker JC. Expanding the consumer base for behavior-analytic services: Meeting the needs of consumers in the 21st century. Behavior Analysis in Practice. 2012;5(1):4–14. doi: 10.1007/BF03391813. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liggett AP, Nastri R, Podlesnik CA. Assessing the combined effects of resurgence and reinstatement in children diagnosed with autism spectrum disorder. Journal of the Experimental Analysis of Behavior. 2018;109(2):408–421. doi: 10.1002/jeab.315. [DOI] [PubMed] [Google Scholar]
- Linstead, E., German, R., Dixon, D., Granpeesheh, D., Novack, M. & Powell, A. (2015). An application of neural networks to predicting mastery of learning outcomes in the treatment of autism spectrum disorder. 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA). Miami, FL, USA. 10.1109/ICMLA.2015.214
- Linstead E, Dixon DR, Hong E, Burns CO, French R, Novack MN, Granpeesheh D. An evaluation of the effects of intensity and duration on outcomes across treatment domains for children with autism spectrum disorder. Translational Psychiatry. 2017;7(9):e1234. doi: 10.1038/tp.2017.207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luh JY, Thompson RF, Lin S. Clinical documentation and patient care using artificial intelligence in radiation oncology. Journal of the American College of Radiology. 2019;16(9):1343–1346. doi: 10.1016/j.jacr.2019.05.044. [DOI] [PubMed] [Google Scholar]
- Makary MA, Daniel M. Medical error the third leading cause of death in the US. British Medical Journal. 2016;353:i2139. doi: 10.1136/bmj.i2139. [DOI] [PubMed] [Google Scholar]
- Marsch LA, Lord SE, Dallery J. Behavioral healthcare and technology. Oxford University Press; 2015. [Google Scholar]
- Marshall IJ, Wallace BC. Toward a systematic review automation: A practical guide to using machine learning tools in research synthesis. Systematic Reviews. 2019;8:163. doi: 10.1186/s13643-019-1074-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mehta SJ, Volpp KG, Asch DA, Goldberg LR, Russell LB, Norton LA, Iannotte LG, Troxel AB. Rationale and design of EMPOWER, a pragmatic randomized trial of automated hovering in patients with congestive heart failure. Circulation: Cardiovascular Quality & Outcomes. 2019;12:e005126. doi: 10.1161/CIRCOUTCOMES.118.005126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Misawa D, Fukuyoshi J, Sengoku S. Cancer prevention using machine learning, nudge theory, and social impact bond. International Journal of Environmental Research and Public Health. 2020;17(3):790. doi: 10.3390/ijerph17030790. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muething C, Call N, Ritchey CM, Pavlov A, Bernstein AM, Podlesnik CA. Prevalence of relapse of automatically maintained behavior resulting from context changes. Journal of Applied Behavior Analysis. 2022;55(1):138–153. doi: 10.1002/jaba.887. [DOI] [PubMed] [Google Scholar]
- Müller A, Guido S. Introduction to machine learning with Python: A guide for data scientists. O’Reilly Media; 2016. [Google Scholar]
- Nair LR, Shetty SD, Shetty SD. Applying spark based machine learning to model on streaming big data for health status prediction. Computers & Electrical Engineering. 2018;65:393–399. doi: 10.1016/j.compeleceng.2017.03.009. [DOI] [Google Scholar]
- Nasrabadi A, Haddadnia J. Predicting heart attacks in patients using artificial intelligence methods. Modern Applied Science. 2016;10(3):66–78. doi: 10.5539/mas.v10n3p66. [DOI] [Google Scholar]
- National Public Radio. (2018). The science in science fiction.https://www.npr.org/2018/10/22/1067220/the-science-in-science-fiction
- NEJM Catalyst. (2018). What is patient flow? Innovations in patient care delivery. https://catalyst.nejm.org/doi/full/10.1056/CAT.18.0289
- Nie L, Zhang L, Yan Y, Chang X, Liu M, Shaoling L. Multiview physician-specific attributes fusion for health seeking. IEEE Transactions on Cybernetics. 2017;47:3680–3691. doi: 10.1109/TCYB.2016.2577590. [DOI] [PubMed] [Google Scholar]
- Ninness C, Yelick A, Ninness SK, Cordova W. Predicting heuristic decisions in child welfare: A neural network exploration. Behavior & Social Issues. 2021;30:194–208. doi: 10.1007/s42822-021-00047-1. [DOI] [Google Scholar]
- Plotz, T., Hammerla, N. Y., Rozga, A., Reavis, A., Call, N., & Abowd, G. D. (2012). Automatic assessment of problem behavior in individuals with developmental disabilities. UbiComp ’12: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, (pp. 391–400). 10.1145/2370216.2370276
- Rabbi M, Pfammatter A, Zhang M, Spring B, Choudhury T. Automated personalized feedback for physical activity and dietary behavior change with mobile phones: A randomized controlled trial on adults. Journal of Medical Internet Research mHealth & uHealth. 2015;3(2):e42. doi: 10.2196/mhealth.4160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ramesh, R. (2017). What is artificial intelligence? In 5 minutes. [Video]. YouTube. https://youtu.be/2ePf9rue1Ao
- Rzhetsky A, Foster JG, Evans JA. Choosing experiments to accelerate collective discovery. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(47):14569–14574. doi: 10.1073/pnas.1509757112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salleh AKM, Makhtar M, Jusoh JA, Lua PL, Mohamad AM. A classification framework for drug relapse prediction. Journal of Fundamental & Applied Sciences. 2017;9(6S):735–750. doi: 10.4314/jfas.v9i6s.55. [DOI] [Google Scholar]
- Shahamiri SR, Thabtah F. Autism AI: A new autism screening system based on artificial intelligence. Cognitive Computation. 2020;12(4):766–777. doi: 10.1007/s12559-020-09743-3. [DOI] [Google Scholar]
- Slocum TA, Detrich R, Wilczynski SM, Spencer TD, Lewis T, Wolfe K. The evidence-based practice of applied behavior analysis. The Behavior Analyst. 2014;37(1):41–56. doi: 10.1007/s40614-014-0005-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Song DY, Kim SY, Bong G, Kim JM, Yoo HJ. The use of artificial intelligence in screening and diagnosis of autism spectrum disorder: A literature review. Journal of the Korean Academy of Child & Adolescent Psychiatry. 2019;30(4):145–152. doi: 10.5765/jkacap.190027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sosine, J., & Cox, D.J. (2023). Identifying trends in the open-access behavior analytic literature via computational analyses (I): Simple descriptions of text. Analysis of Verbal Behavior. [DOI] [PMC free article] [PubMed]
- Srinivas K, Rani BK, Govrdhan A. Applications of data mining techniques in healthcare and prediction of heart attacks. International Journal on Computer Science and Engineering. 2010;2(2):250–255. [Google Scholar]
- Sutton RS, Barto AG. Reinforcement learning: An introduction. Bradford Book; 1998. [Google Scholar]
- Suzuki K. Overview of deep learning in medical imaging. Radiological Physics & Technology. 2017;10(3):257–273. doi: 10.1007/s12194-017-0406-5. [DOI] [PubMed] [Google Scholar]
- Tenhunen H, Hirvonen P, Linna M, Halminen O, Horhammer I. Intelligent patient flow management system at a primary healthcare center: The effect on service use and cost. In: Mantas J, Sonicki Z, Crişan-Vida M, Fišter K, Hägglund M, Kolokathi A, Hercigonja-Szekeres M, editors. Decision support systems and education. IOS Press; 2018. pp. 142–146. [PubMed] [Google Scholar]
- Thompson C, Aitken L, Doran D, Dowding D. An agenda for clinical decision making and judgment in nursing research and education. International Journal of Nursing Studies. 2013;50:1720–1726. doi: 10.1016/j.ijnurstu.2013.05.003. [DOI] [PubMed] [Google Scholar]
- Turgeon S, Lanovaz MJ. Tutorial: Applying machine learning in behavioral research. Perspectives on Behavior Science. 2020;43(4):697–723. doi: 10.1007/s40614-020-00270-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Dantzig S, Geleijnse G, Halteren AT. Toward a persuasive mobile application to reduce sedentary behavior. Personal and Ubiquitous Computing. 2013;17(6):1237–1246. doi: 10.1007/s00779-012-0588-0. [DOI] [Google Scholar]
- Van Dantzig, S., Bulut, M., Krans, M., van der Lans, A., & de Ruyter, B. (2018). Enhancing physical activity through context-aware coaching. [Paper presentation]. PervasiveHealth '18: 12th EAI International Conference on Pervasive Computing Technologies for Healthcare, New York, NY, USA. 10.1145/3240925.3240928
- Vanderveldt A, Green L, Myerson J. Discounting of monetary rewards that are both delayed and probabilistic: Delay and probability combine multiplicatively, not additively. Journal of Experimental Psychology. Learning, Memory, & Cognition. 2015;41(1):148–162. doi: 10.1037/xlm0000029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walsh CG, Ribeiro JD, Franklin JC. Predicting suicide attempts over time through machine learning. Clinical Psychological Science. 2017;5(3):457–469. doi: 10.1177/2167702617691560. [DOI] [Google Scholar]
- Walsh CG, Ribeiro JD, Franklin JC. Predicting suicide attempts in adolescents with longitudinal clinical data and machine learning. Journal of Child Psychology and Psychiatry. 2018;59(12):1261–1270. doi: 10.1111/jcpp.12916. [DOI] [PubMed] [Google Scholar]
- Xing LN, Chen YW, Yang KW, Hou F, Shen XS, Cai HP. A hybrid approach combining an improved genetic algorithm and optimization strategies for the asymmetric traveling salesman problem. Engineering Applications of Artificial Intelligence. 2008;21(8):1370–1380. doi: 10.1016/j.engappai.2008.01.003. [DOI] [Google Scholar]
- Zilcha-Mano S, Constantino MJ, Eubanks CF. Evidence-based tailoring of treatment to patients, providers, and processes: Introduction to the special issue. Journal of Consulting & Clinical Psychology. 2022;90(1):1–4. doi: 10.1037/ccp0000694. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No datasets were generated or analyzed during the current study.


