Abstract
The notion of “engagement,” which plays an important role in various domains of psychology, is gaining increased currency as a concept that is critical to the success of digital interventions. However, engagement remains an ill-defined construct, with different fields generating their own domain-specific definitions. Moreover, given that digital interactions in real-world settings are characterized by multiple demands and choice alternatives competing for an individual’s effort and attention, they involve fast and often impulsive decision making. Prior research seeking to uncover the mechanisms underlying engagement has nonetheless focused mainly on psychological factors and social influences and neglected to account for the role of neural mechanisms that shape individual choices. This paper aims to integrate theories and empirical evidence across multiple domains to define engagement and discuss opportunities and challenges to promoting effective engagement in digital interventions. We also propose the AIM-ACT framework, which is based on a neurophysiological account of engagement, to shed new light on how in-the-moment engagement unfolds in response to a digital stimulus. Building on this framework, we provide recommendations for designing strategies to promote engagement in digital interventions and highlight directions for future research.
Keywords: engagement, digital interventions, affect, motivation, attention
Introduction
The use of mobile and wireless technologies to deliver psychological interventions has increased rapidly since the turn of the century. These interventions range from self-guided tools for helping individuals employ behavioral strategies (e.g., self-monitor physical activity, mood or eating behaviors; practice meditation or relaxation techniques) to more complex and comprehensive psychological therapies (e.g., cognitive–behavioral therapy; acceptance and commitment therapy) (see Graham et al., 2020; Schueller & Torous, 2020). Digital interventions, defined as products or services that leverage technology to facilitate or support behavior change (West & Michie, 2016), are attractive for several reasons, including their potential for cost-effectiveness, convenience, high reach, and capabilities to provide support to individuals in real-world settings (Moshe et al., 2021; Newby et al., 2021). Moreover, the ability of smart devices to sense or collect in-the-moment data can be leveraged via Just-In-Time Adaptive Interventions (JITAIs) to deliver the intervention option that is best for an individual at a particular moment, while minimizing unnecessary burden (Nahum-Shani et al., 2018). This capacity to adapt intervention delivery to the rapidly changing needs of individuals is increasingly viewed as an important innovation in psychological research and practice (Kitayama, 2021; Koch et al., 2021). Thus, while the strong link between digital interventions and scientific inquiry in psychology is evident, research on how digital interventions impact and interact with individuals remains underdeveloped (Harari, 2020; Stieger et al., 2021).
In recent years, it has become clear that research on engagement is critical to realizing the promise of digital interventions. Here, based on synthesis across literatures (described below), we define engagement as a state of energy investment involving physical, affective, and cognitive energies directed toward a focal stimulus or task. The “law of attrition” (Eysenbach, 2005)–the tendency of individuals to drop out before completion or to stop using the technology–plagues studies involving digital interventions (Linardon & Fuller-Tyszkiewicz, 2020; Moshe et al., 2021). In fact, worldwide usage of most mobile applications (apps) drops off sharply over time, with average retention rates of less than 5% after 30 days (Statista, 2020). Although low engagement has been consistently cited as the construct underlying these phenomena (e.g., Chien et al., 2020; Pratap et al., 2020), there has been limited theoretical and empirical work to understand how engagement in digital interventions unfolds. Further, the notion of engagement plays a critical role in various domains of psychology, including occupational (Bakker & van Wingerden, 2021), clinical (Georgeson et al., 2020), educational (Reinke et al., 2019), and health psychology (Nahum-Shani, Rabbi, et al., 2021). However, there is disagreement about the definition of this construct across and within various fields, and it is often unclear how engagement is different from other related constructs, making it difficult to ascertain its scientific value.
Many definitions of engagement are characterized by the underlying assumption that it is inherently effective (i.e., that being engaged leads to a desirable outcome) and positively valenced (i.e., manifesting in positive behaviors, feelings, and thoughts). This assumption contributes to a lack of differentiation between engagement and its consequences. Moreover, while some definitions primarily conceptualize engagement as a relatively enduring, trait-like construct (e.g., Dawes et al., 2015), others highlight the dynamic, state-like nature of engagement (e.g., see Perski et al., 2017). Further, although engagement is often defined as a multi-dimensional construct involving physical, affective, and cognitive dimensions (e.g., Torous et al., 2020), it is unclear how these aspects operate distinctly or in concert.
The present paper aims to synthesize definitions of engagement and integrate theories and empirical evidence across psychology and relevant scientific domains to elucidate the processes leading to in-the-moment engagement in digital interventions. This paper offers several important contributions to psychological theory and practice. First, given the absence of an agreed-upon definition of engagement, we review and then build upon the existing definitions of engagement from multiple fields to clearly distinguish engagement from other constructs. Second, we discuss several concepts relating to engagement that have yet to be synthesized in the literature, including the conceptualization of engagement as a construct that is both stable and dynamic, the difference between engagement and effective engagement, and the difference between positive and negative engagement. Third, we highlight specific challenges to promoting engagement in digital interventions, which often involve the delivery of external stimuli in real-world settings to promote behavior change; these challenges include the informational richness characterizing the digital domain that may hinder attention to digital stimuli and the highly dynamic nature of real-world settings in which multiple demands compete for an individual’s effort. Finally, we propose a new conceptual framework that aims to clarify how positive engagement unfolds in-the-moment in response to a digital stimulus that is intended to facilitate or support behavior change. We extend the affect-integration-motivation (AIM) framework (Samanez-Larkin & Knutson, 2015), which describes the neural basis of individual choice, through clarifying its application to digital interventions and incorporating three additional elements (i.e., ACT: attention, context, and translation of motivation to behavior) that are critical for this specific application. By specifying the elements underlying engagement with digital interventions, the proposed framework seeks to guide future research on stable and dynamic factors that likely shape engagement in digital interventions and to inform strategies for promoting real-time, real-world engagement.
What is Engagement?
Existing definitions of engagement emphasize different aspects, depending on who is intended to be engaged and with what. For example, in education research, engagement is defined in terms of the effort students devote to educationally purposeful activities that contribute to desired learning outcomes (Hu & Kuh, 2002; Krause & Coates, 2008). In the area of industrial/organizational psychology, engagement is often defined as emotional and intellectual commitment to an organization (Richman, 2006; Shaw, 2005) or the amount of discretionary effort exhibited by employees in their jobs (Frank et al., 2004). In computer science and human-computer interaction (HCI), engagement is typically defined as the quality of user experiences with technology (O’Brien & Toms, 2008; Sidner et al., 2004) or as a process by which social connection begins, sustains, and ends (Doherty & Doherty, 2018; Sidner et al., 2004). In healthcare, patient engagement is defined in terms of the actions patients take to support their health (Cunningham, 2014), and in marketing, customer engagement is defined as the intensity of an individual’s participation and connection with an organization’s offerings and activities (Pansari & Kumar, 2017; Vivek et al., 2012). These examples illustrate the lack of universal agreement on the definition of engagement. However, several common themes emerge, which we discuss below and then integrate to formulate our proposed definition.
Engagement as Energy Investment
The conceptualization of engagement as energy investment is grounded in industrial/organizational psychology, specifically the work of Kahn (1990), who introduced the construct of employee engagement as the investment of energy into one’s work role. Since Kahn’s influential publication, the construct of employee engagement has taken various forms, with engagement commonly conceptualized as a positive “energetic” investment (Young et al., 2018). For example, Maslach and Leiter (1997) and Schaufeli and colleagues (2002) viewed the energetic connection that engaged employees have with their work activities as the key element of work engagement. Subsequent reviews of engagement have observed that it is commonly defined by “passion, enthusiasm, focused effort, and energy” (Macey & Schneider, 2008, p. 4). Similarly, Christian and colleagues (2011) concluded that although “engagement research has been plagued by inconsistent construct definitions and operationalizations,” they all involve “the simultaneous investment of personal energies in the experience or performance of work” (p. 95). This perspective motivated Young and colleagues (2018) to view energy as “the currency of employee engagement” (p. 1331), where energy is described as “a type of positive affective arousal” (Quinn & Dutton, 2005, p. 36). Of course, the presence of energy by itself does not solely comprise engagement (Young et al., 2018). Rather, engagement involves the direction and channeling of energy into a specific activity or role (Kahn, 1990). Hence, we conceptualize engagement as energy investment directed by an individual toward a focal stimulus or task. Here, the term stimulus describes an external cue that elicits, or that is intended to elicit, a behavior (e.g., a text message encouraging the individual to take a walk), and the term task refers to a pre-specified performance requirement (e.g., complete a 5-minute walk).
Engagement as a State
An important debate concerns whether engagement is best thought of as a temporally dynamic state, a relatively stable trait, or both (Dalal et al., 2008). Research on work engagement mainly conceptualizes engagement as a relatively stable construct that varies between individuals (e.g., Schaufeli et al., 2002), whereas in the field of HCI, engagement is most frequently characterized as a dynamic state of user experience (Doherty & Doherty, 2018). Empirical evidence indicates that engagement is subject to fluctuations throughout the day around some average level for an individual. For example, Reina-Tamayo and colleagues (2017) found that 88% of the total variance in employee engagement fluctuates from activity to activity and that during these activities (e.g., checking emails, attending meetings), episodic engagement is positively related to performance. Similarly, Rotgans and colleagues (2018) found that cognitive engagement among medical students systematically fluctuates based on distinct activities during a team-based learning session, and Larson and colleagues (2020) found that teams’ engagement (e.g., in strategy and planning) increased over time toward a deadline. These findings are consistent with Kahn’s (1990) notion of engagement as a condition that ebbs and flows. Indeed, in their review of literature on work engagement, Christian and colleagues (2011) concluded that engagement varies both between and within individuals, which is a common characteristic of many psychological constructs, such as affect and satisfaction. Hence, we refer to engagement as a state of energy investment that can be relatively enduring but may fluctuate over time (Schaufeli et al., 2002).
Engagement as a Multi-Dimensional Construct
Another important theme that cuts across multiple research domains is the perspective that engagement is multifaceted and includes physical, affective, and cognitive elements. Physical energy investment refers to the actual performance of an activity or task (Newton et al., 2020). This dimension is labeled “behavioral engagement” in many fields (e.g., Kilday & Ryan, 2019; King et al., 2014). Physical energy investment takes on various forms, depending on the field of research. For example, in intervention research, physical energy investment can be captured via attendance, appointment keeping, or adherence to treatment protocols (King et al., 2014), while in consumer research, it may involve consumption activities, providing reviews and recommendations, blogging or vlogging, and even co-creating products with companies (Zeng & Mourali, 2021). Across fields, physical energy investment is often labeled as “participation” (King et al., 2014; Mai et al., 2021).
Affective energy investment has traditionally been referred to as psychological engagement (e.g., Pham et al., 2021; Williams et al., 2020). It captures a wide range of positive affective reactions to a task or activity (Lee, 2021; May et al., 2004), from feeling pride, enthusiasm, and satisfaction (Bowden et al., 2021; Mirbagheri & Najmi, 2019), to affective states that may underlie more enduring experiences of attachment (i.e., a strong affectional bond; de Oliveira Santini et al., 2020), identification (i.e., a sense of belonging or being in unity with an entity; Ashforth & Mael, 1989), and commitment (i.e., a desire to continue the interaction or relationship; Morgan & Hunt, 1994). Across various fields, there is often a lack of clarity and agreement about whether these different positive affective states make up (i.e., are indicators of) engagement or lead to (i.e., are antecedents of) engagement.
Cognitive energy investment mainly refers to selective attention and processing of information related to a task or activity (Kahn, 1990). This does not necessarily imply “flow” (Csikszentmihalyi & Csikszentmihalyi, 1988), which has been defined and measured primarily in terms of a high degree of concentration and interest in an activity, hence representing a unique ‘peak’ in cognitive absorption (Caniëls et al., 2021; May et al., 2004). In other words, a state of flow indicates the highest level of cognitive energy investment, but cognitive energies can be invested without experiencing flow.
Although there is no consensus on which dimensions of energy investment are most important in defining engagement (Lee, 2014), there is some agreement that engagement represents the simultaneous investment of physical, affective, and cognitive energies (Rich et al., 2010, p. 622). This perspective is based on Kahn (1990; 1992), who described engaged individuals as being fully there: physically involved, feeling positive toward the task and others in the service of task performance, and cognitively focused and attentive (Kahn, 1990). Building on this definition, Rich and colleagues (2010) and others (Wang et al., 2019; Yuan et al., 2021) suggested that, when engaged, individuals harness their full selves in active performance by “driving personal energy into physical, cognitive, and emotional labors” (p. 619). Similarly, King and colleagues (2014) defined client engagement in mental health services as “a multifaceted state of affective, cognitive, and behavioral commitment or investment in the client role over the intervention process” (p. 2). Metaphorically speaking, engagement is manifested in the simultaneous investment of hands, heart, and head (Rich et al., 2010, p. 619). Following these perspectives, we define engagement as a state of energy investment involving physical, affective, and cognitive energies directed toward a focal stimulus or task. In Table 1, we use this definition to highlight the differences between engagement and other related constructs.
Table 1.
Construct | Definition | Distinctions from Engagement | Examples focusing on a particular task: self-monitoring dietary intake via a mobile app |
---|---|---|---|
Engagement | A state of energy investment involving physical, affective, and cognitive energies directed toward a focal stimulus or task | N/A | An individual uses the app to self-monitor their dietary intake while making an effort to accurately record the information and appreciating the opportunity to self-reflect. |
Adherence | The extent to which an individual follows the intended suggestions to complete a focal task (e.g., Bissonnette, 2008) | A person may engage in a task without following instructions. | A patient follows their doctor’s instructions to self-monitor dietary intake twice per day via a mobile app for 2 weeks. |
Involvement | “Cognitive or belief state of psychological identification” (Kanungo, 1982, p. 342) | (a) Engagement with a task does not require psychological identification with the task; (b) involvement is mainly a cognitive state (rather than a state of energy investment). | An individual considers self-monitoring dietary intake via the mobile app as very central to their health and well-being. |
Participation | The investment of physical energy in an activity (Davis et al., 2007) | Participation does not necessarily include the investment of affective or cognitive energies. | An individual uses a mobile app to self-monitor dietary intake. |
Commitment | A long-term orientation toward a course of action, including feelings of psychological attachment and intentions to persist (e.g., Meyer & Allen, 1997) | (a) Engagement in a task may not require a long-term orientation or intentions to persist; (b) Commitment primarily describes emotional attachment or intentions rather than actual investment of energies. | An individual intends to continue using a mobile app to self-monitor dietary intake in the long-term. |
Motivation | An affective drive for action that leads one to approach reward or avoid punishment (Kahn, 1990) | Captures an individual’s drive (the reason for engagement) rather than the investment of energy. | An individual experiences an internal drive to self-monitor dietary intake via the app because they appreciate the benefits of doing so. |
Flow | A high degree of concentration and interest in an activity (e.g., Csikszentmihalyi, 2020) | Represents a unique ‘peak’ in cognitive absorption. | An individual is highly concentrated on self-monitoring dietary intake via the mobile app. |
Persistence | Continued adherence (e.g., Clowes et al., 2004) or continued investment of effort in a task despite obstacles or difficulty (e.g., Howard & Crayne, 2019) | Persistence primarily describes continued investment of cognitive or physical (rather than affective) energies in a task. | An individual makes continued attempts to self-monitor dietary intake via the mobile app. |
What is Effective Engagement?
What constitutes effective engagement depends on the distal outcome (i.e., ultimate goal) that is motivating the need for engagement in a specific target population (Yardley et al., 2016). As noted by Saks (2008), “it is meaningless to refer to engagement without being specific about the role in question” (p. 42). In some fields, the notion of effectiveness is inherent in the definition of engagement, meaning that engagement is conceptualized as an effective state of energy investment. For example, engaged employees are viewed as those who not only invest energy in their work, but also have an effective connection with their job (see Maslach & Leiter, 1997). Effectiveness is assumed in many definitions of work engagement because work-related performance is the distal outcome guiding the need for engagement in this context. However, engagement in and of itself may or may not be effective, and its effectiveness can be determined only in relation to a pre-specified desired outcome to be achieved via the investment of physical, cognitive, and affective energies. For example, work engagement as defined by Maslach and Leiter (1997) can be effective in terms of promoting higher levels of work performance as the distal (i.e., long-term) outcome, but not necessarily in terms of promoting employee work-life balance.
It is critical to identify what constitutes effective engagement in relation to the pre-specified distal outcome. Specifically, what level (or intensity) of engagement is needed, with what, and for how long, in order to achieve the distal outcome? An important point to consider here is that effective engagement may also involve periods of non-engagement, or what is labeled in the literature on work engagement as ‘recovery’— “a process of psychophysiological unwinding that is the opposite of the activation of psychophysiological systems during effort expenditure” (Geurts & Sonnentag, 2006, p. 483). An overview of the literature on daily fluctuations in work engagement, has led Bakker (2014) to conclude that “daily balance between engagement while at work and detachment while at home seems the key to enduring work engagement” (p. 227). Overall, empirical evidence consistently demonstrates that adequate recovery is critical for subsequent engagement, particularly when the level of energy investment is relatively high (Bakker, 2014). Hence, we define effective engagement as follows: Effective engagement is the extent, frequency, and duration of investment of physical, cognitive, and affective energies in a focal stimulus or task needed to bring about a pre-specified outcome.
Positive and Negative Engagement
The majority of research on engagement focuses on its “bright” side, capturing favorable thoughts (e.g., positive evaluations), feelings (e.g., satisfaction), and behaviors (e.g., cooperation) directed toward a focal task or stimulus. However, in recent years there is growing acknowledgment that engagement has a “dark side” that manifests in unfavorable thoughts (e.g., negative evaluations), feelings (e.g., anger), and behaviors (e.g., complaining) (Hollebeek & Chen, 2014). This dark side may be fueled largely by social media networks, which enable individuals to express their negative thoughts and feelings quickly and broadly (Do et al., 2019). Importantly, negative engagement goes beyond passive disengagement, as it has a clear target and results in deliberate and motivated negative action (Lievonen et al., 2018). Hence, we define positive (vs. negative) engagement as a state of energy investment involving positively (vs. negatively) valenced physical, affective, and cognitive energies directed toward a focal stimulus or task.
Interestingly, some studies indicate that individuals may be both positively and negatively engaged at the same time. For example, Moody and colleagues (2014) found that trust and distrust coexist in online e-commerce relationships, resulting in an ambivalent engagement pattern. Turel and Serenko (2012) investigated the benefits and consequences of enjoyment of social networking websites, suggesting that technology-related addictions involve both enjoying and suffering from excessive use. Additionally, Costa Figueiredo and colleagues (2018) showed that in the case of self-monitoring health data, individuals may appreciate and increase their efforts to self-monitor, while simultaneously feeling stress and anxiety about tracking practices. This suggests not only that the connection between positive and negative engagement is complex, but also that positive engagement may not always be effective and negative engagement may not always be ineffective. As noted earlier, whether a specific form of engagement is effective depends on the outcome to be achieved. Next, we build on the above definitions to discuss engagement with digital interventions.
Engagement in Digital Interventions
Digital interventions leverage technological innovations (e.g., mobile and wearable devices) to facilitate or support positive behavior change (i.e., the alteration of existing unhealthy/maladaptive behavior or the uptake of new healthy/adaptive behavior). This is often done by using digital stimuli and/or tasks as a vehicle for engaging individuals with other tasks, non-digital or digital (Ebert et al., 2019; Yardley et al., 2018). Since different stimuli or tasks likely require different strategies to increase engagement, understanding the concept of engagement in digital interventions requires careful consideration of the question, “Engagement with what?” For example, many health-promotion mobile applications deliver push notifications to remind or encourage participants to engage in a digital (e.g., using a mobile app to self-monitor daily behaviors and experiences; Rabbi et al., 2018) or a non-digital (e.g., physical activity, healthy eating; Freyne et al., 2017) task. In this case, the answer to the question “engagement with what” can be “engagement with the push notification” and/or “engagement with the task.” In other cases, push notifications are used to engage individuals in digital content on a mobile app (e.g., playing and listening to a guided relaxation audio on a mobile app), which, in turn, is designed to engage individuals in a non-digital task (e.g., performing a relaxation activity; for examples, see Morrison et al., 2017; Pham et al., 2016). Here, the answer to the question “engagement with what” can range from “engagement with the push notification” to “engagement with the digital content on the app” and/or to “engagement with the non-digital task.” These examples illustrate two important characteristics concerning engagement in digital interventions.
First, digital interventions are developed with the implicit assumption that the distal outcome can be achieved by engaging individuals in certain stimuli and tasks, some digital and some non-digital, in a consecutive or sequential manner. Hence, an important first step in answering the question “engagement with what” is to clearly articulate the process through which the distal outcome can be achieved. This includes specifying the sequence of stimuli and tasks that require engagement to achieve the distal outcome and differentiating which stimuli/tasks can be implemented via digital technology. Second, the delivery of a digital stimulus to engage individuals in a specific task is an important component of digital interventions. These digital stimuli may include “nudges” (Valle et al., 2020; Weintraub et al., 2021), which Thaler and Sunstein (2021) define as a subtle intervention designed to modify people’s behavior “without forbidding any options or significantly changing economic incentives.” Nudges can take various forms, such as text reminders (e.g., to take a walk), graphic warnings (e.g., about the impact of sedentarism), or making a specific option salient (e.g., highlighting the presence of a park nearby). However, digital stimuli used to promote engagement in digital interventions are not limited to nudges. For example, monetary incentives for a specific option do not qualify as nudges (Campos-Mercade et al., 2021), but are sometimes used to promote engagement in digital interventions (Nahum-Shani, Rabbi, et al., 2021). Further, nudging typically seeks to bypass consciousness, deliberation, and reasoning, but digital stimuli for promoting engagement in digital interventions may require deep and lengthy thinking, as they sometimes offer useful information about the person’s behavior and context to facilitate self-reflection (Bidargaddi et al., 2018; Rabbi et al., 2018). Hence, we focus here on digital stimuli, more broadly, not only those that qualify as nudges.
Given that digital interventions concern the facilitation of positive behavior change, both the stimulus and the focal task primarily require positive (rather than negative) engagement (Heffner et al., 2021; O’Neill & Nicholson-Cole, 2009). However, there are two major challenges to positively engaging individuals with a digital stimulus in real-world settings. The first challenge stems from the informational richness of the digital domain. While convenient and accessible, technologies facilitate information exchange at a rate faster than one can process, making it difficult for individuals to determine what is relevant and useful (Schmitt et al., 2021). Individuals may experience information overload, which occurs when the amount of information being directed to an individual exceeds their information processing capacity (Eppler & Mengis, 2004; Matthes et al., 2021). This may lead individuals to respond too quickly to stimuli without paying adequate attention, or to fail to respond altogether (Levitin, 2014). The second challenge concerns contextual influences in real-world settings, where the context is defined as any condition, stable or dynamic, that can be used to characterize a given situation. When attempting to engage individuals in their natural environment, multiple demands may compete for their effort. These conditions may change rapidly over time, shaping an individual’s response to digital stimuli and creating barriers to their ability to perform the task. However, there has been limited theoretical and empirical attention to the processes underlying engagement in situations characterized by multiple alternatives and demands that compete for an individual’s attention and effort (Linardon & Fuller-Tyszkiewicz, 2020; Torok et al., 2020).
Given that decision making in a digital, real-world setting may happen in-the-moment, quickly and often impulsively (Verhagen & Van Dolen, 2011), we draw on neuroscientific findings to propose the Affect-Integration-Motivation and Attention-Context-Translation (AIM-ACT) framework. AIM-ACT outlines the key psychological processes essential to in-the-moment engagement in response to a digital stimulus. This framework is intended to aid in the development of theory, operationalization of key factors, and generation of hypotheses to inform strategies for promoting engagement in digital interventions. Since digital interventions concern the facilitation of positive behavior change, we focus on clarifying the process underlying positive (rather than negative) engagement in response to digital stimuli.
The AIM-ACT Framework
This conceptual framework is based in part on recent empirical evidence from neuroscience linking neural activity to anticipatory affect and motivated behavior (Knutson et al., 2014). Specifically, the affect-integration-motivation (AIM) framework proposed by Samanez-Larkin and Knutson (2015) describes how the neural basis of affective, integrative, and motivational responses predict and promote individual choice. According to the AIM framework, incoming stimuli are processed in a sequential and hierarchical manner, with each stage being associated with separable neural components (i.e., activity in brain regions or circuits). While these stimuli can be either external (e.g., advertisement, human contact) or internal (e.g., hunger, discomfort), we focus here on external stimuli, which are essential to the effectiveness of digital interventions.
To ground the discussion, we consider an example of a digital stimulus (a prompt delivered via a push notification recommending taking a walk) delivered to engage an individual in a focal task (taking a 5-minute walk). In this example, engagement with the stimulus is a pathway through which engagement with a focal task can be achieved. Hence, we describe how engagement with the stimulus unfolds to facilitate engagement with a focal task. The AIM framework specifies that the individual first affectively processes the stimulus. Specifically, a prompt initiating a positive anticipatory affective response activates the nucleus accumbens (NAcc) area of the brain, whereas a negative affective response activates the anterior insula (AIns). In the next stage, over time in the medial prefrontal cortex (MPFC), affective signals are integrated with situational factors (e.g., perfect weather for walking) and other relevant considerations such as social consequences (e.g., not being able to have coffee with friends), reward likelihood (e.g., anticipated sense of well-being after walking), or timing (e.g., ability to complete the walk in time before the next meeting). The integration mechanism has been studied extensively in the neurosciences, with hundreds of empirical studies identifying subregions of the MPFC as being involved in value-based judgments of inputs (Bartra et al., 2013). This mechanism enables direct comparison of qualitatively different inputs via a common pathway, namely a subjective valuation system. The valuation process involves explicitly and implicitly weighing perceived costs (or disadvantages of walking) and benefits (or advantages of walking) that may be qualitatively different, to derive an overall value of inputs. The overall value is linked to affective signals that potentiate motivated behavior (Bartra et al., 2013; Levy & Glimcher, 2012). For instance, we would expect greater activity in the NAcc and MPFC for individuals with positive affective responses to the prompt and who place higher subjective value on factors related to the advantages of walking (or of responding favorably to the prompt); these individuals would, in turn, be more motivated to walk. By contrast, AIns activity accompanied by MPFC activity would indicate negative affective responses, and greater weighting of factors related to the disadvantages of walking that would motivate behavioral avoidance and perhaps doing something else instead. In the final stage, connections to the dorsal straitum and presupplementary motor area (pSMA) are activated to facilitate any necessary behavioral action response (e.g., walking or another behavior) (Samanez-Larkin & Knutson, 2015).
Empirical support for the AIM framework has been found across a broad range of scenarios. For example, activity in the NAcc and MPFC in response to a relevant stimulus predicts individual’s choices to purchase goods (Knutson et al., 2007; Levy & Glimcher, 2012), make financial investments (Preuschoff et al., 2006), donate to charities (Moll et al., 2006), and fund microloans (Genevsky & Knutson, 2015) and crowdfunding projects (Genevsky et al., 2017). The AIM framework fills a theoretical gap by offering a neurobiological account of how individuals process an incoming stimulus. By establishing the links from neurophysiological activity to anticipatory affect, integration, and motivated behavior, the AIM framework provides a useful basis for clarifying the processes underlying engagement in digital settings. There are, however, three additional elements–attention, context, and the translation of motivation to actual behavior–that we seek to incorporate to form AIM-ACT (see Figure 1), a conceptual framework that can be used to guide efforts to engage individuals in digital interventions.
Attention to a Stimulus
When attempting to engage individuals in a digital setting that is often characterized by information overload, attention to a stimulus is likely a necessary element. Here, attention is defined as the selection and processing of the relevant or salient parts of sensory inputs while discarding other potentially irrelevant parts (Rao, 2006). For example, a push notification will not elicit an affective response if it is not registered by the recipient; incoming information about the health benefits of walking will not be cognitively integrated if the individual does not attend to it; and motivation to walk will not translate to an actual behavior if the individual gets distracted.
Although affective responses may occur with or without attention to a specific stimulus, insufficient attention to the stimulus would inevitably undermine engagement in the stimulus and hence in the focal task (Scherer, 2001; Vuilleumier, 2002). Further, empirical evidence suggests that attention is often critical for cognitive processing (Ding et al., 2018; Pessoa & Ungerleider, 2004). For example, experiments with masked primes indicate that some minimal duration and clarity of stimulus presentation are needed for the stimulus to be consciously processed. While cognitive processing can occur at an implicit level, specific mental operations require conscious effort. These include maintaining information related to the stimulus in working memory (e.g., maintain an active and accurate representation of one’s goal), combine several mental operations to perform a novel task (e.g., inhibit a routine behavior and plan a new strategy), and perform an intentional behavior (e.g., get ready to go outside to take a walk) (Dehaene & Naccache, 2001). Hence our framework highlights attention as an element that modulates the affect, integration, and motivation preceding a behavior, by gating the inputs that elicit and shape these responses.
Contextual Influence
When attempting to engage individuals via a digital stimulus in real-world settings, not only does the context need to be amenable for ensuring attention, but context can dramatically alter responses at each stage of the engagement process, and thereby impact engagement. There is substantial evidence that context can shape affective response to a stimulus. For example, emotional expression and experience are influenced by the presence and expressiveness of other people (Goldenberg et al., 2020). Time of day can also influence emotions, with some people experiencing more positive arousal earlier than later in the day (English & Carstensen, 2014). Emotions can also be shaped by the environment, from experiences of excitement in response to natural settings (Hicks, 2018) to feeling overwhelmed in a crowded store (Greven et al., 2019).
In addition, context can shape the valuation of the focal task via the integration of information such as social cues and environmental constraints. For example, the subjective value of taking a walk may be reduced in the context of an unsupportive social environment or uncooperative weather. This implies that motivation to perform the focal task can be heightened by prompting individuals under contextual conditions that serve to enhance, rather than attenuate, the value of the prompted task. In sum, the proposed framework acknowledges that context may impact engagement by modulating an individual’s attention, as well as affective, integrative, motivational, and behavioral responses.
Translation of Motivation to Behavior
The AIM framework suggests that motivation to approach a task in response to a stimulus (e.g., a prompt to encourage walking) can translate into behavior (e.g., walking) immediately or at a later point in time (Knutson & Genevsky, 2018). In digital intervention settings, real-world demands and constraints often interfere with the translation of motivation to immediate behavior by drawing an individual’s attention to other stimuli. For example, an individual may decide to take a walk in response to the prompt, but contextual circumstances (e.g., an important phone call) may prevent effective engagement with this task. Motivation to approach a given task may not necessarily translate into behavior right away, especially in cases where the focal task requires deliberate or effortful processing such as planning a strategy and controlling its execution (Dehaene & Naccache, 2001). The individual may, however, take the walk later in the day, such that the translation of motivation to behavior occurs after some delay. Indeed, recent empirical evidence supports the notion that the translation of motivation to behavior takes place across different time scales (Genevsky et al., 2017; Tong et al., 2020).
The form of motivation may also impact the translation of motivation to behavior. Self-determination theory posits that optimal functioning depends on the extent to which a person’s behavior is autonomous (i.e., coherent with one’s self) rather than controlled by internal or external pressures (Ryan & Deci, 2000b). In this context, intrinsic motivation is viewed as the most autonomous form of motivation, as it captures a drive to do something for its own sake because it is inherently satisfying (e.g., an individual will walk in response to a prompt because they enjoy walking). Naturally, individuals are more likely to invest energy in tasks that involve anticipated intrinsic benefits such as enjoyment, competence, and interest (Studer & Knecht, 2016). However, not all activities are inherently satisfying, and yet individuals may still engage in them because they are extrinsically motivating; that is, they represent a means to an end (e.g., an individual takes a walk in response to the prompt because they believe it will improve their health).
Self-determination theory proposes several forms of extrinsic motivation that vary in the extent to which they are experienced as autonomous (Ryan & Deci, 2000a). The least autonomous form of extrinsic motivation is labeled external regulation, reflecting a drive due to external demands or imposed contingencies (e.g., walking to receive reward points or a badge from a wellness app). The most autonomous form of extrinsic motivation is labeled integrated regulation, reflecting a drive to achieve external outcomes that are internalized and assimilated to one’s self (e.g., walking because staying healthy is an integral and meaningful part of one’s identity). The motivation in the latter case is still extrinsic, as it is driven by the instrumental value of some outcome that is separate from the behavior, but since the behavior is volitional and valued by the self, it involves less inhibition and less conflict and is, thus, likely to be more energizing and facilitate greater levels of performance, persistence, initiative, and creativity (Rigby et al., 1992; Ryan & Deci, 2000b; Spreitzer & Porath, 2014).
Overall, while psychological, educational, and healthcare literatures emphasize the role that different forms of motivation play in human behavior, neuroscience studies have almost uniformly focused on responses to extrinsic incentives such as money, food, or prizes (Murayama et al., 2010). An underlying assumption is that extrinsic and intrinsic benefits are indistinguishable in terms of signaling the value of an action (Murayama, In press; Studer & Knecht, 2016). Further, while a central feature of psychological nudging is that it does not limit the choice set (meaning that the individual can always choose alternative options), given that nudges typically seek to bypass conscious awareness, they have been criticized for undermining autonomy—more specifically, agency (Vugts et al., 2020)—which concerns the person’s ability to process stimuli and not simply react passively (Hitlin & Elder Jr, 2007). While recent empirical evidence suggests that individuals experience digital (vs. human) nudges as less judgmental and therefore as more autonomous (Raveendhran & Fast, 2021), the impact of digital nudges on autonomy remains an open question. The proposed framework underscores the need for theoretical and empirical work to better explain the differential impact of intrinsic and extrinsic motivations on engagement.
Summary of the AIM-ACT Framework
The AIM-ACT framework (Figure 1) sheds new light on the process through which in-the-moment engagement unfolds in response to a digital stimulus. For simplicity, we describe how in-the-moment engagement with a stimulus (e.g., a mobile-based prompt containing a message recommending that the person take a walk) occurs to facilitate engagement with a focal task (e.g., 5-minute walk) according to this framework. Here, in-the-moment engagement with the stimulus is conceptualized as a hierarchical process that involves AIM responses. These responses are modulated by attentional (A) processes and context (C) and lead to engagement in the focal task through pathways (mediators) that facilitate the translation (T) of motivation to behavior. Consistent with the notion of simultaneous investment of heart, head, and hands (Rich et al., 2010), in-the-moment engagement with the digital stimulus involves investing affective, cognitive, and physical energies. However, whether this investment leads to engagement with the focal task depends on the extent to which an individual invests energies in the focal task.
Similar to engagement with the stimulus, engagement with the focal task involves a series of hierarchical affective, integrative, motivational, and behavioral responses that are shaped by attention and context. For example, walking in response to a digital stimulus (e.g., a prompt to encourage walking) can be hindered or facilitated by other stimuli and/or contextual factors. Suppose it starts raining a few minutes after John begins his walk; here, rain is a contextual stimulus that generates attentional (John notices the rain), affective (discomfort), integrative (the downsides of getting wet outweigh the benefits of walking), and motivational (an internal drive to avoid getting wet) responses, leading to a translation to behavior (John starts to walk back home). Now, suppose on his way home, John receives a prompt from his smartwatch indicating that he is close to reaching his daily step goal; here, the prompt is another digital stimulus that generates attentional (John notices the prompt), affective (excitement), integrative (the benefits of meeting his walking goal outweigh the downsides of getting wet) and motivational (an internal drive to achieve his walking goal) responses leading John to decide to continue walking despite the rain. This translation of motivation to behavior may, however, be thwarted by attention to and integration of other contextual factors (e.g., dark clouds accompanied by sounds of thunder) that lead to non-completion of the focal task of walking. Whether this series of hierarchical responses (i.e., engagement with walking) is effective or not depends on how effective engagement with the focal task is operationalized (e.g., walking 10,000 steps per day) in relation to a pre-specified distal outcome (e.g., achieving a clinically meaningful weight loss by the third month).
Limitations
AIM-ACT sheds light on the process through which in-the-moment engagement unfolds in response to an external stimulus intended to promote task completion in digital interventions. If repeated engagement with the task (e.g., walking 10,000 steps each day over the course of 30 days) is needed to achieve the distal outcome, then feedback loops across multiple in-the-moment engagement processes that facilitate effective engagement need to be considered (see Figure 1). This is because past experiences of performing a focal task involving a particular constellation of AIM-ACT elements will affect the person’s memories and expectations that, in turn, influence how they engage with future stimuli or focal tasks related to the distal outcome (Hyman et al., 2006). For example, John is likely to respond more positively when he notices a digital prompt intended to encourage him to walk on Tuesday if he enjoyed his walk on the previous day. However, if he is unlikely to attend to the digital prompt due to habituation (e.g., diminishing tendency to respond to a frequently repeated stimulus; Thompson & Spencer, 1966), then a different stimulus that is more salient or novel may be needed to facilitate the engagement process. It may also be that John is too distracted by other concerns to notice the prompt but is then reminded later to go for a walk by an internal cue (e.g., remembering that he had earlier wanted to go walking) or an external cue (e.g., exposure to a digital ad showing a person walking).
Additionally, the AIM-ACT framework suggests that once a habit is formed, the digital stimulus would require less engagement to facilitate task performance. Here, a habit is defined as “a motor or cognitive routine that, once it is triggered, completes itself without conscious supervision” (Bernacer & Murillo, 2014). Since habits are guided by the stimulus itself, they do not involve value-based judgments of inputs and are not sensitive to reward devaluation or extinction (Adams & Dickinson, 1981). This means that when a behavior becomes “habitual,” less cognitive effort is invested in the stimulus guiding the behavior, and thus the role of integration in the engagement process is attenuated. For example, if John ends up developing a habit of walking following a digital prompt, then walking will be initiated in response to the prompt even if John does not cognitively process the content of the prompt.
While AIM-ACT offers a useful conceptualization of engagement in digital interventions, the proposed mechanisms may not always function as specified. For instance, prior literature on the neuroscience of addiction suggests that substance (e.g., drugs, alcohol) and behavioral (e.g., gambling, video gaming) addiction may alter the mechanisms posited by AIM-ACT. Some studies have shown that affective responses to a cue associated with ones’ addiction are accompanied by steep increases in NAcc activity (MacNiven et al., 2018), and that supraphysiological activation of the NAcc over time leads the brain to attach an abnormally high level of value to an addiction-related stimulus (Courtney et al., 2016). A “hijacking” metaphor suggests that addictions facilitate excessive sensitivity to reward combined with a failure of inhibition (Leshner, 1997). This metaphor includes multiple channels, such as sensitization (i.e., an amplified response to a given stimulus following repeated intermittent exposure), blunting of responses to competing cues, and disinhibition (i.e., poor impulse control) which reduces control over integration, motivation, and behavioral responses (Goldstein & Volkow, 2002). Although a comprehensive specification of how the addicted brain responds to an addiction-related stimulus still awaits future empirical inquiry, empirical evidence nonetheless suggests that the presence of an addiction-related stimulus is likely to divert the AIM-ACT mechanisms away from the pursuit of the focal task. The implications warrant consideration not only in designing digital interventions for addictions, but also in developing any digital intervention attempting to increase affective responses supported by the NAcc—such interventions must be designed carefully to avoid “hijacking” of the brain that leads to ineffective or undesirable outcomes.
Finally, while the AIM elements are grounded in empirical evidence that specifies their neural components in space and time, given the real-world nature of engagement in digital interventions, it is less clear how the spatial localization of the ACT elements should be specified. Nonetheless, we conjecture that in a real-world setting characterized by multiple competing demands, attention and context can modulate the AIM elements at any given time during the AIM process and its translation to behavior. Future research is called for to provide greater specificity about when each of the elements in the AIM-ACT framework operates in real-world settings.
Methodological Implications
Table 2 describes how each element in the AIM-ACT framework can guide the development of strategies to promote engagement in digital interventions. New experimental approaches such as the micro-randomized trial design (Qian et al., 2022) have been developed to investigate the proximal impact of various strategies for stimuli delivery in digital interventions (e.g., message timing, length and framing; see Table 2). Micro-randomized trials can be used to investigate the causal effects of digital stimuli on affective, integrative, motivational, and/or attentional responses and how they are shaped by contextual factors (Dempsey et al., 2020; Nahum-Shani, Potter, et al., 2021). However, most studies investigating the impact of strategies for delivering stimuli in digital settings have focused primarily on whether individuals performed the task and operationalized the process leading to task performance as a “black box.” Understanding the nature of an individual’s response to a digital stimulus, in terms of affect, integration, motivation, and attention is critical for deciding when and how to deliver the stimulus. For example, specific conditions (e.g., habituation) may hinder attention to a digital prompt, requiring modifications to the way the prompt is presented and sent; whereas other conditions (e.g., feeling relaxed) may facilitate the integration of self-relevant information, presenting a window of opportunity to deliver more elaborate prompts (rather than shorter but less informative ones).
Table 2:
Element in AIM-ACT | Implications for the design of engaging digital interventions | Examples of considerations |
---|---|---|
Affect | Designing digital stimuli that promote positive affective response | Considering aspects such as the use of emoticons (Aldunate & González-Ibáñez, 2017; Li et al., 2019); questions (e.g., “Would you like to take a walk?”) versus statements (“Time to take a walk”) (Müller et al., 2016); inspirational or entertaining content (Nahum-Shani, Rabbi, et al., 2021) and focusing on benefits versus consequences (Gallagher & Updegraff, 2012) |
Developing/selecting a task that facilitates positive experiences and hence positive expectations about future performance | Selecting or designing a task that is not too complex or daunting to result in frustration, yet not too simple or easy to result in boredom (see O’Brien et al., 2020; Perone et al., 2020) | |
Integration | Framing the content in a way that is self-relevant to increase the subjective valuation during integration | Using the person’s first name (Sahni et al., 2018); including suggestions that are most relevant to the individual (Resnicow et al., 2008); highlighting the individual’s core personal values, strengths, or valued social relations (Epton et al., 2015); framing content in a way that is culturally sensitive (Yu & Shen, 2013) or self-affirming (Falk et al., 2015); using short and simple messages (Jones et al., 2004) |
Motivation | Using strategies to increase the overall value of performing the task | Making salient the benefits of task performance (Mollen et al., 2017); facilitating a sense of urgency or scarcity (Cialdini, 2007) |
Attention | Using strategies to increase the salience of the digital stimulus | Using delivery formats (e.g., text, voice, image, vibration, pressure) and modalities (e.g., via text message, phone call, push notification) that are most likely to capture attention to the stimulus; integrating or rotating between multiple forms of presentations and/or delivery modes rather than relying on a single type of prompt (Muench & Baumel, 2017) |
Translation of Motivation to Behavior | Reducing the likelihood of barriers or constraints to task performance | Delivering a digital stimulus close to the time at which the task should be performed (Freyne et al., 2017); providing participants sufficient time to engage with the task while minimizing the likelihood of interruptions that may break the link between motivation and behavior |
Increasing autonomous motivation | Framing the content to encourage self-initiation and choice (Gillison et al., 2019; Rigby et al., 1992) | |
Context | Delivering digital stimuli under conditions in which the individual is likely to (a) attend to the content; (b) experience positive affective responses; (c) cognitively integrate self-relevant information; and (d) translate their motivation into actual investment of energy in the task | Considering aspects such as the time of day (Pejovic & Musolesi, 2014), phone-related features (e.g., whether the phone screen is on; Pielot, 2014), the type of task currently performed (Choi & Lee, 2019), physical activity and location (Kunzler et al., 2019), and individual differences (Muench & Baumel, 2017) |
However, current instruments for measuring constructs such as attention (e.g., via eye tracking technology; Armstrong & Olatunji, 2012), cognitive processing (e.g., using neuroimaging: Knutson et al., 2007) and motivation (which is dominated by self-report methodology, e.g., Donald et al., 2020) are based on lab studies and/or rely on assessment tools that are limited in their ecological validity and applicability to real-time, real-world settings (Fulmer & Frijters, 2009; Venkatraman et al., 2012). Further, despite improvements in passive data collection systems via wearable, smartphone-based, and external sensors, unobtrusive measurement of many internal (e.g., level of stress) and external (e.g., presence of other people) contextual factors remains a challenge. Hence unobtrusive measurement of the AIM-ACT elements in real-time, real-world settings represents an important scientific gap to be addressed in the development of engaging digital interventions.
Conclusion
In this paper, we propose a framework that elucidates the processes leading to in-the-moment engagement in digital interventions. This hierarchical (but not necessarily linear) process involves AIM responses, which are moderated by attentional (A) processes and context (C), and likely lead to engagement in the focal task through mediators that facilitate the translation (T) of motivation to behavior. This framework aims to provide a fruitful avenue for identifying scientific questions and generating hypotheses that can be tested to inform the development of strategies for achieving effective engagement in digital interventions.
Public Significance Statement:
Despite the widespread view that engagement is critical to the effectiveness of digital interventions, the concept of engagement remains theoretically ill-defined which has hampered efforts to gain deeper insights about how and why people engage in digital interventions. We integrate prior findings from multiple domains to generate a clear definition of engagement. We then propose a framework to improve the understanding of engagement and to inform strategies for building effective digital interventions.
Contributor Information
Inbal Nahum-Shani, Institute for Social Research, University of Michigan.
Steven D. Shaw, Stephen M. Ross School of Business, University of Michigan
Stephanie M. Carpenter, Institute for Social Research, University of Michigan
Susan A. Murphy, Departments of Statistics & Computer Science, Harvard University
Carolyn Yoon, Stephen M. Ross School of Business, University of Michigan.
References
- Adams CD, & Dickinson A (1981). Instrumental Responding following Reinforcer Devaluation. The Quarterly Journal of Experimental Psychology Section B, 33(2b), 109–121. 10.1080/14640748108400816 [DOI] [Google Scholar]
- Aldunate N, & González-Ibáñez R (2017). An integrated review of emoticons in computer-mediated communication. Frontiers in Psychology, 7(JAN), 2061–2061. 10.3389/fpsyg.2016.02061 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Armstrong T, & Olatunji BO (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clinical psychology review, 32(8), 704–723. 10.1016/j.cpr.2012.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ashforth BE, & Mael F (1989). Social Identity Theory and the Organization. The Academy of Management Review, 14(1), 20–39. https://about.jstor.org/terms [Google Scholar]
- Bakker AB (2014). Daily Fluctuations in Work Engagement. European Psychologist, 19(4), 227–236. 10.1027/1016-9040/a000160 [DOI] [Google Scholar]
- Bakker AB, & van Wingerden J (2021). Do personal resources and strengths use increase work engagement? The effects of a training intervention. Journal of Occupational Health Psychology, 26(1), 20–30. [DOI] [PubMed] [Google Scholar]
- Bartra O, McGuire JT, & Kable JW (2013). The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage, 76, 412–427. 10.1016/j.neuroimage.2013.02.063 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernacer J, & Murillo JI (2014). The Aristotelian conception of habit and its contribution to human neuroscience. Frontiers in Human Neuroscience, 8(November), 883–883. 10.3389/fnhum.2014.00883 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bissonnette JM (2008). Adherence: A concept analysis. Journal of Advanced Nursing, 63(6), 634–643. [DOI] [PubMed] [Google Scholar]
- Bowden JL-H, Tickle L, & Naumann K (2021). The four pillars of tertiary student engagement and success: a holistic measurement approach. Studies in Higher Education, 46(6), 1207–1224. [Google Scholar]
- Campos-Mercade P, Meier AN, Schneider FH, Meier S, Pope D, & Wengström E (2021). Monetary incentives increase COVID-19 vaccinations. Science, 374(6569), 879–882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caniëls MC, Adamska KM, van Oortmerssen LA, & van Assen MF (2021). Set your mind on it: The mediating role of mindset in the relationship between a learning-from-error climate and work-related flow. Current Psychology, 1–10.
- Chien I, Enrique A, Palacios J, Regan T, Keegan D, Carter D, Tschiatschek S, Nori A, Thieme A, Richards D, Doherty G, & Belgrave D (2020). A Machine Learning Approach to Understanding Patterns of Engagement With Internet-Delivered Mental Health Interventions. JAMA network open, 3(7), e2010791–e2010791. 10.1001/jamanetworkopen.2020.10791 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi W, & Lee U (2019). Multi-stage receptivity model for mobile just-in-time health intervention. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(2), 39:31–39:26. 10.1145/3328910 [DOI] [Google Scholar]
- Christian MS, Garza AS, & Slaughter JE (2011). Work engagement: A quantitative review and test of its relations with task and contextual performance. Personnel Psychology, 64(1), 89–136. 10.1111/j.1744-6570.2010.01203.x [DOI] [Google Scholar]
- Cialdini RB (2007). Influence: The psychology of persuasion (Vol. 55). HarperCollins. https://www-oreilly-com.proxy.lib.umich.edu/library/view/influence/9780061899874/?ar [Google Scholar]
- Clowes JA, Peel NF, & Eastell R (2004). The impact of monitoring on adherence and persistence with antiresorptive treatment for postmenopausal osteoporosis: a randomized controlled trial. The Journal of Clinical Endocrinology & Metabolism, 89(3), 1117–1123. [DOI] [PubMed] [Google Scholar]
- Costa Figueiredo M, Caldeira C, Eikey EV, Mazmanian M, & Chen Y (2018). Engaging with health data: The interplay between self-tracking activities and emotions in fertility struggles. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), 1–20. [Google Scholar]
- Courtney KE, Schacht JP, Hutchison K, Roche DJ, & Ray LA (2016). Neural substrates of cue reactivity: association with treatment outcomes and relapse. Addiction biology, 21(1), 3–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Csikszentmihalyi M (2020). Finding flow: The psychology of engagement with everyday life University Press. [Google Scholar]
- Csikszentmihalyi M, & Csikszentmihalyi IS (1988). Optimal experience Cambridge University Press. 10.1017/CBO9780511621956 [DOI] [Google Scholar]
- Cunningham P (2014). Patient engagement during medical visits and smoking cessation counseling. JAMA Internal Medicine, 174(8), 1291–1298. 10.1001/jamainternmed.2014.2170 [DOI] [PubMed] [Google Scholar]
- Dalal RS, Brummel BJ, Wee S, & Thomas LL (2008). Defining employee engagement for productive research and practice. Industrial and Organizational Psychology, 1(1), 52–55. 10.1111/j.1754-9434.2007.00008.x [DOI] [Google Scholar]
- Davis RE, Jacklin R, Sevdalis N, & Vincent CA (2007). Patient involvement in patient safety: What factors influence patient participation and engagement? Health Expect, 10(3), 259–267. 10.1111/j.1369-7625.2007.00450.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dawes CT, Settle JE, Loewen PJ, McGue M, & Iacono WG (2015). Genes, psychological traits and civic engagement. Philosophical Transactions of the Royal Society B: Biological Sciences, 370(1683), 20150015. 10.1098/rstb.2015.0015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Oliveira Santini F, Ladeira WJ, Pinto DC, Herter MM, Sampaio CH, & Babin BJ (2020). Customer engagement in social media: a framework and meta-analysis. Journal of the Academy of Marketing Science, 48, 1211–1228. 10.1007/s11747-020-00731-5 [DOI] [Google Scholar]
- Dehaene S, & Naccache L (2001). Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework. Cognition, 79(1–2), 1–37. 10.1016/s0010-0277(00)00123-2 [DOI] [PubMed] [Google Scholar]
- Dempsey W, Liao P, Kumar S, & Murphy SA (2020). The stratified micro-randomized trial design: sample size considerations for testing nested causal effects of time-varying treatments. The annals of applied statistics, 14(2), 661–684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ding N, Pan X, Luo C, Su N, Zhang W, & Zhang J (2018). Attention is required for knowledge-based sequential grouping: Insights from the integration of syllables into words. Journal of Neuroscience, 38(5), 1178–1188. 10.1523/JNEUROSCI.2606-17.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Do DKX, Rahman K, & Robinson LJ (2019). Determinants of negative customer engagement behaviours. Journal of Services Marketing, 34(2), 117–135. [Google Scholar]
- Doherty K, & Doherty G (2018). Engagement in HCI: Conception, theory and measurement. ACM Computing Surveys, 51(5), Article 99. 10.1145/3234149 [DOI] [Google Scholar]
- Donald JN, Bradshaw EL, Ryan RM, Basarkod G, Ciarrochi J, Duineveld JJ, Guo J, & Sahdra BK (2020). Mindfulness and its association with varied types of motivation: A systematic review and meta-analysis using self-determination theory. Personality and Social Psychology Bulletin, 46(7), 1121–1138. [DOI] [PubMed] [Google Scholar]
- Ebert DD, Harrer M, Apolinário-Hagen J, & Baumeister H (2019). Digital interventions for mental disorders: key features, efficacy, and potential for artificial intelligence applications. In Kim Y-K (Ed.), Frontiers in Psychiatry. Advances in Experimental Medicine and Biology (pp. 583–627). Springer. [DOI] [PubMed] [Google Scholar]
- English T, & Carstensen LL (2014). Emotional experience in the mornings and the evenings: consideration of age differences in specific emotions by time of day. Frontiers in Psychology, 5(MAR), 185–185. 10.3389/fpsyg.2014.00185 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eppler MJ, & Mengis J (2004). The Concept of Information Overload: A Review of Literature from Organization Science, Accounting, Marketing, MIS, and Related Disciplines. The Information Society, 20(5), 325–344. 10.1080/01972240490507974 [DOI] [Google Scholar]
- Epton T, Harris PR, Kane R, van Koningsbruggen GM, & Sheeran P (2015). The impact of self-affirmation on health-behavior change: A meta-analysis. Health Psychology, 34(3), 187–196. 10.1037/hea0000116 [DOI] [PubMed] [Google Scholar]
- Eysenbach G (2005). The Law of Attrition. Journal of Medical Internet Research, 7(1), e11–e11. 10.2196/jmir.7.1.e11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Falk EB, Brook O’donnell M, Cascio CN, Tinney F, Kang Y, Lieberman MD, Taylor SE, An L, Resnicow K, & Strecher VJ (2015). Self-affirmation alters the brain’s response to health messages and subsequent behavior change. Proceedings of the National Academy of Sciences, 112(7), 1977–1982. 10.1073/pnas.1500247112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frank FD, Finnegan RP, & Taylor CR (2004). The race for talent: Retaining and engaging workers in the 21st century. Human Resource Planning, 27(3), 12–25. [Google Scholar]
- Freyne J, Yin J, Brindal E, Hendrie GA, Berkovsky S, & Noakes M (2017). Push notifications in diet apps: Influencing engagement times and tasks. International Journal of Human–Computer Interaction, 33(10), 833–845. 10.1080/10447318.2017.1289725 [DOI] [Google Scholar]
- Fulmer SM, & Frijters JC (2009). A Review of Self-Report and Alternative Approaches in the Measurement of Student Motivation. Psychology Review, 21(3), 219–246. 10.1007/s [DOI] [Google Scholar]
- Gallagher KM, & Updegraff JA (2012). Health message framing effects on attitudes, intentions, and behavior: A meta-analytic review. Annals of Behavioral Medicine, 43(1), 101–116. 10.1007/s12160-011-9308-7 [DOI] [PubMed] [Google Scholar]
- Genevsky A, & Knutson B (2015). Neural affective mechanisms predict market-level microlending. Psychological science, 26(9), 1411–1422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Genevsky A, Yoon C, & Knutson B (2017). When brain beats behavior: Neuroforecasting crowdfunding outcomes. Journal of Neuroscience, 37(36), 8625–8634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Georgeson A, Highlander A, Loiselle R, Zachary C, & Jones DJ (2020). Engagement in technology-enhanced interventions for children and adolescents: Current status and recommendations for moving forward. Clinical psychology review, 78, 101858. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Geurts SA, & Sonnentag S (2006). Recovery as an explanatory mechanism in the relation between acute stress reactions and chronic health impairment. Scandinavian journal of work, environment & health, 32(6), 482–492. [DOI] [PubMed] [Google Scholar]
- Gillison FB, Rouse P, Standage M, Sebire SJ, & Ryan RM (2019). A meta-analysis of techniques to promote motivation for health behaviour change from a self-determination theory perspective. Health psychology review, 13(1), 110–130. [DOI] [PubMed] [Google Scholar]
- Goldenberg A, Garcia D, Halperin E, Zaki J, Kong D, Golarai G, & Gross JJ (2020). Beyond emotional similarity: The role of situation-specific motives. Journal of Experimental Psychology: General, 149(1), 138–159. 10.1037/xge0000625 [DOI] [PubMed] [Google Scholar]
- Goldstein RZ, & Volkow ND (2002). Drug addiction and its underlying neurobiological basis: neuroimaging evidence for the involvement of the frontal cortex. American Journal of Psychiatry, 159(10), 1642–1652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Graham AK, Lattie EG, Powell BJ, Lyon AR, Smith JD, Schueller SM, Stadnick NA, Brown CH, & Mohr DC (2020). Implementation strategies for digital mental health interventions in health care settings. American Psychologist, 75(8), 1080–1092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greven CU, Lionetti F, Booth C, Aron EN, Fox E, Schendan HE, Pluess M, Bruining H, Acevedo B, & Bijttebier P (2019). Sensory processing sensitivity in the context of environmental sensitivity: A critical review and development of research agenda. Neuroscience & Biobehavioral Reviews, 98, 287–305. [DOI] [PubMed] [Google Scholar]
- Harari GM (2020). A process-oriented approach to respecting privacy in the context of mobile phone tracking. Current Opinion in Psychology, 31, 141–147. 10.1016/j.copsyc.2019.09.007 [DOI] [PubMed] [Google Scholar]
- Heffner J, Vives M-L, & FeldmanHall O (2021). Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic. Personality and Individual Differences, 170, 110420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hicks J (2018). Exploring the relationship between awe and leisure: A conceptual argument. Journal of Leisure Research, 49(3–5), 258–276. [Google Scholar]
- Hitlin S, & Elder GH Jr (2007). Time, self, and the curiously abstract concept of agency. Sociological theory, 25(2), 170–191. [Google Scholar]
- Hollebeek LD, & Chen T (2014). Exploring positively-versus negatively-valenced brand engagement: A conceptual model. Journal of Product & Brand Management 10.1108/JPBM-06-2013-0332 [DOI]
- Howard MC, & Crayne MP (2019). Persistence: Defining the multidimensional construct and creating a measure. Personality and Individual Differences, 139, 77–89. [Google Scholar]
- Hu S, & Kuh GD (2002). Being (dis) engaged in educationally purposeful activities: The influences of student and institutional characteristics. Research in Higher Education, 43(5), 555–575. [Google Scholar]
- Hyman SE, Malenka RC, & Nestler EJ (2006). Neural mechanisms of addiction: The role of reward-related learning and memory. Annual Reviews in Neuroscience, 29, 565–598. 10.1146/annurev.neuro.29.051605.113009 [DOI] [PubMed] [Google Scholar]
- Kahn WA (1990). Psychological Conditions of Personal Engagement and Disengagement at Work. The Academy of Management Journal, 33(4), 692–724. https://about.jstor.org/terms [Google Scholar]
- Kahn WA (1992). To be fully there: Psychological presence at work. Human Relations, 45(4), 321–349. [Google Scholar]
- Kanungo RN (1982). Measurement of job and work involvement. Journal of Applied Psychology, 67, 341–349. [Google Scholar]
- Kilday JE, & Ryan AM (2019). Personal and collective perceptions of social support: Implications for classroom engagement in early adolescence. Contemporary Educational Psychology, 58, 163–174. 10.1016/j.cedpsych.2019.03.006 [DOI] [Google Scholar]
- King G, Currie M, & Petersen P (2014). Child and parent engagement in the mental health intervention process: a motivational framework. Child and Adolescent Mental Health, 19(1), 2–8. 10.1111/camh.12015 [DOI] [PubMed] [Google Scholar]
- Kitayama S (2021). Innovative methods and scientific process. Observer, 6. https://www.psychologicalscience.org/observer/innovative-methods
- Knutson B, & Genevsky A (2018). Neuroforecasting aggregate choice. Current Directions in Psychological Science, 27(2), 110–115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knutson B, Katovich K, & Suri G (2014). Inferring affect from fMRI data. Trends in Cognitive Sciences, 18(8), 422–428. 10.1016/j.tics.2014.04.006 [DOI] [PubMed] [Google Scholar]
- Knutson B, Rick S, Wimmer GE, Prelec D, & Loewenstein G (2007). Neural Predictors of Purchases. Neuron, 53(1), 147–156. 10.1016/j.neuron.2006.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koch ED, Moukhtarian TR, Skirrow C, Bozhilova N, Asherson P, & Ebner-Priemer UW (2021). Using e-diaries to investigate ADHD–State-of-the-art and the promising feature of just-in-time-adaptive interventions. Neuroscience & Biobehavioral Reviews, 127, 884–898. [DOI] [PubMed] [Google Scholar]
- Krause KL, & Coates H (2008). Students’ engagement in first‐year university. Assessment & Evaluation in Higher Education, 33(5), 493–505. 10.1080/02602930701698892 [DOI] [Google Scholar]
- Kunzler F, Mishra V, Kramer JN, Kotz D, Fleisch E, & Kowatsch T (2019). Exploring the State-of-Receptivity for mHealth Interventions. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(4), 1–27. 10.1145/3369805 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larson NL, McLarnon MJ, & O’Neill TA (2020). Challenging the “static” quo: Trajectories of engagement in team processes toward a deadline. Journal of Applied Psychology, 105(10), 1145–1163. [DOI] [PubMed] [Google Scholar]
- Lee J-S (2014). The Relationship Between Student Engagement and Academic Performance: Is It a Myth or Reality? The Journal of Educational Research, 107(3), 177–185. 10.1080/00220671.2013.807491 [DOI] [Google Scholar]
- Lee S (2021). Multidimensional structure and measurement invariance of school engagement. Journal of School Psychology, 89, 20–33. [DOI] [PubMed] [Google Scholar]
- Leshner AI (1997). Addiction is a brain disease, and it matters. Science, 278(5335), 45–47. [DOI] [PubMed] [Google Scholar]
- Levitin DJ (2014). The organized mind: Thinking straight in the age of information overload Penguin. [Google Scholar]
- Levy DJ, & Glimcher PW (2012). The root of all value: A neural common currency for choice. Current opinion in neurobiology, 22(6), 1027–1038. 10.1016/j.conb.2012.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li X, Chan KW, & Kim S (2019). Service with Emoticons: How Customers Interpret Employee Use of Emoticons in Online Service Encounters. Journal of Consumer Research, 45(5), 973–987. 10.1093/jcr/ucy016 [DOI] [Google Scholar]
- Lievonen M, Luoma-aho V, & Bowden J (2018). Negative engagement. In Johnston K & Taylor M (Eds.), The handbook of communication engagement (pp. 531–548).
- Linardon J, & Fuller-Tyszkiewicz M (2020). Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review. Journal of consulting and clinical psychology, 88(1), 1–13. [DOI] [PubMed] [Google Scholar]
- Macey WH, & Schneider B (2008). Engaged in Engagement: We Are Delighted We Did It. Industrial and Organizational Psychology, 1(1), 76–83. 10.1111/j.1754-9434.2007.00016.x [DOI] [Google Scholar]
- MacNiven KH, Jensen EL, Borg N, Padula CB, Humphreys K, & Knutson B (2018). Association of neural responses to drug cues with subsequent relapse to stimulant use. JAMA network open, 1(8), e186466–e186466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mai R, Hoffmann S, & Balderjahn I (2021). When drivers become inhibitors of organic consumption: the need for a multistage view. Journal of the Academy of Marketing Science, 49(6), 1151–1174. [Google Scholar]
- Maslach C, & Leiter MP (1997). The Truth about Burnout: How Organizations Cause Personal Stress and What to do about It Jossey-Bass. [Google Scholar]
- Matthes J, Karsay K, Hirsch M, Stevic A, & Schmuck D (2021). Reflective smartphone disengagement: Conceptualization, measurement, and validation. Computers in Human Behavior, 107078.
- May DR, Gilson RL, & Harter LM (2004). The psychological conditions of meaningfulness, safety and availability and the engagement of the human spirit at work. Journal of Occupational and Organizational Psychology, 77(1), 11–37. 10.1348/096317904322915892 [DOI] [Google Scholar]
- Meyer JP, & Allen NJ (1997). Commitment in the workplace: Theory, research and application Sage. [Google Scholar]
- Mirbagheri S, & Najmi M (2019). Consumers’ engagement with social media activation campaigns: Construct conceptualization and scale development. Psychology & Marketing, 36(4), 376–394. [Google Scholar]
- Moll J, Krueger F, Zahn R, Pardini M, de Oliveira-Souza R, & Grafman J (2006). Human fronto–mesolimbic networks guide decisions about charitable donation. Proceedings of the National Academy of Sciences, 103(42), 15623–15628. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mollen S, Engelen S, Kessels LTE, & van den Putte B (2017). Short and sweet: The persuasive effects of message framing and temporal context in antismoking warning labels. Journal of Health Communication, 22(1), 20–28. 10.1080/10810730.2016.1247484 [DOI] [PubMed] [Google Scholar]
- Moody GD, Galletta DF, & Lowry PB (2014). When trust and distrust collide online: The engenderment and role of consumer ambivalence in online consumer behavior. Electronic Commerce Research and Applications, 13(4), 266–282. [Google Scholar]
- Morgan RM, & Hunt SD (1994). The Commitment-Trust Theory of Relationship Marketing. Journal of marketing, 58, 20–38. [Google Scholar]
- Morrison LG, Hargood C, Pejovic V, Geraghty AWA, Lloyd S, Goodman N, Michaelides DT, Weston A, Musolesi M, Weal MJ, & Yardley L (2017). The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial. PLoS ONE, 12(1), e0169162. 10.1371/journal.pone.0169162 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moshe I, Terhorst Y, Philippi P, Domhardt D, Cuijpers P, Cristea I, Pulkki-Råback L, Baumeister H, & Sander L (2021). Digital interventions for the treatment of depression: A meta-analytic review. Psychological Bulletin, 147(8), 749–786. 10.1037/bul0000334 [DOI] [PubMed] [Google Scholar]
- Muench F, & Baumel A (2017). More Than a Text Message: Dismantling Digital Triggers to Curate Behavior Change in Patient-Centered Health Interventions. Journal of Medical Internet Research, 19(5), e147–e147. 10.2196/jmir.7463 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Müller BCN, Ritter SM, Glock S, & Dijksterhuis A (2016). Smoking-related warning messages formulated as questions positively influence short-term smoking behaviour. Journal of Health Psychology, 21(1), 60–68. 10.1177/1359105314522083 [DOI] [PubMed] [Google Scholar]
- Murayama K (In press). A reward-learning framework of autonomous knowledge acquisition: An integrated account of curiosity, interest, and intrinsic-extrinsic rewards. Psychological Review 10.31219/osf.io/zey4k [DOI] [PubMed]
- Murayama K, Matsumoto M, Izuma K, & Matsumoto K (2010). Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proceedings of the National Academy of Sciences, 107(49), 20911–20916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nahum-Shani I, Potter LN, Lam CY, Yap J, Moreno A, Stoffel R, Wu Z, Wan N, Dempsey W, Kumar S, Ertin E, Murphy SA, Rehg JM, & Wetter DW (2021). The Mobile Assistance for Regulating Smoking (MARS) micro-randomized trial design protocol. Contemporary Clinical Trials, in press, 106513. 10.1016/j.cct.2021.106513 [DOI] [PMC free article] [PubMed]
- Nahum-Shani I, Rabbi M, Yap J., Philyaw-Kotov ML., Klasnja P., Bonar EE., Cunningham RM., Murphy SA., & Walton MA. (2021). Translating strategies for promoting engagement in mobile health: A proof-of-concept microrandomized trial [Advance online publication]. Health Psychology, 2021. 10.1037/hea0001101 [DOI] [PMC free article] [PubMed]
- Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, & Murphy SA (2018). Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support. Annals of Behavioral Medicine, 52(6), 446–462. 10.1007/s12160-016-9830-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newby K, Teah G, Cooke R, Li X, Brown K, Salisbury-Finch B, Kwah K, Bartle N, Curtis K, & Fulton E (2021). Do automated digital health behaviour change interventions have a positive effect on self-efficacy? A systematic review and meta-analysis. Health psychology review, 15(1), 140–158. [DOI] [PubMed] [Google Scholar]
- Newton DW, LePine JA, Kim JK, Wellman N, & Bush JT (2020). Taking engagement to task: The nature and functioning of task engagement across transitions. Journal of Applied Psychology, 105(1), 1–18. 10.1037/apl0000428 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Brien HL, Arguello J, & Capra R (2020). An empirical study of interest, task complexity, and search behaviour on user engagement. Information Processing and Management, 57(3), 102226–102226. 10.1016/j.ipm.2020.102226 [DOI] [Google Scholar]
- O’Brien HL, & Toms EG (2008). What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American society for Information Science and Technology, 59(6), 938–955. 10.1002/asi.20801 [DOI] [Google Scholar]
- O’Neill S, & Nicholson-Cole S (2009). “Fear won’t do it” promoting positive engagement with climate change through visual and iconic representations. Science Communication, 30(3), 355–379. 10.1177/1075547008329201 [DOI] [Google Scholar]
- Pansari A, & Kumar V (2017). Customer engagement: The construct, antecedents, and consequences. Journal of the Academy of Marketing Science, 45(3), 294–311. [Google Scholar]
- Pejovic V, & Musolesi M (2014, September ). InterruptMe: Designing intelligent prompting mechanisms for pervasive applications Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing [Google Scholar]
- Perone S, Anderson AJ, & Weybright EH (2020). It is all relative: Contextual influences on boredom and neural correlates of regulatory processes. Psychophysiology, e13746. 10.1111/psyp.13746 [DOI] [PubMed]
- Perski O, Blandford A, West R, & Michie S (2017). Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Translational behavioral medicine, 7(2), 254–267. 10.1007/s13142-016-0453-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pessoa L, & Ungerleider LG (2004). Neuroimaging studies of attention and the processing of emotion-laden stimuli. Progress in Brain Research, 144, 171–182. 10.1016/S0079-6123(03)14401-2 [DOI] [PubMed] [Google Scholar]
- Pham XL, Nguyen TH, Hwang WY, & Chen GD (2016). Effects of push notifications on learner engagement in a mobile learning app 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT), [Google Scholar]
- Pham YK, Murray C, & Gau J (2021). The Inventory of Teacher‐Student Relationships: Factor structure and associations with school engagement among high‐risk youth. Psychology in the Schools
- Pielot M (2014). Large-scale evaluation of call-availability prediction UbiComp ‘14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, [Google Scholar]
- Pratap A, Neto EC, Snyder P, Stepnowsky C, Elhadad N, Grant D, Mohebbi MH, Mooney S, Suver C, Wilbanks J, Mangravite L, Heagerty PJ, Areán P, & Omberg L (2020). Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. npj Digital Medicine, 3(1), 1–10. 10.1038/s41746-020-0224-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preuschoff K, Bossaerts P, & Quartz SR (2006). Neural differentiation of expected reward and risk in human subcortical structures. Neuron, 51(3), 381–390. [DOI] [PubMed] [Google Scholar]
- Qian T, Walton A, Collins LM, Klasnja P, Lanza ST, Nahum-Shani I, Rabbi M, Russell MA, Waltom M, Yoo H, & Murphy SA (2022). The Micro-Randomized Trial for Developing Digital Interventions: Experimental Design and Data Analysis Considerations. Psychological Methods, In Press. [DOI] [PMC free article] [PubMed]
- Quinn RW, & Dutton JE (2005). Coordination as Energy-in-Conversation. Academy of management review, 30(1), 36–57. https://www.jstor.org/stable/20159094?seq=1&cid=pdf- [Google Scholar]
- Rabbi M, Kotov MP, Cunningham R, Bonar EE, Nahum-Shani I, Klasnja P, Walton M, & Murphy S (2018). Toward increasing engagement in substance use data collection: Development of the substance abuse research assistant app and protocol for a microrandomized trial using adolescents and emerging adults. Journal of Medical Internet Research, 20(7), e166. 10.2196/resprot.9850 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rao RP (2006). Models of attention. In Encyclopedia of Cognitive Science Nature Publishing Group. 10.1002/0470018860.s00370 [DOI] [Google Scholar]
- Raveendhran R, & Fast NJ (2021). Humans judge, algorithms nudge: The psychology of behavior tracking acceptance. Organizational Behavior and Human Decision Processes, 164, 11–26. 10.1016/j.obhdp.2021.01.001 [DOI] [Google Scholar]
- Reina-Tamayo AM, Bakker AB, & Derks D (2017). Episodic Demands, Resources, and Engagement. Journal of Personnel Psychology, 16(3), 125–136. 10.1027/1866-5888/a000177 [DOI] [Google Scholar]
- Reinke WM, Smith TE, & Herman KC (2019). Family-school engagement across child and adolescent development. School Psychology, 34(4), 346–349. [DOI] [PubMed] [Google Scholar]
- Resnicow K, Davis RE, Zhang G, Konkel J, Strecher VJ, Shaikh AR, Tolsma D, Calvi J, Alexander G, Anderson JP, & Wiese C (2008). Tailoring a fruit and vegetable intervention on novel motivational constructs: Results of a randomized study. Annals of Behavioral Medicine, 35(2), 159–169. 10.1007/s12160-008-9028-9 [DOI] [PubMed] [Google Scholar]
- Rich BL, Lepine JA, & Crawford ER (2010). Job engagement: Antecedents and effects on job performance. The Academy of Management Journal, 53(3), 617–635. https://about.jstor.org/terms [Google Scholar]
- Richman A (2006). Everyone wants an engaged workforce. How can you create it? Workspan, 49(1), 36–39. [Google Scholar]
- Rigby CS, Deci EL, Patrick BC, & Ryan RM (1992). Beyond the intrinsic-extrinsic dichotomy: Self-determination in motivation and learning. Motivation and emotion, 16(3), 165–185. [Google Scholar]
- Rotgans JI, Schmidt HG, Rajalingam P, Hao JWY, Canning CA, Ferenczi MA, & Low-Beer N (2018). How cognitive engagement fluctuates during a team-based learning session and how it predicts academic achievement. Advances in Health Sciences Education, 23(2), 339–351. 10.1007/s10459-017-9801-2 [DOI] [PubMed] [Google Scholar]
- Ryan RM, & Deci EL (2000a). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54–67. [DOI] [PubMed] [Google Scholar]
- Ryan RM, & Deci EL (2000b). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. [DOI] [PubMed] [Google Scholar]
- Sahni NS, Wheeler SC, & Chintagunta P (2018). Personalization in email marketing: The role of noninformative advertising content. Marketing Science, 37(2), 236–258. 10.1287/mksc.2017.1066 [DOI] [Google Scholar]
- Saks AM (2008). The Meaning and Bleeding of Employee Engagement: How Muddy Is the Water? Industrial and Organizational Psychology, 1(1), 40–43. 10.1111/j.1754-9434.2007.00005.x [DOI] [Google Scholar]
- Samanez-Larkin GR, & Knutson B (2015). Decision making in the ageing brain: changes in affective and motivational circuits. Nature Reviews Neuroscience, 16(5), 278–289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schaufeli W, Salanova M, González-romá V, & Bakker A (2002). The Measurement of Engagement and Burnout: A Two Sample Confirmatory Factor Analytic Approach. Journal of Happiness studies, 3(1), 71–92. 10.1023/A:1015630930326 [DOI] [Google Scholar]
- Scherer KR (2001). Appraisal considered as a process of multilevel sequential checking. In Scherer KR, Schorr A, & Johnstone T (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 92–120).
- Schmitt JB, Breuer J, & Wulf T (2021). From cognitive overload to digital detox: Psychological implications of telework during the COVID-19 pandemic. Computers in Human Behavior, 124, 106899. 10.1016/j.chb.2021.106899 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schueller SM, & Torous J (2020). Scaling evidence-based treatments through digital mental health. American Psychologist, 75(8), 1093–1104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shaw K (2005). An engagement strategy process for communicators. Strategic Communication Management, 9(3), 26–29. [Google Scholar]
- Sidner CL, Kidd CD, Lee C, & Lesh N (2004, January). Where to look: A study of human-robot engagement Proceedings of the 9th international conference on intelligent user interfaces, [Google Scholar]
- Spreitzer GM, & Porath C (2014). Self-determination as nutriment for thriving: Building an integrative model of human growth at work. In The Oxford handbook of work engagement, motivation, and self-determination theory (Vol. 90, pp. 245–258). [Google Scholar]
- Statista. (2020). Mobile app user retention rate by category In.
- Stieger M, Flückiger C, Rüegger D, Kowatsch T, Roberts BW, & Allemand M (2021). Changing personality traits with the help of a digital personality change intervention. Proceedings of the National Academy of Sciences, 118(8), e2017548118. 10.1073/pnas.2017548118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Studer B, & Knecht S (2016). Motivation: What have we learned and what is still missing? Progress in Brain Research, 229, 441–450. [DOI] [PubMed] [Google Scholar]
- Thaler RH, & Sunstein CR (2021). Nudge: The final edition Penguin. [Google Scholar]
- Thompson RF, & Spencer WA (1966). Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychological Review, 73(1), 16–43. [DOI] [PubMed] [Google Scholar]
- Tong LC, Acikalin MY, Genevsky A, Shiv B, & Knutson B (2020). Brain activity forecasts video engagement in an internet attention market. Proceedings of the National Academy of Sciences, 117(12), 6936–6941. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Torok M, Han J, Baker S, Werner-Seidler A, Wong I, Larsen ME, & Christensen H (2020). Suicide prevention using self-guided digital interventions: a systematic review and meta-analysis of randomised controlled trials. The Lancet Digital Health, 2(1), e25–e36. [DOI] [PubMed] [Google Scholar]
- Torous J, Michalak EE, & O’Brien HL (2020). Digital Health and Engagement-Looking Behind the Measures and Methods. JAMA network open, 3(7), e2010918. 10.1001/jamanetworkopen.2020.10918 [DOI] [PubMed] [Google Scholar]
- Turel O, & Serenko A (2012). The benefits and dangers of enjoyment with social networking websites. European Journal of Information Systems, 21(5), 512–528. [Google Scholar]
- Valle CG, Nezami BT, & Tate DF (2020). Designing in-app messages to nudge behavior change: Lessons learned from a weight management app for young adults. Organizational Behavior and Human Decision Processes, 161, 95–101. [Google Scholar]
- Venkatraman V, Clithero JA, & Fitzsimons GJ (2012). New scanner data for brand marketers: How neuroscience can help better understand differences in brand preferences. Journal of consumer psychology, 22(1), 143–153. [Google Scholar]
- Verhagen T, & Van Dolen W (2011). The influence of online store beliefs on consumer online impulse buying: A model and empirical application. Information & Management, 48(8), 320–327. [Google Scholar]
- Vivek SD, Beatty SE, & Morgan RM (2012). Customer engagement: Exploring customer relationships beyond purchase. Journal of Marketing Theory and Practice, 20(2), 122–146. 10.2753/mtp1069-6679200201 [DOI] [Google Scholar]
- Vugts A, Van Den Hoven M, De Vet E, & Verweij M (2020). How autonomy is understood in discussions on the ethics of nudging. Behavioural Public Policy, 4(1), 108–123. [Google Scholar]
- Vuilleumier P (2002). Facial expression and selective attention. Current Opinion in Psychiatry, 15(3), 291–300. [Google Scholar]
- Wang L, Law KS, Zhang MJ, Li YN, & Liang Y (2019). It’s mine! Psychological ownership of one’s job explains positive and negative workplace outcomes of job engagement. Journal of Applied Psychology, 104(2), 229–246. [DOI] [PubMed] [Google Scholar]
- Weintraub J, Cassell D, & DePatie TP (2021). Nudging flow through ‘SMART’goal setting to decrease stress, increase engagement, and increase performance at work. Journal of Occupational and Organizational Psychology, 94(2), 230–258. [Google Scholar]
- West R, & Michie S (2016). A guide to development and evaluation of digital behaviour interventions in healthcare Silverback Publishing. [Google Scholar]
- Williams KJ, Martinez LR, Fall A-M, Miciak J, & Vaughn S (2020). Student Engagement among High School English Learners with Reading Comprehension Difficulties. School Psychology Review, 1–19.
- Yardley L, Bradbury K, Nadarzynski T, & Hunter C (2018). Digital Health Psychology. In Handbook of Health Psychology (pp. 519–525). Routledge. [Google Scholar]
- Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, Merchant GC, Naughton F, & Blandford A (2016). Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions. American Journal of Preventive Medicine, 51(5), 833–842. 10.1016/j.amepre.2016.06.015 [DOI] [PubMed] [Google Scholar]
- Young HR, Glerum DR, Wang W, & Joseph DL (2018). Who are the most engaged at work? A meta‐analysis of personality and employee engagement. Journal of Organizational Behavior, 39(10), 1330–1346. [Google Scholar]
- Yu N, & Shen F (2013). Benefits for me or risks for others: A cross-culture investigation of the effects of message frames and cultural appeals. Health communication, 28(2), 133–145. 10.1080/10410236.2012.662147 [DOI] [PubMed] [Google Scholar]
- Yuan Z, Ye Z, & Zhong M (2021). Plug back into work, safely: Job reattachment, leader safety commitment, and job engagement in the COVID-19 pandemic. Journal of Applied Psychology, 106(1), 62–70. [DOI] [PubMed] [Google Scholar]
- Zeng X, & Mourali M (2021). Consumers as creative agents: How required effort influences willingness to engage. Psychology & Marketing, 38(8), 1220–1237. [Google Scholar]