Skip to main content
Frontiers in Psychology logoLink to Frontiers in Psychology
. 2018 Dec 12;9:2532. doi: 10.3389/fpsyg.2018.02532

Virtual Reality as a New Approach for Risk Taking Assessment

Carla de-Juan-Ripoll 1,*, José L Soler-Domínguez 1, Jaime Guixeres 1, Manuel Contero 1, Noemi Álvarez Gutiérrez 1, Mariano Alcañiz 1
PMCID: PMC6315141  PMID: 30631294

Abstract

Understanding how people behave when facing hazardous situations, how intrinsic and extrinsic factors influence the risk taking (RT) decision making process and to what extent it is possible to modify their reactions externally, are questions that have long interested academics and society in general. In the spheres, among others, of Occupational Safety and Health (OSH), the military, finance and sociology, this topic has multidisciplinary implications because we all constantly face RT situations. Researchers have hitherto assessed RT profiles by conducting questionnaires prior to and after the presentation of stimuli; however, this can lead to the production of biased, non-realistic, RT profiles. This is due to the reflexive nature of choosing an answer in a questionnaire, which is remote from the reactive, emotional and impulsive decision making processes inherent to real, risky situations. One way to address this question is to exploit VR capabilities to generate immersive environments that recreate realistic seeming but simulated hazardous situations. We propose VR as the next-generation tool to study RT processes, taking advantage of the big four families of metrics which can provide objective assessment methods with high ecological validity: the real-world risks approach (high presence VR environments triggering real-world reactions), embodied interactions (more natural interactions eliciting more natural behaviors), stealth assessment (unnoticed real-time assessments offering efficient behavioral metrics) and physiological real-time measurement (physiological signals avoiding subjective bias). Additionally, VR can provide an invaluable tool, after the assessment phase, to train in skills related to RT due to its transferability to real-world situations.

Keywords: virtual reality, risk taking, occupational risks, risk attitude, risk perception, stealth assessment, psychophysiological assessment, embodiment

Introduction

Each year, deficient Occupational Safety and Health (OSH) practices cause a global cost of approximately 2680 billion euros (Elsler et al., 2017). Although OSH training has shown positive impacts in the workplace, its effectiveness is below expectations (Robson et al., 2012). It has been demonstrated that the natural differences between individuals can appreciably influence this low effectiveness at several levels, cognitive, motivational and functional, among others (Motowildo et al., 1997). Risk propensity, defined as the “willingness to take risks” (MacCrimmon and Wehrung, 1990) and risk perception, defined as the individual’s assessment of how risky a situation is (Baird and Thomas, 1985), have been shown to have strong influence on risky decision making behaviors (Sitkin and Weingart, 1995). The measurement of risk taking (RT) attitudes is a recognized challenge for researchers and practitioners. Researchers have mostly employed self-report instruments to assess individual constructs based on theoretical psychological models (Brockhaus Sr, 1980; Ford et al., 1990; Gullone et al., 2000; Portell and Solé, 2001; Steinberg, 2004; Gardner and Steinberg, 2005; Sneddon et al., 2013; Rodríguez-Garzón et al., 2015). We have not found any one model that defines RT, thus its measurement requires further investigation. Lejuez et al. (2002) developed and validated a laboratory-based behavioral measure of RT (Balloon Analog Risk Task – BART). While this is a validated tool that has been used in several studies, we believe that it is desirable to develop a more ecological system to measure RT. VR provides the capability of creating interactive environments in which users can perform while their behavioral responses are recorded (Parsons, 2015). Accordingly, we propose that virtual environment based assessments are tools that can enhance the ecological validity of the evaluation of the responses evoked (Parsey and Schmitter-Edgecombe, 2013).

In this article we focus on the measurement of RT using physiological and behavioral metrics, with VR being employed as a tool to create immersive situations. We propose to use VR to assess RT attitudes under the paradigm of stealth assessment. VR can provide engaging virtual worlds which will allow real time measurement of RT behaviors.

This paper is comprised of four sections. In the first we review the theoretical framework of RT in the previous literature. In the second we summarize the extant instruments for the measurement of RT behaviors and discuss the current issues that make us believe that there is a need to establish a new approach. In the third we propose VR as a step forward in the assessment of RT. The fourth section briefly discusses the substantial implications raised by the article and our proposals for future research in this field.

Research Into Risk Taking

RT research can be said to have started with the nuclear debate of the sixties. It was focused on risk acceptance and dealt with factors such as benefits and voluntariness. Since then, several more factors have been proposed for the explanation of RT: trust, trustworthiness and trust propensity (Colquitt et al., 2007); supportive supervision, job autonomy and communication quality (Parker et al., 2001); problem framing and outcome history (Sitkin and Weingart, 1995); expected utility (Kahneman and Tversky, 1986); genre (Byrnes et al., 1999) and boredom (Schroeter et al., 2014).

While these factors have been demonstrated to influence RT, individual differences constitute a key element in decision making processes (see Figure 1). According to Rundmo, 1996, a biased perception of risk – understood as the subjective evaluation of a risk - can lead to misjudgements of potentially hazardous risk sources. Therefore, if the subjective evaluation of a risk differs from the objective risk, this should be corrected (Risk Research Committee, 1980). Personality traits influence attitude toward risk, prompting risk seeking or risk aversion behaviors. This set of personal, innate, basic characteristics associated with risk were named Intrinsic Risk Attitude (IRA) by Schoemaker (1993) and have been shown to be consistent in various situations and contexts (Dohmen et al., 2011). Additionally, cognitive and affective states are also considered to be key influencers in the decision making process. We highlight mood and cognitive load as two main representative factors in this category. Mood has a strong influence on RT. People in a positive mood tend to focus on the benefits of a risky situation, much more so than those in neutral mood, making them more susceptible to undertake risky behaviors (Forgas, 1982, 1995; Forgas and Bower, 1987; Yuen and Lee, 2003). On the other hand, people in a negative mood overestimate risks and try to avoid potential loss and, therefore, think and act more carefully (Jorgensen, 1996). Cognitive load, the amount of mental activity involved in working memory, might also play a role in risk perception, since some kind of decisions, based on utilitarian judgments, require additional cognitive resources (Greene et al., 2008).

FIGURE 1.

FIGURE 1

Individual differences that influence risk taking.

Risk Taking Measures: Current Issues

RT measurement is a non-deterministic and non-standardized process based on different perspectives. Traditionally, most theories of human behavior are based on a model of the human mind that assumes that humans can think and verbalize accurately about their attitudes, emotions and behaviors (Simon, 1976; Brief, 1998). To date, most of the theoretical constructs used in RT assessment are based on explicit measures such as self-reports. However, recent advances in neuroscience have demonstrated that most of the brain processes that regulate our emotions, attitudes and behaviors are not conscious. That is, they are implicit processes that, in contrast to explicit processes, humans cannot verbalize (Barsade et al., 2009; George, 2009; Becker et al., 2011).

Several explicit measures of RT, oriented to evaluate attitude to risk, deferred risk perception or expected risk behavior, have been proposed in the last fifty years. Some authors have employed self-report measures based on questionnaires on compliance with safety practices in the workplace (Parker et al., 2001; Mohamed et al., 2009; Seo et al., 2015), attitude toward risk and organizational commitment (Kivimäki and Kalimo, 1993) and in studies into decision making (Sitkin and Weingart, 1995). On the other hand, some works have drawn on theoretical multidimensional models based on psychological constructs, such as personality (Lejuez et al., 2002; Skeel et al., 2007), impulsivity (Lejuez et al., 2002), sensation seeking (Horvath and Zuckerman, 1993; Lejuez et al., 2002) and situational awareness (Lejuez et al., 2002).

However, as in many other disciplines, pre- and post-experiment questionnaires have an important intrinsic bias since individuals’ cognitive and psychological states will be different when they answer the questionnaires to when they actually underwent the experiences that the researchers wish to analyse (Kivikangas et al., 2011). As stated in (Wang et al., 2015), this tendency is primarily due to “social desirability effects,” which can lead to untrue accounts of behavior, attitudes and beliefs (Paulhus, 1991). In addition, there may be different interpretations of specific self-report items, resulting in unreliability and poorer validity (Lanyon and Goodstein, 1997). Lastly, some self-reporting questions need people to possess overt knowledge of their dispositions (Schmitt, 1994) and this does not always run true.

To our knowledge, the BART (Lejuez et al., 2002) constitutes, to date, the only tool for RT measurement using implicit measures. The authors developed and validated a laboratory-based behavioral measure of risky behaviors. In this task, a balloon was presented in the middle of the screen. Subjects were asked to pump it as much as possible, knowing that it could exploit at any time. Participants were told that they would obtain a financial reward the more they could inflate the balloon without breaking it. Although the reliability of this tool has been retested (White et al., 2008), extensive investigations have demonstrated that the correspondence between performance in neuropsychological tests and real-life behaviors is very weak (Manchester et al., 2004; Sbordone, 2008; Bottari et al., 2009).

In the BART validation study, researchers employed measures of impulsivity, sensation seeking and behavioral constraint. We consider this a good basis to build on, since each of these constructs has been investigated independently and associated with RT. Firstly, impulsivity has been associated with RT in terms of drug use, drink driving and seatbelt use (de Wit, 2009; Stanford et al., 1996). Some authors have also demonstrated its connection with emotional self-control, inhibition and, especially, the management of frustrating situations (Cooper et al., 2000; Boyer, 2006). In addition, researchers have studied the relationship between the sensation seeking trait and RT in several domains, such as recreation, health, career, finance, safety and social life (Nicholson et al., 2005). Donohew et al. (1999) concluded that sensation seeking is an important factor in sexual RT. According to Tellegen’s (1985), model behavioral constraint is one of the dimensions that composes personality. The behavioral constraint factor encompasses control, harm avoidance and traditionalism facets. In the same way, there is empirical evidence of the influence of personality traits on RT attitudes, in particular punishment avoidance (Paulus et al., 2003). We can find an interesting study from Wills et al. (2006) supporting this idea in the substance abuse field.

Limitations of Current Risk Taking Measures

As mentioned previously, to date the majority of RT assessment tools has been based on explicit measures and the use of questionnaires.

BART, with its multi-dimensional set of psycho-cognitive influences, represents the only alternative to explicit measures of RT behavior, but its design has some intrinsic limitations that current technologies could help to overcome.

In this regard, we believe that the existing measurement instruments do not reflect real situations, in which the subjects can perform as in real life, which leads to skewed results. In the laboratory the controlled stimuli given to subjects often do not include variables that are present in real life situations. Thus, the ecological validity of these methodologies, such as BART, is quite limited. Furthermore, these measurement tools do not involve any strong physical interaction, but require only simple actions, such as clicking a mouse, ignoring the influence of the reactions of the rest of the body. In addition, when an individual is submitted to the currently available tests, (s)he is aware that (s)he is being assessed and can alter the outcomes; so we propose stealth assessment as a means of obtaining reliable results about real behaviors unnoticed by the subject. Lastly, we suggest that physiological processes must be considered as important measures of RT, as these measurements are uncontaminated by the participant’s answering style, social desirability, interpretations of questionnaire item wording, the limits of his or her memory or by observer bias (Kivikangas et al., 2011). Thus, we propose an alternative measurement method which aims to advance in four specific aspects:

  • simple (1)

    Real-world risks: As stated in Bornovalova et al. (2009), p.261. “[BART] …… did not collect information on “real-world” risk-taking. It would be of both theoretical interest and clinical relevance to examine whether the current results “hold” when considering actual risk-taking behavior”. We want to expose individuals to (almost) real risks in order to obtain (almost) real reactions. Amit et al. (2014) found that humans demonstrate two kinds of thought processes in any given situation, verbal and visual. A person who tends to verbal thinking builds meanings using words. This generates an abstract interpretation of a concept. It is usual, in this circumstance, to exhibit controlled cognitive processes, experience high psychological distance and to make utilitarian judgements. In contrast, visual thinking is associated with the use of images to represent concepts, generating a sense of proximity and the making of deontological judgements. People who tend toward visual thinking are willing to be guided by emotional automatic processes and are strongly influenced by secondary emotions. Using the real-world risks approach, we suggest that we can evoke the sensation of physical risk and initiate visual thinking that would arise in a real life, risky situation.

  • simple (2)

    Embodied cognition: How the actions of our bodies influence our perception, communication and learning processes is a field of study known as Embodied Cognition (EC). EC can be defined by stating that cognition is solidly based on corporal interactions with the physical environment (Wilson, 2002; Gallagher, 2005). Going into more detail, systems for sensing, acting and thinking are intrinsically interdependent and human cognition is made up of complex, specific representations combining all three systems (Soler et al., 2017). During recent years, instructional methods based on bodily interactions have been developed to create meaningful connections between physical activity and different knowledge domains, mainly in the STEM (Science, Technology, Engineering and Maths) area, strongly linked to the new Mixed Reality media (Lindgren and Johnson-Glenberg, 2013). To a certain extent, embodied learning could represent an important foundation on which to build a whole set of interactive, immersive learning environments. This concept is supported by previous research (Kontra et al., 2012) that argues that taking a meaningful action enhances learning in comparison to passively perceiving that action. This idea has been strongly supported for decades by classical learning theorists such as Piaget and Cook (1952) and Vygotsky (1978). We propose to take advantage of the ideas underlying embodied learning theory and use high level cognitive experiences, involving sensing, acting and thinking, to measure and change attitudes in a deeper, more effective way.

  • simple (3)

    Stealth assessment: “When embedded assessments are seamlessly woven into the fabric of the learning environment so that they are virtually invisible or unnoticed by the learner, this is stealth assessment” (Shute and Spector, 2008, unpublished, p.2). More specifically, this method offers the possibility of assessing different behaviors related to concrete capabilities, providing indirect evaluations in real time (Mislevy et al., 2003) and reducing test anxiety, while maintaining validity and reliability (Shute et al., 2008). Stealth assessment fits into the framework of evidence-centered design (ECD), which considers three conceptual models that must be present in stimuli design: the competency model, which aims to define the skills that the researcher wishes to assess; the evidence model, that aims to define specific behaviors and their relationships with particular skills and capabilities; and the task model, which is designed to develop specific scenarios and tasks to prompt skills-related behaviors (Shute, 2011). Thus, stealth assessment allows the setting of tasks and creation of situations that can elicit particular behaviors connected with the skills and capabilities to be evaluated.

  • simple (4)

    Physiological real-time measurement: Several physiological measures have recently been proposed as implicit measures of human behavior (Kivikangas et al., 2011). Skin conductance level has been successfully used as a measure of implicit processes such as stress, affective arousal and cognitive processing (Sequeira et al., 2009). Heart variability (HV) has been used for the implicit measurement of complex phenomena, for example cognitive load (Durantin et al., 2014). Eye tracking (ET) is a very interesting measure of subconscious brain processes, showing correlations with information processing in risky decisions (Glöckner and Herbold, 2011) and problem solving (Knoblich et al., 2001). Recent studies, using Functional Near-Infrared Spectroscopy (fNIRS), into decision making under pressure (Tsujii and Watanabe, 2010) and decision making processes in approach-avoidance theories (Ernst et al., 2013), are highly relevant for RT measures.

Virtual Reality and Risk Taking Assessment

Virtual Reality is a 3D synthetic environment able to simulate real experiences in which subjects can interact as if they were in the real world (Alcañiz et al., 2003). VR provides greater immersion, fidelity and higher level of active user involvement than traditional methods of assessment and training (Hedberg and Alexander, 1994). In our view, VR constitutes a suitable tool for behavioral measurement, since it complies with the requirements (see Table 1) of the four specific aspects discussed in the previous section: (1) the real-world risks approach, (2) embodied learning, (3) stealth assessment and (4) physiological real-time measurement.

Table 1.

VRfeatures and benefits of risk taking measurement.

Domain VR features Benefits of measurement
Real-world risks Evokes the sensation of physical risk Neural mechanisms similar to real life
Embodied interactions Actions raised in the first person More emotional decisions
Stealth assessment Indirect evaluation in real time Reduction of test anxiety More validity and reliability
Physiological real-time measurement Physiological measurement during performance Involuntary, uncontaminated by participant answering bias

(1) According to Slater (2009), the result of immersion through technology is the psychological state of “being there,” where the subject essentially forgets that (s)he is in a virtual reality setting. This produces a sense of presence and a “plausibility illusion” which evoke the perception that what is happening in the VR is actual and allows subjects to interact and behave as they might in real life. VR is being used increasingly for natural phenomena and social interactions simulation, since it has been demonstrated that neural mechanisms in humans when they are immersed in a virtual environment are similar to those in real life (Alcañiz et al., 2009). When we talk about training and learning, failure is a necessary ingredient. There is evidence that people who have faced real hazards have a more cautious attitude toward OSH (Cavalcanti and Soares, 2012). Hazards in real life can involve serious danger. This is why VR emerges as a potential medium for RT assessment and training, allowing users to operate, without risks, in a quasi-real environment (Amokrane et al., 2008). VR allows the exposure of a person to a risky situation and the activation of high fidelity cognitive processes and behaviors due to the plausibility of the immersion. (2) VR environments allow users to take part in an embodied learning experience, mainly through physical interactions (Kilteni et al., 2012). Going further with this concept (Dourish, 1999, unpublished), we consider a virtual interaction to be fully embodied when it is believable, in the sense of using our body coherently as we do in the real world. The dual-process theory of moral judgment, when it refers to moral dilemmas, makes a distinction between personal and impersonal dilemmas (Greene et al., 2001; Greene, 2009): personal dilemmas are conflicts in which the subject experiences the situation in the first person and actions are carried out physically – e.g., pushing. Conversely, impersonal dilemmas are seen from the outside, and the subjects do not take overt physical actions, but make only minor responses, such as pressing switches or levers. Based on this distinction, it has been demonstrated that when actions are based on the first person perspective and involve physical acts, the subjects tend to make more emotional decisions (Greene et al., 2001; Amit et al., 2014). (3) Stealth assessment can be also defined as a performance-based method, in which what is evaluated is latent (Rupp et al., 2010). Under this paradigm, embedding assessments in immersive virtual worlds is an innovative approach (Shute and Spector, 2008) that, in our view, is an improvement from the standpoint of ecological validity. (4) Regarding physiological real-time measurement, VR provides interactive and multimodal sensorial stimuli that provide unique advantages over other methodologies in neuroscientific investigation (Bohil et al., 2011). Thus, due to technological advances, researchers can now use accurate, affordable devices to obtain physiological measures which have been found to be more effective than self-reported measures as they (a) are not intrusive, (b) do no rely on participants’ self-assessment of their emotional or cognitive experience, and (c) can detect changes in participants in real time. We have previous experience in combining VR technology with brain activity measures, and these results have shown that interactive virtual environments allow the measurement of emotional responses (Marín-Morales et al., 2018).

For these reasons, customizable, domain independent VR environments, in which individuals can, to a certain extent, act freely and react naturally to different risks or hazards, open to researchers an uncharted field of information about RT attitudes and behaviors. The set of these requirements may result in an application that includes a virtual environment, with a specific narrative that face the users with risky situations. This should be designed following stealth assessment methodology, and would allow physiological and behavioral measurement to provide information about individual decision making in the field of RT. We will show an example of how this tool might perform: the user could be in a virtual environment that consists in a path which (s)he must cover from start to finish, within the shortest possible time. Suddenly, (s)he meets a bifurcation, where (s)he has to choose whether a safe but log way – less risk, less potential benefit -, or a dangerous but short path – higher risk, higher potential benefit -. During this decision making process, we could take measures of galvanic skin response to assess emotional activation, and behavioral measures such as reaction time and the decision made by the user. As a result, we could obtain information about specific weight of emotional processes in RT, and its influence on behavior.

Our future research aims to study to what extent a VR tool is able to measure the cognitive and affective processes that influence RT. Furthermore, we would focus on how virtual interactions and narratives weight on the decision making process.

Conclusion

RT measurement is a major challenge for companies and researchers. Investigations into behavioral measurement are at a turning point as, due to the potential of technological advances, we can generate virtual worlds to evaluate and, going further, train people in certain skills and competences. We suggest that virtual reality is the most appropriate medium for assessing attitudes to risk and risk perception, conditioning factors in the RT process, due to their immersive capabilities. We propose to undertake future investigations into real-world risks, embodied interactions, stealth assessment and physiological real-time measurement as differentiating elements in RT assessment. If we can study and measure the real, unbiased reactions of people facing risky or hazardous situations, it will be possible to create customized training programs to fit their individual characteristics. This can be expected to contribute to the improvement of OSH training programs, reducing work-related incidents and, consequently, costs for companies.

Author Contributions

MA, CdJ, and NÁ were responsible for the general idea of the paper. CdJ and JS participated in drafting the work, while JG and MC revised it in-depth and provided new ideas thanks to their previous experience. MA supervised the entire work, revised the manuscript and approved the final version to be submitted. All authors made substantial contributions to the conception and development of the work.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

Funding. This work was supported by the Spanish Ministry of Economy, Industry and Competitiveness funded projects “Advanced Therapeutic Tools for Mental Health” (DPI2016-77396-R), and “Assessment and Training on Decision Making in Risk Environments” (RTC-2017-6523-6) (MINECO/AEI/FEDER,UE).

References

  1. Alcañiz M., Lozano J. A., Rey B. (2003). Technological background of VR. Stud. Health Technol. Inform. 99 199–214. [PubMed] [Google Scholar]
  2. Alcañiz M., Rey B., Tembl J., Parkhutik V. (2009). A neuroscience approach to virtual reality experience using transcranial doppler monitoring. Presence Tel. Virtual Environ. 18 97–111. 10.1162/pres.18.2.97 [DOI] [Google Scholar]
  3. Amit E., Gottlieb S., Greene J. D. (2014). “Visual versus verbal thinking and dual-process moral cognition,” in Dual-Process Theories of the Social Mind eds Sherman J. W., Gawronski B., Trope Y. (New York, FL: Guilford Press; ) 340–354. [Google Scholar]
  4. Amokrane K., Lourdeaux D., Burkhardt J. M. (2008). HERA: learner tracking in a virtual environment. IJVR 7 23–30. [Google Scholar]
  5. Baird I. S., Thomas H. (1985). Toward a contingency model of strategic risk taking. Acad. Manag. Rev. 10 230–243. 10.5465/amr.1985.4278108 [DOI] [Google Scholar]
  6. Barsade S. G., Ramarajan L., Westen D. (2009). Implicit affect in organizations. Res. Organ. Behav. 29 135–162. 10.1016/j.riob.2009.06.008 [DOI] [Google Scholar]
  7. Becker W. J., Cropanzano R., Sanfey A. G. (2011). Organizational neuroscience: taking organizational theory inside the neural black box. J. Manag. 37 933–961. 10.1177/0149206311398955 [DOI] [Google Scholar]
  8. Bohil C. J., Alicea B., Biocca F. A. (2011). Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 12 752–762. 10.1038/nrn3122 [DOI] [PubMed] [Google Scholar]
  9. Bornovalova M. A., Cashman-Rolls A., O’donnell J. M., Ettinger K., Richards J. B., Lejuez C. W. (2009). Risk taking differences on a behavioral task as a function of potential reward/loss magnitude and individual differences in impulsivity and sensation seeking. Pharmacol. Biochem. Behav. 93 258–262. 10.1016/j.pbb.2008.10.023 [DOI] [PubMed] [Google Scholar]
  10. Bottari C., Dassa C., Rainville C., Dutil E. (2009). The factorial validity and internal consistency of the instrumental activities of daily living profile in individuals with a traumatic brain injury. Neuropsychol. Rehabil. 19 177–207. 10.1080/09602010802188435 [DOI] [PubMed] [Google Scholar]
  11. Boyer T. W. (2006). The development of risk-taking: a multi-perspective review. Dev. Rev. 26 291–345. 10.1016/j.dr.2006.05.002 [DOI] [Google Scholar]
  12. Brief A. P. (1998). Attitudes in and Around Organizations. Thousand Oaks, CA: Sage. [Google Scholar]
  13. Brockhaus (1980). Risk taking propensity of entrepreneurs. Acad. Manag. J. 23 509–520. [Google Scholar]
  14. Byrnes J. P., Miller D. C., Schafer W. D. (1999). Gender differences in risk taking: a meta-analysis. Psychol. Bull. 125:367 10.1037/0033-2909.125.3.367 [DOI] [Google Scholar]
  15. Cavalcanti J., Soares M. (2012). Ergonomic analysis of safety signs: a focus of informational and cultural ergonomics. Work 41(Suppl. 1) 3427–3432. 10.3233/WOR-2012-0619-3427 [DOI] [PubMed] [Google Scholar]
  16. Colquitt J. A., Scott B. A., LePine J. A. (2007). Trust, trustworthiness, and trust propensity: a meta-analytic test of their unique relationships with risk taking and job performance. J. Appl. Psychol. 92 909–927. 10.1037/0021-9010.92.4.909 [DOI] [PubMed] [Google Scholar]
  17. Cooper M. L., Agocha V. B., Sheldon M. S. (2000). A motivational perspective on risky behaviors: the role of personality and affect regulatory processes. J. Pers. 68 1059–1088. 10.1111/1467-6494.00126 [DOI] [PubMed] [Google Scholar]
  18. de Wit H. (2009). Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addict. Biol. 14 22–31. 10.1111/j.1369-1600.2008.00129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Dohmen T., Falk A., Huffman D., Sunde U., Schupp J., Wagner G. G. (2011). Individual risk attitudes: measurement, determinants, and behavioral consequences. J. Eur. Econ. Assoc. 9 522–550. 10.1111/j.1542-4774.2011.01015 [DOI] [Google Scholar]
  20. Donohew R. L., Hoyle R. H., Clayton R. R., Skinner W. F., Colon S. E., Rice R. E. (1999). Sensation seeking and drug use by adolescents and their friends: models for marijuana and alcohol. J. Stud. Alcohol. 60 622–631. 10.15288/jsa.1999.60.622 [DOI] [PubMed] [Google Scholar]
  21. Durantin G., Gagnon J. F., Tremblay S., Dehais F. (2014). Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259 16–23. 10.1016/j.bbr.2013.10.042 [DOI] [PubMed] [Google Scholar]
  22. Elsler D., Takala J., Remes J. (2017). An International Comparison of the Cost of Work-related Accidents and Illnesses. Available at: https://osha.europa.eu/sites/default/files/publications/documents/international_comparison-of_costs_work_related_accidents.pdf [Google Scholar]
  23. Ernst L. H., Plichta M. M., Lutz E., Zesewitz A. K., Tupak S. V., Dresler T., et al. (2013). Prefrontal activation patterns of automatic and regulated approach-avoidance reactions—a functional near-infrared spec- troscopy (fNIRS) study. Cortex 49 131–142. 10.1016/j.cortex.2011.09.013 [DOI] [PubMed] [Google Scholar]
  24. Ford M., Wentzel K., Wood D., Stevens E., Siesfeld G. A. (1990). Processes associated with integrative social competence: emotional and contextual influences on adolescent social responsibility. J. Adolesc. Res. 4 405–425. 10.1177/074355488944002 [DOI] [Google Scholar]
  25. Forgas J. P. (1982). Reactions to life dilemmas: risk taking, success and responsibility attribution. Aust. J. Psychol. 34 25–35. 10.1080/00049538208254714 [DOI] [Google Scholar]
  26. Forgas J. P. (1995). Mood and judgment: the affect infusion model (AIM). Psychol. Bull. 117 39–66. 10.1037/0033-2909.117.1.39 [DOI] [PubMed] [Google Scholar]
  27. Forgas J. P., Bower G. H. (1987). Mood effects on person-perception judgments. J. Pers. Soc. Psychol. 53 53–60. 10.1037//0022-3514.53.1.53 [DOI] [PubMed] [Google Scholar]
  28. Gallagher S. (2005). How the Body Shapes the Mind. Oxford: Oxford University Press; 10.1093/0199271941.001.0001 [DOI] [Google Scholar]
  29. Gardner M., Steinberg L. (2005). Peer influence on risk taking, risk preference, and risky decision making in adolescence and adulthood: an experimental study. Dev. Psychol. 41 625–635. 10.1037/0012-1649.41.4.625 [DOI] [PubMed] [Google Scholar]
  30. George J. M. (2009). The illusion of will in organizational behavior research: nonconscious processes and job design. J. Manag. 35 1318–1339. 10.1177/0149206309346337 [DOI] [Google Scholar]
  31. Glöckner A., Herbold A. K. (2011). An eye-tracking study on information processing in risky decisions: evidence for compensatory strategies based on automatic processes. J. Behav. Decis. Mak. 24 71–98. 10.1002/bdm.684 [DOI] [Google Scholar]
  32. Greene J. D. (2009). Dual-process morality and the personal/impersonal distinction: a reply to mcguire, langdon, coltheart, and mackenzie. J. Exp. Soc. Psychol. 45 581–584. 10.1016/j.jesp.2009.01.003 [DOI] [Google Scholar]
  33. Greene J. D., Morelli S. A., Lowenberg K., Nystrom L. E., Cohen J. D. (2008). Cognitive load selectively interferes with utilitarian moral judgment. Cognition 107 1144–1154. 10.1016/j.cognition.2007.11.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Greene J. D., Sommerville R. B., Nystrom L. E., Darley J. M., Cohen J. D. (2001). An fMRI investigation of emotional engagement in moral judgment. Science 293 2105–2108. 10.1126/science.1062872 [DOI] [PubMed] [Google Scholar]
  35. Gullone E., Moore S., Moss S., Boyd C. (2000). The adolescent risk-taking questionnaire: development and psychometric evaluation. J. Adolesc. Res. 15 231–250. 10.1177/0743558400152003 [DOI] [Google Scholar]
  36. Hedberg J., Alexander S. (1994). Virtual reality in education: defining researchable issues. Educ. Media Int. 31 214–220. 10.1080/0952398940310402 [DOI] [Google Scholar]
  37. Horvath P., Zuckerman M. (1993). Sensation seeking, risk appraisal, and risky behavior. Personal. Individ. Differ. 14 41–52. 10.1016/0191-8869(93)90173-Z [DOI] [Google Scholar]
  38. Jorgensen P. F. (1996). “Affect, persuasion, and communication processes,” in Handbook of Communication and Emotion, eds Andersen P. A., Guerrero L. K. (Amsterdam: Elsevier; ) 403–422. 10.1016/B978-012057770-5/50017-5 [DOI] [Google Scholar]
  39. Kahneman D., Tversky A. (1986). “Choices, values, and frames”, in Judgement and Decision Making: An Interdisciplinary Reader, eds Arkes H. R., Hammond K. R. (New York, NY: Cambridge University Press; ), 194–210. [Google Scholar]
  40. Kilteni K., Groten R., Slater M. (2012). The sense of embodiment in virtual reality. Presence Teleoperators Virtual Environ. 21 373–387. 10.1162/PRES_a_00124 [DOI] [Google Scholar]
  41. Kivikangas J. M., Chanel G., Cowley B., Ekman I., Salminen M., Järvelä S., et al. (2011). A review of the use of psychophysiological methods in game research. J. Gaming Virtual Worlds 3 181–199. 10.1386/jgvw.3.3.181_1 [DOI] [Google Scholar]
  42. Kivimäki M., Kalimo R. (1993). Risk perception among nuclear power plant personnel: a survey. Risk Anal. 13 421–424. 10.1111/j.1539-6924.1993.tb00742 [DOI] [PubMed] [Google Scholar]
  43. Knoblich G., Ohlsson S., Raney G. E. (2001). An eye movement study of insight problem solving. Mem. Cogn. 29 1000–1009. 10.1016/j.actpsy.2008.08.008 [DOI] [PubMed] [Google Scholar]
  44. Kontra C., Goldin-Meadow S., Beilock S. L. (2012). Embodied learning across the life span. Topics Cogn. Sci. 4 731–739. 10.1111/j.1756-8765.2012.01221 [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Lanyon I., Goodstein L. D. (1997). Personality Assessment 3rd Edn. New York, NY: Wiley. [Google Scholar]
  46. Lejuez C. W., Read J. P., Kahler C. W., Richards J. B., Ramsey S. E., Stuart G. L., et al. (2002). Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). J. Exp. Psychol. Appl. 8 75–84. 10.1037/1076-898X.8.2.75 [DOI] [PubMed] [Google Scholar]
  47. Lindgren R., Johnson-Glenberg M. (2013). Emboldened by embodiment: six precepts for research on embodied learning and mixed reality. Educ. Res. 42 445–452. 10.3102/0013189X13511661 [DOI] [Google Scholar]
  48. MacCrimmon K. R., Wehrung D. A. (1990). Characteristics of risk taking executives. Manag. Sci. 36 422–435. 10.1287/mnsc.36.4.422 [DOI] [Google Scholar]
  49. Manchester D., Priestley N., Jackson H. (2004). The assessment of executive functions: coming out of the office. Brain Injury 18 1067–1081. 10.1080/02699050410001672387 [DOI] [PubMed] [Google Scholar]
  50. Marín-Morales J., Higuera-Trujillo J. L., Greco A., Guixeres J., Llinares C., Scilingo E. P., et al. (2018). Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Sci. Rep. 8:13657. 10.1038/s41598-018-32063-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Mislevy R. J., Almond R. G., Lukas J. F. (2003). A Brief Introduction to Evidence-Centered Design. ETS Research Report Series. Princeton: Educational Testing Service; 10.1002/j.2333-8504.2003.tb01908 [DOI] [Google Scholar]
  52. Mohamed S., Ali T. H., Tam W. Y. V. (2009). National culture and safe work behaviour of construction workers in Pakistan. Safety Sci. 47 29–35. 10.1016/j.ssci.2008.01.003 [DOI] [Google Scholar]
  53. Motowildo S. J., Borman W. C., Schmit M. J. (1997). A theory of individual differences in task and contextual performance. Hum. Perform. 10 71–83. 10.1207/s15327043hup1002_1 [DOI] [Google Scholar]
  54. Nicholson N., Soane E., Fenton-O’Creevy M., Willman P. (2005). Personality and domain-specific risk taking. J. Risk Res. 8 157–176. 10.1080/1366987032000123856 [DOI] [Google Scholar]
  55. Parker S. K., Axtell C. M., Turner N. (2001). Designing a safer workplace: importance of job autonomy, communication quality, and supportive supervisors. J. Occup. Health Psychol. 6 211–228. 10.1037/1076-8998.6.3.211 [DOI] [PubMed] [Google Scholar]
  56. Parsey C. M., Schmitter-Edgecombe M. (2013). Applications of technology in neuropsychological assessment. Clin. Neuropsychol. 27 1328–1361. 10.1080/13854046.2013.834971 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Parsons T. D. (2015). Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front. Hum. Neurosci. 9:660. 10.3389/fnhum.2015.00660 [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Paulhus D. L. (1991). “Measurement and control of response bias,” in Measures of Personality and Social Psychological Attitudes eds Robinson J. P., Shaver P. R., Wrightsman L. S. (Cambridge, MA: Academic Press; ) 1759 10.1016/B978-0-12-590241-0.50006-X [DOI] [Google Scholar]
  59. Paulus M. P., Rogalsky C., Simmons A., Feinstein J. S., Stein M. B. (2003). Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 19 1439–1448. 10.1016/S1053-8119(03)00251-9 [DOI] [PubMed] [Google Scholar]
  60. Piaget J., Cook M. T. (1952). The Origins of Intelligence in Children Vol. 8 (New York, NY: International University Press; ) 18. [Google Scholar]
  61. Portell M., Solé M. D. (2001). Riesgo Percibido: Un Procedimiento de Evaluación. Disponible en la Red. Available at: http://www.insht.es/InshtWeb/Contenidos/Documentacion/FichasTecnicas/NTP/Ficheros/501a600/ntp_578.pdf [Google Scholar]
  62. Risk Research Committee (1980). Accidents in Norway. How Do We Perceive and Handle Risk? Oslo: Risk Research Committee. [Google Scholar]
  63. Robson L. S., Stephenson C. M., Schulte P. A., Amick B. C., III, Irvin E. L., Eggerth D. E. et al. (2012). A systematic review of the effectiveness of occupational health and safety training. Scand. J. Work Environ. Health 38 193–208. 10.5271/sjweh.3259 [DOI] [PubMed] [Google Scholar]
  64. Rodríguez-Garzón I., Delgado-Padial A., Martinez-Fiestas M., Lucas-Ruiz V. (2015). The delay of consequences and perceived risk: an analysis from the workers’ view point. Rev. Facultad Ingeniería Univ. Antioquia 74 165–176. 22682612 [Google Scholar]
  65. Rundmo T. (1996). Associations between risk perception and safety. Safety Sci. 24 197–209. 10.1016/S0925-7535(97)00038-6 [DOI] [Google Scholar]
  66. Rupp A. A., Gushta M., Mislevy R. J., Shaffer D. W. (2010). Evidence-centered design of epistemic games: measurement principles for complex learning environments. J. Technol. Learn. Assess. 8 1–47. [Google Scholar]
  67. Sbordone R. J. (2008). Ecological validity of neuropsychological testing: critical issues. Neuropsychol. Handb. 367:394. [Google Scholar]
  68. Schmitt N. (1994). Method bias: The importance of theory and measurement. J. Organ. Behav. 15 393–398. 10.1002/job.4030150504 [DOI] [Google Scholar]
  69. Schoemaker P. J. (1993). Determinants of risk-taking: behavioral and economic views. J. Risk Uncertain. 6 49–73. 10.1007/BF01065350 21724310 [DOI] [Google Scholar]
  70. Schroeter R., Oxtoby J., Johnson D. (2014). “AR and gamification concepts to reduce driver boredom and risk taking behaviours,” in Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Seattle, WA: 10.1145/2667317.2667415 [DOI] [Google Scholar]
  71. Seo H. C., Lee Y. S., Kim J. J., Jee N. Y. (2015). Analyzing safety behaviors of temporary construction workers using structural equation modeling. Safety Sci. 77 160–168. 10.1016/j.ssci.2015.03.010 [DOI] [Google Scholar]
  72. Sequeira H., Hot P., Silvert L., Delplanque S. (2009). Electrical autonomic correlates of emotion. Int. J. Psychophysiol. 71 50–56. 10.1016/j.ijpsycho.2008.07.009 [DOI] [PubMed] [Google Scholar]
  73. Shute V. J. (2011). Stealth assessment in computer-based games to support learning. Computer Games Instruction 55 503–524. [Google Scholar]
  74. Shute V. J., Hansen E. G., Almond R. G. (2008). You can’t fatten a hog by weighing it–or can you? evaluating an assessment for learning system called ACED. Int. J. Artif. Intell. Educ. 18 289–316. [Google Scholar]
  75. Simon H. A. (1976). Administrative Behavior: A Study of Decision-Making Processes in Administrative Organization. New York, NY: Macmillan. [Google Scholar]
  76. Sitkin S. B., Weingart L. R. (1995). Determinants of risky decision-making behavior: a test of the mediating role of risk perceptions and propensity. Acad. Manag. J. 38 1573–1592. 10.2307/256844 [DOI] [Google Scholar]
  77. Skeel R. L., Neudecker J., Pilarski C., Pytlak K. (2007). The utility of personality variables and behaviorally-based measures in the prediction of risk-taking behavior. Personal. Individ. Differ. 43 203–214. 10.1016/j.paid.2006.11.025 [DOI] [Google Scholar]
  78. Slater M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. B Biol. Sci. 364 3549–3557. 10.1098/rstb.2009.0138 [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Sneddon A., Mearns K., Flin R. (2013). Stress, fatigue, situation awareness and safety in offshore drilling crews. Safety Sci. 56 80–88. 10.1016/j.ssci.2012.05.027 [DOI] [Google Scholar]
  80. Soler J. L., Contero M., Alcañiz M. (2017). “VR serious game design based on embodied cognition theory,” in Proceedings of the Joint International Conference on Serious Games (Berlin: Springer; ) 12–21. 10.1007/978-3-319-70111-0_2 [DOI] [Google Scholar]
  81. Stanford M. S., Greve K. W., Boudreaux J. K., Mathias C. W., Brumbelow J. L. (1996). Impulsiveness and risk-taking behavior: Comparison of high-school and college students using the Barratt Impulsiveness Scale. Personal. Individ. Differ. 21 1073–1075. 10.1016/S0191-8869(96)00151-1 [DOI] [Google Scholar]
  82. Steinberg L. (2004). Risk taking in adolescence: what changes, and why? Ann. N. Y. Acad. Sci. 1021 51–58. 10.1196/annals.1308.005 [DOI] [PubMed] [Google Scholar]
  83. Tellegen A. (1985). “Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report,” in Anxiety and the Anxiety Disorders eds Tuma A. H., Maser J. D. (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc; ) 681–706. [Google Scholar]
  84. Tsujii T., Watanabe S. (2010). Neural correlates of belief-bias reasoning under time pressure: a near-infrared spectroscopy study. Neuroimage 50 1320–1326. 10.1016/j.neuroimage.2010.01.026 [DOI] [PubMed] [Google Scholar]
  85. Vygotsky L. (1978). Interaction between learning and development. Read. Dev. Children 23 34–41. [Google Scholar]
  86. Wang L., Shute V., Moore G. (2015). Lessons learned and best practices of stealth assessments. Int. J. Gaming Computer Mediat. Simul. 74 66–87. 10.4018/IJGCMS.2015100104 [DOI] [Google Scholar]
  87. White T. L., Lejuez C. W., de Wit H. (2008). Test-retest characteristics of the Balloon Analogue Risk Task (BART). Exp. Clin. Psychopharmacol. 16 565. 10.1037/a0014083 [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Wills T. A., Walker C., Mendoza D., Ainette M. G. (2006). Behavioral and emotional self-control: relations to substance use in samples of middle and high school students. Psychol. Addict. Behav. 20 265–278. 10.1037/0893-164X.20.3.265 [DOI] [PubMed] [Google Scholar]
  89. Wilson M. (2002). Six views of embodied cognition. Psychon. Bull. Rev. 9 625–636. 10.3758/BF03196322 [DOI] [PubMed] [Google Scholar]
  90. Yuen K. S., Lee T. M. (2003). Could mood state affect risk-taking decisions? J. Affect. Disord. 75 11–18. 10.1016/S0165-0327(02)00022-8 [DOI] [PubMed] [Google Scholar]

Articles from Frontiers in Psychology are provided here courtesy of Frontiers Media SA

RESOURCES