Table 2.
Patents classification according to each regulation strategy.
| Regulation strategies | Patent | Applicant (year) | Driver states to regulate | Main goal | State detection technology | Implemented technique |
|---|---|---|---|---|---|---|
| AD | CN110135355A | Univ Jilin (2019) | Two categories of emotions: positive and negative | To bring back the user at a neutral state if negative feelings are detected, using ambient displays | Recognition of facial expressions | Use of colors for ambient light arranged according to their temperature (hue) and sound arranged according to their “type” (unspecified) |
| AD | CN107953924A | Foshan Shenhang Tech Co. Ltd. (2019) | “Bad feelings” | To detect when the drivers awaits (e.g., traffic jams or traffic lights…) and if so, delivers him acupressure | Through the driving activity (long stops) | Haptic stimulation: steering wheel that can send acupressure |
| AD | KR101427926B1 | Hyundai Motor Co. Ltd. Kia Motors Corp. (2019) |
Stress | To detect stress and relieve it through music recommendation | Driving context & metrics (weather, speed, acceleration) | Music recommendation based on automated extraction of emotional feature of music in a database. When the stress is due to the weather, music suitable for the weather atmosphere is recommended. When the stress is caused by tension, calm music (such as classical music) is recommended. |
| AD | CN105873281A | China Auto Parts (Suzhou) Ind Park Dev Co. Ltd. (2016) | Moods in terms of arousal: excited and calm | To detect driver's mood and modify it using ambient displays | Not precisely specified: “mood monitoring system” | Ambient lights that can adjust their temperature to the mood of the driver |
| AD | CN108628205A | Changzhou Xingyu Automotive Lighting Systems Co. Ltd. (2018) | Irritability | To detect driver's mood and modify it using ambient displays | Recognition of facial expressions, voice, or input of the driver | Display of a ambient light in a specific color pre-configured by the user. Use of odors and music is also evoked |
| AD | CN108109228A | Guangxi Nanning Zhicui Sci Tech Consultation Co. Ltd. (2018) | Anxiety | To determine a level of anxiety using the strength of the closes of the car door. Above a certain threshold, an odor is emitted | Door closing way | Emission of odors when the door is locked too strongly |
| AD (audio & ambient light) CC (prompts) |
CN110393540A | Zhejiang Hongquan Electronic Tech Co. Ltd. (2019) | “Unstable emotions” | To detect driver emotional instability and regulate using ambient displays or prompt him to drive safely | HR, BR (via a radar), driving characteristics | Ambient light and music. Prompts can be emitted through lights on the dashboard |
| AD (music & lights) CC (prompts) |
CN110403617A | Guangzhou Automobile Group Co. (2019) | Mental stress | To monitor a driver's mental state and perform emotional relaxation adjustment when the driver is in a state of mental stress through ambient displays and prompts | EDA | Music recommendation, light control, voice alarm, screen display, seat vibration or steering wheel vibration |
| AD (music) RM (ambient air) |
KR20140080727A | Korea Electronics Telecomm (2014) | Stress, excitement, boredom | To detect and recognize emotions. If negative emotion detected, to regulate them using ambient displays | Recognition of facial expression, voice, gesture, HR, HRV | Music, lighting, opening of a window, air conditioner |
| RM | KR101601957B1 | Hong Yong Pyo (2019) | Stress, anger, drowsiness | To detect stress, anger, drowsiness through driver's voice or vehicle data, and regulate brain waves | – | Monaural beats pre-recorded, that can be modified (envelope, frequency, pitch, waveform), emitted through speakers |
| RM | JP2019194046A | Ecohigashinihon Corp. Kenmei Co. Ltd. Legiotec Co. Ltd. (2019) |
Mental stress, tension, fatigue | To improve the comfort of a driver and other occupants who are riding in a vehicle by using hydrogen gas, or both hydrogen and oxygen gases to relax them | – | Regulation of the levels of hydrogen and oxygen in the vehicle |
| SM | JP2016052881A | Denso Corp. (2016) | Stress | To detect when a driver is feeling anxious and adapt the takeover request and the driving style of an autonomous vehicle | EEG, HR, BVP, EDA, driving context | Modification of vehicle behavior in autonomous mode or adjust the takeover request (time to take over or modality) |
| SM | JP2018020683A | Toyota Motor Corp. (2018) | Anxiety | To reduce potential anxiety due to tunnel running where light is limited | Contextual detection of side walls | Enlighten side walls of the tunnel |
| SM | RO127332A2 | Univ Lucian Blaga Din Sibiu (2012) | Stress, discomfort | To prevent the dazzlement from light of vehicle coming from the opposite direction during nighttime that could generate stress or discomfort | – | Polarization filters to limit the amount of light reaching the eye of the driver |
| SM (tire noise attenuation) RM (monaural beats) |
KR101085081B1 | Kumho Tire Co. Inc. (2011) | Stress due to the noise of the tires | To reduce the noise emitted by the tires in order to reduce it and prevent stress of the driver due to the noise, and to obtain a frequency close to alpha range of brain waves | – | A tire design that generates human brain waves by using the monaural beat phenomenon. The offset frequency is formed in the alpha wave band (8–14 Hz) to use the noise during driving to relieve the driver's stress and improve concentration |
| SM (vehicle control) AD (music) CC (vocal prompt) |
CN109572705A | Wuhan Luogefu Hydrogen Energy Automobile Co. Ltd. (2019) | “Abnormal driver's emotions” including distress | To detect emotional state changes (anger mode, low mode, dangerous mode) and regulate through ambient displays or prompt the driver to have a stable emotional state and a safe driving | Eye activity, interactions with passengers, posture, body temperature, speech, driving metrics (speed, acceleration, deceleration) | Depending on the emotion detected: vocal prompt, music, deceleration toward a pre-registered value or until the stop of the vehicle |
| SM (vehicle control) AD (music) |
CN209186732U | Univ Anyang Normal (2019) | Excitement, sadness, pain and other negative emotions | To detect abnormal emotion, and recommend adapted music or modify vehicle control | HR, BR, body temperature | Music recommendation based on labeled data and speed control |
| SM (vehicle control) AD (music) RM (respiratory exercises) |
FR2998159A1 | Peugeot Citroen Automobiles Sa (2012) | Stress | To detect stress and relieve it through respiratory exercises, use of ADAS, or music recommendation | HR, BR, EDA, body temperature, voice, driving metrics | Visual or auditive respiratory exercises, use of ADAS, music recommendation pre-defined by the user |
| SS | KR20190103521A | Hyundai Motor Co. Ltd Kia Motors Corp (2019) |
Stress | To detect the emotional state and match the GPS guidance to select an optimal path | Driving metrics or user input | GPS which provides an optimal route (previously stored) according to the state of the driver |
| SS (GPS recommendation) SM (vehicle control) AD (music) CC (vocal prompt) |
CN102874259A | Geely Automobile Res Inst Zj Hangzhou Branch Zhejiang Geely Automobile Res Inst Co. Ltd Zhejiang Geely Holoding Group (2019) |
Anger, excitement, which could include distress | To detect negative emotions, control the vehicle and regulate drivers' emotions using vehicle control, music, or vocal prompts | Recognition of facial expressions, HR, driving metrics to determine speed change and steering wheel angle | Vocal prompt or music. If driving control is detected as dangerous, limitation of the vehicle speed and increased steering wheel control, prompt of GPS notification about places to rest |
| SS (GPS recommendation) | JP2011027441A | Alpine Electronics Inc Honda Motor Co. Ltd MBAKK (2011) |
Stress, irritability, fatigue | To search for a travel route to reduce driver stress when following a slow vehicle | Driving context | GPS recommendation if a plurality of preceding vehicles is detected. |
AD, attentional deployment; CC, cognitive change; RM, response modulation; SM, situation modification; SS, situation selection; HR, heart rate; BVP, blood volume pressure; HRV, heart rate variability; BR, breathing rate; EDA, electrodermal answer; EEG, electroencephalogram.