Abstract
The use of robotic nursing care equipment is an important option for solving the shortage of nursing care personnel, but the effects of its introduction have not been fully quantified. Hence, we aimed to verify that face-to-face care is still provided by caregivers in transfer situations when using robotic nursing care equipment. This study was conducted at a nursing home where the bed-release assist robot “Resyone Plus” is installed on a long-term basis. Caregiver gaze was analyzed quantitatively for one user of the equipment during transfer situations, and communication time, which involved looking at the face of the care recipient, as well as face-to-face vocalization, was measured. The caregiver spent 7.9 times longer looking at the face of and talking to the care recipient when using Resyone than when performing a manual transfer. In addition, the recipient was observed to smile during Resyone separation, which takes about 30 s. The results indicate a possible improvement in the QOL of care recipients through the use of robotic nursing care equipment as a personal care intervention. The ongoing development of robot technology is thus expected to continue to reduce the burden of caregiving as well as to improve the QOL of care recipients.
Keywords: gaze analysis, gerontechnology, nursing homes, quality of care
1. Introduction
Addressing the issue of a declining and aging population, and especially the decrease in the working age population, has become urgent and important not only in Japan but also worldwide [1]. Although the Ministry of Health, Labour, and Welfare of Japan has taken the lead in developing the use of robot technology for nursing care [2], it has been reported that there is a low adoption rate of various types of robotic nursing care equipment, and that about half of the facilities that have introduced such equipment do not seem to be making effective use of it [3]. However, we have shown that the use of some robot technologies might be able to reduce the burden of caregivers during transfers, for example, and should improve the efficiency of caregiving tasks [4]. In addition, we have demonstrated the effects and changes that can occur to care recipients when caregivers have more time for caregiving tasks as a result of the reduced burden. For example, we found that long-term use of transfer support equipment increased communication between caregiver and care recipient, as evidenced by an increase in the number of times caregivers spoke to the patient [5] and an increase in the number of smiles of both individuals [6]. One expected result is a positive effect on the quality of life (QOL) of the cared-for person. Here, we measured communication time by analyzing a caregiver’s eye gaze when talking to the care recipient and looking at the care recipient’s face (eye contact), the latter of which is considered to be an important aspect of the body language of caregiving [7]. Furthermore, it has been found that nurses also mainly use gaze, nods, and smiles toward patients to improve communication [8].
In this study, we analyzed the caregiver’s gaze (a specific point at which the caregiver is looking) during transfer assistance (bed separation scenario) using Resyone Plus [9,10] (abbreviated as Resyone; Panasonic Age-Free Corporation, Osaka, Japan). Resyone can assist a bedridden subject to leave the bed without needing a transfer, because half of the electric nursing care bed separates to become a wheelchair (Figure 1). In particular, we demonstrated here that as a practical personal care intervention, assistance using robotic nursing care equipment not only reduces caregiver burden but also has the potential to improve the QOL of care recipients.
Figure 1.
Steps for rise assistance, separating half of the Resyone for use as a wheelchair. The steps are lateral movement on the bed (A), removal of the handrail of the Resyone bed (B), wheelchair separation from the bed (C), raising up the handrail (D), raising the back of the wheelchair (E), and moving as a wheelchair (F).
2. Materials and Methods
2.1. Equipment
Resyone Plus is a motorized care bed in which half of the bed can separate and be used as a wheelchair [10]. This equipment does not operate autonomously. However, just as assist suits are included in the category of nursing care robots, here, we define Resyone Plus as a bed separation support robot, because it assists subjects to get out of bed.
2.2. Intervention Period
The period over which this entire study was conducted has been described previously [6]. The study commenced 13 months after the introduction of this equipment to a nursing home. Briefly, nine months after the introduction of Resyone to a nursing home, we made a “proposal to expand the living area” using the robot, to the extent that it did not interfere with their nursing care duties. Four months later, this study was carried out.
2.3. Subjects
The study was conducted in a nursing home for the elderly with one care recipient and one caregiver. Care recipient: female (75–79 years age range, 150–160 cm range, 40–49 kg range); level of care required, 5; level of daily living independence for disabled elderly, C; level of daily living independence for elderly with dementia, IV. The care recipient was unable to speak but was sometimes able to respond vocally with groaning sounds when spoken to by the caregiver. We refer to these exchanges between caregiver and the care recipient as ‘vocalization’. The care recipient was selected because she had been using the Resyone equipment continuously for 13 months. Caregiver: male (30–34 years age range, 160–170 cm range, 60–70 kg range); nationally certified caregiver. The caregiver was selected because he was primarily responsible for the chosen care recipient. Subject for simulation of transfer assistance operation: male (35–39 years old, 170–180 cm, 50–60 kg); physical therapist.
2.4. Gaze Analysis
Gaze analysis was undertaken using a spectacle-type device (Pupil Invisible, Pupil Labs GmbH, Berlin, Germany), as worn by the caregiver in Figure 1. From the recorded video, we visually checked in how many frames (30 frames/s) the gaze (green circle) was directed towards the face and to other points and measured the number of seconds the gaze was directed towards each point. The gaze path (a 2 s period) is indicated by a pink line (Figure 2). To document vocalization, the frames in the video in which voices were present were counted using video editing software (Adobe Premiere Elements 2021). The scene in which the subject was vocalizing was visually confirmed, and the number of frames counted. Gaze and vocalization were recorded simultaneously, so the work time was increased over the actual operation for each vocalization. Since the duration of each vocalization was less than 0.4 s (<12 frames), which is short compared to the duration of gaze distribution, it did not have a significant impact on the overall analysis time. The analysis showed two occasions when a smile was evident on the care recipient’s face during the Resyone separation phase, as shown in Figure S1.
Figure 2.
Gaze targets during the transfer using Resyone. The current viewpoint is indicated by a yellow-green circle, and the eye movements during the preceding 2 s are represented by a pink line. The gaze target and image, which was cropped from each analysis, are shown in the figure as 01_Face (transient), 02_Face (gazing), 03_Eye contact, 04_Speech, 05_Arms and hands, 06_Shoulders or chest, 07_Waist or abdomen, 08_Legs, 09_Clothes, 10_Socks and shoes, 11_Sheets or blankets, 12_Resyone body/remote control, and 13_Resyone handrail. As the images obtained from analyses 02 to 04 were almost the same, one image is shown.
2.5. Transfer Phases during Resyone Separation
We classified the phases of transfer using Resyone as follows (Figure 3): A_Voice call/Moving blanket, B_Moving the back cushion, C_Moving the leg cushion, D_Lateral movement, E_Handrail up, F_Resyone Separation, G_Handrail up, H_Putting on socks and shoes, I_Resyone pillow insert, J_Raising the backrest, and K_Grooming/Blanketing.
Figure 3.
Gaze analysis of caregiver during transfer assistance using Resyone. The results show gaze analysis for the stages of getting out of bed using the equipment. One bar graph represents each step of getting out of bed, and the number of seconds it took is shown below. This number of seconds was taken as 100%, and the bar graph shows the percentage of time spent looking at each target or performing vocalization. Transiently looking at a face, fixation on a face, or vocalization were indicated using red, pink, and pale pink colors, respectively. When the gaze was looking at various parts of the subject’s body, they were shown in bluish colors. When the eye is looking at the bed or sheets, it is shown in a greenish color, and when looking at shoes or clothes, this is shown in a yellowish color.
2.6. A Simulation of Manual Transfer
To confirm that there is a marked difference in the gaze distribution compared to manual transfers, we performed a simulation of a transfer that caregivers manually perform without Resyone (Figure 4). In the simulation, we asked a therapist to ‘help’ a care practice doll to leave the bed (i.e., to get the doll up and transfer it to a chair), and we performed gaze analysis. The care practice doll weighed 27 kg and was 157 cm tall.
Figure 4.
Analysis of a therapist’s gaze during a simulation in which a nursing practice doll is ‘helped’ to get up from the bed and move to a chair (without Resyone). The gaze in each step is shown in (A), and the gaze time for each step is shown in (B). The transfer steps are shown in the figure as vocalization before transfer (a), bending of the legs (b), placing hands under the neck (c), getting up while rotating (d), putting hands on the shoulders and looking at the face (e), placing hands under the armpits, lifting and transferring (f), checking the position of the chair (g), and putting hands on the shoulders and vocalization (h).
2.7. Communication Time
Communication time was defined as the time spent vocalizing with the care recipient and looking at the care recipient’s face, either momentarily or with a full gaze.
2.8. Ethics Approval and Consent to Participate
The study protocols have been reviewed and approved by the Ethics and Conflict of Interest Committee of the National Center for Geriatrics and Gerontology (acceptance no. 1552). All participants in the study provided informed consent. The care recipient was unable to speak or sign, so her husband signed the informed consent form on her behalf. All methods were carried out in accordance with relevant guidelines and regulations.
3. Results
3.1. A Typical Gaze Pattern during Transfer
An example of actual gaze analysis and a list of points to which the gaze was directed are shown in Figure 2. When the caregiver is gazing at the face, e.g., in panel 03 of Figure 2, this is distinguished by the absence of eye movement, and a momentary glance at the face is distinguished by the presence of eye movement (revealed by a pink line). However, over the whole of the episode recorded in Figure 2, no eye contact with the care recipient was ever observed. A possible reason for this was that, depending on the specifications of the device, the viewpoint may shift if the user himself/herself does not calibrate the gaze when wearing the device. Due to the limitations of time, in this case, calibration was not performed by the caregiver himself, but rather by one of the authors, which may mean that eye contact was not registered by the device, even if it was actually made.
3.2. Result of Gaze Analysis (Using Resyone)
Figure 3 shows the results of eye gaze analysis when a caregiver assisted the patient to leave the bed using Resyone. Speech, facial gazing, and a momentary glance are highlighted in red and pink colors. In total, the period of gaze analysis lasted 245 s, which is a relatively long time for transfer assistance, and for each of the phases A_Speech, F_Resyone Separation, and K_Grooming, it can be seen that there was a great deal of facial gazing. During these periods, it was observed that the care recipient smiled twice (panels A and B, Supplementary Figure S1), especially during the F_Resyone Separation phase.
3.3. Gaze Analysis of Manual Transfer (Rising and Transfering)
For comparison, a simulation of a manual transfer was performed using a care practice doll. The phases of the transfer are shown in Figure 4A (a to h), and the results of the gaze analysis are shown in Figure 4B. The therapist talked to the doll, lifted it up, and then continued with the transfer. The entire process of rising from the bed and subsequently transferring the doll to a chair took 21.4 s. Even in such simulations, it is important that the therapist spends sufficient time (nearly 2 s) looking at the doll’s face before each movement, such as phase C_Placing the hands under the neck and phase F_Placing the hands under the armpits.
3.4. Communication Time
As shown in Figure 5, there was a 7.9-fold difference between manual rise and transfer assistance (7.63 s) and when assisted by Resyone (60.4 s). This confirmed that the amount of communication time between caregiver and care recipient increased significantly with Resyone.
Figure 5.
Time spent looking at the recipient’s face or vocalizing during transfer assistance.
4. Discussion
It has been reported in recent years that the burden of caregiving is becoming heavier not only in Japan but worldwide [11,12,13,14]. In such a situation, the use of robotic technology has been recommended [15,16,17]. However, its effectiveness has not been fully verified so far. The use of robots in nursing care is often thought to reduce the quality of care, but this is not necessarily true.
In a previous paper, we reported an increase in positive facial expressions of care recipients as a result of long-term use of Resyone [6]. In this study, we measured quantitative changes in communication time using eye gaze analysis and video analysis. We have shown in another paper that the use of a transfer support robot called Hug has also been reported to increase normal conversation [5]. However, we feel that the observation of an increase in communication time between caregiver and care recipient resulting from the use of robotic care equipment is novel.
When we suggested in our previous study that Resyone might be used to expand the living area [6], the caregivers involved indicated that there was no significant increase in the burden of caregiving, and they were able to manage their caregiving activities without increasing the number of transfers. Such care operations, which included visits after meals to new places in the care home, should also be applicable to other facilities.
From the above series of studies, we found that when robotic nursing care equipment is used over the long term for bed release or transfers, the time spent communicating with the caregiver increases, although the number of bed releases did not increase as expected. This suggests that similar caregiving operations with other transfer support devices could be organized to increase communication without increasing the caregiving burden. Although the use of a robot takes more time when assisting transfers, it can expand the range of activities available to the care recipient and, as shown in this study, increase communication time, which indicates the usefulness of the equipment. Prior to this study, communication was evaluated by speech analysis or time studies [4,5], but these are not parameters of direct communication. In contrast, the gaze analysis in this study confirmed that the caregiver was looking directly at the patient, and that this led to the expression of a smile in the care recipient, a result that shows the importance of direct and personal communication by caregivers.
Regarding research on caregiver eye contact and gaze, there are several studies on whether it is possible to gain trust from children [18] and patients [8,19,20] or measuring the degree of stress among professional nurses [21,22]. But there are few investigations on communication between caregiver and the recipient involving face gaze. This study is one of the few examples in which the influence of the caregiver’s gaze on the care recipient is visualized. We have observed smiles on the subject’s face, but this was not a quantitative result, nor did it show better QOL. However, the current study covers a single type of robotic equipment and a limited number of subjects. It is necessary to consider facial expression analysis, etc. for further research. Furthermore, no comparative device with Resyone has been commercialized, so we could not provide true control data in this case.
As previously reported, by using the Resyone continuously for several months, caregivers became accustomed to using it, and as a result, the burden of caregiving was reduced [4,6]. At that stage, we suggested that the subject be taken to the entrance or corridor, and the caregiver was able to do so without difficulty. The care operation was able to change because of the sustainable use of the device, and as a result, facial expression of the subject was improved [6]. For facility residents who are almost bedridden and require intensive nursing care, increased communication is expected to improve QOL and contribute to the “realization of wellbeing” advocated by the WHO [23], as well as to promote “social participation of the elderly” in the future as described in a literature [24]. This is a good example of how even a single-function care robot can have such effects when used in a sustainable manner. We believe that this type of assisting device can be implemented for personal care and can be applied to home care as well.
5. Conclusions
This study indicates that the use of robotic nursing care equipment may improve the QOL of care recipients, which is considered to be an effective use of a piece of equipment. The ongoing development of robot technology is thus expected to reduce the burden of caregiving and to improve the QOL of care recipients as well as the quality of caregiving. That may be true not only in nursing homes, but also in private homes.
Acknowledgments
We thank the residents and staff of the “Aiko Home Obuen” nursing home for older adults for their cooperation.
Supplementary Materials
The following supporting information can be downloaded at: https://zenodo.org/records/10457550 (accessed on 21 February 2024), Figure S1: Facial expression of the care recipient.
Author Contributions
Conceptualization, K.K. and T.Y.; methodology, T.Y.; validation, K.A.; formal analysis, T.Y.; investigation, K.K. and T.Y.; writing—original draft preparation, T.Y.; writing—review and editing, K.K and K.A.; supervision, I.K.; project administration, I.K.; funding acquisition, I.K. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
The study protocol has been reviewed and approved by the Ethics and Conflict of Interest Committee of the National Center for Geriatrics and Gerontology (acceptance number 1552, approved on 29 October 2021).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the care recipient to publish this paper.
Data Availability Statement
The datasets analyzed during the current study are not publicly available given that the research team has not completed its analysis, but they are available from the corresponding author on reasonable request with due consideration for the privacy of the subjects.
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
This study was funded by the Japan Agency for Medical Research and Development, grant number JP20he2002001, the Japan Society for the Promotion of Science, grant numbers JP19K19899 and JP22K12942, the Japan Science and Technology Agency, Moonshot Research and Development Program JPMJMS2034, and the National Institute for Geriatrics and Gerontology, Chojuiryokenkyukaihatsuhi, grant numbers 19–5 and 21–21. The APC was funded by the Japan Science and Technology Agency, Moonshot Research and Development Program JPMJMS2034.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Kondo I. Frailty in an Aging Society and the Applications of Robots. Jpn. J. Compr. Rehabil. Sci. 2019;10:47–49. doi: 10.11336/jjcrs.10.47. [DOI] [Google Scholar]
- 2.Robotic Care Devices Portal, Japan Agency for Medical Research and Development. [(accessed on 26 December 2023)]. Available online: https://robotcare.jp/en/development/index.
- 3.Promoting the Development and Spread of Nursing Care Robots, Ministry of Health, Labour and Welfare, Japan. [(accessed on 26 December 2023)]. Available online: https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/0000209634.html.
- 4.Kato K., Yoshimi T., Aimoto K., Sato K., Itoh N., Kondo I. Reduction of Multiple-Caregiver Assistance through the Long-Term Use of a Transfer Support Robot in a Nursing Facility. Assist. Technol. 2022;35:271–278. doi: 10.1080/10400435.2022.2039324. [DOI] [PubMed] [Google Scholar]
- 5.Yoshimi T., Kato K., Tsuchimoto S., Mizuguchi N., Kondo I. Increase of Verbal Communication by Long-Term Use of Transfer-Support Robots in Nursing Facilities. Geriatr. Gerontol. Int. 2021;21:276–277. doi: 10.1111/ggi.14113. [DOI] [PubMed] [Google Scholar]
- 6.Kato K., Yoshimi T., Aimoto K., Sato K., Itoh N., Kondo I. A Rise-Assisting Robot Extends Life Space and Improves Facial Expressions of Nursing Home Residents. BMC Health Serv. Res. 2022;22:1588. doi: 10.1186/s12913-022-08952-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.de Rezende R.D.C., de Oliveira R.M.P., de Araújo S.T.C., Guimarães T.C.F., do Espírito Santo F.H., Porto I.S. Body Language in Health Care: A Contribution to Nursing Communication. Rev. Bras. Enferm. 2015;68:430–436, 490–496. doi: 10.1590/0034-7167.2015680316i. [DOI] [PubMed] [Google Scholar]
- 8.Caris-Verhallen W.M.C.M., Kerkstra A., Bensing J.M. Non-Verbal Behaviour in Nurse–Elderly Patient Communication. J. Adv. Nurs. 1999;29:808–818. doi: 10.1046/j.1365-2648.1999.00965.x. [DOI] [PubMed] [Google Scholar]
- 9.Kume Y., Tsukada S., Kawakami H. Design and Evaluation of Rise Assisting Bed “Resyone®” Based on ISO 13482. J. Robot. Soc. Jpn. 2015;33:781–788. doi: 10.7210/jrsj.33.781. [DOI] [Google Scholar]
- 10.Kume Y., Tsukada S., Kawakami H. Development of Safety Technology for Rise Assisting Robot “Resyone Plus”. Trans. JSME. 2019;85:18–00344. doi: 10.1299/transjsme.18-00344. [DOI] [Google Scholar]
- 11.Igarashi A., Fukuda A., Teng L., Ma F.-F., Dorey J., Onishi Y. Family Caregiving in Dementia and Its Impact on Quality of Life and Economic Burden in Japan-Web Based Survey. J. Mark. Access Health Policy. 2020;8:1720068. doi: 10.1080/20016689.2020.1720068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Nguyen H., Nguyen T., Tran D., Hinton L. “It’s Extremely Hard but It’s Not a Burden”: A Qualitative Study of Family Caregiving for People Living with Dementia in Vietnam. PLoS ONE. 2021;16:e0259788. doi: 10.1371/journal.pone.0259788. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hopps M., Iadeluca L., McDonald M., Makinson G.T. The Burden of Family Caregiving in the United States: Work Productivity, Health Care Resource Utilization, and Mental Health among Employed Adults. J. Multidiscip. Healthc. 2017;10:437–444. doi: 10.2147/JMDH.S135372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nortey S.T., Aryeetey G.C., Aikins M., Amendah D., Nonvignon J. Economic Burden of Family Caregiving for Elderly Population in Southern Ghana: The Case of a Peri-Urban District. Int. J. Equity Health. 2017;16:16. doi: 10.1186/s12939-016-0511-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Schulz R., Beach S.R., Czaja S.J., Martire L.M., Monin J.K. Family Caregiving for Older Adults. Annu. Rev. Psychol. 2020;71:635–659. doi: 10.1146/annurev-psych-010419-050754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Huter K., Krick T., Domhoff D., Seibert K., Wolf-Ostermann K., Rothgang H. Effectiveness of Digital Technologies to Support Nursing Care: Results of a Scoping Review. J. Multidiscip. Healthc. 2020;13:1905–1926. doi: 10.2147/JMDH.S286193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Soriano G.P., Yasuhara Y., Ito H., Matsumoto K., Osaka K., Kai Y., Locsin R., Schoenhofer S., Tanioka T. Robots and Robotics in Nursing. Healthcare. 2022;10:1571. doi: 10.3390/healthcare10081571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hoehl S., Wahl S., Michel C., Striano T. Effects of Eye Gaze Cues Provided by the Caregiver Compared to a Stranger on Infants’ Object Processing. Dev. Cogn. Neurosci. 2012;2:81–89. doi: 10.1016/j.dcn.2011.07.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hillen M.A., de Haes H.C.J.M., van Tienhoven G., Bijker N., van Laarhoven H.W.M., Vermeulen D.M., Smets E.M.A. All Eyes on the Patient: The Influence of Oncologists’ Nonverbal Communication on Breast Cancer Patients’ Trust. Breast Cancer Res. Treat. 2015;153:161–171. doi: 10.1007/s10549-015-3486-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Jongerius C., Twisk J.W.R., Romijn J.A., Callemein T., Goedemé T., Smets E.M.A., Hillen M.A. The Influence of Face Gaze by Physicians on Patient Trust: An Observational Study. J. Gen. Intern. Med. 2022;37:1408–1414. doi: 10.1007/s11606-021-06906-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Hofmaenner D.A., Herling A., Klinzing S., Wegner S., Lohmeyer Q., Schuepbach R.A., Buehler P.K. Use of Eye Tracking in Analyzing Distribution of Visual Attention among Critical Care Nurses in Daily Professional Life: An Observational Study. J. Clin. Monit. Comput. 2021;35:1511–1518. doi: 10.1007/s10877-020-00628-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ahmadi N., Sasangohar F., Yang J., Yu D., Danesh V., Klahn S., Masud F. Quantifying Workload and Stress in Intensive Care Unit Nurses: Preliminary Evaluation Using Continuous Eye-Tracking. Hum. Factors. 2022;66 doi: 10.1177/00187208221085335. [DOI] [PubMed] [Google Scholar]
- 23.The Global Action Plan for Healthy Lives and Well-Being for All. [(accessed on 8 May 2023)]. Available online: https://www.who.int/initiatives/sdg3-global-action-plan.
- 24.Munford L.A., Panagioti M., Bower P., Skevington S.M. Community Asset Participation and Social Medicine Increases Qualities of Life. Soc. Sci. Med. 2020;259:113149. doi: 10.1016/j.socscimed.2020.113149. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets analyzed during the current study are not publicly available given that the research team has not completed its analysis, but they are available from the corresponding author on reasonable request with due consideration for the privacy of the subjects.