Abstract
Background
Self-management is a critical component of chronic disease management and can include a host of activities, such as adhering to prescribed medications, undertaking daily care activities, managing dietary intake and body weight, and proactively contacting medical practitioners. The rise of technologies (mobile phones, wearable cameras) for health care use offers potential support for people to better manage their disease in collaboration with their treating health professionals. Wearable cameras can be used to provide rich contextual data and insight into everyday activities and aid in recall. This information can then be used to prompt memory recall or guide the development of interventions to support self-management. Application of wearable cameras to better understand and augment self-management by people with chronic disease has yet to be investigated.
Objective
The objective of our review was to ascertain the scope of the literature on the use of wearable cameras for self-management by people with chronic disease and to determine the potential of wearable cameras to assist people to better manage their disease.
Methods
We conducted a scoping review, which involved a comprehensive electronic literature search of 9 databases in July 2017. The search strategy focused on studies that used wearable cameras to capture one or more modifiable lifestyle risk factors associated with chronic disease or to capture typical self-management behaviors, or studies that involved a chronic disease population. We then categorized and described included studies according to their characteristics (eg, behaviors measured, study design or type, characteristics of the sample).
Results
We identified 31 studies: 25 studies involved primary or secondary data analysis, and 6 were review, discussion, or descriptive articles. Wearable cameras were predominantly used to capture dietary intake, physical activity, activities of daily living, and sedentary behavior. Populations studied were predominantly healthy volunteers, school students, and sports people, with only 1 study examining an intervention using wearable cameras for people with an acquired brain injury. Most studies highlighted technical or ethical issues associated with using wearable cameras, many of which were overcome.
Conclusions
This scoping review highlighted the potential of wearable cameras to capture health-related behaviors and risk factors of chronic disease, such as diet, exercise, and sedentary behaviors. Data collected from wearable cameras can be used as an adjunct to traditional data collection methods such as self-reported diaries in addition to providing valuable contextual information. While most studies to date have focused on healthy populations, wearable cameras offer promise to better understand self-management of chronic disease and its context.
Keywords: eHealth, review, cameras, life-logging, lifestyle behavior, chronic disease
Introduction
Background
Noncommunicable diseases, principally cardiovascular diseases, cancer, diabetes, and chronic respiratory diseases, are the leading causes of death in most developed countries, contributing to 60% of all deaths globally [1,2]. However, improved medical management has extended the life expectancy of people with chronic disease. Therefore, treatment goals for many noncommunicable diseases include mitigating exacerbations of the disease to reduce symptoms and prevent hospitalizations [3]. For people with chronic disease, appropriate self-management is critical to maximize health, treatment benefits, and quality of life [4].
Self-management refers to an individual’s engagement in undertaking and managing day-to-day tasks, making and sustaining lifestyle changes, and managing physical symptoms and mental health over the course of an illness [5,6]. This can include a host of activities, such as adhering to prescribed medications, undertaking daily care activities (eg, blood glucose monitoring, self-weighing, rehabilitation exercises, toileting activities), managing body weight (eg, reducing energy intake, increasing physical activity), and managing dietary intake (eg, limiting salt consumption). People with chronic disease need to be supported to engage in and maintain self-management, thus reducing symptoms and empowering them to manage their own health.
Improved self-management has been associated with reduced mortality, hospital admissions, and health care costs [7,8]. For example, a trial of nurse-led education to improve self-management in heart failure demonstrated significant reductions in the relative risk of cardiac (0.59, 95% CI 0.38-0.91) and heart failure-related (0.49, 95% CI 0.27-0.88) hospitalizations [9]. To maximize effective behavioral interventions, efforts must focus on understanding the challenges individuals face in managing the complex demands of their illness and the often multiple and competing conditions. New approaches (with low participant burden and cost) are needed to identify these challenges and effectively tailor interventions to match people’s needs.
The rise of technologies for health care use, such as mobile phones and wearable cameras, offers the potential to facilitate self-management for people with chronic disease [8]. Visual “life-logging” is one such technology. It refers to the use of wearable cameras to digitally capture everyday life activities through first-person point-of-view images [10]. Wearable cameras gather data that accurately reflect the participant’s real-world experiences and environments [11]. Self-reporting of behaviors is difficult and subject to underreporting (eg, dietary intake [12]), overreporting (eg, physical activity [13]), or simply forgetting activities undertaken or food consumed. Wearable cameras can be used to prompt recall and provide health care practitioners with valuable insight into people’s daily behaviors and patterns. This information can assist with prompting subsequent behavior change and developing tailored self-management strategies with patients.
Wearable cameras have been used to assess dietary recall [14] and as an intervention to assist in accurate data collection for a range of activities, such as food purchasing [15], time use [16], sedentary behavior [17], and travel times [18], and to observe behavior changes in early-stage dementia [19]. A recent systematic review to assess the utility of camera images to assist in the assessment of dietary intake found that images can enhance self-report by revealing unreported foods and identify misreporting errors not captured by traditional methods alone [12]. While the feasibility of collecting and analyzing images is well documented across a range of behaviors [14,18], the application of this technology to better understand and augment self-management in people with chronic disease has yet to be investigated and should be considered [20]. For example, wearable cameras could be used for behavior change strategies such as increasing awareness and motivation around specific behaviors [20]. Specifically, wearable cameras could monitor the time and contexts in which individuals take prescribed medications or complete self-monitoring activities [20], such as measuring daily body weight. Using camera-assisted recall methods, this approach could facilitate conversations between patients and health care providers to better tailor self-management strategies.
Objective
The aim of this review was to ascertain in a human population of any age, with or without chronic disease, what is known about the potential use of wearable cameras for assisting with self-management of chronic disease, including self-management practices such as self-weighing and taking medication, as well as capturing lifestyle behaviors associated with chronic disease (eg, physical activity, sedentary behavior, diet, or smoking). To do this, we searched original research articles reporting studies using any methods, as well as review articles and published conference proceedings.
Methods
Rationale for a Scoping Review
Given the novelty of using wearable cameras for enhancing self-management, we considered a scoping review appropriate prior to undertaking a systematic review. Scoping reviews involve systematically searching and selecting literature to map key concepts and summarize a range of evidence to convey the breadth and depth of a field [21,22]. These reviews can be used to examine the extent, range, and nature of research activities, determine the value in undertaking a full systematic review, summarize and disseminate research findings, or help identify gaps in the research literature [23]. Following current guidelines for conducting scoping reviews [21,23,24], once we identified the research question, we proceeded to (1) identify relevant studies, (2) select studies, and (3) collate, summarize, and report the results.
Identification of Relevant Studies
We conducted a comprehensive electronic literature search in July 2017 in the following databases: PsycINFO, MEDLINE, CINAHL, and SPORTDiscus (all through EBSCO), EMBASE (through OVID), Web of Science, ProQuest, ACM Digital Library, and Cochrane Library. We combined Medical Subject Headings and free terms to search for focused articles. We used a search string including the following search terms and derivatives for each database (see Multimedia Appendix 1 for the full search strategy): (1) wearable camera* OR life-logging OR SenseCam OR Narrative Clip OR GoPro OR Google Glass AND (2) chronic disease OR lifestyle OR lifestyle modification OR rehabilitation OR diet OR physical activity OR medication adherence OR fluid restriction OR smoking.
We also scanned the reference lists of records identified by the search for additional studies that met our inclusion criteria. For the purpose of this review, we were interested in studies that (1) used wearable cameras to capture one or more modifiable lifestyle risk factors associated with chronic disease (eg, physical activity, sedentary behavior, diet, or smoking), (2) used wearable cameras capture typical self-management behaviors (eg, taking medication, self-weighing), or (3) involved a population group with chronic disease (eg, cardiovascular disease, diabetes, respiratory disease). Wearable cameras can capture images actively and passively [25]; in this review, we excluded studies that only used active image capture, were constrained in context (eg, laboratory settings), or collected data for less than 1 day. We also excluded studies using videos due to concerns around battery life constraints (reducing wear time) and the increased difficulty of annotating and coding video images. The search strategy was not limited by study design or year, and it included conference proceedings and full articles but was limited to articles written in English. As a systematic literature review on the effect of wearable cameras on memory disorders had been conducted recently [26], we excluded articles that used wearable cameras in managing forms of dementia, such as Alzheimer disease.
Study Selection
We imported search results from the databases into the reference software package EndNote version X8 (Clarivate Analytics), which automatically removed most duplicates, with the remaining removed manually. Textbox 1 lists the inclusion criteria for the title and abstract screening. Figure 1 presents a flow diagram leading to the included studies.
Criteria for article inclusion in the scoping review.
Inclusion criteria
Title-level screening:
-
If the title of the article contained the following concepts:
Wearable cameras (eg, SenseCam, Narrative Clip, GoPro)
Life-logging
Abstract-level screening:
-
If the article
Reported the use or effect of the wearable cameras or life-logging on a lifestyle behavior or chronic disease or measured lifestyle behavior with wearable cameras or life-logging and
Was written in English and
Reported qualitative or quantitative findings and
Passively captured images and
Measured free-living activities and
Used the wearable camera for ≥1 day
Exclusion criteria
Articles focused on participants with memory disorders
Data Extraction
Data extraction was performed by 4 reviewers (NSG, RM, MR, and SC) using a custom data extraction sheet (see Multimedia Appendix 2), which comprised 3 sections; article overview (eg, authors, title, year, country, journal, study design, study aim, camera device, interval of images taken), measuring lifestyle (eg, lifestyle behavior, aim to measure or to change behavior), and study details (eg, sample size and characteristics, intervention duration, presence of a control group, type of image annotation, data analysis, challenges or issues with cameras).
Summarizing and Reporting the Results
We categorized and described the included studies according to study characteristics, which included the country where the study was undertaken, characteristics of participants (eg, size of sample, age, health status, presence of chronic disease), study design or type, and behaviors measured using wearable cameras (eg, physical activity, dietary intake, sedentary behavior). We also classified studies according to the data collected (primary or secondary) and whether it was a review or discussion article.
Results
Study Characteristics
Multimedia Appendix 3 [14-17,25,27-46] presents the main results of primary and secondary data collection. Table 1 [11,12,47-50] presents study characteristics of review and discussion studies. Of the 31 studies identified, 22 analyzed primary data and 3 performed a secondary analysis of existing data (Multimedia Appendix 3). These studies were published between 2010 and June 2017, with most primary or secondary data collection studies (22/25, 88%) published since 2013 (Figure 2). Our search strategy also identified 2 discussion articles, 2 reviews, and 2 descriptive articles (Table 1).
Table 1.
Study | Design | Camera device | Aim | Findings | |
Dietary intake | |||||
|
Boushey, 2016 [47] | Narrative review | Multiple | Overview of image-assisted and image-based methods, including implementation and detail on image-based food records. | Accuracy of dietary assessment was improved. Underreporting was reduced in all included studies. |
|
Gemming, 2015 [12] | Systematic review | Multiple | Examination of studies that evaluated or validated image-assisted methods of assessing dietary energy intake. | Evidence regarding the validity of image-assisted methods of dietary assessment was limited. Self-reported data could be enhanced with images, providing a primary record of dietary intake to obtain valid estimates of energy intake. |
|
Sun, 2010 [48] | Descriptive (research program) | Prototype | Description of emerging science for objective methods of dietary assessment. | A research program to automatically record food intake was described. Hardware (camera, reference lights, accelerometer, microphone, global positioning system, and data processor) had been developed; software (enabling privacy protection, video segmentation, food identification, portion size analysis, and nutrient and calorie determinations) was under development. |
Physical activity | |||||
|
Maekawa, 2012 [49] | Descriptive (device) | Wrist-Sense | Description of the implementation of a wrist-worn sensor device. | The camera supplied information on what object the wearer was holding, which related strongly to the activity the wearer was performing. |
Activities of daily living | |||||
|
Doherty, 2013 [11] | Discussion | Multiple | Assessment of the utility of wearable cameras for objectively measuring lifestyle behaviors. | The use of wearable cameras was considered appropriate to understand lifestyle behaviors. |
|
Loveday, 2016 [50] | Discussion | Multiple | Discussion of the objective measurement of context and illustration of the utility of quantifying context using example data from 3 ongoing studies. | Devices that provide contextual information, such as wearable cameras, location monitors, and proximity sensors, provided researchers with a more comprehensive picture of behavior. |
Studies undertaking primary or secondary data analysis (n=25) were predominantly feasibility or pilot studies (n=13, 52%) [15,18,25,27-32,34-36,43,46], followed by methodological studies (n=6, 24%) [37,39-41,44] and validation studies (n=4, 16%) [14,33,42,46]. There was 1 randomized controlled trial [38] conducted with acquired brain injury patients where camera images formed part of a health intervention. There was also 1 descriptive study, which described the context of sedentary time in older adults [17]. The majority of studies were conducted in the United States (n=8, 32%) [27,32,35-37,42-44], the United Kingdom (n=6, 24%) [15-17,28,31,45], and Ireland (n=4, 16%) [30,33,39,41]. A total of 3 studies (12%) [29,34,46] were international multicenter studies, while the remaining studies were from New Zealand (n=3, 12%) [14,25,40] and Spain (n=1, 4%) [38].
Of the remaining 6 review or discussion studies (Table 1), 2 reviews focused on dietary assessment [14,47]. One descriptive study presented a research program and a new device for recording food intake [48], while the other described a wrist-worn device for measuring physical activity [49]. The final 2 studies were discussion articles examining the utility of using wearable cameras for assessing lifestyle behaviors (eg, sedentary and nutrition behaviors, television viewing), their challenges, and ethical-related issues [11,50].
Feasibility and pilot studies [15,18,25,27-32,34,36,43,46] focused predominantly on assessing the feasibility of using wearable cameras to capture information on dietary intake or food consumption, physical activity, and sedentary behavior.
Studies classified as validation studies [14,33,42,46] assessed the validity of wearable cameras either compared with or in combination with other measurement approaches, including self-reported diaries and questionnaires, as well as objective measurement techniques such as accelerometers and doubly labelled water. For the methodological studies [35,37,39-41,44], outcomes focused on testing software or analytic approaches to classify and analyze generated images.
Sample Characteristics
Where sample size was relevant and reported (n=24), numbers were generally small (Figure 3): 8 studies (33%) had fewer than 20 participants (minimum of 5) [16,27-29,31,32,38,41], 13 studies (54%) had between 20 and 50 participants [14,15,17,25,30,33,35,37-39,42-44], and only 3 studies (13%) [34,36,46] had more than 50 participants (maximum of 84). Participants were predominantly healthy adults (n=16, 64%) [14,16,17,25,27-29,31,32,34-36,39,41,44,46], with some studies including athletes (n=4, 16%) [30,33,42,43] or school children (n=2, 8%) [15,40]. One study examined physical activity and sedentary time in a sample of older women [37]. No studies identified in our review recruited participants with a chronic disease; however, 1 study included participants with an acquired brain injury [38]. The majority of studies included convenience samples, often recruited through universities; thus, participants were more likely to be well educated with higher socioeconomic status.
Types and Uses of Wearable Cameras
The SenseCam (subsequently called Vicon Revue, then Vicon Autographer) was the most frequently used brand of wearable camera (n=18, 72%). The remaining studies used a similar technology, worn around the neck on a lanyard or on the wrist. In 22 studies (88%), participants wore a camera for 3 to 7 days; in 1 study, participants wore the cameras for 7 weeks [38]. Studies used wearable cameras to measure, observe, or validate specific behaviors related to dietary intake (n=10, 40%) [14,15,25,27-32,48]; physical activity (n=6, 24%) [33-37,49]; a diverse range of daily activities such as travel, work, and exposure to food marketing (n=5, 20%) [16,38-41]; sedentary behavior (n=4, 16%) [17,42-44]; and travel behaviors such as walking, cycling, or motorized transport (n=2, 8%) [45,46].
Our search found only 1 randomized controlled trial [38], which combined the SenseCam and Actiheart device for goal management training over 7 weeks for 16 people with an acquired brain injury. Results showed that goal management training plus the addition of viewing SenseCam images resulted in greater improvements in cognitive skills compared with goal management training alone.
Issues Associated With Wearable Cameras
Findings from the studies identified in this review highlighted a variety of technical and personal constraints associated with using this technology. These included person-related factors such as feeling self-conscious while wearing the device, forgetting to put the device on, and privacy and ethical concerns for both the person wearing the device and those whose images were being taken. Technical issues noted included short battery life, challenges in analyzing and classifying very large numbers of images captured by the device, and lack of consistent high-quality images.
Utility of Wearable Cameras for Self-Management
Notwithstanding the technical issues reported in many studies, most highlighted that wearable cameras offered a feasible and acceptable method for measuring specific behaviors, namely food consumption, physical activity, and sedentary behaviors, and identifying activities of daily living, especially when used alongside more traditional methods of assessment such as logbooks, diaries, and self-recall questionnaires.
Based on this review, the most common use of wearable cameras was for prompting recall of dietary intake and to identify unreported items [14,15,27,28,30]. In these studies, participants were asked to recall their dietary intake using 24-hour dietary recall reported questionnaires [14,30] or interview [28] techniques alone and then again in combination with reviewing SenseCam images. All 3 studies showed that viewing the images increased self-reported energy intake by 12.5% [28], 8% (men) and 6% (women) [14], or 10.7% to 17.7% [30] compared with 24-hour recall alone. These results suggested that a more accurate estimate of total energy intake is possible by combining the SenseCam data with conventional food diaries.
Wearable camera data also offered promise for dietary assessment [25,30,31] and to augment understanding of eating moments or episodes by providing spatial and contextual information [25,29]. Data from 1 earlier validation study in 2013 identified that eating moments could be identified with a high degree of accuracy (89.7%) [32].
The next most common use of wearable cameras was to augment measurement of physical activity-related behaviors, including travel behaviors such as cycling and using public transport [45,46]. Kelly et al [45] tested the feasibility of measuring travel to school in 2012, followed by validating travel data against a travel diary in 2014 [46] with 84 adults using a variety of transportation modes. Both studies found that self-reported journey data were accurate at the group level but imprecise at the individual level.
Combined with traditional measurement techniques (eg, accelerometry), wearable cameras were used to provide context (type and location) for physical activity [33,34] and sedentary behaviors (eg, location, activity undertaken while sedentary) [17,43]. However, data analysis in these areas is still in its infancy, with 3 methodological studies describing the challenges of developing algorithms [37], machine learning techniques [35], and classification techniques [44] for processing wearable camera images.
The complexity of identifying activities of daily living using wearable cameras was made evident by the high number of methodological studies (3 of 5 studies) in this category [39-41]. These studies aimed to identify personal traits [39], everyday activities [41], and children’s exposure to food marketing and other public health issues (eg, tobacco exposure) [40]. These studies analyzed millions of images (from 1.4 million [40] to 3.5 million [39]) using both manual and software-assisted coding methods.
Using camera images to prompt recall during interviews, 1 study demonstrated the feasibility and acceptability of using wearable cameras to reconstruct daily use of time [16]. We found a single randomized clinical trial, which used daily camera images to enhance self-management by people with an acquired brain injury [38]. This study showed that, in addition to goal management training, reviewing SenseCam images in the intervention arm resulted in health improvements (eg, planning, self-monitoring, error detection), both quantitatively (increased effect sizes between groups) and qualitatively (increased engagement). This was the only study to use wearable cameras as a health intervention and highlighted the potential of extending this approach beyond acquired brain injury to other clinical conditions (such as cardiovascular disease, diabetes, and peritoneal dialysis).
Discussion
Principal Findings
We conducted this scoping review to ascertain what is known about the use of wearable cameras for self-management by people with a chronic disease and to determine the potential for using this approach for helping people to better manage their chronic disease. We identified 31 studies, with most published since 2013, highlighting the infancy of the field. Based on the available evidence, no studies used wearable cameras for self-management activities, but the searched literature demonstrated that wearable cameras have utility for capturing health-related behaviors and lifestyle risk factors of chronic disease, such as dietary intake, physical activity, and sedentary behavior. Thus far, wearable cameras have been predominantly used to augment existing measurement approaches of these behaviors by assisting with recall of activities (eg, eating, sitting at a computer) or have been used to provide contextual information on these behaviors (eg, walking in a park, or associated behaviors such as sitting at a table eating food). These lifestyle behaviors are important for the prevention and management of many chronic diseases but, as we have demonstrated in this review, wearable cameras have yet to be used by people with existing disease. Furthermore, other than Silva and colleagues’ [26] study of the use of wearable cameras to assist with memory and recall for those affected by Alzheimer disease, there is a paucity of research on the use of wearable cameras for capturing other disease self-management practices such as taking medication, self-weighing, and undertaking home dialysis.
The majority of included studies focused on young healthy individuals, with a subset of studies investigating wearable camera use with athletes [30,33,42,43] and school children [15,40]. One study [37] investigated walking and sedentary time in older women, a group that may be at higher risk of chronic disease. We could identify only 1 study [38] that used the SenseCam as an intervention tool for people with an acquired brain injury, which highlighted the potential of this approach to improve health outcomes of those with an injury or chronic health condition. At the time of our review, we could not identify any further studies investigating the use of wearable cameras in other clinical populations.
In terms of diet, our findings are consistent with a systematic review (included in this review) [12], which assessed the utility of images captured using both handheld devices and wearable cameras for supporting traditional self-report methods or to provide a primary record of dietary intake. Of the 13 included studies in the review by Gemming et al [12], 10 used handheld devices, while 3 studies used wearable cameras. Findings from the systematic review showed that images enhanced self-report by revealing unreported foods and identifying misreporting error. In addition, when used as a primary record of dietary intake, images provided valid estimates of energy intake [14,30]. However, both image quality and camera position influenced the quality of data collected, which needs to be considered in future studies involving dietary behaviors [14]. Our scoping review also highlighted studies that investigated the use of wearable cameras for capturing contextual factors and other behaviors associated with food consumption and motivations to eat [25,29].
Privacy and ethical issues associated with captured images need to be considered in future research. Doherty et al [11] argued that this method is useful for observing and understanding participant behavior and could be used as a lifestyle behavior change catalyst; however, only 1 study [38] identified in this review used it for this purpose. Given issues of participant and third-party privacy, ethical frameworks have been developed to guide the use of wearable cameras. One such article [51] presented a research checklist to be used for studies with automated wearable cameras. The checklist addressed informed consent, privacy and confidentiality, nonmaleficence, and autonomy of third parties. Future studies using wearable cameras for self-management in clinical populations need to closely consider these privacy and ethical issues.
Technical issues associated with using wearable cameras present numerous challenges, which need to be considered when undertaking future research. These include issues such as participant compliance and adherence with wearing the device due to factors such as limited battery life and the need to recharge devices, not wanting to wear them, and being self-conscious around others. However, the biggest issues that potentially limit the use of these technologies in their current form relate to lack of image clarity, the difficulty of correctly coding images to reflect specific behaviors, and processing vast amounts of image data [11,41,44]. Of the studies included in this review, 4 developed data algorithms and object classification methodology [37,39,41,44]. As highlighted by these studies, using machine learning techniques, such as deep convolutional neural networks, it is possible to undertake automated image recognition [52,53]. Google has a pretrained model for ImageNet, consisting of a collection 10 million images depicting 1000 object categories. Using this approach, it is possible to determine corresponding probabilities of correct identification of images according to specific labels. The precision of this approach and others, while they are useful, remain variable. Manual processing (reviewing and coding) of images is time and resource intensive. Analysis of images from wearable cameras for summary purposes or for creating viable interventions remains challenging. Thus, the utility of wearable cameras with multiple participants over extended periods of times (eg, 6 months) is unclear. Finally, an ongoing challenge is that many of the devices used in the included studies are no longer available (eg, SenseCam/Vicon and Narrative Clip). In this review, we did not include mobile phone–enabled cameras; however, given their ubiquity, they do offer a viable solution for capturing some activities such as dietary intake, but they do not provide the passive data collection afforded by current wearable camera technologies.
Strengths and Limitations
This is, to our knowledge, the first scoping review to examine the use of wearable cameras for self-management. We conducted an extensive search of the literature using 9 databases from both health and sports science. We did not impose limits on study design and therefore included a diverse range of studies from over 6 countries. On the basis of the number of published studies identified in our original search, we chose not to extend the search to include gray literature. Nor did we perform a quality assessment, as it is suggested that this is not in the remit of scoping reviews [54]. More recently, a consultation phase has been suggested to be included in scoping reviews [24]. This phase involves formally presenting the findings to knowledge users and community members to gain collective experience, expertise, and knowledge on the chosen subject [24]. While recommended, this approach is not mandatory; thus, we did not include a consultation phase as part of this review.
Future Research
Findings from this review suggest that there is interest in the use of wearable cameras to assess lifestyle behaviors, particularly diet, physical activity, and sedentary behavior. In its current form, this method has been used to augment existing measurement techniques through validation, reduction of error associated with recall of behaviors, and provision of rich contextual information. The lessons learned from this research are important if we are to better evaluate these behaviors and empower and support patients with self-management.
There appears to be considerable opportunity to use wearable cameras to specifically assess self-management behaviors and to apply this method to a host of clinical conditions. For example, heart failure is a chronic condition, often with a variable clinical course and frequent exacerbations of symptoms [3]. Appropriate self-management is critical to maximize treatment benefits [4]. To maximize effective behavioral interventions, efforts must focus on understanding the challenges individuals face in managing the complex demands of their illness. Wearable cameras could be used to capture the ecological context in which people manage this disease and identify the extent to which people adhere to key self-management practices (eg, taking medication, daily weighing, fluid restriction, salt consumption in foods). If these behaviors could be correctly identified, then more tailored interventions to match people’s needs could be developed. For example, participants with a new diagnosis of heart failure could wear a camera for 1 to 4 weeks. On the patient’s return to an outpatient clinic, a nurse specialist or other health professional could, by using software, review images alongside the individual to identify self-management practices and offer suggestions for improvement. Such an approach could easily be applied to other scenarios, such as peritoneal dialysis or stroke rehabilitation. Future research is needed to determine the feasibility of such an approach, including whether a chronic disease population would be able to wear and maintain the device for the duration of the intervention and, therefore, how a wearable camera would fit into their lives and disease management [55]. We would expect that the simple nature of these devices would not add additional burden to people with chronic disease and their caregivers, but future research is required [56].
Conclusion
This scoping review highlighted the use of wearable cameras for the assessment of lifestyle-related behaviors (in particular diet and physical activity) among healthy, adult populations; however, none of the studies specifically focused on self-management behaviors by people with chronic disease or in clinical settings. The advanced capabilities of wearable camera technologies, when considered alongside the gap in the evidence base and early findings of the usefulness of cameras in other populations identified here, all point to the promising potential of this approach and the need for further investigation in clinical populations.
Acknowledgments
This research was conducted as part of a Heart Foundation Vanguard Grant, Australia (101348). KB was supported by a Principal Research Fellowship from the Australian National Health and Medical Research Council (ID 1042442). The contents of this paper are the responsibility of the authors and do not necessarily reflect the views of the funding bodies.
Search strategy.
Data extraction form.
Characteristics of primary and secondary data collection studies.
Footnotes
Conflicts of Interest: None declared.
References
- 1.World Health Organization . Non-communicable diseases factsheet. Geneva, Switzerland: WHO; 2015. [2018-11-02]. http://www.who.int/en/news-room/fact-sheets/detail/noncommunicable-diseases . [Google Scholar]
- 2.Abegunde DO, Mathers CD, Adam T, Ortegon M, Strong K. The burden and costs of chronic diseases in low-income and middle-income countries. Lancet. 2007 Dec 08;370(9603):1929–38. doi: 10.1016/S0140-6736(07)61696-1.S0140-6736(07)61696-1 [DOI] [PubMed] [Google Scholar]
- 3.Hobbs FDR, Kenkre JE, Roalfe AK, Davis RC, Hare R, Davies MK. Impact of heart failure and left ventricular systolic dysfunction on quality of life: a cross-sectional study comparing common chronic cardiac and medical disorders and a representative adult population. Eur Heart J. 2002 Dec;23(23):1867–76. doi: 10.1053/euhj.2002.3255.S0195668X02932550 [DOI] [PubMed] [Google Scholar]
- 4.Gardetto NJ. Self-management in heart failure: where have we been and where should we go? J Multidiscip Healthc. 2011 Mar 31;4:39–51. doi: 10.2147/JMDH.S8174. doi: 10.2147/JMDH.S8174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Riegel B, Moser DK, Anker SD, Appel LJ, Dunbar SB, Grady KL, Gurvitz MZ, Havranek EP, Lee CS, Lindenfeld J, Peterson PN, Pressler SJ, Schocken DD, Whellan DJ, American Heart Association Council on Cardiovascular Nursing. American Heart Association Council on Clinical Cardiology. American Heart Association Council on Nutrition, Physical Activity, and Metabolism. American Heart Association Interdisciplinary Council on Quality of Care and Outcomes Research State of the science: promoting self-care in persons with heart failure: a scientific statement from the American Heart Association. Circulation. 2009 Sep 22;120(12):1141–63. doi: 10.1161/CIRCULATIONAHA.109.192628. http://circ.ahajournals.org/cgi/pmidlookup?view=long&pmid=19720935 .CIRCULATIONAHA.109.192628 [DOI] [PubMed] [Google Scholar]
- 6.McManus RJ, Mant J, Franssen M, Nickless A, Schwartz C, Hodgkinson J, Bradburn P, Farmer A, Grant S, Greenfield SM, Heneghan C, Jowett S, Martin U, Milner S, Monahan M, Mort S, Ogburn E, Perera-Salazar R, Shah SA, Yu L, Tarassenko L, Hobbs FDR, TASMINH4 investigators Efficacy of self-monitored blood pressure, with or without telemonitoring, for titration of antihypertensive medication (TASMINH4): an unmasked randomised controlled trial. Lancet. 2018 Mar 10;391(10124):949–959. doi: 10.1016/S0140-6736(18)30309-X. https://linkinghub.elsevier.com/retrieve/pii/S0140-6736(18)30309-X .S0140-6736(18)30309-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Savard LA, Thompson DR, Clark AM. A meta-review of evidence on heart failure disease management programs: the challenges of describing and synthesizing evidence on complex interventions. Trials. 2011;12:194. doi: 10.1186/1745-6215-12-194. http://trialsjournal.biomedcentral.com/articles/10.1186/1745-6215-12-194 .1745-6215-12-194 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Free C, Phillips G, Galli L, Watson L, Felix L, Edwards P, Patel V, Haines A. The effectiveness of mobile-health technology-based health behaviour change or disease management interventions for health care consumers: a systematic review. PLoS Med. 2013;10(1):e1001362. doi: 10.1371/journal.pmed.1001362. http://dx.plos.org/10.1371/journal.pmed.1001362 .PMEDICINE-D-12-00520 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Koelling TM, Johnson ML, Cody RJ, Aaronson KD. Discharge education improves clinical outcomes in patients with chronic heart failure. Circulation. 2005 Jan 18;111(2):179–85. doi: 10.1161/01.CIR.0000151811.53450.B8.01.CIR.0000151811.53450.B8 [DOI] [PubMed] [Google Scholar]
- 10.Gurrin C, Smeaton AF, Doherty AR. Lifelogging: personal big data. Found Trends Inf Retrieval. 2014;8(1):1–125. http://doras.dcu.ie/19998/1/FnTIR_lifelogging_journal.pdf . [Google Scholar]
- 11.Doherty AR, Hodges SE, King AC, Smeaton AF, Berry E, Moulin CJA, Lindley S, Kelly P, Foster C. Wearable cameras in health: the state of the art and future possibilities. Am J Prev Med. 2013 Mar;44(3):320–3. doi: 10.1016/j.amepre.2012.11.008.S0749-3797(12)00866-5 [DOI] [PubMed] [Google Scholar]
- 12.Gemming L, Utter J, Ni Mhurchu C. Image-assisted dietary assessment: a systematic review of the evidence. J Acad Nutr Diet. 2015 Jan;115(1):64–77. doi: 10.1016/j.jand.2014.09.015.S2212-2672(14)01469-5 [DOI] [PubMed] [Google Scholar]
- 13.Welk G. Physical Activity Assessments for Health-Related Research. Champaign, IL: Human Kinetics; 2002. [Google Scholar]
- 14.Gemming L, Rush E, Maddison R, Doherty A, Gant N, Utter J, Ni Mhurchu C. Wearable cameras can reduce dietary under-reporting: doubly labelled water validation of a camera-assisted 24 h recall. Br J Nutr. 2015 Jan 28;113(2):284–91. doi: 10.1017/S0007114514003602.S0007114514003602 [DOI] [PubMed] [Google Scholar]
- 15.Cowburn G, Matthews A, Doherty A, Hamilton A, Kelly P, Williams J, Foster C, Nelson M. Exploring the opportunities for food and drink purchasing and consumption by teenagers during their journeys between home and school: a feasibility study using a novel method. Public Health Nutr. 2016 Jan;19(1):93–103. doi: 10.1017/S1368980015000889.S1368980015000889 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Kelly P, Thomas E, Doherty A, Harms T, Burke Ó, Gershuny J, Foster C. Developing a method to test the validity of 24 hour time use diaries using wearable cameras: a feasibility pilot. PLoS One. 2015;10(12):e0142198. doi: 10.1371/journal.pone.0142198. http://dx.plos.org/10.1371/journal.pone.0142198 .PONE-D-15-11500 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Leask CF, Harvey JA, Skelton DA, Chastin SF. Exploring the context of sedentary behaviour in older adults (what, where, why, when and with whom) Eur Rev Aging Phys Act. 2015;12:4. doi: 10.1186/s11556-015-0146-7. https://eurapa.biomedcentral.com/articles/10.1186/s11556-015-0146-7 .146 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kelly P, Doherty A, Berry E, Hodges S, Batterham AM, Foster C. Can we use digital life-log images to investigate active and sedentary travel behaviour? Results from a pilot study. Int J Behav Nutr Phys Act. 2011;8:44. doi: 10.1186/1479-5868-8-44. http://www.ijbnpa.org/content/8//44 .1479-5868-8-44 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Piasek P, Irving K, Smeaton AF. Case study in SenseCam use as an intervention technology for early-stage dementia. Int J Comput Healthc. 2012;1(4):304. doi: 10.1504/IJCIH.2012.051798. [DOI] [Google Scholar]
- 20.Doherty A, Williamson W, Hillsdon M, Hodges S, Foster C, Kelly P. Influencing health-related behaviour with wearable camerastrategies & ethical considerations. 4th International SenseCam & Pervasive Imaging Conference; Nov 18-19, 2013; San Diego, CA, USA. New York, NY: ACM; 2013. pp. 60–67. [DOI] [Google Scholar]
- 21.Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69. doi: 10.1186/1748-5908-5-69. http://www.implementationscience.com/content/5//69 .1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Colquhoun HL, Levac D, O'Brien KK, Straus S, Tricco AC, Perrier L, Kastner M, Moher D. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014 Dec;67(12):1291–4. doi: 10.1016/j.jclinepi.2014.03.013.S0895-4356(14)00210-8 [DOI] [PubMed] [Google Scholar]
- 23.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005 Feb;8(1):19–32. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
- 24.O'Brien KK, Colquhoun H, Levac D, Baxter L, Tricco AC, Straus S, Wickerson L, Nayar A, Moher D, O'Malley L. Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps. BMC Health Serv Res. 2016 Dec 26;16:305. doi: 10.1186/s12913-016-1579-z. https://bmchealthservres.biomedcentral.com/articles/10.1186/s12913-016-1579-z .10.1186/s12913-016-1579-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Gemming L, Doherty A, Utter J, Shields E, Ni Mhurchu C. The use of a wearable camera to capture and categorise the environmental and social context of self-identified eating episodes. Appetite. 2015 Sep;92:118–25. doi: 10.1016/j.appet.2015.05.019.S0195-6663(15)00246-9 [DOI] [PubMed] [Google Scholar]
- 26.Silva AR, Pinho MS, Macedo L, Moulin CJA. A critical review of the effects of wearable cameras on memory. Neuropsychol Rehabil. 2018 Jan;28(1):117–141. doi: 10.1080/09602011.2015.1128450. [DOI] [PubMed] [Google Scholar]
- 27.Arab L, Estrin D, Kim DH, Burke J, Goldman J. Feasibility testing of an automated image-capture method to aid dietary recall. Eur J Clin Nutr. 2011 Oct;65(10):1156–62. doi: 10.1038/ejcn.2011.75. http://europepmc.org/abstract/MED/21587282 .ejcn201175 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Gemming L, Doherty A, Kelly P, Utter J, Ni Mhurchu C. Feasibility of a SenseCam-assisted 24-h recall to reduce under-reporting of energy intake. Eur J Clin Nutr. 2013 Oct;67(10):1095–9. doi: 10.1038/ejcn.2013.156.ejcn2013156 [DOI] [PubMed] [Google Scholar]
- 29.Ng K, Shipp V, Mortier R, Benford S, Flintham M, Rodden T. Understanding food consumption lifecycles using wearable cameras. Pers Ubiquitous Comput. 2015;19(7):1183–1195. doi: 10.1007/s00779-015-0871-y. [DOI] [Google Scholar]
- 30.O'Loughlin G, Cullen SJ, McGoldrick A, O'Connor S, Blain R, O'Malley S, Warrington GD. Using a wearable camera to increase the accuracy of dietary analysis. Am J Prev Med. 2013 Mar;44(3):297–301. doi: 10.1016/j.amepre.2012.11.007.S0749-3797(12)00863-X [DOI] [PubMed] [Google Scholar]
- 31.Pettitt C, Liu J, Kwasnicki RM, Yang G, Preston T, Frost G. A pilot study to determine whether using a lightweight, wearable micro-camera improves dietary assessment accuracy and offers information on macronutrients and eating rate. Br J Nutr. 2016 Jan 14;115(1):160–7. doi: 10.1017/S0007114515004262.S0007114515004262 [DOI] [PubMed] [Google Scholar]
- 32.Thomaz E, Parnami A, Essa I, Abowd GD. Feasibility of identifying eating moments from first-person images leveraging human computation. 4th International SenseCam & Pervasive Imaging Conference; Nov 18-19, 2013; San Diego, CA, USA. New York, NY: ACM; 2013. pp. 26–33. [DOI] [Google Scholar]
- 33.O Connor S, McCaffrey N, Whyte E, Moran K. The novel use of a SenseCam and accelerometer to validate training load and training information in a self-recall training diary. J Sports Sci. 2016;34(4):303–10. doi: 10.1080/02640414.2015.1050600. [DOI] [PubMed] [Google Scholar]
- 34.Doherty AR, Kelly P, Kerr J, Marshall S, Oliver M, Badland H, Hamilton A, Foster C. Using wearable cameras to categorise type and context of accelerometer-identified episodes of physical activity. Int J Behav Nutr Phys Act. 2013;10:22. doi: 10.1186/1479-5868-10-22. http://www.ijbnpa.org/content/10//22 .1479-5868-10-22 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Ellis K, Godbole S, Chen J, Marshall S, Lanckriet G, Kerr J. Physical activity recognition in free-living from body-worn sensors. 4th International SenseCam & Pervasive Imaging Conference; Nov 18-19, 2013; San Diego, CA, USA. New York, NY: ACM; 2013. pp. 88–89. [DOI] [Google Scholar]
- 36.Nebeker C, Lagare T, Takemoto M, Lewars B, Crist K, Bloss CS, Kerr J. Engaging research participants to inform the ethical conduct of mobile imaging, pervasive sensing, and location tracking research. Transl Behav Med. 2016 Dec;6(4):577–586. doi: 10.1007/s13142-016-0426-4.10.1007/s13142-016-0426-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Rosenberg D, Godbole S, Ellis K, Di C, Lacroix A, Natarajan L, Kerr J. Classifiers for accelerometer-measured behaviors in older women. Med Sci Sports Exerc. 2017 Dec;49(3):610–616. doi: 10.1249/MSS.0000000000001121. http://europepmc.org/abstract/MED/28222058 .00005768-201703000-00027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Cuberos-Urbano G, Caracuel A, Valls-Serrano C, García-Mochón L, Gracey F, Verdejo-García A. A pilot investigation of the potential for incorporating lifelog technology into executive function rehabilitation for enhanced transfer of self-regulation skills to everyday life. Neuropsychol Rehabil. 2018 Jun;28(4):589–601. doi: 10.1080/09602011.2016.1187630. [DOI] [PubMed] [Google Scholar]
- 39.Doherty AR, Caprani N, Conaire CÓ, Kalnikaite V, Gurrin C, Smeaton AF, O’Connor NE. Passively recognising human activities through lifelogging. Comput Hum Behav. 2011 Sep;27(5):1948–1958. doi: 10.1016/j.chb.2011.05.002. [DOI] [Google Scholar]
- 40.Signal LN, Smith MB, Barr M, Stanley J, Chambers TJ, Zhou J, Duane A, Jenkin GLS, Pearson AL, Gurrin C, Smeaton AF, Hoek J, Ni Mhurchu C. Kids'Cam: an objective methodology to study the world in which children live. Am J Prev Med. 2017 Sep;53(3):e89–e95. doi: 10.1016/j.amepre.2017.02.016.S0749-3797(17)30163-0 [DOI] [PubMed] [Google Scholar]
- 41.Wang P, Smeaton AF. Using visual lifelogs to automatically characterize everyday activities. Inf Sci. 2013 May;230:147–161. doi: 10.1016/j.ins.2012.12.028. [DOI] [Google Scholar]
- 42.Kerr J, Marshall SJ, Godbole S, Chen J, Legge A, Doherty AR, Kelly P, Oliver M, Badland HM, Foster C. Using the SenseCam to improve classifications of sedentary behavior in free-living settings. Am J Prev Med. 2013 Mar;44(3):290–6. doi: 10.1016/j.amepre.2012.11.004.S0749-3797(12)00849-5 [DOI] [PubMed] [Google Scholar]
- 43.Marinac C, Merchant G, Godbole S, Chen J, Kerr J, Clark B, Marshall S. The feasibility of using SenseCams to measure the typecontext of daily sedentary behaviors. 4th International SenseCam & Pervasive Imaging Conference; Nov 18-19, 2013; San Diego, CA, USA. New York, NY: ACM; 2013. pp. 42–49. [DOI] [Google Scholar]
- 44.Moghimi M, Wu W, Chen J, Godbole S, Marshall S, Kerr J, Belongie S. Analyzing sedentary behavior in life-logging images. 2014 IEEE International Conference on Image Processing; Oct 27-30, 2014; Paris, France. 2014. pp. 1011–1015. [DOI] [Google Scholar]
- 45.Kelly P, Doherty AR, Hamilton A, Matthews A, Batterham AM, Nelson M, Foster C, Cowburn G. Evaluating the feasibility of measuring travel to school using a wearable camera. Am J Prev Med. 2012 Nov;43(5):546–50. doi: 10.1016/j.amepre.2012.07.027. http://linkinghub.elsevier.com/retrieve/pii/S0749-3797(12)00531-4 .S0749-3797(12)00531-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Kelly P, Doherty A, Mizdrak A, Marshall S, Kerr J, Legge A, Godbole S, Badland H, Oliver M, Foster C. High group level validity but high random error of a self-report travel diary, as assessed by wearable cameras. J Transport Health. 2014 Sep;1(3):190–201. doi: 10.1016/j.jth.2014.04.003. [DOI] [Google Scholar]
- 47.Boushey CJ, Spoden M, Zhu FM, Delp EJ, Kerr DA. New mobile methods for dietary assessment: review of image-assisted and image-based dietary assessment methods. Proc Nutr Soc. 2016 Dec 12;:1–12. doi: 10.1017/S0029665116002913.S0029665116002913 [DOI] [PubMed] [Google Scholar]
- 48.Sun M, Fernstrom JD, Jia W, Hackworth SA, Yao N, Li Y, Li C, Fernstrom MH, Sclabassi RJ. A wearable electronic system for objective dietary assessment. J Am Diet Assoc. 2010 Jan;110(1):45–7. doi: 10.1016/j.jada.2009.10.013. http://europepmc.org/abstract/MED/20102825 .S0002-8223(09)01689-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Maekawa T, Kishino Y, Yanagisawa Y, Sakurai Y. WristSense: wrist-worn sensor device with camera for daily activity recognition. 2012 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops); Mar 19-23, 2012; Lugano, Switzerland. 2012. pp. 510–512. [DOI] [Google Scholar]
- 50.Loveday A, Sherar LB, Sanders JP, Sanderson PW, Esliger DW. Novel technology to help understand the context of physical activity and sedentary behaviour. Physiol Meas. 2016 Dec;37(10):1834–1851. doi: 10.1088/0967-3334/37/10/1834. [DOI] [PubMed] [Google Scholar]
- 51.Kelly P, Marshall SJ, Badland H, Kerr J, Oliver M, Doherty AR, Foster C. An ethical framework for automated, wearable cameras in health behavior research. Am J Prev Med. 2013 Mar;44(3):314–9. doi: 10.1016/j.amepre.2012.11.006.S0749-3797(12)00862-8 [DOI] [PubMed] [Google Scholar]
- 52.Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. 25th International Conference on Neural Information Processing Systems; Dec 3-6, 2012; Lake Tahoe, NV, USA. 2012. pp. 1097–1105. [Google Scholar]
- 53.Biswas D, Su H, Wang C, Blankenship J, Stevanovic A. An automatic car counting system using OverFeat framework. Sensors (Basel) 2017 Jun 30;17(7) doi: 10.3390/s17071535. http://www.mdpi.com/resolver?pii=s17071535 .s17071535 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Peters MDJ, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015 Sep;13(3):141–6. doi: 10.1097/XEB.0000000000000050. [DOI] [PubMed] [Google Scholar]
- 55.Lazar A, Koehler C, Tanenbaum J, Nguyen DH. Why we use and abandon smart devices. 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing; Sep 7-11, 2015; Osaka, Japan. New York, NY: ACM; 2015. pp. 635–646. [DOI] [Google Scholar]
- 56.May CR, Eton DT, Boehmer K, Gallacher K, Hunt K, MacDonald S, Mair FS, May CM, Montori VM, Richardson A, Rogers AE, Shippee N. Rethinking the patient: using burden of treatment theory to understand the changing dynamics of illness. BMC Health Serv Res. 2014;14:281. doi: 10.1186/1472-6963-14-281. http://bmchealthservres.biomedcentral.com/articles/10.1186/1472-6963-14-281 .1472-6963-14-281 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Search strategy.
Data extraction form.
Characteristics of primary and secondary data collection studies.