Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2009 Feb 4;18(1):48–57. doi: 10.1002/mpr.276

Computerized ambulatory monitoring in psychiatry: a multi‐site collaborative study of acceptability, compliance, and reactivity

Elizabeth I Johnson 1, Olivier Grondin 2, Marion Barrault 2,6, Malika Faytout 2, Sylvia Helbig 3, Mathilde Husky 4, Eric L Granholm 5, Catherine Loh 5, Louise Nadeau 6, Hans‐Ulrich Wittchen 3, Joel Swendsen 1,✉
PMCID: PMC6878313  PMID: 19195050

Abstract

Computerized ambulatory monitoring overcomes a number of methodological and conceptual challenges to studying mental disorders, however concerns persist regarding the feasibility of this approach with severe psychiatric samples and the potential of intensive monitoring to influence data quality. This multi‐site investigation evaluates these issues in four independent samples. Patients with schizophrenia (n = 56), substance dependence (n = 85), anxiety disorders (n = 45), and a non‐clinical sample (n = 280) were contacted to participate in investigations using computerized ambulatory monitoring. Micro‐computers were used to administer electronic interviews several times per day for a one‐week period. Ninety‐five percent of contacted individuals agreed to participate in the study, and minimum compliance was achieved by 96% of these participants. Seventy‐eight percent of all programmed assessments were completed overall, and only 1% of micro‐computers were not returned to investigators. There was no evidence that missing data or response time increased over the duration of the study, suggesting that fatigue effects were negligible. The majority of variables investigated did not change in frequency as a function of study duration, however some evidence was found that socially sensitive behaviors changed in a manner consistent with reactivity. Copyright © 2009 John Wiley & Sons, Ltd.

Keywords: ambulatory monitoring, experience sampling method, ESM, ecological momentary assessment, EMA, feasibility, reactivity

Full Text

The Full Text of this article is available as a PDF (177.8 KB).

REFERENCES

  1. Aaron L.A., Mancl L., Turner J.A., Sawchuk C.N., Klein K.M. (2004) Reasons for missing interviews in the daily electronic assessment of pain, mood, and stress. Pain, 109, 389–398, DOI: 10.1016/j.pain.2004.02.014 [DOI] [PubMed] [Google Scholar]
  2. Bolger N., Davis A., Rafaeli E. (2003) Diary methods: capturing life as it is lived. Annual Review of Psychology, 54, 579–616, DOI: 10.1146/annurev.psych.54.101601.145030 [DOI] [PubMed] [Google Scholar]
  3. Broderick J.E., Schwartz J.E., Shiffman S., Hufford M.R., Stone A.A. (2003) Signaling does not adequately improve diary compliance. Annals of Behavioral Medicine, 26, 139–148, DOI: 10.1207/S15324796ABM2602_06 [DOI] [PubMed] [Google Scholar]
  4. Brown L.H., Silvia P.J., Myin‐Germeys I., Kwapil T.R. (2007) When the need to belong goes wrong: the expression of social anhednoia and social anxiety in daily life. Psychological Science, 18, 778–782, DOI: 10.1111/j.1467‐9280.2007.01978.x [DOI] [PubMed] [Google Scholar]
  5. Collins R.L., Morsheimer E.T., Shiffman S., Paty J.A., Gnys M., Papandonatos G.D. (1998) Ecological momentary assessment in a behavior drinking moderation training program. Experimental and Clinical Psychopharmacology, 6, 306–315, DOI: 10.1037/1064‐1297.6.3.306 [DOI] [PubMed] [Google Scholar]
  6. Compton W.M., Thomas Y.F., Conway K.P., Colliver J.D. (2005) Developments in the epidemiology of drug use and drug use disorders. American Journal of Psychiatry, 162, 1494–1502. DOI: 10.1176/appi.ajp.162.8.1494 [DOI] [PubMed] [Google Scholar]
  7. Cooney N.L., Litt M.D., Cooney J.L., Pilkey D.T., Steinberg H.R., Oncken C.A. (2007) Alcohol and tobacco cessation in alcohol‐dependent smokers: analysis of real‐time reports. Psychology of Addictive Behaviors, 21, 277–286, DOI: 10.1037/0893‐164X.21.3.277 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Csikszentmihalyi M., Larson R. (1987) Validity and reliability of the experience‐sampling method. Journal of Nervous and Mental Disease, 175, 526–536, DOI: 10.1097/00005053‐198709000‐00004 [DOI] [PubMed] [Google Scholar]
  9. Delespaul P., deVries M., van Os J. (2002) Determinants of occurrence and recovery from hallucinations in daily life. Social Psychiatry and Psychiatric Epidemiology, 37, 97–104, DOI: 10.1007/s001270200000 [DOI] [PubMed] [Google Scholar]
  10. deVries M.W., Delespaul P.A. (1989) Time, context, and subjective experiences in schizophrenia. Schizophrenia Bulletin, 15, 233–244. [DOI] [PubMed] [Google Scholar]
  11. Dijkman C.I.M., deVries M.W. (1987) The social ecology of anxiety: theoretical and quantitative perspectives. Journal of Nervous and Mental Disease, 175, 550–557, DOI: 10.1097/00005053‐198709000‐00007 [DOI] [PubMed] [Google Scholar]
  12. Ebner‐Priember U.W., Kuo J., Welch S.W., Thielgen T., Witte S., Bohus M., Linehan M.M. (2006) A valence‐dependent group‐specific recall bias of retrospective self‐reports: a study of Borderline Personality Disorder in everyday life. Journal of Nervous and Mental Disease, 194, 774–779, DOI: 10.1097/01.nmd.0000239900.46595.72 [DOI] [PubMed] [Google Scholar]
  13. Farmer R.F., Nash H.M., Dance D. (2004) Mood patterns and variations associated with personality disorder pathology. Comprehensive Psychiatry, 45, 289–303, DOI: 10.1016/ j.comppsych.2004.03.009 [DOI] [PubMed] [Google Scholar]
  14. Feldman Barrett L., Barrett D.J. (2001) An introduction to computerized experience sampling in psychology. Social Science Computer Review, 19, 175–185. [Google Scholar]
  15. First M.B., Gibbon M. (2003) The Structured Clinical Interview for DSM‐IV Axis I Disorders (SCID‐I) and the Structured Clinical Interview for DSM‐IV Axis II Disorders (SCID‐II). In: Comprehensive Handbook of Psychological Assessment (eds Hilsenroth M.J, Segal D.L.), Volume 2, pp. 134–143, John Wiley & Sons. [Google Scholar]
  16. First M.B., Spitzer R.L., Gibbon M., Williams J.B.W. (1995) Structured Clinical Interview for DSM‐IV Axis I Disorder Patient Edition (SCID I/P), Patient Edition, Biometrics Research Department, New York State Psychiatric Institute. [Google Scholar]
  17. Freedman M.J., Lester K.M., McNamara C., Milby J.B., Schumacher J.E. (2006) Cell phones for ecological momentary assessment with cocaine‐addicted homeless patients in treatment. Journal of Substance Abuse Treatment, 30, 105–111, DOI: 10.1016/j.jsat.2005.10.005 [DOI] [PubMed] [Google Scholar]
  18. Granholm E., Loh C., Swendsen J.D. (2008) Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophrenia Bulletin, 34, 507–514. DOI: 10.1093/schbul/sbm113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Green A.S., Rafaeli E., Bolger N., Shrout P.E., Reis H.T. (2006) Paper or plastic? Data equivalence in paper and electronic diaries. Psychological Methods, 11, 87–105, DOI: 10.1037/1082‐989X.11.1.87 [DOI] [PubMed] [Google Scholar]
  20. Grondin O.S., Husky M.M., Chakroun N. (2002) Bordeaux Experience Sampling Program 1.0. Bordeaux, unpublished manuscript.
  21. Hilbert A., Tuschen‐Caffier B. (2007) Maintenance of binge eating through negative mood: a naturalistic comparison of binge eating disorder and bulimia nervosa. International Journal of Eating Disorders, 40, 521–530, DOI: 10.1002/eat.20401 [DOI] [PubMed] [Google Scholar]
  22. Hopper J.W., Su Z., Looby A.R., Ryan E.T., Penetar D.M., Palmer C.M., Lukas S.E. (2006) Incidence and patterns of polydrug use and craving for ecstasy in regular ecstasy users: An ecological momentary assessment study. Drug and Alcohol Dependence, 85, 221–235, DOI: 10.1016/j.drugalcdep.2006.04.012 [DOI] [PubMed] [Google Scholar]
  23. Hormuth S.E. (1986) The sampling of experiences in situ. Journal of Personality, 54, 262–293, DOI: 10.1111/j.1467‐6494.1986.tb00395.x [Google Scholar]
  24. Hoyer J., Scholz D., Ruhl U., Wittchen H.U. (2006) Patients' feedback after computerized clinical diagnostic interviews for mental disorders. Psychotherapy Research, 13, 414–421, DOI: 10.1080/10503300500485540 [Google Scholar]
  25. Hufford M.R., Shields A.L., Shiffman S., Paty J., Balabanis M. (2002) Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. Psychology of Addictive Behaviors, 16, 205–211, DOI: 10.1037/0893‐164X.16.3.205 [PubMed] [Google Scholar]
  26. Hurlburt R.T. (1997) Randomly sampling thinking in the natural environment. Journal of Consulting and Clinical Psychology, 65, 941–949, DOI: 10.1037/0022‐006X.65.6.941 [DOI] [PubMed] [Google Scholar]
  27. Husky M., Mazure C., Maciejewski P., Swendsen J. (2007) A daily life comparison of sociotropy‐autonomy and hopelessness theories of depression. Cognitive Therapy and Research, 31, 659–676, DOI: 10.1007/s10608‐006‐9025‐x [Google Scholar]
  28. Johnson E.I., Barrault M., Nadeau L., Swendsen J. (2009) Feasibility and validity of computerized ambulatory monitoring in drug‐dependent women. Drug and Alcohol Dependence, 99, 322–326, DOI: 10.1016/j.drugalcdep.2008.06.010 [DOI] [PubMed] [Google Scholar]
  29. Kashdan T.B., Steger M.F. (2006) Expanding the topography of social anxiety: an experience‐sampling assessment of positive emotions, positive events, and emotion suppression. Psychological Science, 17, 120–128, DOI: 10.1111/j.1467‐9280.2006.01674.x [DOI] [PubMed] [Google Scholar]
  30. Kimhy D., Delespaul P., Corcoran C., Ahn H., Yale S., Malaspina D. (2006) Computerized experience sampling method (ESMc): assessing feasibility and validity among individuals with schizophrenia. Journal of Psychiatric Research, 40, 231–230, DOI: 10.1016/j.jpsychires.2005.09.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Krahn D.D., Bohn M.J., Henk H.J., Grossman J.L., Gosnell B. (2005) Patterns of urges during early abstinence in alcohol‐dependent subjects. American Journal on Addictions, 14, 248–255, DOI: 10.1080/10550490590949424 [DOI] [PubMed] [Google Scholar]
  32. Lee M.R., Okazaki S., Yoo H.C. (2006) Frequency and intensity of social anxiety in Asian Americans and European Americans. Cultural Diversity and Ethnic Minority Psychology, 12, 291–305, DOI: 10.1037/1099‐9809.12.2.291 [DOI] [PubMed] [Google Scholar]
  33. Lecrubier Y., Sheehan D.V., Weiller E., Amorim P., Bonora I., Sheehan K.H., Janavs J., Dunbar G.C. (1997) The Mini International Neuropsychiatric Interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. European Psychiatry, 12, 224–231, DOI: 10.1016/S0924‐9338(97)83296‐8 [Google Scholar]
  34. Litt M.D., Cooney N.L., Morse P. (1998) Ecological momentary assessment (EMA) with treated alcoholics: methodological problems and potential solutions. Health Psychology, 17, 48–52, DOI: 10.1037/0278‐6133.17.1.48 [DOI] [PubMed] [Google Scholar]
  35. Loewenstein R.J., Hamilton J., Alagna S., Reid N., deVries M. (1987) Experience sampling in the study of multiple personality disorder. American Journal of Psychiatry, 144, 19–24. [DOI] [PubMed] [Google Scholar]
  36. Lukasiewicz M., Benyamina A., Reynaud M., Falissard B. (2005) An in vivo study of the relationship between craving and reaction time during alcohol detoxification using the Ecological Momentary Assessment. Alcoholism: Clinical and Experimental Research, 29, 2135–2143, DOI: 10.1097/01.alc.0000191760.42980.50 [DOI] [PubMed] [Google Scholar]
  37. Magneberg R. (1998) The effect of electronic surveillance on alcohol misuse and everyday behavior. Addictive Behaviors, 23, 281–301, DOI: 10.1016/S0306‐4603(97)00067‐1 [DOI] [PubMed] [Google Scholar]
  38. Moskowitz D.S., Young S.N. (2006) Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. Journal of Psychiatry and Neuroscience, 31, 13–20. [PMC free article] [PubMed] [Google Scholar]
  39. Myin‐Germeys I., van Os J., Schwartz J.E., Stone A.A., Delespaul P.A. (2001) Emotional reactivity to daily life stress in psychosis. Archives of General Psychiatry, 58, 1137–1144, DOI: 10.1001/archpsyc.58.12.1137 [DOI] [PubMed] [Google Scholar]
  40. Myin‐Germeys I., Peeters F., Havermans R., Nicolson N.A., deVries M.W., Delespaul P., van Os J. (2003) Emotional reactivity to daily life stress in psychosis and affective disorder: an experience sampling study. Acta Psychiatrica Scandinavica, 107, 124–131, DOI: 10.1034/j.1600‐0447.2003.02025.x [DOI] [PubMed] [Google Scholar]
  41. Nelson R.O. (1977) Assessment and therapeutic functions of self‐monitoring In: Progress in Behavioral Modification (eds Hersen M, Eisler R.M., Miller P.), pp. 3–41, Academic Press. [Google Scholar]
  42. Peeters F., Berkhof J., Delespaul P., Rottenberg J., Nicolson N.A. (2006) Diurnal mood variation in major depressive disorder. Emotion, 6, 383–391, DOI: 10.1037/1528‐3542.6.3.383 [DOI] [PubMed] [Google Scholar]
  43. Raudenbush S., Bryk A., Congdon R. (2005) HLM for Windows, Version 6.03, Scientific Software International. [Google Scholar]
  44. Scollon C.N., Kim‐Prieto C., Diener E. (2003) Experience sampling: promises and pitfalls, strengths and weaknesses. Journal of Happiness Studies, 4, 5–34, DOI: 10.1023/A:1023605205115 [Google Scholar]
  45. Smyth J.M., Wonderlich S.A., Heron K.E., Sliwinski M.J., Crosby R.D., Mitchell J.E., Engel S.G. (2007) Daily and momentary mood and stress are associated with binge eating and vomiting in bulimia nervosa patients in the natural environment. Journal of Consulting and Clinical Psychology, 75, 629–638, DOI: 10.1037/0022‐006X.75.4.629 [DOI] [PubMed] [Google Scholar]
  46. Stein K.F. (1996) Affect instability in adults with a borderline personality disorder. Archives of Psychiatric Nursing, 10, 32–40, DOI: 10.1016/S0883‐9417(96)80084‐7 [DOI] [PubMed] [Google Scholar]
  47. Stein K.F., Corte C.M. (2003) Ecological momentary assessment of eating‐disordered behaviors. International Journal of Eating Disorders, 34, 349–360. DOI: 10.1002/eat.10194 [DOI] [PubMed] [Google Scholar]
  48. Stone A.A., Kessler R.C., Haythornthwaite J.A. (1991) Measuring daily events and experiences: decisions for the researcher. Journal of Personality, 59, 575–607, DOI: 10.1111/j.1467‐6494.1991.tb00260.x [DOI] [PubMed] [Google Scholar]
  49. Stone A.A., Shiffman S., Schwartz J.E., Broderick J.E., Hufford M.R. (2003a) Patient compliance with paper and electronic diaries. Controlled Clinical Trials, 24, 182–199, DOI: 10.1016/S0197‐2456(02)00320‐3 [DOI] [PubMed] [Google Scholar]
  50. Stone A.A., Broderick J.E., Schwartz J.E., Shiffman S., Litcher‐Kelly L., Clavanese P. (2003b) Intensive momentary report of pain with an electronic diary: reactivity, compliance and patient satisfaction. Pain, 104, 343–351, DOI: 10.1016/S0304‐3959(03)00040‐X [DOI] [PubMed] [Google Scholar]
  51. Swendsen J.D. (1998) The helplessness‐hopelessness theory and daily mood experience: an idiographic and cross‐situational perspective. Journal of Personality and Social Psychology, 74, 1398–1408, DOI: 10.1037/0022‐3514.74.5.1398 [Google Scholar]
  52. Swendsen J.D., Tennen H., Carney M.A., Affleck G., Willard A., Hromi A. (2000) Mood and alcohol consumption: an experience sampling test of the self‐medication hypothesis. Journal of Abnormal Psychology, 109, 198–204, DOI: 10.1037/0021‐843X.109.2.198 [PubMed] [Google Scholar]
  53. Verdoux H., Husky M., Tournier M., Sorbara F., Swendsen J.D. (2003) Social environments and daily life occurrence of psychotic symptoms: an experience sampling test in a non‐clinical population. Social Psychiatry and Psychiatric Epidemiology, 38, 654–661, DOI: 10.1007/s00127‐003‐0702‐8 [DOI] [PubMed] [Google Scholar]
  54. Weiss H.M., Beal D.J., Lucy S.L., MacDermid S.M. (2004) Constructing EMA Studies with PMAT: The Purdue Momentary Assessment Tool User's Manual, Military Family Research Institute, Purdue University.
  55. Wittchen H.U. (1994) Reliability and validity studies of the WHO‐Composite International Diagnostic Interview (CIDI): a critical review. International Journal of Psychiatric Research, 28, 57–84, DOI: 10.1016/0022‐3956(94)90036‐1 [DOI] [PubMed] [Google Scholar]
  56. Wittchen H.U., Lachner G., Wunderlich U., Pfister H. (1998) Test–retest reliability of the computerized DSM‐IV version of the Munich‐Composite International Diagnostic Interview (M‐CIDI). Social Psychiatry and Psychiatric Epidemiology, 33, 568–578, DOI: 10.1007/s001270050095 [DOI] [PubMed] [Google Scholar]
  57. Zanarini M.C., Frankenburg F.R. (2001) Attainment and maintenance of reliability of axis I and axis II disorders over the course of a longitudinal study. Comprehensive Psychiatry, 42, 369–374, DOI: 10.1053/comp.2001.24556 [DOI] [PubMed] [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES