Key Points
Question
When a patient receives acute hospital-level care at home (home hospital), is the use of remote physician visits noninferior to in-home physician visits in terms of safety and patient experience?
Findings
In this 2-site randomized clinical trial of 172 patients, the mean adverse event count was 6.8 per 100 patients for patients receiving remote care vs 3.9 per 100 patients for control patients, for a difference of 2.8, supporting noninferiority, although 19% of patients receiving remote care required in-home physician visits. Patient experience was noninferior.
Meaning
In this study, remote physician visits were noninferior to in-home physician visits during home hospital care for adverse events and patient experience, although in-home physician care was necessary to support 1 in 5 patients receiving remote care.
This randomized clinical trial of adult patients who required hospital-level home care for select acute conditions assesses whether remote physician visits were noninferior to in-home physician visits.
Abstract
Importance
Home hospital care is the substitutive provision of home-based acute care services usually associated with a traditional inpatient hospital. Many home hospital models require a physician to see patients at home daily, which may hinder scalability. Whether remote physician visits can safely substitute for most in-home visits is unknown.
Objective
To compare remote and in-home physician care.
Design, Setting, and Participants
This randomized clinical trial assessed 172 adult patients at an academic medical center and community hospital who required hospital-level care for select acute conditions, including infection, heart failure, chronic obstructive pulmonary disease, and asthma, between August 3, 2019, and March 26, 2020; follow-up ended April 26, 2020.
Interventions
All patients received acute care at home, including in-home nurse or paramedic visits, intravenous medications, remote monitoring, and point-of-care testing. Patients were randomized to receive physician care remotely (initial in-home visit followed by daily video visit facilitated by the home hospital nurse) vs in-home care (daily in-home physician visit). In the remote care group, the physician could choose to see the patient at home beyond the first visit if it was felt to be medically necessary.
Main Outcomes and Measures
The primary outcome was the number of adverse events, compared using multivariable Poisson regression at a noninferiority threshold of 10 events per 100 patients. Adverse events included a fall, pressure injury, and delirium. Secondary outcomes included the Picker Patient Experience Questionnaire 15 score (scale of 0-15, with 0 indicating worst patient experience and 15 indicating best patient experience) and 30-day readmission rates.
Results
A total of 172 patients (84 receiving remote care and 88 receiving in-home physician care [control group]) were randomized; enrollment was terminated early because of COVID-19. The mean (SD) age was 69.3 (18.0) years, 97 patients (56.4%) were female, 77 (45.0%) were White, and 42 (24.4%) lived alone. Mean adjusted adverse event count was 6.8 per 100 patients for remote care patients vs 3.9 per 100 patients for control patients, for a difference of 2.8 (95% CI, –3.3 to 8.9), supporting noninferiority. For remote care vs control patients, the mean adjusted Picker Patient Experience Questionnaire 15 score difference was −0.22 (95% CI, −1.00 to 0.56), supporting noninferiority. The mean adjusted 30-day readmission absolute rate difference was 2.28% (95% CI, –3.23% to 7.79%), which was inconclusive. Of patients in the remote group, 16 (19.0%) required in-home visits beyond the first visit.
Conclusions and Relevance
In this study, remote physician visits were noninferior to in-home physician visits during home hospital care for adverse events and patient experience, although in-home physician care was necessary to support many patients receiving remote care. Our findings may allow for a more efficient, scalable home hospital approach but require further research.
Trial Registration
ClinicalTrials.gov Identifier: NCT04080570
Introduction
Hospitals are the standard of care for acute illness in the US, but hospital care is expensive and potentially unsafe and uncomfortable, particularly for older individuals.1,2,3,4 Home hospital care is the substitutive provision of home-based acute care services usually associated with a traditional inpatient hospital.5 Such care is specifically for the acutely ill patient who would have required care in a hospital bed but instead receives that care at home. Prior work6,7,8,9,10,11,12,13,14,15 suggests that home hospital care can reduce costs, maintain quality and safety, and improve patient experience for select acutely ill adults who require traditional hospital-level care.
The concept of decentralizing hospital care to the home contrasts with most theories on economies of scale, yet outcomes on cost and quality make the intervention high value.16,17,18 One criticism of home hospital care is the inefficiency incurred by the attending physician or advanced practice clinician. Patient-physician ratios are typically lower for home hospital care than traditional medical wards, in part because of the need to travel to each patient. Nurse ratios are usually similar or less per patient compared with traditional medical wards because there is traditionally no nurse coverage at night. In some respects, this intensive, in-home physician approach may prevent the spread and scale of home hospital care, especially to remote rural areas. Whether a physician could substitute all but the first in-home admission visit with remote video visits (but allow for in-home visits if necessary) without negatively affecting safety, readmission, or patient experience is unknown. Because the efficacy of home hospital care has already been well demonstrated,19,20 we sought to demonstrate the noninferiority of this hybrid remote physician care model to in-home care. If successful, this program could increase efficiency, catalyze the model’s scale, and open remote physicians to care for acutely ill adults in multiple settings, including dense urban, rural, international, and even in-hospital settings.
Methods
Design
We performed a parallel-design, noninferiority randomized clinical trial (RCT) with participants randomized to receive home hospital care with remote physician care (remote) vs usual home hospital care with in-home physician care (control). Patients, study staff, and physicians were not blinded to allocation status. We enrolled participants between August 3, 2019, and March 26, 2020; follow-up ended April 26, 2020. The trial was abruptly halted because of the COVID-19 pandemic, when as much care as possible was shifted to the remote model. The trial protocol was approved by the Mass General Brigham Institutional Review Board. All participants provided written informed consent before randomization. This report follows the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline for randomized studies. The trial protocol can be found in Supplement 1.
Setting and Participants
Findings from the first home hospital pilot RCT in the US were previously reported21 and subsequently replicated in a larger population.16,22 In the current study, we generally maintained these methods. Briefly, adult participants were recruited in the emergency department and medical ward at Brigham and Women’s Hospital (an academic medical center) and Brigham and Women’s Faulkner Hospital (a community hospital). Patients were eligible to enroll if they required admission, lived within the 5-mile catchment area, and were acutely ill from a medical condition, such as infection (eg, cellulitis, complicated urinary tract infection, and diverticulitis), heart failure, chronic obstructive pulmonary disease, or asthma. Patients were ineligible if they required critical care, routine administration of controlled substances, an invasive procedure, more than 1 person’s assistance to reach a bedside commode, or advanced imaging, among other criteria.16 Patients were not excluded based on insurance status or if they lived alone and were not compensated. We approached all eligible patients. Complete criteria for each diagnosis are in the eAppendix in Supplement 2.
Randomization and Interventions
Randomization was generated by a biostatistician (E.J.O.) using SAS statistical software, version 9.4 (SAS Institute Inc) and stratified by infection, heart failure, chronic obstructive pulmonary disease or asthma, and other diagnosis, with randomly selected block sizes of 4 or 6 with allocation concealment via sealed, opaque envelopes. Participants who provided informed consent were randomized by trained research study staff to usual home hospital care with an in-home attending physician (control group) or home hospital care with a remote attending physician (remote group).
The previously reported16 home hospital intervention method was generally maintained, with the addition of the 2 randomized groups. In the control group, the attending physician performed rounds each day in the patient’s home alongside the home hospital nurse or paramedic. In the remote group, the attending physician performed an initial in-home visit on admission followed by a daily encrypted video visit facilitated by the home hospital nurse or paramedic who was able to perform examination maneuvers as needed, including transmission of heart and lung sounds (Eko Health). Although the default was to see a patient by video each day after an initial in-home visit, the clinical team could choose at any time to see the patient in person if the physician thought it was medically necessary. If a physician’s time on service (typically 7 days) ended but the patient remained on service, the incoming physician would perform a single in-home visit and then continue with remote visits. With the exception of the physician interaction, patients otherwise received the same home hospital services, including twice-daily, in-home nurse visits (Mass General Brigham Home Care), intravenous infusions via programmable pump (Smiths Medical), respiratory therapies, continuous remote monitoring with a wearable patch that transmitted alarms directly to clinician phones (VitalConnect), and point-of-care testing with the iSTAT (Abbott Laboratories). In both groups, patients had immediate after-hours access via video and telephone to their physician, who could dispatch a mobile integrated health paramedic to the home who could then bring the physician in by video as needed for management. Training of the physicians and nurses included a 1-hour didactic session on best practices in telemedicine. Patients and caregivers received minimal training in telemedicine on admission. Physicians were not given specific protocols for patient management, and patients were discharged when deemed to no longer require acute care.
Outcomes and Follow-up
The study period began on admission and ended 30 days after discharge. For both groups, study staff interviewed patients on admission and after discharge (contact via telephone attempted between 1 day and 30 days after discharge). On admission, patients reported their sociodemographic characteristics and completed assessments of frailty (Program of Research on Integration of Services for the Maintenance of Autonomy [PRISMA-7]),23 cognitive impairment (Ascertain Dementia 8-item Informant Questionnaire),24 depression (Patient Health Questionnaire 2),25 emotional support (Patient-Reported Outcomes Measurement Information System),26 health literacy (Brief Health Literacy Screener),27 quality of life (EuroQol Visual Analog Scale),28 and functional status (activities of daily living and instrumental activities of daily living).29 Study staff collected information from clinical staff and the electronic health record (EHR) for all other variables. Race and ethnicity were included as variables in this study because they have been associated with the social determinants of health.
Our primary outcome was the number of adverse events that occurred during a patient’s admission. For interpretability, we report the rate of adverse events per 100 patients. Adverse events included fall, delirium, potentially preventable venous thromboembolism, new pressure injury, thrombophlebitis at peripheral intravenous site, catheter-associated urinary tract infection, new Clostridioides difficile infection, new methicillin-resistant Staphylococcus aureus infection, new arrhythmia, hypokalemia, acute kidney injury, transfer back to the hospital, unplanned mortality during the admission, and unplanned mortality within 30 days after discharge. These adverse events were drawn from prior home hospital literature and hospital safety literature.6,30 All data were extracted through medical record review by trained research assistants (M.P., K.B., and R.B.). When necessary, the research assistant could ask the nurse for clarification.
Our secondary outcomes were the Picker Patient Experience Questionnaire 15 (scale: 0-15, with 0 indicating worst patient experience and 15 indicating best patient experience),31 global experience (scale: 0-10, with 0 indicating worst patient experience and 10 indicating best patient experience), and 30-day readmission. Both experience measures were obtained during the postdischarge telephone call. For global experience, patients were asked, “Using any number from 0 to 10, where 0 is the worst hospital possible and 10 is the best hospital possible, what number would you use to rate home hospital during your stay?” If patients were unable to be reached after discharge (37 total patients, including 18 in the control group and 19 in the remote group), we did not measure patient experience. Thirty-day readmission started with discharge from the acute care episode (from home or the hospital in the case of an escalation). For 30-day readmission, in addition to EHR records from all Mass General Brigham facilities (the health care system that includes Brigham and Women’s Hospital and Brigham and Women’s Faulkner Hospital), we used the CareEverywhere system that joins all institutions that use the Epic EHR.
We explored health care utilization during the acute care episode. Utilization included laboratory orders, radiology studies, consultations, and length of stay. All measures were derived from the EHR. We also measured each home visit’s length, defined as time of entry into the home subtracted from time of exit from the home in minutes, reported by the clinician. In the postdischarge period, we additionally measured whether a patient had an emergency department visit (unrelated to readmission) within 30 days or a primary care visit within 14 days.
Statistical Analysis
During the prior RCT of home hospital,16 patients experienced a mean (SD) of 9 (29) adverse events per 100 patients during their home hospital admission. We believe the smallest clinically meaningful treatment difference would be 10 adverse events (ie, from 9 to 19 adverse events per 100 patients). In this noninferiority trial (α = .025, power of 80%, and noninferiority limit of 0.1 events), we required 210 patients (105 in each arm). As noted above, the RCT was stopped early because of the COVID-19 pandemic. Given that we prespecified only 3 secondary outcomes, we did not account for multiple comparisons. We report our nonprimary and nonsecondary outcomes descriptively only.
We followed an intent-to-treat approach and assessed the noninferiority of the primary outcome with a generalized linear model using Poisson regression and a prespecified noninferiority threshold of 10 events per 100 patients (trial protocol in Supplement 1). For our secondary outcomes, we used logistic regression for 30-day readmission (noninferiority threshold of 5%) and a generalized linear model with a γ-distribution and log link for the Picker and global experiences (noninferiority threshold of 2 points for both). When the 95% CI of the difference failed to cross a noninferiority threshold, noninferiority was considered to be upheld. If a 95% CI of the difference crossed zero and the noninferiority margin, it was considered inconclusive (failed to reject that remote care was inferior).32 For all models, we prespecified adjustments for age, gender, race and ethnicity, PRISMA-7 (a measure of frailty),23 and HOSPITAL (hemoglobin at discharge, discharge from an oncology service, sodium level at discharge, procedure during the index admission, index type of admission, number of admissions during the last 12 months, and length of stay) score (a predictor of potentially avoidable readmission).33 Because of missing data (26 controls and 20 remote care patients), we removed PRISMA-7 from the final models, although the randomized design provided good balance between arms for available PRISMA-7 values. We performed 2 post hoc models: one without the HOSPITAL score given it was based on variables known at discharge and another with the addition of primary language; however, neither of these models changed our findings.
We present descriptive data with numbers (percentages), means (95% CIs), or medians (IQRs) as appropriate. We present both unadjusted and adjusted outcomes for our primary and secondary outcomes. We performed all analyses in SAS statistical software, version 9.4 (SAS Institute Inc).
Results
Patient Demographic Characteristics
Of the 277 patients who were screened for eligibility, 172 were randomized (84 remote care patients and 88 controls; mean [SD] age, 69.3 [18.0] years; 97 [56.4%] female and 75 [43.6%] male; 33 [19.3%] Black, 39 [22.8%] Latinx, 77 [45.0%] White, and 22 [12.9%] of other race or ethnicity), and all received their allocated treatment (Figure). Patients who were female (70 of 105 [66.7%] vs 97 of 172 [56.4%]) and had Medicaid (14 of 105 [13.3%] vs 7 of 172 [4.1%]) declined more often, whereas patients who were Latinx were enrolled more often (39 of 171 [22.8%] vs 9 of 105 [8.6%]) (eTable 1 in Supplement 2).34
Figure. Flow of Participants in the Study.
aNot completing a postdischarge call incurred missing values for patient experience.
Patients in the control group were younger (mean [SD] age, 66.5 [18.9] vs 72.1 [16.6] years) and more often White (45 [51.7%] vs 32 [38.1%]), privately insured (33 [37.5%] vs 18 [21.4%]), and employed but otherwise clinically similar. Twenty-two patients (26.2%) in the remote care group and 20 (22.7%) in the control group lived alone. At baseline in both groups, patients were frail and chronically ill, had several limitations in their functional status, had frequently used hospital and emergency care in the past 6 months, and had fair health-related quality of life (Table 1). Both groups had similar proportions of patients in the prespecified blocked strata of infection, heart disease, respiratory disease, and other diagnoses. On discharge, the mean HOSPITAL score was 3.0 (95% CI, 2.7-3.4) for the remote group vs 2.7 (95% CI, 2.4-3.1) for the control group.
Table 1. Baseline Patient Characteristicsa.
| Characteristic | Remote care group (n = 84) | Control group (n = 88) | P value |
|---|---|---|---|
| Age, mean (SD), y | 72.1 (16.6) | 66.5 (18.9) | .04 |
| Sex | |||
| Female | 51 (60.7) | 46 (52.3) | .28 |
| Male | 33 (39.3) | 42 (47.7) | |
| Race or ethnicity | |||
| Black | 16 (19.0) | 17 (19.5) | .15 |
| Latinx | 21 (25.0) | 18 (20.7) | |
| White | 32 (38.1) | 45 (51.7) | |
| Otherb | 15 (17.9) | 7 (8.0) | |
| Partner status | |||
| Partnered | 35 (41.7) | 46 (52.9) | .55 |
| Divorced | 9 (10.7) | 6 (6.9) | |
| Widowed | 11 (13.1) | 7 (8.0) | |
| Single, never partnered | 29 (33.4) | 27 (31.0) | |
| Other | 0 | 1 (1.2) | |
| Primary language | |||
| English | 57 (67.9) | 67 (76.1) | .25 |
| Spanish | 23 (27.4) | 20 (22.7) | |
| Other | 4 (4.8) | 1 (1.1) | |
| Insurance | |||
| Private | 18 (21.4) | 33 (37.5) | .09 |
| Medicare | 53 (63.1) | 40 (45.5) | |
| Medicaid | 4 (4.8) | 3 (3.4) | |
| Medicare and Medicaid | 9 (10.7) | 11 (12.5) | |
| None | 0 | 1 (1.1) | |
| Educational level | |||
| Less than high school | 18 (28.1) | 10 (15.9) | .25 |
| High school | 12 (18.8) | 18 (28.6) | |
| <4-y College | 15 (23.4) | 12 (19.1) | |
| 4-y College | 10 (15.6) | 16 (25.4) | |
| >4-y College | 9 (14.1) | 7 (11.1) | |
| Employment | |||
| Employed | 13 (16.5) | 24 (30.4) | .11 |
| Unemployed | 14 (17.7) | 13 (16.5) | |
| Retired | 52 (65.8) | 42 (53.2) | |
| Cigarette smoking | |||
| Never | 42 (50.6) | 36 (40.9) | .05 |
| Current | 4 (4.8) | 14 (15.9) | |
| Prior | 37 (44.6) | 38 (43.2) | |
| Lives alone | 22 (26.2) | 20 (22.7) | .72 |
| PRISMA-7 score (range, 0-7), mean (95% CI) | 3.4 (3.0-3.8) | 3.1 (2.7-3.5) | .37 |
| AD-8 score (range, 0-8), mean (95% CI) | 1.6 (0.9-2.3) | 0.9 (0.5-1.4) | .09 |
| BHLS score (range, 4-20), mean (95% CI) | 17.2 (15.9-18.4) | 16.9 (15.6-18.2) | .77 |
| No. of chronic comorbidities, mean (95% CI) | 3.9 (3.4-4.4) | 4.1 (3.6-4.7) | .53 |
| Full code statusc | 71 (85.5) | 76 (88.4) | .65 |
| No. of ADLs on admission (range, 0-6), mean (95% CI) | 5.0 (4.6-5.5) | 5.2 (4.9-5.6) | .49 |
| No. of IADLs on admission (range, 0-8), mean (95% CI) | 5.2 (4.6-5.9) | 5.4 (4.7-6.1) | .74 |
| PHQ-2 (range, 0-6), mean (95% CI) | 1 (0.6-1.5) | 1 (0.6-1.5) | .96 |
| Hospital admission in last 6 mo | 29 (34.5) | 30 (34.1) | >.99 |
| Emergency department visit in last 6 mo | 27 (32.1) | 40 (45.5) | .09 |
| EQ-VAS score (range, 0-100), mean (95% CI) | 55.8 (49.5-62.2) | 57.0 (50.8-63.2) | .79 |
| Diagnosis, No. (%)d | |||
| Infection | .98 | ||
| Pneumonia | 14 (16.7) | 14 (15.9) | |
| Skin/soft-tissue infection | 9 (10.7) | 13 (14.8) | |
| Complicated UTI or pyelonephritis | 17 (20.2) | 12 (13.6) | |
| Other infection | 11 (13.1) | 10 (11.4) | |
| Heart failure | 9 (10.7) | 13 (14.8) | |
| Airway disease | |||
| Asthma | 8 (9.5) | 8 (9.1) | |
| COPD | 8 (9.5) | 10 (11.4) | |
| Othere | 8 (9.5) | 8 (9.1) |
Abbreviations: AD-8, Ascertain Dementia 8-item Informant Questionnaire (with 0-1 indicating normal cognition and ≥2 indicating cognitive impairment likely to be present); ADLs, activities of daily living; BHLS, Brief Health Literacy Screener (with 4-12 indicating limited; 13-16, marginal; and 17-20, adequate); COPD, chronic obstructive pulmonary disease; EQ-VAS, EuroQol Visual Analog Scale (with 0 indicating worst imaginable health and 100 indicating best imaginable health); IADLs, instrumental activities of daily living; PHQ-2, Patient Health Questionnaire 2 (scale of 0-6, with scores ≥3 indicating possible depression); PRISMA, Program of Research on Integration of Services for the Maintenance of Autonomy (with scores ≥2 indicating frailty); UTI, urinary tract infection.
Data are presented as number (percentage) of patients unless otherwise indicated.
Other includes Asian and multiracial.
Patients who chose resuscitation and intubation.
Diagnoses were block randomized at the level of infection, heart failure, airway disease, and other.
Other diagnoses, such as atrial fibrillation with rapid ventricular response, diabetes, pulmonary embolism, and others (see eTable 2 in Supplement 2 for complete list and criteria).
Adverse Events, Patient Experience, and 30-Day Readmission
Few adverse events occurred. The 3 adverse events were transfer back to the hospital (3.6 per 100 patients for remote care patients and 2.3 for control patients), delirium (4.8 for remote care patients and 1.1 for control patients), and fall (1.2 for remote care patients and 2.3 for control patients) (Table 2). The mean adjusted adverse event count was 6.8 events per 100 patients (95% CI, 2.9-15.7) for remote care patients and 3.9 events per 100 patients (95% CI, 1.4-11.0) for control patients (difference, 2.8; 95% CI, −3.3 to 8.9), supporting noninferiority (Table 3).
Table 2. Adverse Events.
| Adverse event | No. (%) of adverse events | |
|---|---|---|
| Remote care group (n = 84) | Control group (n = 88) | |
| Fall | 1 (1.2) | 2 (2.3) |
| Loss of consciousness | 0 | 0 |
| Delirium | 4 (4.8) | 1 (1.1) |
| Potentially preventable VTE | 0 | 0 |
| New pressure ulcer | 0 | 0 |
| Thrombophlebitis at peripheral intravenous site | 0 | 0 |
| CAUTI | 0 | 0 |
| New Clostridioides difficile | 0 | 0 |
| New MRSA | 0 | 0 |
| New other hospital-acquired infection | 0 | 0 |
| Transfer back to hospital | 3 (3.6) | 2 (2.3) |
| Mortality (unplanned) during admission | 0 | 0 |
| Mortality (unplanned) 30-d postdischarge | 0 | 0 |
Abbreviations: CAUTI, catheter-associated urinary tract infection; MRSA, methicillin-resistant Staphylococcus aureus; VTE, venous thromboembolism.
Table 3. Noninferiority Analysis: Adverse Events, 30-Day Readmission, and Patient Experience.
| Measure | Mean (95% CI) | ||
|---|---|---|---|
| Remote care group (n = 84) | Control group (n = 88) | Differencea | |
| Primary outcome | |||
| Adverse event count per 100 patients, unadjusted | 6.0 (2.5 to 14.3) | 3.4 (1.1 to 10.6) | 2.5 (–4.0 to 9.1) |
| Adverse event count per 100 patients, adjustedb | 6.8 (2.9 to 15.7) | 3.9 (1.4 to 11.0) | 2.8 (–3.3 to 8.9) |
| Secondary outcomes | |||
| Picker Patient Experience Questionnaire 15 score, unadjustedc | 13.49 (12.96 to 14.05) | 13.75 (13.23 to 14.29) | –0.26 (–1.03 to 0.50) |
| Picker Patient Experience Questionnaire 15, adjustedb | 13.46 (12.93 to 14.01) | 13.68 (13.16 to 14.22) | –0.22 (–1.00 to 0.56) |
| Global experience, unadjustedd | 9.46 (9.23 to 9.69) | 9.67 (9.45 to 9.90) | –0.21 (–0.53 to 0.11) |
| Global experience, adjustedb | 9.50 (9.28 to 9.73) | 9.62 (9.40 to 9.84) | –0.12 (–0.44 to 0.21) |
| 30-Day readmission rate, unadjusted | 8.33 (4.03 to 16.46) | 5.68 (2.39 to 12.93) | 2.65 (–4.99 to 10.29) |
| 30-Day readmission rate, adjustedb | 5.70 (2.28 to 13.56) | 3.43 (1.11 to 10.07) | 2.28 (–3.23 to 7.79) |
Difference represents the remote care group minus the control group.
Adjusted for age, sex, race or ethnicity, and HOSPITAL (hemoglobin at discharge, discharge from an oncology service, sodium level at discharge, procedure during the index admission, index type of admission, number of admissions during the last 12 months, and length of stay) score.
Picker Patient Experience Questionnaire 15 is a 0- to 15-point score, with more points indicating a better experience.
Global experience is a 0- to 10-point scale with 0 indicating the worst hospital possible and 10 indicating the best hospital possible.
The mean adjusted Picker Patient Experience Questionnaire 15 score was 13.46 (95% CI, 12.93-14.01) for remote care patients and 13.68 (95% CI, 13.16-14.22) for control patients (difference, −0.22; 95% CI, −1.00 to 0.56), supporting noninferiority (Table 3). Mean adjusted global experience was noninferior between remote care patients (9.50; 95% CI, 9.28-9.73) and control patients (9.62; 95% CI, 9.40-9.84) (difference, −0.12; 95% CI, −0.44 to 0.21). The mean adjusted 30-day readmission rate was 5.70% (95% CI, 2.28%-13.56%) for remote care patients and 3.43% (95% CI, 1.11%-10.07%) for control patients (difference, 2.28; 95% CI, −3.23 to 7.79), which was inconclusive.
Utilization and Operational Metrics
Patients were admitted for a median of 4 days (IQR, 3-6 days) in the remote care group and 4 days (IQR, 3-5 days) in the control group (Table 4). Nurse or paramedic visits took somewhat longer in the remote care group (median 46.5 minutes [IQR, 38.6-57.4 minutes]) vs the control group (38.0 minutes [IQR, 31.9-49.0 minutes]). Patient disposition was similar in both groups, with somewhat higher rates of home health disposition in the remote group (7 [8.3%]) compared with the control group (2 [2.3%]). Utilization within the 30-day postacute episode was similar for primary care follow-up and 30-day emergency department presentation.
Table 4. Utilization and Operational Metrics.
| Measure | Remote care group (n = 84) | Control group (n = 88) |
|---|---|---|
| During acute episode | ||
| Length of stay, median (IQR), d | 4 (3-6) | 4 (3-5) |
| Nurse or paramedic visit duration, median (IQR), min | 46.5 (38.6-57.4) | 38.0 (31.9-49.0) |
| Disposition, No. (%)a | ||
| Routine | 72 (85.7) | 83 (94.3) |
| Home health | 7 (8.3) | 2 (2.3) |
| Home hospice | 1 (1.2) | 1 (1.1) |
| Other | 4 (4.8) | 2 (2.3) |
| 30-d Postacute care episode | ||
| Primary care visit within 14 d after discharge, No. (%) | 42 (50.0) | 40 (45.5) |
| 30-d ED presentation, No. (%) | 11 (13.1) | 11 (12.5) |
Abbreviation: ED, emergency department.
Disposition following the acute care episode.
Physician Visits
Each patient received at least 1 physician visit each day, either in the home or remotely. Among patients in the remote care group, 16 (19.0%) required in-home physician visits beyond the initial in-home admission visit. These patients spoke Spanish more often and were able to perform fewer activities and instrumental activities of daily living, although this post hoc analysis was limited by a small sample size (eTable 2 in Supplement 2). Among patients who required an additional in-home physician visit, physicians performed a median of 2.5 (IQR, 1.0-3.0) additional in-home visits per patient.
Discussion
In this 2-site, noninferiority RCT of home hospital care delivery, we found that patients who received predominantly remote physician care compared with only in-home physician care had a noninferior number of adverse events and noninferior patient experience, although the ability to deliver in-home physician care for remote patients was critical to the care of 1 in 5 patients. Individual programs must decide, however, whether a potential increase in 2.8 adverse events per 100 patients is clinically meaningful to their program and patients.
Home hospital care traditionally has been delivered through in-home care teams with excellent clinical outcomes.6,15,16 One known inefficiency of home hospital care is the time required to travel to patients’ homes. Home hospital care models now lie on a spectrum with respect to physician care. On one end, some newer home hospital care models involve complete remote physician care to alleviate the physician’s travel burden, although the safety and efficacy of remote physician evaluation and management for acutely ill patients has been unclear. On the other end, in some models, physicians continue to see all patients in the home. Our model was a hybrid, lying perhaps in the middle of the spectrum, in that it required an initial in-home physician visit, allowed for additional in-home visits if deemed necessary, and depended heavily on a facilitated care interaction between the physician and patient whereby the nurse or paramedic performed examination maneuvers and served as a facilitator throughout the visit.
There are clear trade-offs to the remote physician model. On one hand, physicians have reduced travel burden and are thus able to spend more time selecting and recruiting patients in the hospital and caring for patients in general, increasing their efficiency. This approach could also in the future allow for physicians to cover a higher patient census or larger catchment areas and could facilitate expansion to more rural areas. On the other hand, nurse and paramedic visit times increased 8.5 minutes with remote care. This increase was almost certainly because a second pair of hands makes visits more efficient by allowing for accomplishing tasks in parallel rather than in sequence, helps teams be aligned on the care plan, and uses travel time to discuss patients and coordinate care. In addition, facilitating the physician’s evaluation requires additional time. Whether the value gained from remote physician visits outweighs the 8.5 minutes lost per visit for nurse and paramedic team members is a question each home hospital service should assess locally.
We did not test a fully remote physician model; therefore, our data do not support or refute fully remote physician care. However, it is likely that the remote group’s outcomes depended on and would not have reached noninferiority had these in-home physician visits not occurred. As a result, we believe it is necessary for any home hospital program to have the capacity to provide in-home physician visits. Given the important proportion of patients who required additional in-home physician visits despite randomization to the remote group, a fully remote model likely would underserve a sizable proportion of patients. These patients often did not speak English or had severe visual or auditory impairments, cognitive deficits, or complicated presentations that continued to require in-home physician examination. Although our data are limited when examining these patients’ sociodemographic characteristics, we believe our findings point to the importance of providing high-quality interpretation services that are integrated with the video system to ensure equity for patients who do not speak English as their primary language. It is likely that lack of integration between a telephone interpreter and the video connection resulted in degraded sound quality and required in-home visits for better communication. It is also possible that patients with fewer instrumental activities of daily living are likely to require in-home visits.
When clinicians are not forced into a randomization schema, they likely can tailor remote vs in-home visits based on the patient’s needs. For example, a clinician might choose in-home care when a patient is less stable, has a fluctuating physical condition, has multiple tasks to be completed, speaks a language different from the physician and/or nurse, has sensory impairments that cannot be overcome, or is cognitively impaired. Patients or their family may also have a strong preference for in-home care. In contrast, a patient progressing along the plan of care without large changes in management might be more amenable to remote care. The flexibility of the program design to allow for in-home visits when needed with most of the care delivered in a remote fashion may be most effective. Future work can include risk stratification algorithms to better understand which patients will do well in a model that includes remote visits and which will not.
Our work builds on others who have used remote physicians in acute care. In the traditional hospital setting, Gutierrez and colleagues35 demonstrated in a pre-post study the feasibility and acceptability of telehospitalist work for acutely ill adults on a medical ward but did not report on cases that could not be completed remotely. Kuperman and colleagues36 showed in a pre-post study that rural patients could receive safe care locally with a telehospitalist. Significant use of teleintensive care occurs, with likely a positive effect on mortality.37,38,39 In the home hospital setting, Sitammagari and colleagues40 demonstrated in a prospective case series a home hospital unit that used remote physician care for patients with COVID-19 with a reasonable safety profile (escalation rate, 13%; mortality, 0%). As noted above, our group was forced by the pandemic to deploy hybrid remote physician care for all patients, with good results.41 Compared with the current literature, this study adds a robust randomization schema and noninferiority analysis to examine the effect of remote physician care and allows for incorporation of remote care rather than strictly in-home care. Given the large number of new programs in the US, it also adds evidence for how to design in-home physician care.42 Many questions remain unanswered, including how deficits in remote care might be mitigated and where on the spectrum of remote vs in-home physician care is best.43
Limitations
Our study has limitations. First, we were forced to cease enrollment early because of the COVID-19 pandemic, although we were still able to demonstrate noninferiority of our primary outcome and 2 of our 3 secondary outcomes (but chose not to adjust for multiple testing among our 3 secondary outcomes). Second, we enrolled at 2 sites, limiting generalizability, although patients’ demographic characteristics were diverse by race and ethnicity, payer, educational status, and others. Third, loss to follow-up could have led to nonresponse bias for the patient experience measures. Study staff made 3 telephone calls at different times to attempt to mitigate loss to follow-up. Fourth, our noninferiority limit for adverse events, although determined a priori, was sizable given the actual adverse event rate we found empirically. In-home physician care would likely have been superior in any tighter definition of noninferiority than that used in this study or if patients in the remote care group were not offered in-home physician care when remote care was deemed inadequate. Because of our noninferiority design, clinicians, program directors, and policy makers can interpret the upper bound of the CI with respect to any threshold they consider appropriate and ascertain whether it falls within the CI. The value of this study is to provide these data, not to set policy or dictate a model for a particular hospital. Fifth, we allowed for up to a month-long window to conduct patient experience follow-up surveys, which could have led to variable recall bias toward the null. Sixth, it was not possible to blind the research assistant ascertaining adverse event occurrence, although these outcomes are objective and well defined to minimize bias.
Conclusions
When delivering acute care at home, remote physician care was generally acceptable and statistically noninferior to in-home physician care for patient safety and patient experience, although in-home physician visit capabilities when needed were critical to the remote physician group, and any system of remote physician care cannot be relied on in isolation. Given the home hospital model’s prior evidence base and newer data to suggest its role during COVID-19, expansion is important. Remote physician care may be a tool to significantly bolster a physician’s reach and efficiency when providing acute care, wherever a patient may be—at home, in the hospital, or elsewhere.44,45
Trial Protocol
eAppendix. Detailed Inclusion and Exclusion Criteria
eTable 1. Characteristics of Patients Who Enrolled and Declined
eTable 2. Characteristics of Patients Who Required In-home Visits vs Those Who Did Not, Among the Remote Group
Data Sharing Statement
References
- 1.FastStats. Health expenditures. Accessed December 3, 2018. https://www.cdc.gov/nchs/fastats/health-expenditures.htm
- 2.Hung WW, Ross JS, Farber J, Siu AL. Evaluation of the Mobile Acute Care of the Elderly (MACE) service. JAMA Intern Med. 2013;173(11):990-996. doi: 10.1001/jamainternmed.2013.478 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Covinsky KE, Pierluissi E, Johnston CB. Hospitalization-associated disability: “She was probably able to ambulate, but I’m not sure”. JAMA. 2011;306(16):1782-1793. doi: 10.1001/jama.2011.1556 [DOI] [PubMed] [Google Scholar]
- 4.Loyd C, Markland AD, Zhang Y, et al. Prevalence of hospital-associated disability in older adults: a meta-analysis. J Am Med Dir Assoc. 2020;21(4):455-461.e5. doi: 10.1016/j.jamda.2019.09.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Leff B. Defining and disseminating the hospital-at-home model. CMAJ. 2009;180(2):156-157. doi: 10.1503/cmaj.081891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Leff B, Burton L, Mader SL, et al. Hospital at home: feasibility and outcomes of a program to provide hospital-level care at home for acutely ill older patients. Ann Intern Med. 2005;143(11):798-808. doi: 10.7326/0003-4819-143-11-200512060-00008 [DOI] [PubMed] [Google Scholar]
- 7.Cryer L, Shannon SB, Van Amsterdam M, Leff B. Costs for ‘hospital at home’ patients were 19 percent lower, with equal or better outcomes compared to similar inpatients. Health Aff (Millwood). 2012;31(6):1237-1243. doi: 10.1377/hlthaff.2011.1132 [DOI] [PubMed] [Google Scholar]
- 8.Tibaldi V, Isaia G, Scarafiotti C, et al. Hospital at home for elderly patients with acute decompensation of chronic heart failure: a prospective randomized controlled trial. Arch Intern Med. 2009;169(17):1569-1575. doi: 10.1001/archinternmed.2009.267 [DOI] [PubMed] [Google Scholar]
- 9.Caplan GA, Sulaiman NS, Mangin DA, Aimonino Ricauda N, Wilson AD, Barclay L. A meta-analysis of “hospital in the home”. Med J Aust. 2012;197(9):512-519. doi: 10.5694/mja12.10480 [DOI] [PubMed] [Google Scholar]
- 10.Shepperd S, Doll H, Angus RM, et al. Avoiding hospital admission through provision of hospital care at home: a systematic review and meta-analysis of individual patient data. CMAJ. 2009;180(2):175-182. doi: 10.1503/cmaj.081491 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Shepperd S, Iliffe S, Doll HA, et al. Admission avoidance hospital at home. Cochrane Database Syst Rev. 2016;9(9):CD007491. doi: 10.1002/14651858.CD007491.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Board N, Brennan N, Caplan GA. A randomised controlled trial of the costs of hospital as compared with hospital in the home for acute medical patients. Aust N Z J Public Health. 2000;24(3):305-311. doi: 10.1111/j.1467-842X.2000.tb01573.x [DOI] [PubMed] [Google Scholar]
- 13.Caplan GA, Coconis J, Board N, Sayers A, Woods J. Does home treatment affect delirium? a randomised controlled trial of rehabilitation of elderly and care at home or usual treatment (The REACH-OUT trial). Age Ageing. 2006;35(1):53-60. doi: 10.1093/ageing/afi206 [DOI] [PubMed] [Google Scholar]
- 14.Caplan GA, Coconis J, Woods J. Effect of hospital in the home treatment on physical and cognitive function: a randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2005;60(8):1035-1038. doi: 10.1093/gerona/60.8.1035 [DOI] [PubMed] [Google Scholar]
- 15.Federman AD, Soones T, DeCherrie LV, Leff B, Siu AL. Association of a bundled hospital-at-home and 30-day postacute transitional care program with clinical outcomes and patient experiences. JAMA Intern Med. 2018;178(8):1033-1040. doi: 10.1001/jamainternmed.2018.2562 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Levine DM, Ouchi K, Blanchfield B, et al. Hospital-level care at home for acutely ill adults: a randomized controlled trial. Ann Intern Med. 2020;172(2):77-85. doi: 10.7326/M19-0600 [DOI] [PubMed] [Google Scholar]
- 17.Cai S, Intrator O, Chan C, et al. Association of costs and days at home with transfer hospital in home. JAMA Netw Open. 2021;4(6):e2114920. doi: 10.1001/jamanetworkopen.2021.14920 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Arsenault-Lapierre G, Henein M, Gaid D, Le Berre M, Gore G, Vedel I. Hospital-at-home interventions vs in-hospital stay for patients with chronic disease who present to the emergency department: a systematic review and meta-analysis. JAMA Netw Open. 2021;4(6):e2111568. doi: 10.1001/jamanetworkopen.2021.11568 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Levine DM, Desai MP, Ross J, Como N, Anne Gill E. Rural perceptions of acute care at home: a qualitative analysis. J Rural Health. 2021;37(2):353-361. doi: 10.1111/jrh.12551 [DOI] [PubMed] [Google Scholar]
- 20.Levine DM, Desai MP, Ross JB, Como N, Holley S. Scoping and testing rural acute care at home: a simulation analysis. BMJ Innov. 2021;7:539-547. doi: 10.1136/bmjinnov-2020-000592 [DOI] [Google Scholar]
- 21.Levine DM, Ouchi K, Blanchfield B, et al. Hospital-level care at home for acutely ill adults: a pilot randomized controlled trial. J Gen Intern Med. 2018;33(5):729-736. doi: 10.1007/s11606-018-4307-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Levine DM, Pian J, Mahendrakumar K, Patel A, Saenz A, Schnipper JL. Hospital-level care at home for acutely ill adults: a qualitative evaluation of a randomized controlled trial. J Gen Intern Med. 2021;36(7):1965-1973. doi: 10.1007/s11606-020-06416-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Raîche M, Hébert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr. 2008;47(1):9-18. doi: 10.1016/j.archger.2007.06.004 [DOI] [PubMed] [Google Scholar]
- 24.Galvin JE, Roe CM, Powlishta KK, et al. The AD8: a brief informant interview to detect dementia. Neurology. 2005;65(4):559-564. doi: 10.1212/01.wnl.0000172958.95282.2a [DOI] [PubMed] [Google Scholar]
- 25.Kroenke K, Spitzer RL, Williams JBW. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284-1292. doi: 10.1097/01.MLR.0000093487.78664.3C [DOI] [PubMed] [Google Scholar]
- 26.Ader DN. Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Med Care. 2007;45(suppl 1):S1-S2. doi: 10.1097/01.mlr.0000260537.45076.74 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med. 2004;36(8):588-594.https://www.ncbi.nlm.nih.gov/pubmed/15343421 [PubMed] [Google Scholar]
- 28.van Hout B, Janssen MF, Feng YS, et al. Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15(5):708-715. doi: 10.1016/j.jval.2012.02.008 [DOI] [PubMed] [Google Scholar]
- 29.Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179-186. doi: 10.1093/geront/9.3_Part_1.179 [DOI] [PubMed] [Google Scholar]
- 30.Logan MS, Myers LC, Salmasian H, et al. Expert consensus on currently accepted measures of harm. J Patient Saf. 2021;17(8):e1726-e1731. doi: 10.1097/PTS.0000000000000754 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Jenkinson C, Coulter A, Bruster S. The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14(5):353-358. doi: 10.1093/intqhc/14.5.353 [DOI] [PubMed] [Google Scholar]
- 32.Piaggio G, Elbourne DR, Pocock SJ, Evans SJW, Altman DG; CONSORT Group . Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594-2604. doi: 10.1001/jama.2012.87802 [DOI] [PubMed] [Google Scholar]
- 33.Donzé J, Aujesky D, Williams D, Schnipper JL. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med. 2013;173(8):632-638. doi: 10.1001/jamainternmed.2013.3023 [DOI] [PubMed] [Google Scholar]
- 34.Levine DM, Paz M, Burke K, Schnipper JL. Predictors and reasons why patients decline to participate in home hospital: a mixed methods analysis of a randomized controlled trial. J Gen Intern Med. 2022;37(2):327-331. doi: 10.1007/s11606-021-06833-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Gutierrez J, Moeckli J, Holcombe A, et al. Implementing a telehospitalist program between veterans health administration hospitals: outcomes, acceptance, and barriers to implementation. J Hosp Med. 2021;16(3):156-163. doi: 10.12788/jhm.3570 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kuperman EF, Linson EL, Klefstad K, Perry E, Glenn K. The virtual hospitalist: a single-site implementation bringing hospitalist coverage to critical access hospitals. J Hosp Med. 2018;13(11):759-763. doi: 10.12788/jhm.3061 [DOI] [PubMed] [Google Scholar]
- 37.Vranas KC, Slatore CG, Kerlin MP. Telemedicine coverage of intensive care units: a narrative review. Ann Am Thorac Soc. 2018;15(11):1256-1264. doi: 10.1513/AnnalsATS.201804-225CME [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lilly CM, Cody S, Zhao H, et al. ; University of Massachusetts Memorial Critical Care Operations Group . Hospital mortality, length of stay, and preventable complications among critically ill patients before and after tele-ICU reengineering of critical care processes. JAMA. 2011;305(21):2175-2183. doi: 10.1001/jama.2011.697 [DOI] [PubMed] [Google Scholar]
- 39.Fusaro MV, Becker C, Scurlock C. Evaluating tele-ICU implementation based on observed and predicted ICU mortality: a systematic review and meta-analysis. Crit Care Med. 2019;47(4):501-507. doi: 10.1097/CCM.0000000000003627 [DOI] [PubMed] [Google Scholar]
- 40.Sitammagari K, Murphy S, Kowalkowski M, et al. Insights from rapid deployment of a “virtual hospital” as standard care during the COVID-19 pandemic. Ann Intern Med. 2021;174(2):192-199. doi: 10.7326/M20-4076 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Levine DM, Mitchell H, Rosario N, et al. Acute care at home during the COVID-19 pandemic surge in Boston. J Gen Intern Med. 2021;36(11):3644-3646. doi: 10.1007/s11606-021-07052-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Levine DM, DeCherrie LV, Siu AL, Leff B. Early uptake of the acute hospital care at home waiver. Ann Intern Med. 2021;174(12):1772-1774. doi: 10.7326/M21-2516 [DOI] [PubMed] [Google Scholar]
- 43.Leff B, DeCherrie LV, Montalto M, Levine DM. A research agenda for hospital at home. J Am Geriatr Soc. 2022;70(4):1060-1069. doi: 10.1111/jgs.17715 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ouchi K, Liu S, Tonellato D, Keschner YG, Kennedy M, Levine DM. Home hospital as a disposition for older adults from the emergency department: benefits and opportunities. J Am Coll Emerg Physicians Open. 2021;2(4):e12517. doi: 10.1002/emp2.12517 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Bryan AF, Levine DM, Tsai TC. Home hospital for surgery. JAMA Surg. 2021;156(7):679-680. doi: 10.1001/jamasurg.2021.0597 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Trial Protocol
eAppendix. Detailed Inclusion and Exclusion Criteria
eTable 1. Characteristics of Patients Who Enrolled and Declined
eTable 2. Characteristics of Patients Who Required In-home Visits vs Those Who Did Not, Among the Remote Group
Data Sharing Statement

