Table 5.

Evaluation Plan for the ePROM intervention across an integrated chronic pain network

Outcome	Definition	Measure/Indicator
Implementation outcomes
Acceptability	Satisfaction with the ePROM system	Acceptability of Intervention Measure [1, 2]
Adoption	Utilization of the ePROM system	Adoption of Information Technology Innovation Measure % of clinicians using the ePROM system
Appropriateness	Perceived fit of the innovation: compatibility, usability, relevance	Intervention Appropriateness Measure [1, 2]
Compatibility	The degree of tangible fit between meaning and values attached to the intervention by involved individuals, how those align with individuals’ own norms, values, and perceived risks and needs, and how the intervention fits with existing workflows and systems [27].	Survey of Organizational Readiness for E-Health Open-ended questions
Usability	How useful, usable, and satisfying a system is for the intended users to accomplish goals in the work domain by performing certain sequences of tasks [33]	End-User Computing Satisfaction Questionnaire [3] Open-ended questions
Relevance	The cognitive impact, as well as any use and patient health benefit associated with the information derived from PROM scores	Information Assessment Method [4]
Feasibility	Actual fit of the innovation	Feasibility of Intervention Measure 2] System's web analytics, administrative data Examples of indicators: % of patients to whom an ePROM link was sent % of patients that filled ePROM before appointment
Fidelity	Innovation delivered as intended	Administrative data: % of patients admitted to the program who completed ePROM as planned
Implementation cost	Marginal cost, cost-effectiveness, cost–benefit	Cost of developing and implementing the ePROM system Screening for a program allocation Number of visits
Penetration	Reach, spread, access of the service	Administrative data Number of actual users divided by the total number of persons eligible to use the system
Sustainability	Maintenance, continuation, durability, incorporation, integration, institutionalization, sustained use	Sustainability questionnaire
Impact outcomes
Patient-centred care	Providing care that is respectful of, and responsive to, individual patient preferences, needs and values, and ensuring that patient values guide all clinical decisions	Patient Assessment of Chronic Illness Care + [5, 6]
Workability	Work ability and productivity	Are you working at a physically less demanding job now because of your pain? What is your current work status? How long after you received treatment for pain did you return to work?
Health status	Individuals’ general health perceptions	EQ-5D-5L [7] VAS [8]
Medication adherence	Adherence to prescribed medication	Morisky 8 Medication Adherence Questionnaire [9, 10]
Global health	Individual’s physical, mental, and social health	Global health: PROMIS short form [11]
Adherence to treatment	Adherence to clinicians’ recommendations	Single item VAS [8]