Skip to main content
. 2017 Feb 20;7(2):e012431. doi: 10.1136/bmjopen-2016-012431

Table 3.

Alignment of return on investment in quality improvement capacity building assessments

Phillips’ ROI in Training and Improvement Model68 The Productive Ward Rapid Assessment69 Value of QI Educational Intervention24 Common Elements
Planning
  • Develop evaluation plan and baseline data

Gather relevant material
  • Collate existing work.

  • Investigate ROI approaches adopted elsewhere.

  • Decide on which perspective we need to address.

  • Clarify the aims and objectives of the improvement initiative.

  • Define the time period for the ROI analysis.



Who Benefits: the value of outcomes depends on the stakeholder perspective.

Timing of Analysis: prospective vs. retrospective
Planning

  • Stakeholder perspective of the economic assessment



  • Temporal perspective of the economic assessment

Define the elements of economic appraisal Cost Analysis: consider all costs used in service provision.
Discerning Benefits: a tangible measure of value is needed. Determine if changes in purchasing could be attributed to the training program.
Identifying costs
Data Collection
  • Reaction/Satisfaction

  • Learning

  • Application

  • Business impact

Identify data
Obtain improvement evidence
Identifying benefits
Identifying intangible benefits that will not be included in the ROI estimation
Isolate Effects of Program Discerning % attribution to each measure Discerning attribution
Data Analysis
  • Convert data to monetary value

  • Return in investment

  • Identify intangible benefits

Produce ROI impact assessment
  • Insert data into ROI calculator.

  • Report an overall ROI result.

  • Report costs and benefits to each organization/sector.

Calculate the ROI ROI calculations
Reporting
  • Include an assessment of the risks.

  • Articulate any assumptions made.

Assess the Sensitivity to changes in assumptions Sensitivity Analysis