Evaluation framework for SAGE program

Major evaluation questions	Indicators	Data sources	Data collection methods
Level 1: Residents’ and supervisors’ reactions
Are the residents satisfied with the SAGE program?	- Residents’ opinions	- Residents	- Questionnaire
Are residents’ scholarly supervisors satisfied with the SAGE program?	- Scholarly supervisors’ opinions	- Scholarly supervisors	- Questionnaire
Level 2: Residents’ learning
Do residents acquire the intended knowledge and skills to complete their research project?	- Residents’ opinions - # of completed projects - # of resident publications - # of presentations	- Residents - SAGE tracking logs	- Questionnaire - Document review
Level 3: Organization support & change
Are sufficient resources available to the residents to support their research projects?	- Residents’ opinions - Scholarly supervisors’ opinions - Research Institute staff members’ opinions	- Residents - Scholarly supervisors - Research Institute staff members	- Interviews
Are residents’ research successes recognized and shared within our institution?	- Residents’ opinions - Scholarly supervisors’ opinions	- Residents - Scholarly supervisors	- Interviews
Level 4: Residents’ use of new knowledge and skills
Are residents following the SAGE program's guidelines?	- # of submitted research question worksheets - # of submitted articles related to residents’ research ideas and methodology - # of submitted resident research proposals - # of submitted final resident research proposals	- SAGE tracking logs	- Document review
Are residents utilizing the research resources that have been developed or promoted by the SAGE program?	- # of residents using their dedicated research blocks - # of residents using the designated SAGE research training videos - # of residents attending SAGE rounds - # of residents accessing Research Institute services	- SAGE tracking logs - # of training video views - Research Institute staff members’ service logs	Document review
Level 5: Residents’ learning outcomes
Is the SAGE program increasing residents’ research productivity?	- # of residents submitting grant applications - # of residents obtaining research grants - # of residents presenting at the annual resident research day - # of residents presenting at conferences - # of residents publishing in peer-reviewed journals	- SAGE tracking logs	- Document review