Introduction
Letters of reference are a cornerstone of the Canadian urology residency selection process. Structured reference letters (SRLs) have emerged as a potential solution to improve standardization and fairness; however, their acceptability and structure for Canadian urology residency selection remains unknown.
Methods
We conducted a survey of a purposively sampled panel comprising of program directors (PDs) and residents from Canadian urology residency programs. The survey included 10 items (five quantitative and five qualitative) addressing three domains: opinions on SRLs, recommended content, and preferred letter structure. Responses collected on seven-point Likert scales were summarized using medians and interquartile ranges, while qualitative data were analyzed using content analysis and frequency counts of codes.
Results
Nine responses (six PDs, three residents) were received from seven unique residency programs. There was strong support for incorporating SRLs into residency applicants (median 6 [IQR 6–7]) and moderate agreement that SRLs are superior to narrative letters (median 5 [IQR 4–6]). Perceived benefits included increased standardization of evaluations (88.9%), greater efficiency for letter writers and file reviewers (44.4%), enhanced transparency (33.3%), and improved accuracy in distinguishing applicant attributes (22.2%). Concerns regarding exclusive reliance on SRLs included diminished granularity in differentiating candidates (44.4%), inability to capture unique applicant experiences (33.3%), and reduced ability to convey personalized insights (22.2%). Recommended global assessment domains included teamwork and collaboration (77.8%), communication (77.8%), initiative and work ethic (55.6%), professionalism and reliability (44.4%), and receptiveness to feedback (22.2%). Urology-specific domains emphasized included procedural skills appropriate to level of training (55.6%), foundational urologic knowledge (44.4%), demonstrated commitment to urology (44.4%), and overall residency potential or program fit (22.2%). All respondents supported the inclusion of a narrative comment section.
Conclusions
Among a cohort of Canadian urology PDs and resident trainees, there was strong support for the incorporation of SRLs into residency selection, particularly when combined with a narrative component. Findings from this study can inform a Delphi-based process for SRL development, including pilot testing to assess feasibility, usability, and potential impact on applicant evaluation.



