Skip to main content
. 2017 May 12;12(5):e0177321. doi: 10.1371/journal.pone.0177321

Table 6. Summary of best-evidence synthesis.

Target population Instrument Internal consistency Reliability Measurement error Content validity Structural validity Hypothesis testing Cross-cultural validity Criterion validity Responsiveness
As a comprehensive construct
Physicians Self-administrated rating
DUQuE professionalism instrument [58] ? ? +
Multi Source Feedback
GMC patient and colleague questionnaires [39] ? +++
Patients’ opinion
Chandratilake’s general public scale [68] ? ?
Residents Self-administrated rating
Arnold scale (14-items) [43] ++ ++ ?
Arnold scale (12-items) [44] + +
Arnold scale (17-items) [45] ++ ++ ?
Gillespie’s scale [74] ? ? +
Simulation
ECFMG-CSA [59] --
p-OSCE [60] ++
Multi Source Feedback
p-360°evaluation [60] ++
Direct observation
UMDSPAI[61] ?
P-MEX[62–64] ? +++ ?
EPRO-GP instrument[38] ++
Nijmegen Professionalism Scale [66] ? ?
Adaptation of AACS fro foreigner [65] ++
p-mini-CEX [60] ++
Role model evaluation
Ephgrave’s Assessment[69] + ?
Professionalism environment
Gillespie’s scale [74] ? ? +
Medical students Self-administrated rating
Arnold scale (14-items) [43] ++ ++ ?
PSCOM Professionalism Questionnaire [46–48] +++ ++ +++ - --
Tsai ABIM questionnaire [49, 50] ++ ++ ?
PSIQ [52] ?
Blue’s Multiple instruments [51] ? ?
Jiang’s knowledge instrument [54] ++ --
LAMPS [55] +
Wittich Reflection instrument [56] ++ ?
The new PAS[57] ++ ? --
Peer assessment
Cottrell’s peer assessment [67] ?
Role model evaluation
Arnold’s scale-environment version [70] ? ++
PACT[72] ? ++
LEP survey[71] ++ ++
Nurses Self-administrated rating
Professionalism in Nursing Inventory [42] ? + ?
DUQuE professionalism instrument [58] ? ? +
Nursing students Self-administrated rating
Hisar’s instrument for nursing students [53] +++ ++ ? +++
Professionalism environment
PEFWQ [73] ++ -- ++ ++
As one facet of competence
Physicians Self-administrated rating
VPPVS [79] ++ ?
Multi Source Feedback
CPSA-PAR MSF for anesthesiologists [83] ? ++
CPSA-PAR MSF for emergency physicians[84] ? ++
CPSA-PAR MSF for pediatricians [85] ? ?
CPSA-PAR MSF for Psychiatrists[87] ? ?
CPSA-PAR MSF for physicians [88] ? ++
CPSA-PAR MSF for P&LMP [89] ? ?
Overeem’s MSF instruments [96] ++ ? ++ ?
Direct observation
Handoff CEX[106, 107] +/- +/-
Residents Self-administrated rating
Hotjat’s Jefferson competency scale[75] + + ?
ABIM Patient Assessment-self assessment version [76] ++ ++
Multi Source Feedback
Musick 360-degree instrument [81] ?
Wood’s 360-degree evaluation [82] ?
End-of-rotation evaluations [91] ++
EOS group 360-degree instrument[92–94] ? +++ ?
Senol’s Turkish 360-degree assessment [95] ? ?
CPSA-PAR MSF for international graduates [86] ? ?
Direct observation
ACGME-TRF [97] + ? ?
Global rating form for ACGME competencies [98] ++ ++
OCEX[100, 101] ? ++
ACGME general competencies [99] ?
Durning’s Supervisor’s evaluation form [102] ? ++ --
Durning’s Supervisor’s evaluation form-PGY3[103] ++ ++ --
COMPASS [105] +++ ? ++
ITER [108] + + +
Dong’s Graduates Form [109] ++ ++
Simulation
SDOT [110] ++
Jefferies’s OSCE of CanMEDS Roles [111] ? ?
Ponton-Carss Checklist of OSPRE [112] -- ? + -
RO&CA [113] +++ ? +
ACGME competency checklist of OSCE[114] ++ ?
CanMEDS OSCE [115] ? ?
Role model evaluation
Faculty Supervision Evaluation [116] ? ? ?
Colletti evaluation of clinical educators [117] + +
Smith instrument [120] ++ ? ? +
Medical students Multi Source Feedback
CPSA-PAR MSF for Middle eastern interns [90] ? ? ?
Role model evaluation
PFCI [118] +++ +++
Professionalism environment
MSSAPS [119] ++ ++ --
Nurses Self-administrated rating
NPVS-R [77, 78] ++ ? ++
NPRCS [80] +++ +++
Direct observation
Handoff CEX[106, 107] +/- +/-
Nursing students Direct observation
Karayurt nursing students’ performance [104] ++ ++