ABSTRACT
In this review, we gathered information about competency-based admissions and holistic admissions related to healthcare education to understand current practices better and offer recommendations within the healthcare education field. A literature search was conducted to gather peer-reviewed articles detailing information related to competency-based admissions and holistic admissions that have been implemented in healthcare education, including medical schools, nursing schools, dental schools, and other allied health fields. After screening and the addition of articles through ancestral search, 166 articles were included in this systematic review. The articles were coded for information related to definitions of competency-based admissions and holistic admissions, specific desired competencies, procedures to evaluate these competencies, outcomes of these practices, and the success of admitting well-prepared students using these practices. Results show there is wide variation in established definitions and desired competencies. Similarly, there was some variation in methods for evaluating these competencies with some common practices identified. Lastly, little evidence demonstrates the effectiveness of admitting students who are well-prepared for their programs when competency-based or holistic admissions are employed. There is a need for future research to establish a standard definition for both competency-based admissions and holistic admissions. Desired competencies should be established based on the program’s mission and vision statements for what type of students they want to admit. Lastly, future research needs to focus on the long-term outcomes of implementing these practices.
KEYWORDS: Competency-based admissions, holistic admissions, admissions practices, healthcare education, medical education
Introduction
For many health professions education programs, admissions practices are moving toward a competency-based admission (CBA) or holistic admission (HA) approach rather than evaluating applicants solely on academic metrics, which has historically been the practice [1]. Although the health professions span many different fields including medical, nursing, dentistry, animal science, and more, these education programs have shifted toward these admissions practices to ensure that they are admitting well-prepared students who mirror the ever-changing demographic of the United States population [1–5], to health professions education programs implementing more holistic admissions practices. With this shift, variation in how health professions programs develop and implement CBA and HA, specifically in what competencies and qualities health professions programs desire and how they are assessing those competencies and qualities may attenuate the effectiveness of CBA and HA. This might lead to reluctance of programs in other health professional programs across fields to adopt these types of practices. Best practices for implementation have not been defined, which leaves little guidance for health professions programs that are looking to move toward CBA or HA in their own admissions processes. Therefore, the present review sought to explore all health professions education programs that implement and use CBA and HA.
Study purpose and research questions
The present systematic review was conducted to gather information about CBA and HA practices within health professions fields to better understand practices and related challenges and benefits. Specifically, we asked four research questions:
How do health professional education programs define and operationalize CBA and HA?
When implementing CBA or HA, what do health professional education programs use as the competencies to determine if a student is well prepared for their program?
When implementing CBA or HA, how do health professional education programs assess their set competencies?
How effective are health professional education programs in admitting students who are well prepared to succeed within their programs using CBA or HA?
Findings from this review contribute to evidence supporting future development and implementation of CBA and HA and highlight the needs of future research.
Methods
Selection criteria and search procedures
The aim of this review was to gather and synthesize information about CBA and HA in health professions education programs to better understand how those programs are using and implementing CBA and HA. Selection criteria included peer-reviewed articles published from 2000 to the date that the literature search was completed, in August 2023. This publication range was used to capture how practices changed within the last decade as well as the most current publications related to CBA and HA. Additional inclusion criteria required that articles discussed CBA or HA within health professional education programs. This included programs within animal science, dental, medical, nursing, pharmaceutical, veterinary, and other healthcare and allied health fields, in addition to some residency and fellowship programs. Although there is a wide variation across these types of programs, they were selected to encompass how CBA and HA have been utilized and implemented to inform future practices in fields where these practices are not commonplace. Specifically, this review was done in partnership with the Admissions and Recruitment Committee of the American Association of Veterinary Medical Colleges to inform recommendations to veterinary medical colleges regarding the implementation of CBA and HA. Additionally, due to the lack of the literature synthesizing how CBA and HA have been implemented, the current review was mainly interested in gathering information about the process of using CBA and HA.
Although this project initially aimed to explore CBA practices in health professions education, an initial literature search showed a very small number of articles specifically discussing CBA. However, within this initial search, a related concept of HA emerged as a similar practice that has been more widely implemented. Due to the exploratory nature of this project, and due to the similarities in CBA and HA, it was decided to include both articles discussing CBA and HA to capture a wider scope of the literature surrounding more comprehensive and competency focused admissions practices.
Exclusion criteria included omitting any articles that focused on undergraduate education programs. Additionally, master’s theses and doctoral dissertations were excluded as they did not meet the inclusion requirement of being peer-reviewed. In the initial literature searches, some articles emerged that investigated CBA and HA in fields outside of the health professions, which were excluded from this review.
A comprehensive and systematic search of the medical education and allied health fields education literature was conducted between 15 May and 19 May 2022 using ERIC-EBSCO, MEDLINE (PubMed), Web of Science, CABI (the database for international literature related to agriculture, health, and the life sciences), and CABI VetMed (the database for veterinary information to support practice, based on evidence and continuing education). The search strategy used for each database included 18 searches within each database using the combination of ‘competency based admission’ or ‘holistic admission’ with the following keywords: ‘allied health’, ‘animal science’, ‘dental education’, ‘healthcare’, ‘healthcare education’, ‘medical education’, ‘nursing education’, ‘pharmacy education’, and ‘veterinary education’. Admissions and health education experts including members of the Admissions and Recruitment Committee of the American Association of Veterinary Medical Colleges were consulted in the development of keywords and the selection of databases.
The results from all databases yielded 3,477 total results, and 44 articles were added through ancestral search [6] of included articles, leaving a total of 3,521. Following the deletion of duplicates, 1,180 articles remained to be screened. Screening and decisions regarding the eligibility of articles at each screening phase were conducted by both authors, who met weekly to review decisions and discuss discrepancies. Any discrepancies that arose were discussed till an agreement was met between the authors. Initial screening of the abstracts using inclusion criteria resulted in an exclusion of 882, leaving 298 items for the following phase of review. The next phase of review included reading through each article and extracting pertinent information related to the research questions and excluding any articles that, upon further review, did not meet our inclusion criteria. Following all reviews of the gathered corpus of the literature, 166 articles were retained and included. Details of the database search and results are shown as a PRISMA flow diagram in Figure 1.
Figure 1.

PRISMA (preferred reporting items for systematic reviews and meta-analysis) diagram showing the article selection procedure.
Coding protocol
The information extraction process was conducted using a Microsoft Excel spreadsheet [7] which was created using information exported from Zotero reference indexing program [8]. One coder (author 1) reviewed each article individually to determine if they contained any relevant information that addressed the research questions. If any relevant information was found, it was summarized by the coder in an Excel sheet (see supplemental material for template with example articles coded). Due to the large number of articles included, a random subset of articles (20%) was independently coded by a second coder (author 2), following the same method. The decision to have the coders summarize the information that addressed each research question was made due to the fact that the articles were more descriptive and qualitative [9,10]. Through this method, there was an adequate level of agreement between the coders, indicating that they identified the same information that addressed each research question. If present, information that addressed the research questions was extracted from each article. Additionally, each article was coded to indicate whether they discussed CBA or HA, what health professions was discussed, and any challenges noted as a part of implementing CBA or HA within specific practices. Also, due to this review’s exploratory nature, any additional information that could inform future design and implementation of CBA or HA was recorded for thematic analysis.
Results
A total of 166 articles were included in this review. Table 1 lists all articles included, type of education program, country of origin, and whether they were using the terminology CBA or HA. For the articles that were double-coded, there was a consensus regarding the information extracted that addressed each research question.
Table 1.
Articles included in the systematic review including type of program, country of origin, and terminology used.
| Article (Listed by Author) | Type of Program | Country of Origin | Terminology Used |
|---|---|---|---|
| Abrams et al. [11] | Medical School | United States | Holistic Review/Assessment |
| Ackerman-Barger et al. [2] | Nursing School | United States | Holistic Review |
| Ahluwalia and Swanwick [12], | Residency Program for General Practitioners | United Kingdom | Competency Based Assessment |
| Ahmed et al. [13] | Residency Program for General Practitioners | United Kingdom | Competency Based Selection |
| Ahmed et al. [14] | Residency Program for General Practitioners | United Kingdom | Competency Based Selection |
| Aibana et al. [3] | Internal Medicine Residency | United States | Holistic Review |
| Akintade et al. [15] | Nursing School | United States | Holistic Admissions |
| Akoh et al. [16] | Dermatology Residency | United States | Holistic Review |
| Albanese et al. [17] | Medical School | United States | Competencies |
| Alpern et al. [18] | Medical School | United States | Competencies |
| Anderson et al. [19] | Medical School | United States | Holistic Review |
| Anderson et al. [20] | Medical School | United States | Holistic Review |
| Andreou et al. [21] | Residency Program for General Practitioners | Belgium | Competencies |
| Angus et al. [22] | Internal Medicine Residency | United States | Holistic Review |
| Artinian et al. [4] | Health Profession | United States | Holistic Review |
| Bajwa et al. [23] | Pediatrics Residency | Switzerland | Competencies |
| Bajwa et al. [24] | Pediatrics Residency | Switzerland | Competencies |
| Ballejos et al. [25] | Bachelors/Doctor of Medicine | United States | Holistic Review |
| Bandiera et al. [26] | Medical School | Canada | Competencies |
| Barceló et al. [27] | Psychiatry Residency | United States | Holistic Review |
| Barton et al. [28] | Second Degree Nursing | United States | Holistic Admissions |
| Baugh [29], | Medical School | United States | Holistic Approach/Review |
| Bennett et al. [30] | Nursing School | United States | Holistic Admissions/Review |
| Bice et al. [31] | Nursing School | United States | Holistic Review |
| Bird et al. [32] | Medical School | United States | Holistic Assessment/Competencies |
| Bird et al. [33] | Medical Residency | United States | Holistic Screening/Selection/Competency |
| Blamoun et al. [34] | Medical Residency | United States | Holistic Selection Process |
| Boatright et al. [35] | Graduate Medical Education | United States | Holistic Review |
| Booker et al. [36] | Dental School | United States | Holistic Admissions |
| Brenneman et al. [37] | Physician Assistant | United States | Holistic Admissions/Competency Based Admissions |
| Brotherton et al. [38] | Occupational Therapy | United States | Holistic Admissions/Review |
| Buchs and McDaniel [39], | Physician Assistant | Germany | Competencies |
| Burk-Rafel et al. [40] | Medical Residency | United States | Holistic Review |
| Bußenius and Harendza [41], | Medical School | United States | Psychosocial Competencies |
| Canham et al. [42] | Physical Therapy | United States | Holistic Review |
| Chaviano-Moran et al. [43] | Dental School | United States | Holistic Review/Admissions |
| Chaviano-Moran et al. [44] | Dental School | United States | Holistic Review/Admissions |
| Choi et al. [45] | Pharmacy School & Other Health Professions | N/A | Holistic Review/Admissions |
| Conlon et al. [46] | Veterinary School | Canada | Non-Technical Competencies |
| Conrad et al. [47] | Medical School | United States | Holistic Review |
| Coplan and Evans [48], | Physician Assistant | United States | Holistic Admissions/Review |
| Crandall et al. [49] | Veterinary School | Canada | Communication Competency |
| Crosby et al. [50] | Nursing School | United States | Critical Competencies/Characteristics |
| Cunningham et al. [51] | Nursing School | United States | Holistic Review/Judgement |
| Davis et al. [52] | Nursing School | United States | Holistic Admission Review |
| DeWitty [53], | Nursing School | United States | Holistic Admissions |
| DeWitty and Byrd [54], | Healthcare Professions | United States | Holistic Admissions |
| Diaz et al. [55] | Medical School | United States | Holistic Admissions |
| DiBaise et al. [56] | Physician Assistant | United States | Holistic Admissions |
| Dong et al. [57] | Medical School | United States | Holistic Review |
| Doukas et al. [58] | Medical School | United States | Competencies-Based Account of Professionalism |
| Eva et al. [59] | Health Profession | Canada | Competencies |
| Felix et al. [60] | Medical School | United States | Holistic Admissions Process |
| Fleming et al. [61] | Dental School | United States | Holistic Admissions |
| Francis et al. [62] | Doctorate in Social Work | United States | Holistic Admissions |
| Gallahue et al. [63] | Medical Residency | United States | Holistic Review/Behavioral Competencies |
| Gay et al. [64] | Medical School | United States | Holistic Review |
| Geng et al. [65] | Dental School | China | Competencies |
| Glazer et al. [66] | Nursing School | United States | Holistic Admissions Review |
| Glazer et al. [67] | Health Profession | United States | Holistic Review |
| Gliatto et al. [68] | Medical School & Residency | United States | Holistic Review |
| Goldgar et al. [69] | Physican Assistant | United States | Admission Competencies/Noncognitive Skills |
| Gould et al. [70] | Nursing School | United States | Holistic Admissions |
| Grabowski [71], | Medical School & Residency | United States | Holistic Review |
| Grbic et al. [72] | Medical School | United States | Holistic Review |
| Guiberson and Vigil [73], | SpeechLanguage Pathology | United States | Holistic Review |
| Hackett and Ruyak [74], | Nursing School | United States | Holistic Review |
| Hampton et al. [75] | Nursing School | United States | Holistic Admissions Review |
| Hampton and Apen [76], | Nursing School | United States | Holistic Admissions Review |
| Hampton et al. [77] | Nursing School | United States | Holistic Admissions Review |
| Hänsel et al. [78] | Medical School | Germany | Non-Cognitive Competencies |
| Hanson and Eva [79], | Medical School | United States and Canada | Holistic Review/Competencies |
| Hanson et al. [80] | Medical School | Canada | Holistic Review/Assessment/Approach |
| Harrison [81], | Medical School | United States and Canada | Holistic Review |
| Henderson et al. [82] | Medical School | United States | Holistic Admissions |
| Henderson et al. [83] | Medical School | Canada | Holistic Admissions |
| Hofmeister et al. [84] | Family Medicine Residency | Canada | Competencies |
| Houlahan et al. [85] | Nursing School | United States | Holistic Admissions |
| Hunker and Robb [86], | Doctor of Nursing | United States | Holistic Admissions/Criteria |
| Hupp [87], | Medical Residency | N/A | Holistic Admissions |
| Jerant et al. [88] | Medical School | United States | Holistic Recruitment Approaches |
| Jones et al. [89] | Medical School | United States | Holistic Admissions |
| Jung et al. [90] | Nursing School | United States | Holistic Admissions |
| Katsufrakis et al. [91] | Medical School & Residency | United States | Holistic Review |
| Katz and Vinker [92], | Medical School | Israeli | Holistic Rubric |
| Kennedy et al. [93] | Medical School | United States | Holistic Approach |
| Kerrigan et al. [94] | Medical School | United States | Competency-Based Admissions/Holistic Review |
| Kim et al. [95] | Medical School | Korea | Non-Academic Competencies |
| King et al. [6] | Medical School | United States | Holistic Application Review |
| Knorr and Hissbach [96], | Healthcare Professions | N/A | Competencies/Non-Cognitive Attributes |
| Ko and Ton [97], | Medical School | United States | Holistic Review |
| Koenig et al. [98] | Medical School | United States | Personal Competencies |
| Kreiter [99], | Medical School | United States | Holistic Based-Admission Process |
| Kreiter and Axelson [100], | Medical School | United States | Holistic/Personal Competencies |
| Künzel and Breit [101], | Veterinary School | Austria | Social Competency |
| Lancaster et al. [102] | Nursing School | United States | Holistic Admissions |
| Langer et al. [103] | Medical School | United States | Holistic Review Process |
| Lee [104], | Medical School | United States | Holistic Review |
| Lewing et al. [105] | Doctor of Pharmacy | United States | Holistic Approach using Holistic Composite Score |
| Lewis et al. [106] | Nursing School | United States | Holistic Review/Admissions |
| Lewis [107], | Accelerated Baccalaureate Nursing | United States | Holistic Admissions |
| Maher et al. [108] | Occupational Therapy | United States | Holistic Admissions |
| Mahon et al. [109] | Medical School | United States | Holistic Admissions/Review and Competency-Based Admissions |
| Mann et al. [110] | Baccalaureate Nursing | United States | Holistic Admissions |
| Marshall et al. [111] | Hematology-Oncology Fellowship | United States | Holistic Review Process |
| Marvin et al. [112] | Psychiatry Residency | United States | Holistic Review |
| Mason et al. [113] | Medical School | United States | Holistic Review |
| Matthews et al. [114] | Nursing School | United States | Holistic Admissions/Review |
| McGaghie and Kreiter [115], | Higher Education & Healthcare Professions | United States | Holistic Review |
| Morrow [116], | Nursing School | United States | Holistic Admissions Review |
| Moynahan [117], | Medical Education (Undergraduate & Graduate) | United States | Holistic Admissions |
| Murray [118], | Nursing School | N/A | Holistic Admissions Process |
| Murray and Noone [119], | Nursing School | United States | Holistic Admissions |
| Murray et al. [120] | Nursing School | United States | Holistic Admissions Review Process |
| Nakae et al. [121] | Medical School | United States | Holistic Review |
| Nakae et al. [122] | Medical School | United States | Holistic Review |
| Nehemiah et al. [123] | General Surgery Residency | United States | Holistic Review |
| Nguyen et al. [124] | Health Profession | United States | Holistic Admissions/Review/Framework |
| Nohria et al. [125] | Pharmacy School | United States | Holistic Review |
| Noone and Najjar [126], | Nursing School | United States | Holistic Admissions |
| Okorie-Awé et al. [127] | Pharmacy School | United States | Holistic Review |
| Patterson et al. [128] | General Practice Residency | United Kingdom | Competency Based Selection System |
| Price & Grant-Mills [129] | Dental School | United States | Holistic Application Review |
| Price et al. [130] | Dental School | United States | Holistic Admissions |
| Radabaugh et al. [131] | Medical School | United States | Holistic Assessment/Competency |
| Randall et al. [132] | Pediatrics Residency | United Kingdom | Competency Based Center |
| Relf [133], | Nursing School | United States | Holistic Review |
| Roach et al. [134] | Baccalaureate Nursing | United States | Holistic Review |
| Roberts et al. [135] | Medical School | Australia | Competency-based Selection |
| Roberts [136], | Medical School | United States | Holistic Review |
| Robinett et al. [137] | Medical School | United States | Holistic Review |
| Rosenberg [138], | Medical School | United States | Holistic Review |
| Schreurs et al. [139] | Medical School | Netherlands | Competencies |
| Schreurs et al. [140] | Medical School | Netherlands | Competencies/Holistic Review |
| Schulz et al. [141] | Urology Residency Program | United States | Holistic Review |
| Schuster et al. [142] | Medical School | United States | Holistic Admissions |
| Scott and Zerwic [143], | Nursing School | United States | Holistic Admissions |
| Sims and Lynch [144], | Medical School | United States | Holistic Review |
| Sklar [145], | Health Profession | United States | Holistic Admissions |
| Smith et al. [146] | Residency Program | United Kingdom | Competency-based Assessments |
| Sommers et al. [147] | Nursing School | Indonesia | Holistic Admissions |
| Sommers et al. [148] | Baccalaureate Nursing | Indonesia | Holistic Admissions |
| Spector and Railey [149], | Neurology Residency | United States | Holistic Review |
| Stratton & Elam I [150] | Medical School | United States | Holistic Review |
| Thomas and Dockter [151], | Medical School | United States | Holistic Review |
| Thompson and Sonke [152], | Nursing School | United States | Holistic Admissions Review Process |
| Tidwell et al. [153] | Surgical Residency | United States | Holistic Review |
| Trivedi et al. [154] | Veterinary School | United States | Holistic Review |
| VanderMeulen et al. [155] | Physician Assistant | United States | Holistic Admissions |
| [156] | Health Profession | United States | Holistic Admissions Process |
| Veesart and Cannon [157], | Undergraduate Nursing | United States | Holistic Admissions |
| Vermeulen et al. [158] | General Practice Residency | Netherlands | Competency-based Selection |
| Vermeulen et al. [159] | General Practice Residency | Netherlands | Competency-based Selection |
| Vick et al. [160] | Medical School | United States | Holistic Review |
| Wagner et al. [161] | Nursing School | United States | Holistic Admissions |
| Wall et al. [162] | Pharmacy School | United States | Holistic Review |
| Wells et al. [163] | Dental School | United States | Holistic Admissions Review |
| Wilcox and Lawson [164], | Health Profession | United States | Holistic Review |
| Wildermuth [165], | Physician Assistant | United States | Holistic Admissions Review |
| Wilson et al. [166] | Dental School | United States | Holistic Review |
| Wise et al. [167] | Physical Therapy | United States | Holistic Review |
| Witzburg and Sondheimer [168], | Medical School | United States | Holistic Review |
| Wros and Noone [169], | Nursing School | United States | Holistic Admissions |
| Zaidi et al. [170] | Medical School | United States | Holistic Evaluation/Approach |
| Zerwic et al. [171] | Nursing School | United States | Holistic Admissions |
| Zimnicki et al. [172] | Nursing School | United States | Holistic Admissions Review |
This table includes all articles that were included in the present systematic review. Type of program, country of origin, and terminology for each article are included.
Article characteristics
Articles included were published between the years 2000 and 2023. The most common healthcare education programs included were medical schools (n = 54, 32.5%), nursing schools (n = 34, 20.5%), dental schools (n = 9, 5.4%), and health professions (non-specified; n = 9, 5.4%). Other included programs were more specialized (see Table 1 for full list). Most articles focused on healthcare education within the United States, however other countries were mentioned including Canada, the Netherlands, and the United Kingdom (see Table 1).
RQ1)
How do health professional education programs define and operationalize CBA and HA? The first aim of this systematic review was to identify how health education programs define and operationalize CBA. Thirty-one articles explicitly discussed competencies related to admissions in some capacity. Those articles differed in the terminology for what they called ‘competencies’. For example, articles often referenced these competencies as non-cognitive skills, non-cognitive attributes, non-academic competencies, non-technical competencies, or psychosocial competencies. Like the variation in terminology, definitions of competencies related to admissions or competencies desired in applicants varied widely, with more than half of the articles not providing an explicit definition of CBA. Kerrigan et al. [94] came the closest to providing an outcome of CBA, stating that it provides greater flexibility and reduces barriers to admissions. Similarly, multiple articles used the terminology ‘competency-based selection’ but like CBA, no concrete definition was provided. Other articles described foundational competencies or skills including empathy and sensitivity, communication and other professionalism skills, and critical thinking that were deemed necessary for practicing physicians or other related professionals. However, Kerrigan et al. [94], along with seven other articles [32,33,37,79, [100,109,140], mentioned competencies or CBA as either equivalent or part of HA. Due to this evidence, this review will discuss findings related to both types of admissions practices.
The remaining 135 articles discussed holistic admissions or holistic review which were found to be used interchangeably. Sixty-one of those articles defined holistic review using a definition provided by the Association of American Medical Colleges (AAMC) [173]
… a flexible, individualized way of assessing an applicant’s capabilities by which balanced consideration is given to experiences, attributes, and academic metrics (E-A-M) and, when considered in combination, how the individual might contribute to value as a medical student and future physician. (p. ix)
In addition to this definition, many articles also cited the core principles that the AAMC recommends schools integrate into the holistic admission process. These principles include (1) having selection criteria be broad in nature and linked to the school’s mission and goals, as well as promote diversity, (2) that the selection criteria include experiences and attributes in addition to academic performance, and (3) that schools should consider each applicant’s potential contribution to both the school and the field, allowing the school to weigh and balance the range of criteria for admission to their programs.
Sixty-two other articles that describe HA, had definitions which followed similar themes of the AAMC definition, stating that holistic review/admissions focus on reviewing applicants’ qualities, characteristics, attributes, experiences, and background to gain a more holistic or complete picture of each applicant and how they might contribute to the mission and goals of the program as well as how they might contribute to the field (e.g. [102,127,129,150,164]. Furthermore, increasing diversity was noted as the main goal of designing and implementing holistic admissions or review. For example, Anderson et al. [20] stated that holistic review has been characterized to address racial health disparities by increasing physician workforce diversity.
With the lack of a clear definition for CBA or HA, many programs have noted that there is a demand for consensus which would aid in explaining the need for changes in admissions to schools’ upper administration and stakeholders, which has been noted as a challenge to implementation [36,66,110].
RQ2)
When implementing CBA or HA, what do health professional education programs use as the competencies to determine if a student is well-prepared for their program? Our second goal was to identify what competencies health education programs were using to identify well-prepared students to admit to their programs. Competencies listed from programs that were discussing CBA or using competencies as part of admissions, included communication skills, personal and professional development, leadership, empathy and sensitivity, teamwork, conceptual/critical thinking and problem-solving skills, along with other personal attributes (for full list see Table 2). Additionally, articles also mentioned clinical competencies or required a specific level of medical knowledge as a desired competency for admission.
Table 2.
Competencies mentioned in articles discussing CBA by count and percentage.
| Competency | Number of Articles Mentioned | Percent of Articles Mentioned |
|---|---|---|
| Communication | 20 | 12 |
| Ethical/Integrity | 13 | 8 |
| Medical/Clinical Knowledge | 12 | 7 |
| Adaptability/Coping with Stress | 10 | 6 |
| Teamwork/Collaboration | 10 | 6 |
| Empathy/Sensitivity | 8 | 5 |
| Critical Thinking | 6 | 4 |
| Interpersonal/Social Skills | 6 | 4 |
| Professionalism | 6 | 4 |
| Leadership Experience | 4 | 2 |
| Problem Solving | 4 | 2 |
| Resiliency | 4 | 2 |
| Cultural Competence | 3 | 2 |
| Motivation | 3 | 2 |
| Personal Management Skills | 3 | 2 |
| Service Oriented/Community Service | 3 | 2 |
| Sound Judgement | 3 | 2 |
| Capacity for Improvement | 2 | 1 |
| Clinical Experience | 2 | 1 |
| Health Advocate | 2 | 1 |
| Altruism | 1 | 1 |
| Cognitive Ability | 1 | 1 |
| Scholar | 1 | 1 |
This table includes all the competencies listed in articles discussing competency-based admissions.
Comparably, articles discussing HA included similar characteristics or qualities, however, programs integrated those characteristics and qualities into the E-A-M model provided by the Association of American Medical Colleges [173]. Experiences that admissions committees deemed important for evaluation included clinical exposure, community service, research, military experience, hardships, experience with diverse cultures, and extracurricular experiences. Attributes that were seen as important for evaluation in the admission process included socioeconomic status, gender, race, ethnicity, leadership, altruism, communication skills, collaboration/teamwork, critical thinking and problem-solving skills, and ethics. And academic Metrics that were noted as important for evaluation in the admissions process included grade point average (GPA) and field-specific entrance exam scores (i.e. Medical College Admissions Test, Graduate Record Exam, Test of Essential Academic Skills, etc.). Although not all programs that discussed HA used the E-A-M framework when determining the desired characteristics and qualities of applicants, most other characteristics and qualities listed can fall into this framework. See Table 3 for full list of characteristics included in the articles.
Table 3.
Qualities, attributes, and experiences mentioned in articles discussing HA by count and percentage.
| Quality, Attribute, or Experience | Number of Articles Mentioned | Percent of Articles Mentioned |
|---|---|---|
| Service Orientation/Community Service | 31 | 19 |
| Leadership Experience | 24 | 14 |
| Life Experiences/Adversity | 19 | 11 |
| Communication | 14 | 8 |
| Diversity (Student Identifies with an Underrepresented Group) | 14 | 8 |
| Socioeconomic Status | 14 | 8 |
| Race/Ethnicity | 13 | 8 |
| Ethical/Integrity | 12 | 7 |
| Gender | 12 | 7 |
| Teamwork/Collaboration | 12 | 7 |
| Clinical Experience | 11 | 7 |
| Motivation | 10 | 6 |
| Critical Thinking | 9 | 5 |
| Desire to Learn/Intellectual Curiosity | 9 | 5 |
| Altruism | 8 | 5 |
| Cultural Competence | 8 | 5 |
| Language Proficiency/Multilingual | 8 | 5 |
| Professionalism | 8 | 5 |
| Resiliency | 8 | 5 |
| 1st Generation College Student | 7 | 4 |
| Good Self-Concept/Confident | 7 | 4 |
| Interpersonal/Social Skills | 7 | 4 |
| Work Experience | 6 | 4 |
| Empathy/Sensitivity | 5 | 3 |
| Age | 4 | 2 |
| Health/Patient Advocate | 4 | 2 |
| Problem-Solving | 4 | 2 |
| Veteran/Military Service | 4 | 2 |
| Extracurricular Activities | 3 | 2 |
| Geographic Location (Rural, Urban, Vicinity to Program) | 3 | 2 |
| Capacity for Improvement | 2 | 1 |
| Clinical Knowledge | 2 | 1 |
| Disability (Self-Identified) | 1 | 1 |
| Manual Dexterity | 1 | 1 |
This table includes all the qualities, attributes, and experiences that were listed in articles discussing holistic admissions.
RQ3)
When implementing CBA or HA, how do health professional education programs assess their set competencies? Aim three of our review was to evaluate how healthcare education programs that have implemented CBA assess their target competencies. Although a wide range of desired competencies were identified, many programs used similar methods of assessing those competencies. Overall, there were common methods for evaluating competencies across programs, and methods of assessment did not differ between programs that employed CBA or HA.
Interviews
Across the articles, the most cited method used to review applicants and assess desired competencies was interviews. Forty-two percent of papers cited interviews as the most frequent tool for assessing competencies. Traditional interviews as well as more progressive forms of interviews were mentioned, including multiple mini-interviews. Multiple mini-interviews are an increasingly popular form of interviews in the health sciences fields [96]. The most common format for multiple mini-interviews consists of several short assessments, or stations, that can last anywhere from 10 minutes to an hour. In these assessments, applicants are asked questions by an interviewer or asked to participate in a role-play scenario where they are observed by individuals participating in the scenario or individuals viewing the scenario [96]. During multiple mini-interviews, interviewers and observers are looking for markers of desired competencies within applicants. Multiple mini-interviews have gained popularity due to their ability to have multiple individuals observe and assess applicants while also providing an opportunity to see how they react to various scenarios that they might encounter in their field.
Standardized video interview
In 2016, the AAMC introduced the Standardized Video Interview where applicants were asked to provide oral responses to several competency-focused questions while being video recorded [33]. Although this method has been used by many different types of programs, it is a particularly well-used method for residency program admissions [33]. Applicants’ responses are then evaluated and scored, like a traditional interview, where the reviewer is looking for evidence that the applicants possess the desired competencies. This also allows multiple reviewers to view each applicants’ responses to ensure a consensus regarding each applicant. The Standard Video Interview is seen as an alternative to traditional interviews that do not require organizing a real-time interview, allowing students to submit their responses at a time of their choosing.
Personal statements and essays
Personal statements and essays were found to be other popular methods of assessing competencies in admissions for healthcare education programs. Although these tools have been staples of admissions processes [174], standardization of these tools has been a key practice when implementing them into CBA and HA. Including more explicit and detailed prompts and questions for personal statements and essays has helped standardize these assessments. An example essay question from an accelerated Bachelor of Science in nursing program’s HA process asks applicants ‘Why do you want to be a nurse? Include your academic, professional, and life experiences and how they are relevant to the nursing profession. Include your professional nursing goals’ [106]. By standardizing these tools, programs have noted an improvement of interrater reliability and predictive validity compared to non-standardized tools [100].
Letters of recommendation
Standardized letters of recommendation have also become more common in admissions, with programs providing form letters of recommendation to recommenders rather than giving them a prompt and letting them structure the letter how they like. Additionally, standardized letters of recommendation have led to greater inter-rater reliability compared to non-standardized letters, in addition to being effective in mitigating bias, which is commonly noted as a risk of using non-standardized letters [153]. Standardized letters of recommendation offer a faster and less subjective alternative that has been used by many residency programs during the admissions process [153].
Situational judgement tests
Situational judgement tests were cited as an evaluation tool for CBA and HA in 10% of papers reviewed. Situational judgment tests ask applicants to indicate how they would respond to various scenarios presented to them in either a text, video, or animated format. Responses can be in the form of multiple-choice options, identifying the most and least effective responses and/or in the form of open-ended questions depending on how the program is evaluating and ‘scoring’ the applicants [37]. Situational judgement tests have been found to be good indicators of professional attributes, and that unlike some other methods of evaluating non-academic attributes, situational judgement tests are often cost-efficient [39].
Other tools
Other tools used to assess competencies in CBA and HA that were mentioned within the papers included psychological inventories and assessments, resumes and curriculum vitas, and other tests of clinical or related knowledge. Regardless of what tools were described in the articles, scoring systems, or ranking for each competency were used or proposed to compare applicants to aid in admission decisions.
Regardless of what method or tool is implemented, many articles noted the importance of training interviewers, observers, and reviewers in how to evaluate and score (if applicable) each candidate. Lack of consistency in reviewing has been seen as a challenge of CBA and HA, which many programs have solved by implementing a rigorous training program and explicit instructions for reviewing applicants, as well as constructing rubrics for different methods of evaluation. This increased training and rubrics has also been used to avoid implicit or unconscious bias within admissions decisions. As previously stated, many programs implemented HA as a strategy to diversify their programs and respective fields. The AAMC has developed a range of resources aimed at helping programs address this concern, including online resources, virtual seminars, and group workshops. Robinett et al. [137] noted participation in a 4-day train-the-trainer workshop facilitated by the AAMC was aimed at mitigating any bias throughout multiple points of the selection process, including screening, interview, and committee discussion and decisions.
RQ4)
How effective are health professional education programs in admitting students who are well prepared to succeed within their programs using CBA or HA? The last aim of our review was to evaluate any evidence on how effective CBA was at admitting students who were well-prepared. Due to the varying purposes of articles included and the current state of the field, there was paucity of information related to CBA effectiveness. However, Matthews et al. [114] and Zerwic et al. [171] found that after implementing HA for the University of Illinois Chicago, College of Nursing, they saw an increase in the diversity of admitted students without seeing a decrease in academic metrics compared to previous admissions cycles where HA was not used. Specifically, they found no statistical differences in science grade point average (GPA) at admission, overall GPA, two-year graduation rate, or first-time NCLEX pass rates of the first two graduating classes of bachelor’s degree students under the new admissions policy. Additionally, Hunker and Robb (2021) found that 81.6% of admitted applicants were identified as being academically successful after their first semester in a Doctor of Nursing Practice program. These findings, although isolated to these specific programs, support the view that implementation of CBA and HA does not reduce the quality of applicants, which is why some faculty hesitate to support implementation [45,110].
In addition to the findings from Matthews et al. [114] and Zerwic et al. [171] regarding an increase in diversity, 48 other articles provided evidence that implementing CBA or HA resulted in increased diversity, specifically race/ethnicity, gender, first-generation students, and underrepresented minorities within their respective fields. Although these studies did not mention how well-prepared students are, they do offer support that CBA can help identify diverse candidates. Eighty articles in this review cited diversity as a goal and/or outcome of implementing CBA and HA.
Discussion
This review explored the use of competency-based admissions and holistic admissions within health professions education programs to better understand these practices and inform future implementation. Our first goal was to define and operationalize CBA and HA. However, we found a lack of a clear definition of CBA, whereas HA has been well-defined by the Association of American Medical Colleges [173]. Despite the lack of a clear definition for CBA, many articles cited very similar foundational principles to HA. Standardizing HA definitions and processes could enable better systematic study and lead to improvements in admission practices.
Regarding the second goal of this review, the competencies and qualities that were assessed were relatively consistent across CBA and HA. However, there was little evidence to support that these competencies and qualities align with program mission and goals. The third goal of this review was to determine how programs evaluated competencies and qualities. Findings showed that many programs are implementing updated traditional assessments, such as multiple mini-interviews (MMIs). One consideration that programs must consider as they begin implementing these methods is the resource demand that they can have on programs. However, changes in practices that resulted from the COVID-19 pandemic, such as shifting to virtual interviews, might offer a solution to the logistic demands of these methods.
Lastly, no evidence was found regarding the effectiveness of CBA or HA in admitting well-prepared students into programs. However, some studies provided evidence that the use of CBA and HA has been associated with increased diversity. The findings of this review demonstrated a significant gap in the literature regarding CBA and HA. While the findings of this review were able to address some of our research questions regarding the types of competencies and qualities programs are interested in and how they assess them, more information is needed to get a complete picture of CBA and HA in health professions education. Although the current literature on CBA and HA focuses on increased diversity, there is a gap in the literature regarding other outcomes of CBA and HA. However, future research should investigate the impact of CBA and HA on student success, including academic performance, professional readiness, and career trajectories. Such research is critical to provide a more comprehensive picture of the implications and benefits of CBA and HA.
Limitations
There are some limitations to this review. First, the articles included in this review focus on CBA and HA across multiple different health professions education programs. Although this was done to gain a general understanding of these admissions practices within health professions education programs, there may be differences in admissions criteria, specific trends, and standards for admissions across these programs. Second, the articles included in this review came from multiple countries. Although this review wanted to gather information about how health professions programs implement CBA and HA, each country has its own educational structures that have its own nuances and challenges. Therefore, there may be inherent differences in how CBA and HA are implemented.
Supplementary Material
Funding Statement
This work was supported by the American Association of Veterinary Medical Colleges. This work was presented, in part, at the American Education Research Association Conference, April 2024, Pennsylvania Convention Center, Philadelphia, PA, and at the American Association of Veterinary Medical Colleges Annual Conference, April 2024, Washington, DC The American Association for Veterinary Medical Colleges.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Supplementary material
Supplemental data for this article can be accessed online at https://doi.org/10.1080/10872981.2025.2486979
References
- [1].Monroe A, Quinn E, Samuelson W, et al. An overview of the medical school admission process and use of applicant data in decision making: what has changed since the 1980s? Acad Med. 2013;88(5):672–16. doi: 10.1097/ACM.0b013e31828bf252 [DOI] [PubMed] [Google Scholar]
- [2].Ackerman-Barger K, London M, Yi A, et al. Exploring early admission processes: implications for nursing workforce diversity and health care equity. Nurs Educ Perspect. 2022;43(6):E73–E75. doi: 10.1097/01.NEP.0000000000000953 [DOI] [PubMed] [Google Scholar]
- [3].Aibana O, Swails JL, Flores RJ, et al. Bridging the gap: holistic review to increase diversity in graduate medical education. Academic Med: J Assoc Am Med Colleges. 2019;94(8):1137–1141. doi: 10.1097/ACM.0000000000002779 [DOI] [PubMed] [Google Scholar]
- [4].Artinian NT, Drees BM, Glazer G, et al. Holistic admissions in the health professions: strategies for leaders. Coll Univ: J Am Assoc Collegiate Registrars. 2017;92(2):65–68. [PMC free article] [PubMed] [Google Scholar]
- [5].Hadinger MA. Underrepresented minorities in medical school admissions: a qualitative study. Teach Learn Med. 2017;29(1):31–41. doi: 10.1080/10401334.2016.1220861 [DOI] [PubMed] [Google Scholar]
- [6].King A, Mayer C, Starnes A, et al. Using the Association of American Medical Colleges standardized video interview in a holistic residency application review. Cureus. 2017;9(12):e1913. doi: 10.7759/cureus.1913 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Microsoft Corporation . Microsoft excel 2018. [cited 2024 Jun 19]. Available from: https://office.microsoft.com/excel
- [8].Roy Rosenzweig Center for History and New Media . Zotero [Computer software]. 2024. [cited 2024 Jun 19]. Available from: https://www.zotero.org/download
- [9].Campbell JL, Quincy C, Osserman J, et al. Coding in-depth semistructured interviews: problems of utilization and intercoder reliability and agreement. Sociological Methods & Res. 2013;42(3):294–320. doi: 10.1177/0049124113500475 [DOI] [Google Scholar]
- [10].Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic review. BMC Med Res Methodol. 2008;8(45). doi: 10.1186/1471-2288-8-45 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [11].Abrams M, Olvet DM, Ellenbogen L, et al. Comparison of the multiple mini-interview and the traditional interview in medical school admissions: lessons learned using a hybrid model at one institution. Academic Med: J Assoc Am Med Colleges. 2023;98(5):606–613. doi: 10.1097/ACM.0000000000005127 [DOI] [PubMed] [Google Scholar]
- [12].Ahluwalia S, Swanwick T. Specialty training for general practice in the United Kingdom. J Ambul Care Manage. 2008;31(3):276–281. doi: 10.1097/01.JAC.0000324673.14025.5b [DOI] [PubMed] [Google Scholar]
- [13].Ahmed H, Rhydderch M, Matthews P. Can knowledge tests and situational judgement tests predict selection centre performance? Med Educ. 2012;46(8):777–784. doi: 10.1111/j.1365-2923.2012.04303.x [DOI] [PubMed] [Google Scholar]
- [14].Ahmed H, Rhydderch M, Matthews P. Do general practice selection scores predict success at MRCGP? An exploratory study. Educ For Primary Care: An Off Publ Assoc Course Organisers, Natl Assoc GP Tutors, World Organisation Fam Doctors. 2012;23(2):95–100. doi: 10.1080/14739879.2012.11494083 [DOI] [PubMed] [Google Scholar]
- [15].Akintade B, Gonzalez J, Idzik S, et al. Intentional diversity in academia: recruiting, admitting, enrolling, and retaining underrepresented students in nursing programs. J Prof Nurs. 2023;45:21–28. doi: 10.1016/j.profnurs.2023.01.004 [DOI] [PubMed] [Google Scholar]
- [16].Akoh CC, Shankar S, Strachan DD, et al. Diversifying the dermatology workforce: physician characteristics vary by race/ethnicity. J Natl Med Assoc. 2022;114(4):369–376. doi: 10.1016/j.jnma.2022.02.011 [DOI] [PubMed] [Google Scholar]
- [17].Albanese MA, Snow MH, Skochelak SE, et al. Assessing personal qualities in medical school admissions. Academic Med: J Assoc Am Med Colleges. 2003;78(3):313–321. doi: 10.1097/00001888-200303000-00016 [DOI] [PubMed] [Google Scholar]
- [18].Alpern RJ, Belitsky R, Long S. Competencies in premedical and medical education: the AAMC-HHMI report. Perspect Biol Med. 2011;54(1):30–35. doi: 10.1353/pbm.2011.0001 [DOI] [PubMed] [Google Scholar]
- [19].Anderson KG, Lemos J, Pickell S, et al. Athletes in medicine: a systematic review of performance of athletes in medicine. Med Educ. 2023;57(9):807–819. doi: 10.1111/medu.15033 [DOI] [PubMed] [Google Scholar]
- [20].Anderson N, Nguyen M, Marcotte K, et al. The long shadow: a historical perspective on racism in medical education. Acad Med. 2023;98(8S):S28–S36. doi: 10.1097/ACM.0000000000005253 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [21].Andreou V, Eggermont J, Gielis G, et al. Proficiency testing for identifying underperforming students before postgraduate education: a longitudinal study. BMC Med Educ. 2020;20(1):261. doi: 10.1186/s12909-020-02184-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [22].Angus SV, Williams CM, Stewart EA, et al. Internal medicine residency program directors’ screening practices and perceptions about recruitment challenges. Acad Med. 2020;95(4):582–589. doi: 10.1097/ACM.0000000000003086 [DOI] [PubMed] [Google Scholar]
- [23].Bajwa NM, Nendaz MR, Galetto-Lacour A, et al. Can professionalism mini-evaluation exercise scores predict medical residency performance? Validity evidence across five longitudinal cohorts. Acad Med. 2019;94(11S):S57–S63. doi: 10.1097/ACM.0000000000002895 [DOI] [PubMed] [Google Scholar]
- [24].Bajwa NM, Yudkowsky R, Belli D, et al. Improving the residency admissions process by integrating a professionalism assessment: a validity and feasibility study. Adv In Health Sci Educ. 2017;22(1):69–89. doi: 10.1007/s10459-016-9683-8 [DOI] [PubMed] [Google Scholar]
- [25].Ballejos MP, Fortner S, Reira J, et al. Applying holistic review practices to a combined baccalaureate/medical degree program: reflections on lessons learned. J Natl Med Assoc. 2023;115(3):326–332. doi: 10.1016/j.jnma.2023.03.006 [DOI] [PubMed] [Google Scholar]
- [26].Bandiera G, Maniate J, Hanson MD, et al. Access and selection: Canadian perspectives on who will be good doctors and how to identify them. Acad Med. 2015;90(7):946–952. doi: 10.1097/ACM.0000000000000683 [DOI] [PubMed] [Google Scholar]
- [27].Barceló NE, Shadravan S, Wells CR, et al. Reimagining merit and representation: promoting equity and reducing bias in GME through holistic review. Acad Psychiatry. 2021;45(1):34–42. doi: 10.1007/s40596-020-01327-5 [DOI] [PubMed] [Google Scholar]
- [28].Barton L, Willis A, Lin HH. Using a holistic preadmission assessment to help predict second-degree nursing student success. Nurse Educ. 2017;42(1):42–46. doi: 10.1097/NNE.0000000000000292 [DOI] [PubMed] [Google Scholar]
- [29].Baugh RF. I Am an African American: distinguishing between African American and African applicants in medical school admissions matters. Acad Med. 2018;93(9):1281–1285. doi: 10.1097/ACM.0000000000002235 [DOI] [PubMed] [Google Scholar]
- [30].Bennett MP, Lovan S, Smith M, et al. Nursing’s leaky pipeline: barriers to a diverse nursing workforce. J Prof Nurs. 2021;37(2):441–450. doi: 10.1016/j.profnurs.2020.05.002 [DOI] [PubMed] [Google Scholar]
- [31].Bice AA, Kantor R, Parker D, et al. Holistic review of BSN to DNP applicants: a step-by-step approach to implementation. J Prof Nurs. 2021;37(5):971–977. doi: 10.1016/j.profnurs.2021.07.020 [DOI] [PubMed] [Google Scholar]
- [32].Bird SB, Blomkalns A, Deiorio NM, et al. Beyond test scores and medical knowledge: the standardized video interview, an innovative and ethical approach for holistic assessment of applicants. Acad Med. 2018;93(2):151. doi: 10.1097/ACM.0000000000002040 [DOI] [PubMed] [Google Scholar]
- [33].Bird SB, Hern HG, Blomkalns A, et al. Innovation in residency selection: the AAMC standardized video interview. Acad Med. 2019;94(10):1489–1497. doi: 10.1097/ACM.0000000000002705 [DOI] [PubMed] [Google Scholar]
- [34].Blamoun J, Hakemi A, Armstead T. Perspectives on transitioning step 1 of the United States medical licensing examination to a pass/fail scoring model: defining new frameworks for medical students applying for residency. Adv Med Educ Pract. 2021;12:149–154. doi: 10.2147/AMEP.S296286 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [35].Boatright D, London M, Soriano AJ, et al. Strategies and best practices to improve diversity, equity, and inclusion among US graduate medical education programs. JAMA Netw Open. 2023;6(2):e2255110. doi: 10.1001/jamanetworkopen.2022.55110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Booker C, Rhineberger E, Lowery L. Holistic admissions in dental education 2022 and beyond. J Dent Educ. 2022;86(9):1107–1112. doi: 10.1002/jdd.13063 [DOI] [PubMed] [Google Scholar]
- [37].Brenneman AE, Goldgar C, Hills KJ, et al. Noncognitive attributes in physician assistant education. J Physician Assist Educ. 2018;29(1):25–34. doi: 10.1097/JPA.0000000000000187 [DOI] [PubMed] [Google Scholar]
- [38].Brotherton S, Smith CR, Boissonneault G, et al. Holistic admissions: strategies for increasing student diversity in occupational therapy, physical therapy, and physician assistant studies programs. J Allied Health. 2021;50(3):e91–e97. [PubMed] [Google Scholar]
- [39].Buchs SR, McDaniel MJ. New advances in physician assistant admissions: the history of situational judgement tests and the development of CASPer. J Physician Assist Educ. 2021;32(2):87–89. doi: 10.1097/JPA.0000000000000350 [DOI] [PubMed] [Google Scholar]
- [40].Burk-Rafel J, Reinstein I, Feng J, et al. Development and validation of a machine learning-based decision support tool for residency applicant screening and review. Acad Med. 2021;96(11S):S54–S61. doi: 10.1097/ACM.0000000000004317 [DOI] [PubMed] [Google Scholar]
- [41].Bußenius L, Harendza S. Are different medical school admission tests associated with the outcomes of a simulation-based OSCE? BMC Med Educ. 2021;21(1):263. doi: 10.1186/s12909-021-02703-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].Canham LE, Manago MM, Dannemiller L, et al. Holistic review in doctor of physical therapy admissions can lead to enhanced diversity in admitted students. J Phys Ther Educ. 2021;35(3):195–202. doi: 10.1097/jte.0000000000000192 [DOI] [Google Scholar]
- [43].Chaviano-Moran R, Chuck E, Perez H. Postbaccalaureate and graduate applicants to dental school: an analysis of holistic review. J Dent Educ. 2020;84(7):781–791. doi: 10.1002/jdd.12147 [DOI] [PubMed] [Google Scholar]
- [44].Chaviano-Moran R, Chuck E, Perez H. Unintended demographic bias in GPA/DAT-Based pre-admission screening: an argument for holistic admissions in dental schools. J Dent Educ. 2019;83(11):1280–1288. doi: 10.21815/JDE.019.144 [DOI] [PubMed] [Google Scholar]
- [45].Choi AN, Flowers SK, Heldenbrand SD. Becoming more holistic: a literature review of nonacademic factors in the admissions process of colleges and schools of pharmacy and other health professions. Curr In Pharm Teach & Learn. 2018;10(10):1429–1437. doi: 10.1016/j.cptl.2018.07.013 [DOI] [PubMed] [Google Scholar]
- [46].Conlon P, Hecker K, Sabatini S. What should we be selecting for? A systematic approach for determining which personal characteristics to assess for during admissions. BMC Med Educ. 2012;12(1):105. doi: 10.1186/1472-6920-12-105 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].Conrad SS, Addams AN, Young GH. Holistic review in medical school admissions and selection: a strategic, mission-driven response to shifting societal needs. Acad Med. 2016;91(11):1472–1474. doi: 10.1097/ACM.0000000000001403 [DOI] [PubMed] [Google Scholar]
- [48].Coplan B, Evans BC. How organizational culture influences holistic review: a qualitative multiple case study. Adv Health Sci Educ Theory Pract. 2021;26(5):1491–1517. doi: 10.1007/s10459-021-10055-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- [49].Crandall KA, Khosa D, Conlon P, et al. Investigating the relationship between multiple mini-interview communication skills outcomes and first-year communication skills performance and reflections in students at the Ontario Veterinary College. J Vet Med Educ. 2022;50(3):370–378. Advance online publication. doi: 10.3138/jvme-2021-0152 [DOI] [PubMed] [Google Scholar]
- [50].Crosby FE, Dunn JD, Fallacaro MD, et al. Preadmission characteristics of advanced practice nursing students. J Am Acad Nurse Practitioners. 2003;15(9):424–431. doi: 10.1111/j.1745-7599.2003.tb00417.x [DOI] [PubMed] [Google Scholar]
- [51].Cunningham CJ, Manier A, Anderson A, et al. Rational versus empirical prediction of nursing student success. J Prof Nurs. 2014;30(6):486–492. doi: 10.1016/j.profnurs.2014.03.006 [DOI] [PubMed] [Google Scholar]
- [52].Davis RK, Grobbel C, Mallette C, et al. Social justice as an expression of caring through holistic admissions in a nursing program: a proposed conceptual model. Nurs Forum. 2020;55(4):723–729. doi: 10.1111/nuf.12489 [DOI] [PubMed] [Google Scholar]
- [53].DeWitty VP. What is holistic admissions review, and why does it matter? J Nurs Educ. 2018;57(4):195–196. doi: 10.3928/01484834-20180322-01 [DOI] [PubMed] [Google Scholar]
- [54].DeWitty VP, Byrd DA. Recruiting underrepresented students for nursing schools. Creat Nurs. 2021;26(1):40–45. doi: 10.1891/CRNR-D-20-00069 [DOI] [PubMed] [Google Scholar]
- [55].Diaz T, Huerto R, Weiss J. Making merit just in medical school admissions. AMA J Ethics. 2021;23(3):E223–E228. doi: 10.1001/amajethics.2021.223 [DOI] [PubMed] [Google Scholar]
- [56].DiBaise M, Salisbury H, Hertelendy A, et al. Strategies and perceived barriers to recruitment of underrepresented minority students in physician assistant programs. J Physician Assist Educ. 2015;26(1):19–27. doi: 10.1097/JPA.0000000000000005 [DOI] [PubMed] [Google Scholar]
- [57].Dong T, Hutchinson J, Torre D, et al. What influences the decision to interview a candidate for medical school? Mil Med. 2020;185(11–12):e1999–e2003. doi: 10.1093/milmed/usaa237 [DOI] [PubMed] [Google Scholar]
- [58].Doukas DJ, Kirch DG, Brigham TP, et al. Transforming educational accountability in medical ethics and humanities education toward professionalism. Acad Med. 2015;90(6):738–743. doi: 10.1097/ACM.0000000000000616 [DOI] [PubMed] [Google Scholar]
- [59].Eva KW, Macala C, Fleming B. Twelve tips for constructing a multiple mini-interview. Med Teach. 2019;41(5):510–516. doi: 10.1080/0142159X.2018.1429586 [DOI] [PubMed] [Google Scholar]
- [60].Felix H, Laird J, Ennulat C, et al. Holistic admissions process: an initiative to support diversity in medical education. J Physician Assist Educ. 2012;23(3):21–27. doi: 10.1097/01367895-201223030-00004 [DOI] [PubMed] [Google Scholar]
- [61].Fleming E, Agyemfra M, Anige N, et al. Building sustainable approaches to recruit, retain, and professionalize black, latinx, and American Indian students interested in dental careers. J Dent Educ. 2022;86(9):1090–1097. doi: 10.1002/jdd.13019 [DOI] [PubMed] [Google Scholar]
- [62].Francis AM, Klein LB, Thomas SH, et al. Holistic admissions and racial/ethnic diversity: a systematic review and implications for social work doctoral education. J Soc Work Educ. 2021;58(2):227–244. doi: 10.1080/10437797.2021.1895927 [DOI] [Google Scholar]
- [63].Gallahue FE, Deiorio NM, Blomkalns A, et al. The AAMC standardized video interview: lessons learned from the residency selection process. Acad Med. 2020;95(11):1639–1642. doi: 10.1097/ACM.0000000000003573 [DOI] [PubMed] [Google Scholar]
- [64].Gay SE, Santen SA, Mangrulkar RS, et al. The influence of MCAT and GPA preadmission academic metrics on interview scores. Adv Health Sci Educ Theory Pract. 2018;23(1):151–158. doi: 10.1007/s10459-017-9779-9 [DOI] [PubMed] [Google Scholar]
- [65].Geng Y, Zhao L, Wang Y, et al. Competency model for dentists in China: results of a delphi study. PLoS One. 2018;13(3):e0194411. doi: 10.1371/journal.pone.0194411 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [66].Glazer G, Clark A, Bankston K, et al. Holistic admissions in nursing: we can do this. J Prof Nurs. 2016;32(4):306–313. doi: 10.1016/j.profnurs.2016.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [67].Glazer G, Clark A, Bankston K. Legislative: from policy to practice: a case for holistic review diversifying the nursing workforce. Online J Issues In Nurs. 2015;20(3):10. [PubMed] [Google Scholar]
- [68].Gliatto P, Leitman IM, Muller D. Scylla and Charybdis: the MCAT, USMLE, and degrees of freedom in undergraduate medical education. Acad Med. 2016;91(11):1498–1500. doi: 10.1097/ACM.0000000000001247 [DOI] [PubMed] [Google Scholar]
- [69].Goldgar C, Hills KJ, VanderMeulen SP, et al. Using the core competencies for new physician assistant graduates to prioritize admission criteria for PA practice in 2025. J Physician Assist Educ. 2019;30(2):111–117. doi: 10.1097/JPA.0000000000000255 [DOI] [PubMed] [Google Scholar]
- [70].Gould W, Simmons VC, Damico NK, et al. Addressing structural and systemic barriers in nurse anesthesia programs: recommendation to eliminate the GRE and adopt holistic admissions. Nurs Outlook. 2023;71(1):101888. doi: 10.1016/j.outlook.2022.10.001 [DOI] [PubMed] [Google Scholar]
- [71].Grabowski CJ. Impact of holistic review on student interview pool diversity. Adv In Health Sci Educ. 2018;23(3):487–498. doi: 10.1007/s10459-017-9807-9 [DOI] [PubMed] [Google Scholar]
- [72].Grbic D, Morrison E, Sondheimer HM, et al. The association between a holistic review in admissions workshop and the diversity of accepted applicants and students matriculating to medical school. Acad Med. 2019;94(3):396–403. doi: 10.1097/ACM.0000000000002446 [DOI] [PubMed] [Google Scholar]
- [73].Guiberson M, Vigil D. Speech-language pathology graduate admissions: implications to diversify the workforce. Commun Disord Q. 2021;42(3):145–155. doi: 10.1177/1525740120961049 [DOI] [Google Scholar]
- [74].Hackett JM, Ruyak SL. Holistic admissions review in nursing education: a concept analysis using Rodgers’ evolutionary method. Nurs Educ Perspect. 2022;43(2):85–90. doi: 10.1097/01.NEP.0000000000000898 [DOI] [PubMed] [Google Scholar]
- [75].Hampton MD, Dawkins D, Rickman Patrick S, et al. Nursing program admission barriers in the United States: considerations for increasing black student enrollment. Nurse Educ. 2022;47(1):19–25. doi: 10.1097/NNE.0000000000001071 [DOI] [PubMed] [Google Scholar]
- [76].Hampton MD, Apen LV. Impact of rubric weight on holistic admissions for underrepresented students in nursing. Teach Learn In Nurs. 2022;17(4):344–349. doi: 10.1016/j.teln.2022.07.007 [DOI] [Google Scholar]
- [77].Hampton MD, Dawkins D, Rickman Patrick S, et al. Holistic admissions review integration in nursing programs. J Nurs Educ. 2022;61(7):361–366. doi: 10.3928/01484834-20220610-01 [DOI] [PubMed] [Google Scholar]
- [78].Hänsel M, Klupp S, Graupner A, et al. Dresden faculty selection procedure for medical students: what impact does it have, what is the outcome? GMS Z Med Ausbild. 2010;27(2):Doc25. doi: 10.3205/zma000662 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [79].Hanson MD, Eva KW. A reflection upon the impact of early 21st-century technological innovations on medical school admissions. Acad Med. 2019;94(5):640–644. doi: 10.1097/ACM.0000000000002590 [DOI] [PubMed] [Google Scholar]
- [80].0Hanson MD, Kulasegaram KM, Coombs DL, et al. Admissions file review: applying the multiple independent sampling (MIS) methodology. Acad Med. 2012;87(10):1335–1340. doi: 10.1097/ACM.0b013e3182674629 [DOI] [PubMed] [Google Scholar]
- [81].Harrison LE. Using holistic review to form a diverse interview pool for selection to medical school. Bayl Univ Med Cent Proc. 2019;32(2):218–221. doi: 10.1080/08998280.2019.1576575 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [82].Henderson MC, Green C, Chen C. What does it mean for medical school admissions to be socially accountable? AMA J Ethics. 2021;23(12):E965–E974. doi: 10.1001/amajethics.2021.965 [DOI] [PubMed] [Google Scholar]
- [83].Henderson RI, Walker I, Myhre D, et al. An equity-oriented admissions model for indigenous student recruitment in an undergraduate medical education program. Can Med Educ J. 2021;12(2):e94–e99. doi: 10.36834/cmej.68215 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [84].Hofmeister M, Lockyer J, Crutcher R. The multiple mini-interview for selection of international medical graduates into family medicine residency education. Med Educ. 2009;43(6):573–579. doi: 10.1111/j.1365-2923.2009.03380.x [DOI] [PubMed] [Google Scholar]
- [85].Houlahan B, Deveneau L, Robinson J. The lasting effects of historical racial divides in nursing education: a case study examining holistic admission policies development. Nurse Educ Today. 2022;114:105392. doi: 10.1016/j.nedt.2022.105392 [DOI] [PubMed] [Google Scholar]
- [86].Hunker DF, Robb M. Admission characteristics that influence DNP students’ first-semester success: a retrospective study. Nurs Forum. 2022;57(6):1007–1011. doi: 10.1111/nuf.12774 [DOI] [PubMed] [Google Scholar]
- [87].Hupp JR. Holistic review in residency admissions. J Oral Maxillofac Surg. 2020;78(8):1217–1218. doi: 10.1016/j.joms.2020.05.014 [DOI] [PubMed] [Google Scholar]
- [88].Jerant A, Fancher T, Henderson MC, et al. Associations of postbaccalaureate coursework with underrepresented race/ethnicity, academic performance, and primary care training among matriculants at five California medical schools. J Health Care Poor Underserved. 2021;32(2):971–986. doi: 10.1353/hpu.2021.0075 [DOI] [PubMed] [Google Scholar]
- [89].Jones AC, Nichols AC, McNicholas CM, et al. Admissions is not enough: the racial achievement gap in medical education. Acad Med. 2021;96(2):176–181. doi: 10.1097/ACM.0000000000003837 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [90].Jung D, Latham C, Fortes K, et al. Using holistic admissions in pre-licensure programs to diversify the nursing workforce. J Prof Nurs. 2021;37(2):359–365. doi: 10.1016/j.profnurs.2020.04.006 [DOI] [PubMed] [Google Scholar]
- [91].Katsufrakis PJ, Uhler TA, Jones LD. The residency application process: pursuing improved outcomes through better understanding of the issues. Acad Med. 2016;91(11):1483–1487. doi: 10.1097/ACM.0000000000001411 [DOI] [PubMed] [Google Scholar]
- [92].Katz S, Vinker S. New non-cognitive procedures for medical applicant selection: a qualitative analysis in one school. BMC Med Educ. 2014;14(1):237. doi: 10.1186/1472-6920-14-237 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [93].Kennedy AB, Riyad CNY, Gunn LH, et al. More than their test scores: redefining success with multiple mini-interviews. Med Sci educator. 2020;30(3):1049–1060. doi: 10.1007/s40670-020-01013-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- [94].Kerrigan N, Akabas MH, Betzler TF, et al. Implementing competency based admissions at the Albert Einstein College of Medicine. Med Educ Online. 2016;21:30000. doi: 10.3402/meo.v21.30000 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [95].Kim T, Chang JY, Myung SJ, et al. Predictors of undergraduate and postgraduate clinical performance: a longitudinal cohort study. J Surg Educ. 2016;73(4):715–720. doi: 10.1016/j.jsurg.2016.03.006 [DOI] [PubMed] [Google Scholar]
- [96].Knorr M, Hissbach J. Multiple mini-interviews: same concept, different approaches. Med Educ. 2014;48(12):1157–1175. doi: 10.1111/medu.12535 [DOI] [PubMed] [Google Scholar]
- [97].Ko M, Ton H. The not underrepresented minorities: Asian Americans, diversity, and admissions. Acad Med. 2020;95(2):184–189. doi: 10.1097/ACM.0000000000003019 [DOI] [PubMed] [Google Scholar]
- [98].Koenig TW, Parrish SK, Terregino CA, et al. Core personal competencies important to entering students’ success in medical school: what are they and how could they be assessed early in the admission process? Acad Med. 2013;88(5):603–613. doi: 10.1097/ACM.0b013e31828b3389 [DOI] [PubMed] [Google Scholar]
- [99].Kreiter CD. A proposal for evaluating the validity of holistic-based admission processes. Teach Learn Med. 2013;25(1):103–107. doi: 10.1080/10401334.2012.741548 [DOI] [PubMed] [Google Scholar]
- [100].Kreiter CD, Axelson RD. A perspective on medical school admission research and practice over the last 25 years. Teach Learn Med. 2013;25(sup1):S50–S56. doi: 10.1080/10401334.2013.842910 [DOI] [PubMed] [Google Scholar]
- [101].Künzel W, Breit SM. Admissions procedures at the University of Veterinary Medicine Vienna, Austria. J Vet Med Educ. 2007;34(5):639–644. doi: 10.3138/jvme.34.5.639 [DOI] [PubMed] [Google Scholar]
- [102].Lancaster RJ, Baseman E, Smolinski L. A quality improvement project: defining and operationalizing a holistic admission selection policy. J Prof Nurs. 2020;36(4):259–263. doi: 10.1016/j.profnurs.2020.01.003 [DOI] [PubMed] [Google Scholar]
- [103].Langer T, Ruiz C, Tsai P, et al. Transition to multiple mini interview (MMI) interviewing for medical school admissions. Perspect Med Educ. 2020;9(4):229–235. doi: 10.1007/s40037-020-00605-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [104].Lee R. How should medical school admissions drive health care workforce diversity? AMA J Ethics. 2021;23(12):E912–E918. doi: 10.1001/amajethics.2021.912 [DOI] [PubMed] [Google Scholar]
- [105].Lewing B, Wanat M, Pitman P, et al. Development and evaluation of additional college of pharmacy admittance variables: life experiences and holistic composite scores. Curr In Pharm Teach & Learn. 2020;12(10):1194–1200. doi: 10.1016/j.cptl.2020.05.015 [DOI] [PubMed] [Google Scholar]
- [106].Lewis L, Biederman D, Hatch D, et al. Outcomes of a holistic admissions process in an accelerated baccalaureate nursing program. J Prof Nurs. 2021;37(4):714–720. doi: 10.1016/j.profnurs.2021.05.006 [DOI] [PubMed] [Google Scholar]
- [107].Lewis L. Can Greentree University adopt holistic admissions practices and still maintain status as an elite institution? J Cases In Educ Leadersh. 2021;24(2):126–134. doi: 10.1177/1555458920985555 [DOI] [Google Scholar]
- [108].Maher S, Parnell RN, Moore EWG, et al. Computer-based assessment of non-cognitive attributes of occupational therapy students: a pilot evaluation. The Internet J Allied Health Sci And Pract. 2023;21(1):1–5. Article 1. [Google Scholar]
- [109].Mahon KE, Henderson MK, Kirch DG. Selecting tomorrow’s physicians: the key to the future health care workforce. Acad Med. 2013;88(12):1806–1811. doi: 10.1097/ACM.0000000000000023 [DOI] [PubMed] [Google Scholar]
- [110].Mann N, Dulemba L, Carmack A, et al. Transitioning to holistic review for admissions in a baccalaureate nursing program: one school’s journey. J Prof Nurs. 2022;41:43–52. doi: 10.1016/j.profnurs.2022.04.005 [DOI] [PubMed] [Google Scholar]
- [111].Marshall AL, Halfdanarson TR, Nowakowski GS, et al. Holistic review for hematology-oncology fellowship applicants: a new paradigm? Am J Hematol. 2020;95(10):1124–1126. doi: 10.1002/ajh.25930 [DOI] [PubMed] [Google Scholar]
- [112].Marvin R, Park YS, Dekhtyar M, et al. Implementation of the AAMC’s holistic review model for psychiatry resident recruitment. MedEdPORTAL: The J Teach Learn Resour. 2023;19:11299. doi: 10.15766/mep_2374-8265.11299 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [113].Mason HRC, Ata A, Nguyen M, et al. First-generation and continuing-generation college graduates’ application, acceptance, and matriculation to U.S. medical schools: a national cohort study. Med Educ Online. 2022;27(1):2010291. doi: 10.1080/10872981.2021.2010291 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [114].Matthews AK, Abboud S, Smith AU, et al. Strategies to address structural and institutional barriers to success among students of color in nursing programs. J Prof Nurs. 2022;40:96–104. doi: 10.1016/j.profnurs.2022.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [115].McGaghie WC, Kreiter CD. SPECIAL ARTICLE: holistic versus actuarial student selection. Teach Learn Med. 2005;17(1):89–91. doi: 10.1207/s15328015tlm1701_16 [DOI] [PubMed] [Google Scholar]
- [116].Morrow MR. Holistic admission: what is it? How successful has it been in nursing, and what are the possibilities? Nurs Sci Q. 2021;34(3):256–262. doi: 10.1177/08943184211010431 [DOI] [PubMed] [Google Scholar]
- [117].Moynahan KF. The current use of United States medical licensing examination step 1 scores: holistic admissions and student well-being are in the balance. Acad Med. 2018;93(7):963–965. doi: 10.1097/ACM.0000000000002101 [DOI] [PubMed] [Google Scholar]
- [118].Murray TA. Holistic admissions: could you be biased? J Nurs Educ. 2021;60(8):427–428. doi: 10.3928/01484834-20210722-01 [DOI] [PubMed] [Google Scholar]
- [119].Murray TA, Noone J. Advancing diversity in nursing education: a groundwater approach. J Prof Nurs. 2022;41:140–148. doi: 10.1016/j.profnurs.2022.05.002 [DOI] [PubMed] [Google Scholar]
- [120].Murray TA, Simmons KJ, Boyd E, et al. Evidence-based strategies to advance BSN student diversity. J Prof Nurs. 2022;39:122–130. doi: 10.1016/j.profnurs.2021.12.013 [DOI] [PubMed] [Google Scholar]
- [121].Nakae S, Porfeli EJ, Davis D, et al. Enrollment management in undergraduate medical school admissions: a complementary framework to holistic review for increasing diversity in medicine. Acad Med. 2021;96(4):501–506. doi: 10.1097/ACM.0000000000003866 [DOI] [PubMed] [Google Scholar]
- [122].Nakae S, Palermo AG, Sun M, et al. Bias breakers: continuous practice for admissions and selection committees. MedEdPORTAL: The J Teach And Learn Resour. 2022;18:11285. doi: 10.15766/mep_2374-8265.11285 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [123].Nehemiah A, Roberts SE, Song Y, et al. Looking beyond the numbers: increasing diversity and inclusion through holistic review in general surgery recruitment. J Surg Educ. 2021;78(3):763–769. doi: 10.1016/j.jsurg.2020.08.048 [DOI] [PubMed] [Google Scholar]
- [124].Nguyen M, Dent R, Fancher TL, et al. Revolutionizing health professions admissions to achieve an inclusive workforce. Ann Fam Med. 2023;21(Suppl 2):S75–S81. doi: 10.1370/afm.2922 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [125].Nohria R, Adams J, Garrison GE. Inclusion of socioeconomic status as an additional criterion in holistic pharmacy school admission processes. Am J Pharm Educ. 2019;83(7):7016. doi: 10.5688/ajpe7016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [126].Noone J, Najjar RH. Minimizing unconscious bias in nursing school admission. J Nurs Educ. 2021;60(6):317–323. doi: 10.3928/01484834-20210520-03 [DOI] [PubMed] [Google Scholar]
- [127].Okorie-Awé C, Tenhoeve T, Michaels J, et al. Using holistic review to build a pharmacist workforce that can achieve health equity. J Best Practices In Health Professions Diversity. 2015;8(2):1106–1108. Available from: https://www.jstor.org/stable/26554223 [Google Scholar]
- [128].Patterson F, Ferguson E, Norfolk T, et al. A new selection system to recruit general practice registrars: preliminary findings from a validation study. BMJ. 2005;330(7493):711–714. doi: 10.1136/bmj.330.7493.711 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [129].Price SS, Grant-Mills D. Effective admissions practices to achieve greater student diversity in dental schools. J Dent Educ. 2010;74(S10):S87–S97. doi: 10.1002/j.0022-0337.2010.74.10_suppl.tb04985.x [DOI] [PubMed] [Google Scholar]
- [130].Price SS, Crout RJ, Mitchell DA, et al. Increasing minority enrollment utilizing dental admissions workshop strategies. J Dent Educ. 2008;72(11):1268–1276. [PubMed] [Google Scholar]
- [131].Radabaugh CL, Hawkins RE, Welcher CM, et al. Beyond the United States medical licensing examination score: assessing competence for entering residency. Acad Med. 2019;94(7):983–989. doi: 10.1097/ACM.0000000000002728 [DOI] [PubMed] [Google Scholar]
- [132].Randall R, Davies H, Patterson F, et al. Selecting doctors for postgraduate training in paediatrics using a competency based assessment centre. Arch Dis Child. 2006;91(5):444–448. doi: 10.1136/adc.2005.076653 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [133].Relf MV. Advancing diversity in academic nursing. J Prof Nurs. 2016;32(5):S42–S47. doi: 10.1016/j.profnurs.2016.02.010 [DOI] [PubMed] [Google Scholar]
- [134].Roach A, Rose A, Beiers-Jones K, et al. Incorporating group interviews into holistic review in baccalaureate nursing school admissions. Nurs Educ Perspect. 2019;40(2):125–127. doi: 10.1097/01.NEP.0000000000000338 [DOI] [PubMed] [Google Scholar]
- [135].Roberts C, Khanna P, Rigby L, et al. Utility of selection methods for specialist medical training: a BEME (best evidence medical education) systematic review: BEME guide no. 45. Med Teach. 2018;40(1):3–19. doi: 10.1080/0142159X.2017.1367375 [DOI] [PubMed] [Google Scholar]
- [136].Roberts LW. The new MCAT exam and the continuing imperative of holistic review in the selection of medical students. Acad Med. 2020;95(3):323–326. doi: 10.1097/ACM.0000000000003123 [DOI] [PubMed] [Google Scholar]
- [137].Robinett K, Kareem R, Reavis K, et al. A multi-pronged, antiracist approach to optimize equity in medical school admissions. Med Educ. 2021;55(12):1376–1382. doi: 10.1111/medu.14589 [DOI] [PubMed] [Google Scholar]
- [138].Rosenberg L. A practical guide for implementing a holistic admissions review. J Nurs Educ. 2019;58(11):669–673. doi: 10.3928/01484834-20191021-11 [DOI] [PubMed] [Google Scholar]
- [139].Schreurs S, Cleutjens K, Collares CF, et al. Opening the black box of selection. Adv Health Sci Educ Theory Pract. 2020;25(2):363–382. doi: 10.1007/s10459-019-09925-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [140].Schreurs S, Cleutjens KB, Muijtjens AMM, et al. Selection into medicine: the predictive validity of an outcome-based procedure. BMC Med Educ. 2018;18(1):214. doi: 10.1186/s12909-018-1316-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- [141].Schulz AE, Nussbaum JE, Loloi J, et al. The impact of holistic review of urology residency applications on selection for interview during the COVID-19 pandemic. Urol. 2023;173:34–40. doi: 10.1016/j.urology.2022.11.034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [142].Schuster MA, Conwell WD, Connelly MT, et al. Building equity, inclusion, and diversity into the fabric of a new medical school: early experiences of the Kaiser Permanente Bernard J. Tyson School of Medicine. Acad Med. 2020;95(12S):S66–S70. doi: 10.1097/ACM.0000000000003695 [DOI] [PubMed] [Google Scholar]
- [143].Scott LD, Zerwic J. Holistic review in admissions: a strategy to diversify the nursing workforce. Nurs Outlook. 2015;63(4):488–495. doi: 10.1016/j.outlook.2015.01.001 [DOI] [PubMed] [Google Scholar]
- [144].Sims SM, Lynch JW. Medical educational culture: introducing patients to applicants as part of the medical school interview: feasibility and initial impact show and tell. Med Educ Online. 2016;21:31760. doi: 10.3402/meo.v21.31760 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [145].Sklar DP. Diversity, fairness, and excellence: three pillars of holistic admissions. Acad Med. 2019;94(4):453–455. doi: 10.1097/ACM.0000000000002588 [DOI] [PubMed] [Google Scholar]
- [146].Smith PE, Dunstan FD, Wiles CM. Selecting specialist registrars by station interview. Clin Med (Lond). 2006;6(3):279–280. doi: 10.7861/clinmedicine.6-3-279 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [147].Sommers C, Wirawan G. The relationship of demographic and admission exam scores with first semester grade point average in two cohorts of first year nursing students. Belitung Nurs J. 2019;5(1):23–31. doi: 10.33546/bnj.628 [DOI] [Google Scholar]
- [148].Sommers CL, Houghty GS, Purbojo R, et al. Factors influencing nursing students’ continued success in a baccalaureate nursing program in Indonesia. Belitung Nurs J. 2022;8(4):340–348. doi: 10.33546/bnj.2160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [149].Spector AR, Railey KM. Reducing reliance on test scores reduces racial bias in neurology residency recruitment. J Natl Med Assoc. 2019;111(5):471–474. doi: 10.1016/j.jnma.2019.03.004 [DOI] [PubMed] [Google Scholar]
- [150].Stratton TD, Elam CL. A holistic review of the medical school admission process: examining correlates of academic underperformance. Med Educ Online. 2014;19(1):22919. doi: 10.3402/meo.v19.22919 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [151].Thomas BR, Dockter N. Affirmative action and holistic review in medical school admissions: where we have been and where we are going. Acad Med. 2019;94(4):473–476. doi: 10.1097/ACM.0000000000002482 [DOI] [PubMed] [Google Scholar]
- [152].Thompson T, Sonke A. Multiple mini interviews as part of holistic admissions review for nursing schools. J Prof Nurs. 2021;37(6):1086–1091. doi: 10.1016/j.profnurs.2021.08.009 [DOI] [PubMed] [Google Scholar]
- [153].Tidwell J, Yudien M, Rutledge H, et al. Reshaping residency recruitment: achieving alignment between applicants and programs in surgery. J Surg Educ. 2022;79(3):643–654. doi: 10.1016/j.jsurg.2022.01.004 [DOI] [PubMed] [Google Scholar]
- [154].Trivedi S, Clark JC, Royal KD. The impact of COVID-19 on pre-veterinary opportunities and recommendations for DVM admissions. J Vet Med Educ. 2022;49(3):280–288. doi: 10.3138/jvme-2020-0145 [DOI] [PubMed] [Google Scholar]
- [155].VanderMeulen S, Hills K, Snyder JA, et al. Reflections on a physician assistant entrance exam: does the profession need one? J Physician Assist Educ. 2021;32(1):20–25. doi: 10.1097/JPA.0000000000000343 [DOI] [PubMed] [Google Scholar]
- [156].Varnado K, Richardson S, Kessler A. Rejecting the status quo: a call to action using culturally responsive pedagogy in health professions programs. J Allied Health. 2022;51(4):274–280. [PubMed] [Google Scholar]
- [157].Veesart A, Cannon S. The lived experience of nursing students who were unsuccessful in an undergraduate nursing program-a narrative inquiry. Nurse Educ Today. 2022;118:105517. doi: 10.1016/j.nedt.2022.105517 [DOI] [PubMed] [Google Scholar]
- [158].Vermeulen MI, Tromp F, Zuithoff NPA, et al. A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability. Eur J Gen Pract. 2014;20(4):307–313. doi: 10.3109/13814788.2014.885013 [DOI] [PubMed] [Google Scholar]
- [159].Vermeulen MI, Kuyvenhoven MM, Zuithoff NP, et al. Selection for Dutch postgraduate GP training; time for improvement. Eur J Gen Pract. 2012;18(4):201–205. doi: 10.3109/13814788.2012.680588 [DOI] [PubMed] [Google Scholar]
- [160].Vick AD, Baugh A, Lambert J, et al. Levers of change: a review of contemporary interventions to enhance diversity in medical schools in the USA. Adv Med Educ Pract. 2018;9:53–61. doi: 10.2147/AMEP.S147950 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [161].Wagner R, Maddox KR, Glazer G, et al. Maximizing effectiveness of the holistic admission process: implementing the multiple mini interview model. Nurse Educ. 2020;45(2):73–77. doi: 10.1097/NNE.0000000000000702 [DOI] [PubMed] [Google Scholar]
- [162].Wall AL, Aljets A, Ellis SC, et al. White paper on pharmacy admissions: developing a diverse work force to meet the health-care needs of an increasingly diverse society: recommendations of the American Association of Colleges of Pharmacy Special Committee on Admissions. Am J Pharm Educ. 2015;79(7):S7. doi: 10.5688/ajpe797S7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [163].Wells A, Brunson D, Sinkford JC, et al. Working with dental school admissions committees to enroll a more diverse student body. J Dent Educ. 2011;75(5):685–695. [PubMed] [Google Scholar]
- [164].Wilcox RE, Lawson KA. Predicting performance in health professions education programs from admissions information - comparisons of other health professions with pharmacy. Curr In Pharm Teach & Learn. 2018;10(4):529–541. doi: 10.1016/j.cptl.2017.12.004 [DOI] [PubMed] [Google Scholar]
- [165].Wildermuth A. Admissions interviews: how history can pave the way toward a holistic future in military PA program admissions and hiring. Med J (Fort Sam Houst, Tex). 2023;Per 23-4/5/6:72–79. [PubMed] [Google Scholar]
- [166].Wilson MB, Sedlacek WE, Lowery BL. An approach to using noncognitive variables in dental school admissions. J Dent Educ. 2014;78(4):567–574. doi: 10.1002/j.0022-0337.2014.78.4.tb05707.x [DOI] [PubMed] [Google Scholar]
- [167].Wise D, Dominguez J, Kapasi Z, et al. Defining underrepresented minorities and promoting holistic review admissions strategies in physical therapist education. J Phys Ther. 2017;31(4):8–13. doi: 10.1097/JTE.0000000000000009 [DOI] [Google Scholar]
- [168].Witzburg RA, Sondheimer HM. Holistic review–shaping the medical profession one applicant at a time. N Engl J Med. 2013;368(17):1565–1567. doi: 10.1056/NEJMp1300411 [DOI] [PubMed] [Google Scholar]
- [169].Wros P, Noone J. Holistic admissions in undergraduate nursing: one school’s journey and lessons learned. J Prof Nurs. 2018;34(3):211–216. doi: 10.1016/j.profnurs.2017.08.005 [DOI] [PubMed] [Google Scholar]
- [170].Zaidi NLB, Santen SA, Purkiss JA, et al. A hybrid interview model for medical school interviews: combining traditional and multisampling formats. Acad Med. 2016;91(11):1526–1529. doi: 10.1097/ACM.0000000000001218 [DOI] [PubMed] [Google Scholar]
- [171].Zerwic JJ, Scott LD, McCreary LL, et al. Programmatic evaluation of holistic admissions: the influence on students. J Nurs Educ. 2018;57(7):416–421. doi: 10.3928/01484834-20180618-06 [DOI] [PubMed] [Google Scholar]
- [172].Zimnicki KM, Aaron KS, McQuillen EP, et al. When holistic admissions review is not enough: barriers to diversity. J Nurs Educ. 2022;61(7):375–382. doi: 10.3928/01484834-20220610-03 [DOI] [PubMed] [Google Scholar]
- [173].Association of American Medical Colleges . Roadmap to excellence: key concepts for evaluating the impact of medical school holistic admissions. 2013. Available from: https://store.aamc.org/roadmap-to-excellence-key-concepts-for-evaluating-the-impact-of-medical-school-holistic-admissions-pdf.html
- [174].Roulston A, McNeill C, Hayes D, et al. Evaluating shortlisting methods for admission into the social work degree: personal statement versus psychological test. Soc Work Educ. 2022;43(4):841–861. doi: 10.1080/02615479.2022.2146668 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
