Multiple mini-interview

<h2 id="introduction">Introduction</h2>
Interviews have been used widely for different purposes, including assessment and recruitment. Candidate assessment is normally deemed successful when the scores generated by the measuring tool predict for future outcomes of interest, such as job performance or job retention. <a href="/facts/Meta-analysis/IcfChd8z">Meta-analysis</a> of the <a href="/facts/Human_resources/vSYnWaKX">human resource</a> literature has demonstrated low to moderate ability of interviews to predict for future job performance.<a class="footnote-ref" id="fnref:2" href="#fn:2">2</a> How well a candidate scores on one interview is only somewhat correlated with how well that candidate scores on the next interview. Marked shifts in scores are buffered when collecting many scores on the same candidate, with a greater buffering effect provided by multiple interviews than by multiple interviewers acting as a panel for one interview.<a class="footnote-ref" id="fnref:3" href="#fn:3">3</a> The score assigned by an interviewer in the first few minutes of an interview is rarely changed significantly over the course of the rest of the interview, an effect known as the <a href="/facts/Halo_effect/PuQQ79rG">halo effect</a>.
Therefore, even very short interviews within an MMI format provide similar ability to differentiate reproducibly between candidates.<a class="footnote-ref" id="fnref:4" href="#fn:4">4</a> Ability to reproducibly differentiate between candidates, also known as overall test reliability, is markedly higher for the MMI than for other interview formats.<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a> This has translated into higher <a href="/facts/Predictive_validity/95Hb2PbE">predictive validity</a>, correlating for future performance much more highly than standard interviews.<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a><a class="footnote-ref" id="fnref:7" href="#fn:7">7</a><a class="footnote-ref" id="fnref:8" href="#fn:8">8</a><a class="footnote-ref" id="fnref:9" href="#fn:9">9</a><a class="footnote-ref" id="fnref:10" href="#fn:10">10</a>

<h2 id="history">History</h2>
Aiming to enhance predictive correlations with future performance in medical school, <a href="/facts/Postgraduate_education/VhXDbhBz">post-graduate</a> medical training, and future performance in practice, McMaster University began research and development of the MMI in 2001. The initial pilot was conducted on 18 <a href="/facts/Graduate_school/e19zs58x">graduate students</a> volunteering as "medical school candidates". High overall test reliability (0.81) led to a larger study conducted in 2002 on real medical school candidates, many of whom volunteered after their standard interview to stay for the MMI. Overall test reliability remained high,<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> and subsequent follow-up through medical school and on to national licensure examination (Medical Council of Canada Qualifying Examination Parts I and II) revealed the MMI to be the best predictor for subsequent clinical performance,<a class="footnote-ref" id="fnref:12" href="#fn:12">12</a><a class="footnote-ref" id="fnref:13" href="#fn:13">13</a> professionalism,<a class="footnote-ref" id="fnref:14" href="#fn:14">14</a> and ability to communicate with patients and successfully obtain national licensure.<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a><a class="footnote-ref" id="fnref:16" href="#fn:16">16</a>
Since its formal inception at the <a href="/facts/Michael_G._DeGroote_School_of_Medicine/PPywqlJo">Michael G. DeGroote School of Medicine</a> at McMaster University in 2004, the MMI subsequently spread as an admissions test across medical schools, and to other healing arts disciplines. By 2008, the MMI was being used as an admissions test by the majority of medical schools in Canada, Australia, Israel, and Brunei. Also in 2008, a pilot test was conducted with the tool at the <a href="/facts/University_of_Cincinnati_Academic_Health_Center/TcAjvz9L">University of Cincinnati College of Medicine</a>, and went live in the fall of that year, as the first implementation of MMI at a medical college in the United States;<a class="footnote-ref" id="fnref:17" href="#fn:17">17</a><a class="footnote-ref" id="fnref:18" href="#fn:18">18</a><a class="footnote-ref" id="fnref:19" href="#fn:19">19</a><a class="footnote-ref" id="fnref:20" href="#fn:20">20</a> additional medical schools in the country have since adopted the process.<a class="footnote-ref" id="fnref:21" href="#fn:21">21</a>
These lead to the development of a McMaster spin-off company, APT Inc., to commercialize the MMI system. The MMI was branded as ProFitHR and made available to both the academic and corporate sector.<a class="footnote-ref" id="fnref:22" href="#fn:22">22</a> By 2009, the list of other disciplines using the MMI included schools for <a href="/facts/Dentistry/p8b1zmts">dentistry</a>, <a href="/facts/Pharmacy/P2KTFVdW">pharmacy</a>, <a href="/facts/Midwifery/vdh9DMEK">midwifery</a>, <a href="/facts/Physical_therapy/q24XDqHF">physiotherapy</a> and <a href="/facts/Occupational_therapy/eKTxd7kM">occupational therapy</a>, <a href="/facts/Veterinary_medicine/KYNaodgl">veterinary medicine</a>, <a href="/facts/Sonographer/5UWl3BBl">ultrasound</a> technology, <a href="/facts/Nuclear_medicine/L9Dzjd90">nuclear medicine</a> technology, <a href="/facts/Radiologic_technologist/ekNv8xMp">X-ray</a> technology, <a href="/facts/Medical_laboratory/ov10GjQD">medical laboratory</a> technology, <a href="/facts/Podiatry/3UACchzt">chiropody</a>, <a href="/facts/Dental_hygienist/9xvdmXEa">dental hygiene</a>, and postgraduate training programs in dentistry and medicine.

<h2 id="mmi-procedure">MMI procedure</h2>
<ol><li>Interview stations – the domain(s) being assessed at any one station are variable, and normally reflects the objectives of the selecting institution. Examples of domains include the "soft skills" – ethics, professionalism, interpersonal relationships, ability to manage, communicate, collaborate, as well as perform a task. An MMI interview station takes considerable time and effort to produce; it is composed of several parts, including the stem question, probing questions for the interviewer, and a scoring sheet.</li>
<li>Circuit(s) of stations – to reduce costs of the MMI significantly below that of most interviews,<a class="footnote-ref" id="fnref:23" href="#fn:23">23</a> the interview "stations" are kept short (eight minutes or less) and are conducted simultaneously in a circuit as a bell-ringer examination. The preferred number of stations depends to some extent on the characteristics of the candidate group being interviewed, though nine interviews per candidate represents a reasonable minimum.<a class="footnote-ref" id="fnref:24" href="#fn:24">24</a> The circuit of interview stations should be within sufficiently close quarters to allow candidates to move from interview room to interview room. Multiple parallel circuits can be run, each circuit with the same set of interview stations, depending upon physical plant limitations.</li>
<li>Interviewers – one interviewer per interview station is sufficient.<a class="footnote-ref" id="fnref:25" href="#fn:25">25</a> In a typical MMI, each interviewer stays in the same interview throughout, as candidates rotate through. The interviewer thus scores each candidate based upon the same interview scenario throughout the course of the test.</li>
<li>Candidates – each candidate rotates through the circuit of interviews. For example, if each interview station is eight minutes, and there are nine interview stations, it will take the nine candidates being assessed on that circuit 72 minutes to complete the MMI. Each of the candidates begins at a different interview station, rotating to the next interview station at the ringing of the bell.</li>
<li>Administrators – each circuit requires at least one administrator to ensure that the MMI is conducted fairly and on time.</li></ol>
<h2 id="utility-of-the-mmi">Utility of the MMI</h2>
Test security breaches tend not to unduly influence results.<a class="footnote-ref" id="fnref:26" href="#fn:26">26</a> While the creators of the test claim that sex of candidate and candidate status as under-represented minority tends not to unduly influence results,<a class="footnote-ref" id="fnref:27" href="#fn:27">27</a><a class="footnote-ref" id="fnref:28" href="#fn:28">28</a> independent research has demonstrated that the MMI causes both gender<a class="footnote-ref" id="fnref:29" href="#fn:29">29</a> and socioeconomic<a class="footnote-ref" id="fnref:30" href="#fn:30">30</a> bias. Although some research have suggested that preparatory courses taken by the candidate tend not to unduly influence results,<a class="footnote-ref" id="fnref:31" href="#fn:31">31</a> such research has not been duplicated and further research has to be done to make any scientifically sound argument for or against preparatory courses. Furthermore, such research must be designed to directly examine the efficacy of leading preparatory companies' courses rather than general evaluation. Although, it may be argued that all the validation so far has been done by McMaster and/or its affiliated company which constitute a conflict of interest and any result must be interpreted with caution. However, it is worth noting that MMI performance can be compromised by introversion.<a class="footnote-ref" id="fnref:32" href="#fn:32">32</a>

<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/Objective_structured_clinical_examination/Cqk0NWxb">Objective structured clinical examination</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Eva KW, Reiter HI, Rosenfeld J, Norman GR. An admissions OSCE: the multiple mini-interview. Medical education, 38:314–326 (2004). <a href="/wiki/Medical_education" target="_blank">/wiki/Medical_education</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Barrick, MR; Mount, MK (1991). "The Big 5 personality dimensions and job performance: a meta-analysis". Personnel Psychology. 44: 1–26. doi:10.1111/j.1744-6570.1991.tb00688.x. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Eva, KW; Reiter, HI; Rosenfeld, J; Norman, GR (June 2004). "The relationship between interviewer characteristics and ratings assigned during a Multiple Mini-Interview". Academic Medicine. 79 (6): 602–9. doi:10.1097/00001888-200406000-00021. PMID 15165983. <a href="https://doi.org/10.1097%2F00001888-200406000-00021" target="_blank">https://doi.org/10.1097%2F00001888-200406000-00021</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Dodson, M; Crotty, B; Prideaux, D; Carne, R; Ward, A; de Leeuw, E (February 2009). "The multiple mini-interview: how long is long enough?". Medical Education. 43 (2): 168–74. doi:10.1111/j.1365-2923.2008.03260.x. PMID 19161488. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Eva KW, Reiter HI, Rosenfeld J, Norman GR. An admissions OSCE: the multiple mini-interview. Medical education, 38:314–326 (2004). <a href="/wiki/Medical_education" target="_blank">/wiki/Medical_education</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">Eva, KW; Reiter, HI; Rosenfeld, J; Norman, GR (October 2004). "The ability of the Multiple Mini-Interview to predict pre-clerkship performance in medical school". Academic Medicine. 79 (10 Suppl): S40–2. doi:10.1097/00001888-200410001-00012. PMID 15383385. <a href="https://doi.org/10.1097%2F00001888-200410001-00012" target="_blank">https://doi.org/10.1097%2F00001888-200410001-00012</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Reiter, HI; Eva, KW; Rosenfeld, J; Norman, GR (April 2007). "Multiple Mini-Interview Predicts for Clinical Clerkship Performance, National Licensure Examination Performance". Medical Education. 41 (4): 378–84. CiteSeerX 10.1.1.544.6911. doi:10.1111/j.1365-2929.2007.02709.x. PMID 17430283. <a href="/wiki/CiteSeerX_(identifier)" target="_blank">/wiki/CiteSeerX_(identifier)</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. "Predictive validity of the multiple mini-interview for selecting medical trainees. Accepted for publication January 2009 in Medical Education. <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Hofmeister, M; Lockyer, J; Crutcher, R (June 2009). "The multiple mini-interview for selection of international medical graduates into family medicine residency education". Medical Education. 43 (6): 573–9. doi:10.1111/j.1365-2923.2009.03380.x. PMID 19493182. <a href="/wiki/Residency_(medicine)" target="_blank">/wiki/Residency_(medicine)</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Hadad, Aviel; Gafni, Naomi; Moshinsky, Avital; Turvall, Elliot; Ziv, Amitai; Israeli, Avi (November 2016). "The multiple mini-interviews as a predictor of peer evaluations during clinical training in medical school". Medical Teacher. 38 (11): 1172–1179. doi:10.1080/0142159X.2016.1181730. ISSN 1466-187X. PMID 27249334. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Eva KW, Reiter HI, Rosenfeld J, Norman GR. An admissions OSCE: the multiple mini-interview. Medical education, 38:314–326 (2004). <a href="/wiki/Medical_education" target="_blank">/wiki/Medical_education</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">Eva, KW; Reiter, HI; Rosenfeld, J; Norman, GR (October 2004). "The ability of the Multiple Mini-Interview to predict pre-clerkship performance in medical school". Academic Medicine. 79 (10 Suppl): S40–2. doi:10.1097/00001888-200410001-00012. PMID 15383385. <a href="https://doi.org/10.1097%2F00001888-200410001-00012" target="_blank">https://doi.org/10.1097%2F00001888-200410001-00012</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. "Predictive validity of the multiple mini-interview for selecting medical trainees. Accepted for publication January 2009 in Medical Education. <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Reiter, HI; Eva, KW; Rosenfeld, J; Norman, GR (April 2007). "Multiple Mini-Interview Predicts for Clinical Clerkship Performance, National Licensure Examination Performance". Medical Education. 41 (4): 378–84. CiteSeerX 10.1.1.544.6911. doi:10.1111/j.1365-2929.2007.02709.x. PMID 17430283. <a href="/wiki/CiteSeerX_(identifier)" target="_blank">/wiki/CiteSeerX_(identifier)</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. "Predictive validity of the multiple mini-interview for selecting medical trainees. Accepted for publication January 2009 in Medical Education. <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
<li id="fn:16">Hofmeister, M; Lockyer, J; Crutcher, R (June 2009). "The multiple mini-interview for selection of international medical graduates into family medicine residency education". Medical Education. 43 (6): 573–9. doi:10.1111/j.1365-2923.2009.03380.x. PMID 19493182. <a href="/wiki/Residency_(medicine)" target="_blank">/wiki/Residency_(medicine)</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></li>
<li id="fn:17">Castano, Ellie (July 8, 2013). "Illuminating who medical school applicants really are". UMassMedNOW. umassmed.edu. Archived from the original on October 8, 2023. Retrieved February 9, 2015. <a href="https://web.archive.org/web/20231008202021/https://www.umassmed.edu/news/news-archives/2013/07/mmi-gives-students-multiple-opportunities-to-shine/" target="_blank">https://web.archive.org/web/20231008202021/https://www.umassmed.edu/news/news-archives/2013/07/mmi-gives-students-multiple-opportunities-to-shine/</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></li>
<li id="fn:18">Koenig, Angela (August 17, 2009). "UC College of Medicine Changes Admission Process to Screen for Healers, Not Just Health Care Providers". UC Health News. healthnewsuc.edu. Archived from the original on March 7, 2016. Retrieved October 8, 2023. <a href="https://web.archive.org/web/20160307222426/http://healthnews.uc.edu/news/?/9032/" target="_blank">https://web.archive.org/web/20160307222426/http://healthnews.uc.edu/news/?/9032/</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></li>
<li id="fn:19">Koenig, Angela (September 8, 2011). "Entrance into UC Medical School Based on New Guidelines". UC Health News. healthnewsuc.edu. Archived from the original on March 8, 2016. Retrieved October 8, 2023. <a href="https://web.archive.org/web/20160308052309/http://healthnews.uc.edu/news/?/14446/" target="_blank">https://web.archive.org/web/20160308052309/http://healthnews.uc.edu/news/?/14446/</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></li>
<li id="fn:20">Collins, Thomas R. (September 6, 2012). "New Med School Screening Recommendations to Assess Ethics, Professionalism". ENTtoday.org. Archived from the original on October 8, 2023. <a href="https://web.archive.org/web/20231008211507/https://www.enttoday.org/article/new-med-school-screening-recommendations-to-assess-ethics-professionalism/2/" target="_blank">https://web.archive.org/web/20231008211507/https://www.enttoday.org/article/new-med-school-screening-recommendations-to-assess-ethics-professionalism/2/</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></li>
<li id="fn:21">Harris, Gardiner (July 10, 2011). "New for Aspiring Doctors, the People Skills Test". The New York Times. Archived from the original on August 27, 2023. Retrieved October 8, 2023. <a href="https://web.archive.org/web/20230827232024/https://www.nytimes.com/2011/07/11/health/policy/11docs.html" target="_blank">https://web.archive.org/web/20230827232024/https://www.nytimes.com/2011/07/11/health/policy/11docs.html</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></li>
<li id="fn:22">"Welcome to ProFitHR". <a href="http://www.ProFitHR.com" target="_blank">http://www.ProFitHR.com</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></li>
<li id="fn:23">Rosenfeld J, Eva KW, Reiter HI, Trinh K. A Cost-Efficiency Comparison between the Multiple Mini-Interview and Panel-based Admissions Interviews. Advanced Health science Education Theory Pract. 2008 Mar;13(1):43–58 <a href="/wiki/Health_science" target="_blank">/wiki/Health_science</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></li>
<li id="fn:24">Eva, KW; Reiter, HI; Rosenfeld, J; Norman, GR (June 2004). "The relationship between interviewer characteristics and ratings assigned during a Multiple Mini-Interview". Academic Medicine. 79 (6): 602–9. doi:10.1097/00001888-200406000-00021. PMID 15165983. <a href="https://doi.org/10.1097%2F00001888-200406000-00021" target="_blank">https://doi.org/10.1097%2F00001888-200406000-00021</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></li>
<li id="fn:25">Eva, KW; Reiter, HI; Rosenfeld, J; Norman, GR (June 2004). "The relationship between interviewer characteristics and ratings assigned during a Multiple Mini-Interview". Academic Medicine. 79 (6): 602–9. doi:10.1097/00001888-200406000-00021. PMID 15165983. <a href="https://doi.org/10.1097%2F00001888-200406000-00021" target="_blank">https://doi.org/10.1097%2F00001888-200406000-00021</a> <a href="#fnref:25" class="footnote-back-ref">↩</a></li>
<li id="fn:26">Reiter, HI; Salvatori, P; Rosenfeld, J; Trinh, K; Eva, KW (2006). "The Impact of Measured Violations of Test Security on Multiple-Mini Interview (MMI)". Medical Education. 40 (1): 36–42. doi:10.1111/j.1365-2929.2005.02348.x. PMID 16441321. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:26" class="footnote-back-ref">↩</a></li>
<li id="fn:27">Eva KW, Reiter HI, Rosenfeld J, Norman GR. An admissions OSCE: the multiple mini-interview. Medical education, 38:314–326 (2004). <a href="/wiki/Medical_education" target="_blank">/wiki/Medical_education</a> <a href="#fnref:27" class="footnote-back-ref">↩</a></li>
<li id="fn:28">Moreau, K; Reiter, HI; Eva, KW (2006). "Comparison of Aboriginal and Non-Aboriginal Applicants for Admissions on the Multiple Mini-Interview using Aboriginal and Non-Aboriginal Interviewers". Teaching and Learning in Medicine. 18 (1): 58–61. doi:10.1207/s15328015tlm1801_12. PMID 16354142. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:28" class="footnote-back-ref">↩</a></li>
<li id="fn:29">Ross, Marshall; Walker, Ian; Cooke, Lara; Raman, Maitreyi; Ravani, Pietro; Coderre, Sylvain; McLaughlin, Kevin (June 2017). "Are Female Applicants Rated Higher Than Males on the Multiple Mini-Interview? Findings From the University of Calgary". Academic Medicine. 92 (6): 841–846. doi:10.1097/ACM.0000000000001466. ISSN 1938-808X. PMID 28557950. <a href="https://doi.org/10.1097%2FACM.0000000000001466" target="_blank">https://doi.org/10.1097%2FACM.0000000000001466</a> <a href="#fnref:29" class="footnote-back-ref">↩</a></li>
<li id="fn:30">Jerant, Anthony; Fancher, Tonya; Fenton, Joshua J.; Fiscella, Kevin; Sousa, Francis; Franks, Peter; Henderson, Mark (December 2015). "How Medical School Applicant Race, Ethnicity, and Socioeconomic Status Relate to Multiple Mini-Interview-Based Admissions Outcomes: Findings From One Medical School". Academic Medicine. 90 (12): 1667–1674. doi:10.1097/ACM.0000000000000766. ISSN 1938-808X. PMID 26017355. <a href="https://doi.org/10.1097%2FACM.0000000000000766" target="_blank">https://doi.org/10.1097%2FACM.0000000000000766</a> <a href="#fnref:30" class="footnote-back-ref">↩</a></li>
<li id="fn:31">Griffin, B; Harding, DW; Wilson, IG; Yeomans, ND (September 2008). "Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school". Medical Journal of Australia. 189 (5): 270–3. doi:10.5694/j.1326-5377.2008.tb02024.x. PMID 18759725. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:31" class="footnote-back-ref">↩</a></li>
<li id="fn:32">Jerant, A; Griffin, E; Rainwater, J; Henderson, M; Sousa, F; Bertakis, KD; Fenton, JJ; Franks, P (September 2012). "Does applicant personality influence multiple mini-interview performance and medical school acceptance offers?". Academic Medicine. 87 (9): 1250–9. doi:10.1097/ACM.0b013e31826102ad. PMID 22836836. <a href="https://doi.org/10.1097%2FACM.0b013e31826102ad" target="_blank">https://doi.org/10.1097%2FACM.0b013e31826102ad</a> <a href="#fnref:32" class="footnote-back-ref">↩</a></li>
</ol>

Multiple mini-interview open-in-new

Multiple mini-interview