2007 USMLE Performance Data
As published in the 2007 NBME Annual Report,
Copyright 2008 by the National Board of Medical Examiners®
USMLE Administration, Minimum Passing Scores, and Performance
Continuous test administration of the USMLE is available to all examinees. For Step 1, Step 2 Clinical Knowledge (CK), and Step 3, which are the computer-based testing (CBT) components of the USMLE program, test scheduling and delivery are provided by Prometric. These CBT examinations are currently administered at more than 350 US/Canadian Prometric test centers and more than 125 international Prometric test centers. Additional test centers are located at seven medical schools in the United States. The Step 1 and Step 2 CK examinations are administered worldwide; the Step 3 examination is administered only in the United States.
Step 2 Clinical Skills (CS) is a standardized patient (SP) examination. Scheduling and test delivery for Step 2 CS are provided by the Clinical Skills Evaluation Collaboration (CSEC). There are five CSEC centers.
For each of the Step examinations, once the registration process is completed, applicants make their own appointment to take the examination at a location and time most convenient to their schedule. Examination results are processed continuously, and scores are reported weekly. Most examinees taking the computer-based Step examinations receive their scores approximately three to four weeks after their test date. For Step 2 CS, examinees receive their results by approximately eight weeks but this length of time may vary for some individuals because of the scoring and quality assurance steps associated with this component of USMLE. The schedule for reporting Step 2 CS results is published here.
A pass or fail result is provided, as a USMLE recommendation, for each examinee. Passing results are based on achievement of specified levels of proficiency established prior to administration of examinations. Statistical procedures are employed to ensure that for each Step, the level of proficiency required to pass remains uniform across forms of the examination. As noted in the USMLE Bulletin of Information and on this website, the score required to meet the recommended level of proficiency is reviewed periodically and may be adjusted without prior notice. Notice of adjustments is posted on this website.
In reviewing standards for USMLE examinations, the USMLE Step Committees employ information gathered from a number of sources including standard setting surveys. These surveys, which seek opinions on the appropriateness of current USMLE pass/fail standards for each of the Steps, are sent to random samples of examinees, directors of basic and clinical science courses and clinical clerkships, associate deans for academic and student affairs, directors and chief residents from residency programs, members of USMLE test material development committees, executive directors and presidents of all state medical boards, and members of the NBME Board and the FSMB Board of Directors.
In addition to surveys, USMLE Step Committees consider the results of content review by standard setting panels. These panels typically consist of physicians who are not otherwise involved in the USMLE program. These panels review the content of the Step examinations and, through a series of exercises, provide data that reflect their opinions on minimally acceptable levels of performance.
Step 1
Details on the performance of examinees taking Step 1 in 2006 and 2007 are provided in Table 1. Data for 2007 are based upon examinees whose results were reported through February 6, 2008. Approximately 16,800 and 17,000 first-time takers from US and Canadian medical schools that grant the MD degree were tested in both 2006 and 2007. First-time takers from non-US/Canadian medical schools numbered 14,585 and 15,762 for the same years. The pass rate for first-time takers from MD-granting US and Canadian medical schools was 95% for both years. Because failing examinees generally retake Step 1, the ultimate passing rate across test administrations is expected to increase to approximately 99% for this same group.
| TABLE 1 - 2006-2007 STEP 1 ADMINISTRATIONS Number Tested and Percent Passing |
||||
|---|---|---|---|---|
| 2006 | 2007* | |||
| #Tested | %Passing | #Tested | %Passing | |
| Examinees from US/Canadian Schools that Grant | ||||
| MD Degree | 18,167 | 93% | 18,218 | 93% |
| 1st Takers | 16,818 | 95% | 17,028 | 95% |
| Repeaters** | 1,349 | 67% | 1,190 | 65% |
| DO Degree | 1,325 | 76% | 1,470 | 81% |
| 1st Takers | 1,258 | 77% | 1,411 | 82% |
| Repeaters** | 67 | 52% | 59 | 49% |
| Total US/Canadian | 19,492 | 92% | 19,688 | 92% |
| Examinees from Non-US/Canadian Schools | ||||
| 1st Takers | 14,585 | 71% | 15,762 | 70% |
| Repeaters** | 6,017 | 39% | 6,126 | 37% |
| Total non-US/Canadian | 20,602 | 61% | 21,888 | 61% |
| * Represents data for examinees tested in 2007 and reported through February 6, 2008. ** 'Repeaters' represents examinations given, not number of different examinees. |
||||
Step 2 CK
Details on the performance of examinees taking Step 2 CK in the 2005-2006 and 2006-2007 academic years are provided in Table 2A. First-time takers from US and Canadian medical schools granting the MD degree numbered 16,447 for 2004-2005 and 16,493 for 2005-2006. First-time takers from non-US/Canadian medical schools numbered approximately 16,500 for 2005-2006 and 2006-2007. First-time takers from non-US/Canadian medical schools numbered 11,305 and 12,584, respectively. The pass rates for first-time takers from MD-granting US and Canadian medical schools were 95% and 96%, respectively. As noted with Step 1, given the opportunity for this same group to repeat the examination, the ultimate Step 2 CK passing rate across test administrations is expected to increase to approximately 99%.
| TABLE 2A - 2005-2007 STEP 2 CK ADMINISTRATIONS* Number Tested and Percent Passing |
||||
|---|---|---|---|---|
| 2005-2006 | 2006-2007 | |||
| #Tested | %Passing | #Tested | %Passing | |
| Examinees from US/Canadian Schools that Grant | ||||
| MD Degree | 17,714 | 93% | 17,571 | 94% |
| 1st Takers | 16,493 | 95% | 16,512 | 96% |
| Repeaters** | 1,221 | 72% | 1,059 | 72% |
| DO Degree | 453 | 80% | 567 | 87% |
| 1st Takers | 439 | 80% | 546 | 87% |
| Repeaters** | 14 | 57% | 21 | 71% |
| Total US/Canadian | 18,167 | 93% | 18,138 | 94% |
| Examinees from Non-US/Canadian Schools | ||||
| 1st Takers | 11,305 | 77% | 12,584 | 79% |
| Repeaters** | 3,557 | 50% | 3,653 | 52% |
| Total non-US/Canadian | 14,862 | 71% | 16,237 | 73% |
| * Data for Step 2 CK are provided for examinees tested during the period of July 1 to June 30. ** 'Repeaters' represents examinations given, not number of different examinees. |
||||
Step 2 CS
Details on the numbers and overall performance of examinees taking Step 2 CS in the 2005-2006 and 2006-2007 academic years are provided in Table 2B. First-time takers from US and Canadian medical schools granting the MD degree numbered 16,611 for 2005-2006 and 16,769 for 2006-2007, with corresponding passing rates of 98% and 97%, respectively. First-time takers from non-US/Canadian medical schools numbered 13,235 and 14,439 during these two periods. The respective, overall passing rates were 85% and 77%.
Examinees taking Step 2 CS must pass three separate sub-components in order to record an overall pass on Step 2 CS. The three sub-components are: Integrated Clinical Encounter (ICE), Communication and Interpersonal Skills (CIS), Communication and Interpersonal Skills (CIS), and Spoken English Proficiency (SEP). For the total US/Canadian and the total non-US/Canadian medical school groups separetly, Table 2C provides first-taker passing rates on each of the CS sub-components.
Step 2 Standard Setting
Performance standards for both Step 2 CK and CS were reviewed in 2007. Data for consideration in the review included the results of an August 2006 survey regarding the appropriateness of current USMLE pass/fail standards for the computer-based Steps, described on page 49. An additional survey regarding the appropriateness of current USMLE pass/fail standards for Step 2 CS was conducted in March 2007.
In addition to the survey, standard setting exercises were conducted using six panels of physicians. Three panels reviewed materials for the Step 2 CK examination, and three panels reviewed materials for the Step 2 CS examination. The 62 panelists (29 for CK and 33 for CS) were selected to represent a range of medical schools and medical specialties. In addition, panelists had a broad range of roles, such as course and clerkship directors, program directors, department chairs, practitioners, and state board members; a range of gender and ethnic groups were also included. Each CK panel met for 1½ days, engaging in a modified version of the Angoff standard-setting procedure. Each CK panelist saw a subset of the items appearing on the Step 2 CK exam. Each CS panel met for 3 days. CS panelists saw a set of videotaped patient encounters from the CS exam, as well as patient notes from those encounters. As a result of their review, a recommended minimum passing performance level was identified, representing the opinion of the panelists on the required mastery of examination content for medical licensure purposes. The results were provided to the Step 2 Committee for consideration.
At its June 2007 meeting, the Step 2 Committee considered the results of the surveys and the standard setting exercises, as well as data on recent trends in examinee performance and on the relationship of score precision to the pass/fail decision. As a result of this review, the Step 2 Committee decided to raise the three-digit score recommended to pass Step 2 CK from 182 to 184. The new minimum passing score was applied to Step 2 CK examinations for which the first day of testing was on or after July 1, 2007.
For Step 2 CS, the Step 2 Committee decided to increase the performance levels required to receive a passing outcome on two of the three Step 2 CS subcomponents: CIS and SEP. No change was made to minimum passing requirements for the ICE subcomponent of Step 2 CS. The new passing requirements were applied to Step 2 CS examinations for which the first day of testing was on or after July 15, 2007.
| TABLE 2B - 2005-2007 STEP 2 CS ADMINISTRATIONS* Number Tested and Percent Passing |
||||
|---|---|---|---|---|
| 2005-2006 | 2006-2007 | |||
| #Tested | %Passing | #Tested | %Passing | |
| Examinees from US/Canadian Schools that Grant | ||||
| MD Degree | 16,936 | 98% | 17,256 | 97% |
| 1st Takers | 16,611 | 98% | 16,769 | 97% |
| Repeaters** | 325 | 97% | 487 | 93% |
| DO Degree | 28 | 89% | 28 | 93% |
| 1st Takers | 27 | 89% | 28 | 93% |
| Repeaters** | 1 | † | 0 | N/A |
| Total US/Canadian | 16,964 | 98% | 17,284 | 97% |
| Examinees from Non-US/Canadian Schools | ||||
| 1st Takers | 13,235 | 85% | 14,439 | 77% |
| Repeaters** | 1,875 | 81% | 2,379 | 68% |
| Total non-US/Canadian | 15,110 | 84% | 16,818 | 76% |
| * Data for Step 2 CS are provided for examinees tested during the period of July 1 to June 30. **‘Repeaters’ represents examinations given, not number of different examinees. † Performance data not reported for categories containing fewer than 5 examinees. N/A not applicable. |
||||
| TABLE 2C - 2005-2007 STEP 2 CS ADMINISTRATIONS* First Taker Passing Rates** for Subcomponents: Integrated Clinical Encounter (ICE), Communication and Interpersonal Skills (CIS), Spoken English Proficiency (SEP) |
||||||
|---|---|---|---|---|---|---|
| 2005-2006 | 2006-2007 | |||||
| ICE | CIS | SEP | ICE | CIS | SEP | |
| All US/Canadian Schools | 98 | >99 | >99 | 97 | 99 | 100 |
| All Non-US/Canadian Schools | 89 | 93 | 98 | 85 | 87 | 99 | * Data for Step 2 CS are provided for examinees tested during the period of July 1 to June 30. **‘>99’ is used to signify those passing rates that would otherwise round up to 100%. |
Step 3
Details on the performance of examinees taking Step 3 in 2006 and 2007 are provided in Table 3. Data for 2007 are based upon examinees whose results were reported through February 6, 2008. First-time takers who were graduates of MD-granting schools in the US and Canada numbered 16,395 in 2006 and 16,633 in 2007. First-time takers who were graduates of non-US/Canadian medical schools numbered 9,003 and 9,384, respectively for the same years. For both 2006 and 2007, the pass rate for first-time takers who were graduates of MD-granting US and Canadian medical schools was 96%. Like Step 1 and Step 2 CK, the ultimate Step 3 passing rate, accounting for repeat attempts, is expected to increase to approximately 99% for this same group.
| TABLE 3 - 2006-2007 STEP 3 ADMINISTRATIONS Number Tested and Percent Passing |
||||
|---|---|---|---|---|
| 2006 | 2007* | |||
| #Tested | %Passing | #Tested | %Passing | |
| Examinees from US/Canadian Schools that Grant | ||||
| MD Degree | 17,427 | 94% | 17,570 | 95% |
| 1st Takers | 16,395 | 96% | 16,633 | 96% |
| Repeaters** | 1,032 | 70% | 937 | 72% |
| DO Degree | 34 | 97% | 21 | 86% |
| 1st Takers | 32 | 97% | 20 | 85% |
| Repeaters** | 2 | † | 1 | † |
| Total US/Canadian | 17,461 | 94% | 17,591 | 95% |
| Examinees from Non-US/Canadian Schools | ||||
| 1st Takers | 9,003 | 75% | 9,384 | 79% |
| Repeaters** | 3,471 | 56% | 3,537 | 60% |
| Total non-US/Canadian | 12,474 | 70% | 12,921 | 73% |
| * Represents data for examinees tested in 2007 and reported through February 6, 2008. ** 'Repeaters' represents examinations given, not number of different examinees. † Performance data not reported for categories containing fewer than 5 examinees. |
||||