NRMP-like market: applications and interviews
Applications and interviews
The funnel from applications to rank order lists, which applicants get an interview and a match, how the interviews are spread over applicants, the signals, what interviews revealed, and every application with filters.
What to do here
- Filter the applications by the stage they reached, by signal or by name.
- The tabs above lead to the population, the views before interviews, the applications, the match, and the lists of applicants and programs.
Columns
- Applicant
- The applicant; the link opens their page.
- Program
- The program applied to; the link opens its page.
- Applicant's pre-interview rank
- Where the applicant ranked the program before interviews. 1 is the favourite.
- Signal
- The tier of the signal the applicant sent, if any.
- Invited
- The wave in which the program invited the applicant.
- Interview
- Yes if the interview took place; Declined if the applicant was invited but did not go.
- Applicant's list rank
- Where the applicant put the program on their rank order list.
- Program's list rank
- Where the program put the applicant on its rank order list.
- Match
- Marks the applications that ended in the match.
A saved run of the simulator: everyone who opens it sees this same market. Simulated from the assumptions in the parameters; not a prediction of any real applicant's or program's match.
From applications to rank order lists
Where do applications drop out?
Every application through the stages: invited to interview or not, interviewed or not (declined, or over the applicant's interview cap), on the applicant's rank order list or not, matched or not. Each band's width is a number of applications; hover a band for its count and share. Grey marks drop-offs. It counts applications (applicant–program pairs), not applicants.
Learn more in the helpOf 31,447 applications, 13,969 led to an interview invitation, 8,203 to an interview, 8,203 to a place on the applicant's rank order list and 886 to a match.
The numbers
| Stage | Applications | Share of all |
|---|---|---|
| Applied | 31,447 | 100.0% |
| Invited | 13,969 | 44.4% |
| Interviewed | 8,203 | 26.1% |
| On the applicant's list | 8,203 | 26.1% |
| Matched | 886 | 2.8% |
Which applicants get an interview and a match?
Every applicant counted once: whether they had at least one interview, and whether they matched. With Colour by strength on, each stage splits into five groups by strength percentile (fifths; applicants of equal strength stay in the same group), from the bottom 20% in red through the middle in grey to the top 20% in blue, and each drop-off shows which groups it holds, so the quality of the applicants can be followed through the stages. Each band's width is a number of applicants. Hover a stage or a band for its count and its share of all applicants (with the switch on, of its group) and to highlight its path; a band after the first stage also gives its share of the stage it leaves. No interview splits into never invited and invited without an interview. With the switch on, each drop-off's bar is split into the groups' colours in proportion, and the small bar beside its label shows the same mix from weaker to stronger; hover the drop-off for each group's count, its share of the drop-off and the share of the group it holds: a group that loses a larger share of its applicants does worse. Strength is the applicant's latent strength. The view all programs share is mostly strength, mixed with the applicant's attributes, and each program sees it only through its own noisy view. The funnel above counts applications instead: strong applicants hold many interviews but match only once.
Learn more in the helpOf 1,000 applicants, 961 had at least one interview and 886 matched (88.6%); 39 had no interview, 39 of them never invited. By strength, 68.0% of the bottom 20% matched, against 96.0% of the top 20%. The bottom 20% make up 23 of the 39 with no interview and 41 of the 75 interviewed but not matched.
- Bottom 20%: 0–20
- 20th–40th percentile: 20–40
- 40th–60th percentile: 40–60
- 60th–80th percentile: 60–80
- Top 20%: 80–100
The numbers
| Who | Strength (z) | Applicants | Never invited | Invited, no interview | Interviewed | Interviewed, not matched | Matched | Share matched |
|---|---|---|---|---|---|---|---|---|
| Bottom 20% | -4.99 to -1.28 | 200 | 23 | 0 | 177 | 41 | 136 | 68.0% |
| 20th–40th percentile | -1.28 to -0.45 | 200 | 3 | 0 | 197 | 13 | 184 | 92.0% |
| 40th–60th percentile | -0.44 to 0.21 | 200 | 5 | 0 | 195 | 12 | 183 | 91.5% |
| 60th–80th percentile | 0.21 to 0.90 | 200 | 4 | 0 | 196 | 5 | 191 | 95.5% |
| Top 20% | 0.90 to 4.01 | 200 | 4 | 0 | 196 | 4 | 192 | 96.0% |
| All applicants | 1,000 | 39 | 0 | 961 | 75 | 886 | 88.6% |
Who gets the interviews?
Applicants by the number of interviews they had, from none upwards. With Colour by strength on, each bar is split into five groups by strength percentile, from the bottom 20% in red at its foot, through the middle in grey, to the top 20% in blue at its top. Each bar is a share of all applicants. A tall first bar is applicants no program interviewed; a tall last bar is applicants who reached the most interviews an applicant accepts (Interviews per applicant (max)). With the switch on, a bar's colours show who had that many: blue towards the right means the strongest applicants hold the most interviews. Hover a bar for the numbers. The summary says how concentrated the interviews are: the share held by the tenth of applicants with the most, and the Gini coefficient (0 = every applicant has the same number, 1 = one applicant has them all). It counts the interviews held, not the invitations: one an applicant declined, or could not fit under their limit, is left out.
Learn more in the helpApplicants had 8.2 interviews on average: 39 (3.9%) had none and 450 (45.0%) had 12, the most. The tenth of applicants with the most interviews holds 14.6% of all interviews (Gini 0.28). By strength, the bottom 20% had 5.1 interviews on average and the top 20% 10.0.
- Bottom 20%: 0–20
- 20th–40th percentile: 20–40
- 40th–60th percentile: 40–60
- 60th–80th percentile: 60–80
- Top 20%: 80–100
The numbers
| Interviews | Applicants | Share of all | By strength percentile | ||||
|---|---|---|---|---|---|---|---|
| 0–20 | 20–40 | 40–60 | 60–80 | 80–100 | |||
| No interview | 39 | 3.9% | 23 | 3 | 5 | 4 | 4 |
| 1 interview | 60 | 6.0% | 26 | 17 | 10 | 6 | 1 |
| 2 interviews | 52 | 5.2% | 21 | 12 | 7 | 8 | 4 |
| 3 interviews | 56 | 5.6% | 21 | 8 | 10 | 11 | 6 |
| 4 interviews | 48 | 4.8% | 18 | 9 | 7 | 4 | 10 |
| 5 interviews | 52 | 5.2% | 14 | 17 | 11 | 6 | 4 |
| 6 interviews | 48 | 4.8% | 11 | 10 | 9 | 12 | 6 |
| 7 interviews | 41 | 4.1% | 9 | 13 | 5 | 9 | 5 |
| 8 interviews | 46 | 4.6% | 10 | 14 | 6 | 4 | 12 |
| 9 interviews | 38 | 3.8% | 7 | 10 | 10 | 4 | 7 |
| 10 interviews | 36 | 3.6% | 5 | 9 | 11 | 5 | 6 |
| 11 interviews | 34 | 3.4% | 4 | 5 | 11 | 8 | 6 |
| 12 interviews | 450 | 45.0% | 31 | 73 | 98 | 119 | 129 |
| Applications | 31.45 |
|---|---|
| Signals | 0.00 |
| Interview invitations | 13.97 |
| Interviews | 8.20 |
| Rank order list entries | 8.20 |
- Interviews per position
- 8.86
- Interview slots offered
- 9,260
- Invitations declined (or over the applicant's cap)
- 5,766
- Applicants with no interview
- 39
Signals
No signals were sent: there are no signal tiers in the parameters. Of all applications, 26.1% led to an interview.
Interviews and outcomes for applicants
- Where the match stands among the applicant's interviews, by realised utility (1 = the best)
- 2.39
- Regret: best interviewed program minus the match (SD)
- 0.567
- Post-interview fidelity, applicants
- 0.981
- Post-interview fidelity, programs
- 0.979
The realised utility includes the fit an interview reveals. Post-interview fidelity is the correlation of the realised utility and the post-interview view over all interviews (1 = interviews reveal everything).
Every application
Each row is one application: the applicant's pre-interview rank of the program, the signal they sent, the program's invitation (and its wave), whether the interview took place, where each side put the other on its rank order list, and the match. Filter by stage, signal or name; names link to each agent's page.
Showing 1–100 of 31447