Interviews
A scorecard works when every interviewer is looking for the same evidence.
Unstructured interviews feel personal and still disagree. A short scorecard gives the conversation a shared target, so the debrief is about the work instead of who told the better story.
01Name the few traits that change the hire
Start from the decisions this person will make in the first six months. Turn those decisions into three to five traits. A trait is useful when two reviewers can point at evidence for it. “Culture fit” and “high potential” are not traits until you can say what you would see or hear.
Separate must-haves from preferences. A scorecard that tries to measure everything measures nothing, and interviewers quietly invent their own shortcuts.
02Write the evidence before you meet anyone
For each trait, describe what a strong, mixed, and weak answer looks like in this role. Use observable language: the sequence they would follow, the tradeoff they would name, the people they would tell. Avoid adjectives that only restate the trait.
If the trait was already tested in a written or video work sample, the live interview should go deeper on that answer rather than start over. The scorecard can include both the async evidence and the follow-up.
03Score independently, then compare
Each interviewer should record a score and a short note before the debrief. That note should quote or paraphrase what the candidate actually said. Independent scores keep the loudest person in the room from setting the memory of the interview.
In the debrief, start with disagreements. Agreement is easy. The useful conversation is why two people heard different evidence for the same trait, and whether the rubric itself is unclear.
04Keep the card short enough to survive a busy week
A scorecard people abandon is worse than no scorecard, because the team thinks it has a process. One page is enough: trait, question, evidence scale, note. Attach it to the applicant record so the next reviewer can see it without asking for a recap.
Revisit the card after a few hires. Drop traits that never changed a decision. Add a trait when the same surprise keeps showing up on the job.
Questions
How many traits belong on an interview scorecard?
Three to five traits is enough for most roles. More than that and interviewers stop using the scale and start writing impressions.
Should every interviewer ask the same questions?
Yes for the traits you are comparing. You can leave a little time for role-specific follow-ups, but the scored portion should be consistent so the scores mean the same thing.
Can AI write the scorecard?
AI can draft traits and sample evidence from a job description. A hiring manager should edit that draft so the evidence matches the real work, and a person should still own every score.