Case 50

Fair Interview Scorecard

Scenario

You are hiring a team leader for the customer service function at Millbrook Utilities. Last time, interviewers each assessed different things and could not agree.

Why this framework

Uses PIN: what it's for, the context and source of truth, and a narrow ask. Enough for most everyday work.

Example context

Job description, Team Leader, Customer Service, Millbrook Utilities: leads a team of 12 advisers handling billing and payment calls and webchat. Responsibilities: coach advisers weekly using call reviews; manage daily rotas and intraday staffing with the planning team; handle escalated complaints and resolve within policy; hit team targets for call quality (internal score 85+), first contact resolution and complaint response times; spot repeat issues and feed them to process improvement; support vulnerable customers in line with our vulnerability policy. Essential: experience leading or coaching a team in a customer contact setting; confident handling difficult conversations; uses data to manage performance. Desirable: experience of utilities or regulated industry. Competency framework (extract): Leading people (sets clear expectations, coaches, gives feedback); Customer focus (understands needs, resolves issues fairly); Using information (reads data, acts on it); Resilience (stays calm under pressure); Working together (builds relationships across teams); Doing the right thing (follows policy, protects vulnerable customers).

Prompt

Purpose: Build a scorecard and interview questions for the team leader role so every interviewer assesses the same things.

Context: Use the attached job description and our competency framework. The job description is the final word on what the role needs.

Narrow the ask: Give me five criteria drawn from the job description, what strong, adequate and weak evidence looks like for each, and two interview questions per criterion. A table, then the questions. Avoid questions about personal circumstances.

Materials (pasted here in place of the attachments):
Job description, Team Leader, Customer Service, Millbrook Utilities: leads a team of 12 advisers handling billing and payment calls and webchat. Responsibilities: coach advisers weekly using call reviews; manage daily rotas and intraday staffing with the planning team; handle escalated complaints and resolve within policy; hit team targets for call quality (internal score 85+), first contact resolution and complaint response times; spot repeat issues and feed them to process improvement; support vulnerable customers in line with our vulnerability policy. Essential: experience leading or coaching a team in a customer contact setting; confident handling difficult conversations; uses data to manage performance. Desirable: experience of utilities or regulated industry.
Competency framework (extract): Leading people (sets clear expectations, coaches, gives feedback); Customer focus (understands needs, resolves issues fairly); Using information (reads data, acts on it); Resilience (stays calm under pressure); Working together (builds relationships across teams); Doing the right thing (follows policy, protects vulnerable customers).

Example output from ChatGPT

Team Leader Interview Scorecard

Millbrook Utilities | Customer Service Team Leader | Structured interview

Purpose: Assess all candidates consistently against the role requirements, using the job description as the primary source and the competency framework to define observable behaviours.

1. Interview scorecard

Use the same five criteria and scoring scale for every candidate. The suggested weights reflect the responsibilities in the job description; they are not specified by Millbrook Utilities.

CriterionWeightStrong evidence (5)Adequate evidence (3)Weak evidence (1)
1. Leading and coaching advisers25%Gives specific examples of weekly call reviews, constructive feedback, measurable improvement and clear expectations.Has coached staff and given feedback, but limited evidence of sustained improvement.No clear coaching method; relies on instruction or criticism.
2. Performance management using data25%Uses call quality, first contact resolution and complaint response data to identify causes, take action and measure results. Understands the 85+ quality target.Understands KPIs and monitors performance, but actions or outcomes lack detail.Cannot explain how data informs decisions or improvement.
3. Complaint handling and customer protection25%Resolves difficult complaints fairly within policy, stays calm, identifies vulnerability and makes appropriate adjustments or referrals.Can manage complaints and follow policy, but gives limited evidence of handling vulnerability or complex cases.Escalates unnecessarily, disregards policy or overlooks vulnerable customers.
4. Workforce planning and daily operations15%Adjusts rotas and intraday staffing based on demand, service impact and coordination with planning teams.Can manage schedules and respond to staffing changes with some support.Cannot prioritise coverage or respond effectively to unexpected demand.
5. Cross-team collaboration and process improvement10%Identifies repeat customer issues, uses evidence to recommend fixes, works across teams and measures improvement.Shares recurring issues and works with others, but limited evidence of implemented improvements.Treats recurring issues individually or struggles to collaborate.

Competency mapping: 1: Leading people; 2: Using information; 3: Customer focus, Resilience and Doing the right thing; 4: Working together and Using information; 5: Working together and Using information.

2. Interview questions

Use these ten core questions in the same order for every candidate.

Criterion 1: Leading and coaching advisers

  1. Tell us about a time you coached an adviser whose customer interactions were below expectations. How did you approach the conversation, what actions followed, and what changed?
  2. How would you structure weekly call reviews and coaching for a team of 12 advisers while balancing individual development and team targets?

Criterion 2: Performance management using data

  1. Describe a time you used customer contact performance data to identify a problem and improve results. Which measures did you review, what did you do, and what was the outcome?
  2. Your team's call quality score is 82 against a target of 85+, while first contact resolution is declining. How would you investigate and improve both measures?

Criterion 3: Complaint handling and customer protection

  1. Tell us about a difficult customer complaint you handled. How did you establish the facts, remain calm, follow policy and reach a fair outcome?
  2. A customer is distressed about an overdue bill and says they cannot afford the proposed payment arrangement. How would you respond, including how you would identify and support potential vulnerability within policy?

Criterion 4: Workforce planning and daily operations

  1. Tell us about a time unexpected absence or increased contact volumes affected your team's service levels. How did you prioritise and coordinate the response?
  2. Two advisers call in sick during a busy morning, webchat queues are growing and several complaints need urgent responses. How would you manage the next two hours, including working with the planning team?

Criterion 5: Cross-team collaboration and process improvement

  1. Describe a recurring customer issue you identified. How did you establish its cause, involve other teams and assess whether the solution worked?
  2. Your advisers report that customers repeatedly contact the team because bills are difficult to understand. How would you investigate and work with other departments to address the problem?

3. Consistent scoring method

Score each criterion independently after recording the candidate's evidence.

Scoring anchors

ScoreInterpretation
1Weak evidence
2Between weak and adequate
3Adequate evidence
4Between adequate and strong
5Strong evidence

Each interviewer should independently record the candidate's specific actions, examples and outcomes before discussing scores with the panel. Ask consistent follow-ups such as "What did you personally do?" and "How did you measure success?"

Fairness safeguards: Assess essential experience in leading or coaching a customer contact team, difficult conversations and data-led performance management. Treat utilities or regulated-industry experience as desirable, not mandatory. Do not ask about age, family, health, childcare or other personal circumstances.

Decision rule: Compare weighted scores alongside the recorded evidence. Any proposed minimum score or hiring threshold should be agreed by the panel before interviews, not introduced after seeing candidates' results.