Case 50
Fair Interview Scorecard
Scenario
You are hiring a team leader for the customer service function at Millbrook Utilities. Last time, interviewers each assessed different things and could not agree.
Why this framework
Uses PIN: what it's for, the context and source of truth, and a narrow ask. Enough for most everyday work.
Example context
Job description, Team Leader, Customer Service, Millbrook Utilities: leads a team of 12 advisers handling billing and payment calls and webchat. Responsibilities: coach advisers weekly using call reviews; manage daily rotas and intraday staffing with the planning team; handle escalated complaints and resolve within policy; hit team targets for call quality (internal score 85+), first contact resolution and complaint response times; spot repeat issues and feed them to process improvement; support vulnerable customers in line with our vulnerability policy. Essential: experience leading or coaching a team in a customer contact setting; confident handling difficult conversations; uses data to manage performance. Desirable: experience of utilities or regulated industry. Competency framework (extract): Leading people (sets clear expectations, coaches, gives feedback); Customer focus (understands needs, resolves issues fairly); Using information (reads data, acts on it); Resilience (stays calm under pressure); Working together (builds relationships across teams); Doing the right thing (follows policy, protects vulnerable customers).
Prompt
Purpose: Build a scorecard and interview questions for the team leader role so every interviewer assesses the same things.
Context: Use the attached job description and our competency framework. The job description is the final word on what the role needs.
Narrow the ask: Give me five criteria drawn from the job description, what strong, adequate and weak evidence looks like for each, and two interview questions per criterion. A table, then the questions. Avoid questions about personal circumstances.
Materials (pasted here in place of the attachments):
Job description, Team Leader, Customer Service, Millbrook Utilities: leads a team of 12 advisers handling billing and payment calls and webchat. Responsibilities: coach advisers weekly using call reviews; manage daily rotas and intraday staffing with the planning team; handle escalated complaints and resolve within policy; hit team targets for call quality (internal score 85+), first contact resolution and complaint response times; spot repeat issues and feed them to process improvement; support vulnerable customers in line with our vulnerability policy. Essential: experience leading or coaching a team in a customer contact setting; confident handling difficult conversations; uses data to manage performance. Desirable: experience of utilities or regulated industry.
Competency framework (extract): Leading people (sets clear expectations, coaches, gives feedback); Customer focus (understands needs, resolves issues fairly); Using information (reads data, acts on it); Resilience (stays calm under pressure); Working together (builds relationships across teams); Doing the right thing (follows policy, protects vulnerable customers).Example output from ChatGPT
Team Leader Interview Scorecard
Millbrook Utilities | Customer Service Team Leader | Structured interview
Purpose: Assess all candidates consistently against the role requirements, using the job description as the primary source and the competency framework to define observable behaviours.
1. Interview scorecard
Use the same five criteria and scoring scale for every candidate. The suggested weights reflect the responsibilities in the job description; they are not specified by Millbrook Utilities.
| Criterion | Weight | Strong evidence (5) | Adequate evidence (3) | Weak evidence (1) |
|---|---|---|---|---|
| 1. Leading and coaching advisers | 25% | Gives specific examples of weekly call reviews, constructive feedback, measurable improvement and clear expectations. | Has coached staff and given feedback, but limited evidence of sustained improvement. | No clear coaching method; relies on instruction or criticism. |
| 2. Performance management using data | 25% | Uses call quality, first contact resolution and complaint response data to identify causes, take action and measure results. Understands the 85+ quality target. | Understands KPIs and monitors performance, but actions or outcomes lack detail. | Cannot explain how data informs decisions or improvement. |
| 3. Complaint handling and customer protection | 25% | Resolves difficult complaints fairly within policy, stays calm, identifies vulnerability and makes appropriate adjustments or referrals. | Can manage complaints and follow policy, but gives limited evidence of handling vulnerability or complex cases. | Escalates unnecessarily, disregards policy or overlooks vulnerable customers. |
| 4. Workforce planning and daily operations | 15% | Adjusts rotas and intraday staffing based on demand, service impact and coordination with planning teams. | Can manage schedules and respond to staffing changes with some support. | Cannot prioritise coverage or respond effectively to unexpected demand. |
| 5. Cross-team collaboration and process improvement | 10% | Identifies repeat customer issues, uses evidence to recommend fixes, works across teams and measures improvement. | Shares recurring issues and works with others, but limited evidence of implemented improvements. | Treats recurring issues individually or struggles to collaborate. |
Competency mapping: 1: Leading people; 2: Using information; 3: Customer focus, Resilience and Doing the right thing; 4: Working together and Using information; 5: Working together and Using information.
2. Interview questions
Use these ten core questions in the same order for every candidate.
Criterion 1: Leading and coaching advisers
- Tell us about a time you coached an adviser whose customer interactions were below expectations. How did you approach the conversation, what actions followed, and what changed?
- How would you structure weekly call reviews and coaching for a team of 12 advisers while balancing individual development and team targets?
Criterion 2: Performance management using data
- Describe a time you used customer contact performance data to identify a problem and improve results. Which measures did you review, what did you do, and what was the outcome?
- Your team's call quality score is 82 against a target of 85+, while first contact resolution is declining. How would you investigate and improve both measures?
Criterion 3: Complaint handling and customer protection
- Tell us about a difficult customer complaint you handled. How did you establish the facts, remain calm, follow policy and reach a fair outcome?
- A customer is distressed about an overdue bill and says they cannot afford the proposed payment arrangement. How would you respond, including how you would identify and support potential vulnerability within policy?
Criterion 4: Workforce planning and daily operations
- Tell us about a time unexpected absence or increased contact volumes affected your team's service levels. How did you prioritise and coordinate the response?
- Two advisers call in sick during a busy morning, webchat queues are growing and several complaints need urgent responses. How would you manage the next two hours, including working with the planning team?
Criterion 5: Cross-team collaboration and process improvement
- Describe a recurring customer issue you identified. How did you establish its cause, involve other teams and assess whether the solution worked?
- Your advisers report that customers repeatedly contact the team because bills are difficult to understand. How would you investigate and work with other departments to address the problem?
3. Consistent scoring method
Score each criterion independently after recording the candidate's evidence.
Scoring anchors
| Score | Interpretation |
|---|---|
| 1 | Weak evidence |
| 2 | Between weak and adequate |
| 3 | Adequate evidence |
| 4 | Between adequate and strong |
| 5 | Strong evidence |
Each interviewer should independently record the candidate's specific actions, examples and outcomes before discussing scores with the panel. Ask consistent follow-ups such as "What did you personally do?" and "How did you measure success?"
Fairness safeguards: Assess essential experience in leading or coaching a customer contact team, difficult conversations and data-led performance management. Treat utilities or regulated-industry experience as desirable, not mandatory. Do not ask about age, family, health, childcare or other personal circumstances.
Decision rule: Compare weighted scores alongside the recorded evidence. Any proposed minimum score or hiring threshold should be agreed by the panel before interviews, not introduced after seeing candidates' results.
