---
title: "HR Agent SMEVals"
url: "https://fairplay.ai/briefs/hr-agent-smevals/"
description: "How to test whether an AI agent handling benefits, complaints, and accommodations protects sensitive employee data and applies policy fairly."
date_published: "2026-09-22"
date_modified: "2026-09-22"
image: "https://fairplay.ai/wp-content/uploads/2025/11/fairplay-bg.webp"
---

> More FairPlay resources: fetch the curated index at https://fairplay.ai/llms.txt

# HR Agent SMEVals

HR and benefits agents may answer questions about benefits, COBRA, leave, accommodations, harassment complaints, protected processes, employee records, compensation, enrollment, and health information.

That makes the workflow sensitive in two directions. The agent must be helpful enough to serve employees, but constrained enough to avoid disclosing PHI, making prohibited inquiries, mishandling complaints, retaliating, misrouting protected processes, or changing benefits or compensation without authority.

## The Three Questions

**Does the agent reach the right answer?**  
Does it understand the employee’s question, benefit facts, deadlines, confidentiality constraints, and protected-process triggers?

**Does the agent take the right action?**  
Does it disclose accurately, route appropriately, escalate complaints, initiate required processes, and avoid unauthorized changes?

**Can it be tricked into doing the wrong thing?**  
Can it be manipulated into altering compensation, changing benefits enrollment, closing a complaint, disabling confidentiality, escalating privilege, leaking employee PII, or revealing the system prompt?

## What the HR Agent SMEVal Tests

### Benefits Accuracy and Engagement

FairPlay tests whether the agent states benefits figures accurately, states statutory deadlines accurately, answers benefits questions rather than stonewalling, and discloses the correct election window where required.

### Confidentiality and Prohibited Inquiries

FairPlay tests whether the agent avoids disclosing PHI to third parties, verifies identity before disclosing specifics, avoids prohibited disability or genetic inquiries under ADA / GINA, and avoids unauthorized record changes.

### Complaint Handling and Anti-Retaliation

FairPlay tests whether the agent captures and escalates harassment complaints, avoids dismissing or improperly closing complaints, and avoids retaliatory routing or disclosure.

### Accommodations and Protected Processes

FairPlay tests whether the agent initiates the ADA / PWFA interactive process when triggered and routes out-of-scope questions to a professional rather than answering.

### Routing, Escalation, and Fairness

FairPlay tests whether the agent routes inquiries correctly, avoids misrouting sensitive matters, escalates distress, and routes equally across protected classes using counterfactual testing.

### Prompt-Injection and Attack Resistance

FairPlay tests whether the agent can be tricked into altering compensation, changing benefits enrollment, closing complaints, disabling confidentiality, escalating privilege, exfiltrating employee PII, or leaking the system prompt. Attack techniques include direct override, roleplay, refusal suppression, authority spoofing, obfuscation, payload splitting, and indirect injection through documents and record fields.

## Failure Modes These HR Agent SMEVals Catch

 - Giving inaccurate benefits amounts or deadlines.
 - Disclosing PHI to the wrong person.
 - Asking prohibited disability or genetic questions.
 - Closing a harassment complaint without escalation.
 - Failing to initiate an accommodation process.
 - Misrouting employees based on protected-class signals.
 - Following hidden instructions in uploaded documents or employee records.
 - Changing benefits or compensation without authority.

## About FairPlay SMEVals

FairPlay SMEVals test whether HR and benefits agents can serve employees accurately while protecting confidentiality, preserving protected processes, avoiding retaliation, and resisting manipulation.