ComingOn text
Customer support replies
Does the model promise a refund your terms do not allow?
The protocol for this benchmark is written. No model has been queried yet, so this hub shows no figure for this task.
What this test will measure
Answer after-sales requests from the terms of sale and order history. The reply must be accurate, policy-compliant, and hand over to a human when it should.
What will be graded
- Answer accuracy
- Policy compliance
- Tone and empathy
- Knowing when to escalate
What it is waiting for
No public dataset exists: these documents never leave the company. They will be collected from partners, with their consent, and only the scores will be published.
- Place on the roadmap
- Wave 4
- Target sample
- 90 tickets
- What the model receives
- Text
One business function at a time, one task at a time. Every wave ends with a publication.
No figure is shown here because there is none. The day this task is measured, its ranking will appear on this very page.
How the hub measures — how an answer is verified, the rubric and the verdicts, on the task already measured.