ComingOn text
Tier-1 IT support
Can the model unblock a colleague without telling them to disable the antivirus?
The protocol for this benchmark is written. No model has been queried yet, so this hub shows no figure for this task.
What this test will measure
Resolve routine requests — mail, VPN, access rights — from the internal knowledge base. Advising a dangerous action is disqualifying, whatever the quality of the rest.
What will be graded
- Diagnosis
- Procedure compliance
- Refusing risky actions
- Escalation
What it is waiting for
No public dataset exists: these documents never leave the company. They will be collected from partners, with their consent, and only the scores will be published.
- Place on the roadmap
- Wave 4
- Target sample
- 80 requests
- What the model receives
- Text
One business function at a time, one task at a time. Every wave ends with a publication.
No figure is shown here because there is none. The day this task is measured, its ranking will appear on this very page.
How the hub measures — how an answer is verified, the rubric and the verdicts, on the task already measured.