ComingOn documents
Risk clause detection
Does the model see the auto-renewal buried on page twelve?
The protocol for this benchmark is written. No model has been queried yet, so this hub shows no figure for this task.
What this test will measure
Find, in supplier contracts, the clauses a lawyer would flag: unbalanced liability caps, exclusivity, auto-renewal, penalties, personal-data subprocessing.
What will be graded
- Liability
- Exclusivity
- Auto-renewal
- Penalties
- Personal data
What it is waiting for
A real, annotated public dataset exists. It remains to be wired into the pipeline.
- Place on the roadmap
- Wave 1
- Target dataset
- CUAD — 510 contrats commerciaux annotés par des juristes, CC BY 4.0
- Target sample
- 50 contracts
- What the model receives
- Documents (images or PDF)
One business function at a time, one task at a time. Every wave ends with a publication.
No figure is shown here because there is none. The day this task is measured, its ranking will appear on this very page.
How the hub measures — how an answer is verified, the rubric and the verdicts, on the task already measured.