Benchmark
First measurement: 27 models read 100 real invoices
The winner costs $0.0009 per invoice and misses none out of a hundred. The two most expensive models in the panel miss one — and three models invent a VAT number that does not exist.
What enters the rankings, what changes in the method, and the reasoning behind every choice.
Benchmark
The winner costs $0.0009 per invoice and misses none out of a hundred. The two most expensive models in the panel miss one — and three models invent a VAT number that does not exist.
Announcement
From invoice reading alone to 22 benchmarks, from finance to management. One is measured today; the other twenty-one have a written protocol and a test set still to be built.
Analysis
Accuracy, cost, time, hallucinations: the hub never melts them into one number. A model can top the accuracy table and still be unusable because it makes things up.
24 articles
Benchmark
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Announcement
Model
Written from the rankings
Analysis
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Analysis
Model
Written from the rankings
Analysis
Benchmark
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings
Model
Written from the rankings