Honesty about missing fields
Does it say nothing when the answer isn't there?
About one field in five that we ask for is not in the document. The right answer is null. Any value the model returns there is invented.
False nulls are shown next to it, so a model can't look honest by returning nothing.
Null honesty returns nothing when the field isn't there
Clairic
Cloudflare
NuExtract3
NuMind
GLiNER2
Fastino
Share of fields missing from the document where the model returned null instead of inventing a value.
False nulls returned nothing for a field that was there
Clairic
Cloudflare
NuExtract3
NuMind
GLiNER2
Fastino
Share of fields in the document that the model returned as null.
Test items and precision
- Items
- About 1,500 missing fields per test set, plus a document type where most fields are missing
- Precision
- About ±2 to ±3 points.