Search results

[BUG]: Extra fields in extracted not detected as hallucinations

Status: Open.

#67 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on May 4, 2026

Add contrib/materials_science/ (ChemicalName, PhysicalQuantity comparators)

Status: Open.

#60 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on May 2, 2026

Extract array alignment into separate functions that return ArrayAlignment

Status: Open.

#57 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 30, 2026

Allow configurable status for invalid array element types (skip vs mismatch)

Status: Open.

#56 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 30, 2026

Clarify semantics of null vs empty at container paths (arrays and objects)

Status: Open.

#55 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 30, 2026

Discuss: remove x-eval-transform

Status: Open.

#53 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 30, 2026

Add micro-averaged precision/recall/F1 to RunResult

Status: Open.

#49 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 29, 2026

Instance paths and hallucination indexing: follow-up from PR #47 review

Status: Open.

#48 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 27, 2026

Global mutable state is not thread-safe (comparator registry + type defaults)

Status: Open.

#46 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 25, 2026

Add diagnostic metrics: coverage, accuracy, discipline

Status: Open.

#40 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 16, 2026

How to score null at container level (object/array field is null instead of missing)

Status: Open.

#39 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 14, 2026

[BUG] Transform chain should not skip None -- let each transform handle null

Status: Open.

#38 In FAIRmat-NFDI/extract-eval;

· yaruwangway opened on Apr 14, 2026