LLM-based Schema-Guided Extraction and Validation of Missing-Person Intelligence from Heterogeneous Data Sources

Missing-person and child-safety investigations rely on heterogeneous case documents, including structured forms, bulletin-style posters, and narrative web profiles. Variations in layout, terminology, and data quality impede rapid triage, large-scale analysis, and search-planning workflows. This paper introduces the Guardian Parser Pack, an AI-driven parsing and normalization pipeline that transforms multi-source investigative documents into a unified, schema-compliant representation suitable for operational review and downstream spatial modeling. The proposed system integrates (i) multi-engine PDF text extraction with Optical Character Recognition (OCR) fallback, (ii) rule-based source identification with source-specific parsers, (iii) schema-first harmonization and validation, and (iv) an optional Large Language Model (LLM)-assisted extraction pathway incorporating validator-guided repair and shared geocoding services. We present the system architecture, key implementation decisions, and output design, and evaluate performance using both gold-aligned extraction metrics and corpus-level operational indicators. On a manually aligned subset of 75 cases, the LLM-assisted pathway achieved substantially higher extraction quality than the deterministic comparator (F1 = 0.8664 vs. 0.2578), while across 517 parsed records per pathway it also improved aggregate key-field completeness (96.97\% vs. 93.23\%). The deterministic pathway remained much faster (mean runtime 0.03 s/record vs. 3.95 s/record for the LLM pathway). In the evaluated run, all LLM outputs passed initial schema validation, so validator-guided repair functioned as a built-in safeguard rather than a contributor to the observed gains. These results support controlled use of probabilistic AI within a schema-first, auditable pipeline for high-stakes investigative settings.

Paper

References (18)

Scroll for more · 6 remaining

Similar papers

Agents ingesting contracts, invoices and filings need nested JSON matching a caller-supplied schema, but 2026 extraction benchmarks report frontier models achieving five-percent field-level pass rates on complex nested documents, because repeated arrays must be row-aligned and an absent field is indistinguishable from an invented one. A naive single prompt with schema-constrained decoding guarantees syntactically valid JSON, not correct JSON: it silently fabricates plausible values for missing fields and emits no per-field trust signal, so callers ingest hallucinations. Evaluate a vision-language extractor combining page-level retrieval, per-field self-consistency across repeated re-reads and layout crops, logprob-and-agreement confidence fusion, mandatory source-span grounding with page and bounding-box coordinates, an explicit not_present sentinel, and arithmetic cross-checks on totals. Measure field-level precision, recall and F1, hallucination rate on deliberately absent fields, span-grounding accuracy and risk-coverage AUROC of the confidence, against a hand-labeled gold set of nested documents with injected omissions, beating a naive base-model prompt, constrained-decoding-only extraction, and a commercial OCR pipeline. Deliver as the prototype a minimal runnable Python MCP server (stdio) exposing the priced AI tool extract_schema_with_abstention that invokes a language or ML model to produce its output, with a typed input/output schema, an x402-style pay-per-call metering stub that records a per-call price in USDT and emits a settlement receipt, and one smoke test that exercises the tool end to end.Dogukan Ali Gundogan2026 · Zenodo (CERN European Organization for Nuclear Research) In Library
Agents ingesting contracts, invoices and filings need nested JSON matching a caller-supplied schema, but 2026 extraction benchmarks report frontier models achieving five-percent field-level pass rates on complex nested documents, because repeated arrays must be row-aligned and an absent field is indistinguishable from an invented one. A naive single prompt with schema-constrained decoding guarantees syntactically valid JSON, not correct JSON: it silently fabricates plausible values for missing fields and emits no per-field trust signal, so callers ingest hallucinations. Evaluate a vision-language extractor combining page-level retrieval, per-field self-consistency across repeated re-reads and layout crops, logprob-and-agreement confidence fusion, mandatory source-span grounding with page and bounding-box coordinates, an explicit not_present sentinel, and arithmetic cross-checks on totals. Measure field-level precision, recall and F1, hallucination rate on deliberately absent fields, span-grounding accuracy and risk-coverage AUROC of the confidence, against a hand-labeled gold set of nested documents with injected omissions, beating a naive base-model prompt, constrained-decoding-only extraction, and a commercial OCR pipeline. Deliver as the prototype a minimal runnable Python MCP server (stdio) exposing the priced AI tool extract_schema_with_abstention that invokes a language or ML model to produce its output, with a typed input/output schema, an x402-style pay-per-call metering stub that records a per-call price in USDT and emits a settlement receipt, and one smoke test that exercises the tool end to end.Dogukan Ali Gundogan2026 · Zenodo (CERN European Organization for Nuclear Research) In Library
© 2026 NYSGPT2525 LLC