NEPVERSA: a version-aware Nepali statutory retrieval benchmark derived from amendment footnotes
Bhagat, N. (2026). Preprint, Zenodo. Under review at ACM TALLIP. Mentor: Prof. Achut Raj Kattel, Tribhuvan University.
Laws change, and a legal assistant that answers with last year's text is confidently wrong. NEPVERSA asks retrieval systems what a provision said on a given date: 455 provisions from 5 Acts, 99 amendment operations and 181 point-in-time questions, of which 61.3% expect the system to abstain. Gold answers come from the amendment footnotes themselves, not from an LLM judge.
Recovering that history meant reading scanned Gazette notices and PDFs that extract to corrupted Unicode. I found 7 silent extraction defects, pinned each with mutation-tested regression tests, and shipped a one-command reproduction that re-verifies every published number by SHA-256.


