From df023474f1c9e9fb017a86b3468dacccad9365cb Mon Sep 17 00:00:00 2001 From: Abimael Martell Date: Mon, 20 Apr 2026 22:50:57 -0700 Subject: [PATCH] update eval instructions --- CLAUDE.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/CLAUDE.md b/CLAUDE.md index 05ccaa0..2b1e38f 100644 --- a/CLAUDE.md +++ b/CLAUDE.md @@ -61,7 +61,8 @@ src/ - **Unit tests**: inline `#[cfg(test)] mod tests` in each module with synthetic data. - **Integration tests**: `tests/integration_tests.rs` with fixture PDFs in `tests/fixtures/`. -- **Regression suite**: sibling repo `pdf-evals` with 179+ snapshot PDFs. Run `cargo build --release` then `bench.py test` in that repo before committing. +- **Regression suite**: sibling repo `pdf-evals` with 187+ snapshot PDFs. Run `cargo build --release` then `bench.py test` in that repo before committing. +- **Semantic quality**: run `bench.py score` in `pdf-evals` for the semantic verdict (TEDS + MHS + reading order + char/word + list preservation, composited). Character-level diff alone misclassifies structural improvements (e.g., column-detection rewrites) as regressions — `score` is the tie-breaker. See `pdf-evals/CLAUDE.md` "Semantic scoring". ## Debugging