Abimael MartellandClaude Opus 4.6 d2c96e2842 fix(cjk): Skip Latin case heuristics for CJK text in fallback spacing path ...

The fallback estimated-width path in should_join_items() used Latin
case-based thresholds (uppercase/lowercase transitions) to decide word
boundaries. For CJK text emitted as per-glyph items, these heuristics
incorrectly inserted spaces within words (e.g., "ス テ ップ" instead of
"ステップ"). Now detects CJK characters and uses a generous join
threshold, matching the behavior already applied in the accurate-width path.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-13 13:25:22 -08:00

..

bin

chore: Fix clippy warnings in debug binaries

2026-02-13 12:57:49 -08:00

detector.rs

improve spacing detection, and layout detection

2026-02-09 12:45:08 -08:00

extractor.rs

fix(cjk): Skip Latin case heuristics for CJK text in fallback spacing path

2026-02-13 13:25:22 -08:00

glyph_names.rs

fix(text): Fix ligature corruption and expand ligature characters

2026-02-12 15:59:04 -08:00

lib.rs

fix encoding, and spacing on custom fonts

2026-02-11 12:17:42 -08:00

markdown.rs

fix(text): Improve word spacing, paragraph joining, and page breaks

2026-02-13 12:55:00 -08:00

tables.rs

fix(tables): Use font-size-adaptive threshold for row boundary detection

2026-02-13 13:18:41 -08:00

tounicode.rs

fix(encoding): Fix CJK/Unicode encoding bug

2026-02-11 12:33:06 -08:00