Implementation Guide

r"-\s\n\s" should be replaced with "" (empty string) to join words.

tools-only Updated 7 repo stars

File contents

Implementation Guide

Code Structure

How is the code organized?

  • pdf_to_epub/validation/text_canonicalizer.py

Implementation Notes

Key technical details to remember:

Unicode

Use python's unicodedata module.

Ligatures Mapping

Include at least:

  • fi -> fi
  • fl -> fl
  • ff -> ff
  • ffi -> ffi
  • ffl -> ffl
  • æ -> ae
  • œ -> oe

Hyphenation Regex

r"-\s*\n\s*" should be replaced with "" (empty string) to join words.

Error Handling

How do we handle failures?

  • Ensure it handles None input.
  • Log instances where aggressive mode makes "destructive" changes if possible.

tools-only/X-Skills/tree/main/development/897-feature-text-canonicalizer_e05cbcc2 commit 967352134b

Frequently asked questions

npx skillmds@latest add tools-only/implementation-guide-5