900 Feature Text Segmenter B4d46654

Project Planning & Task Breakdown

Milestones

What are the major checkpoints?

• Milestone 1: Core segmentation logic implemented.
• Milestone 2: 100% test coverage and validation.

Task Breakdown

What specific work needs to be done?

Phase 1: Implementation

• Task 1.1: Define the Chunk dataclass.
• Task 1.2: Implement normalize_whitespace helper.
• Task 1.3: Implement segment_text with sliding window logic.
• Task 1.4: Integrate default values from core.utils.

Phase 2: Testing

• Task 2.1: Write unit tests (tests/core/test_segmenter.py).
  • Test with empty string.
  • Test with string shorter than chunk size.
  • Test exact chunk size.
  • Test overlap continuity.
  • Test whitespace normalization.

Dependencies

What needs to happen in what order?

• Depends on pdf_to_epub/core/utils.py (Completed).

Timeline & Estimates

When will things be done?

• Task 1.1-1.4: 1 hour
• Task 2.1: 1.5 hours

Risks & Mitigation

What could go wrong?

• Risk: Off-by-one errors in index calculation.
• Mitigation: Extensive testing with boundary sizes (e.g., chunk size 10, overlap 2).