Data Pipeline Processor Error Handling

Sub-skill of data-pipeline-processor: Error Handling.

vamseeachanta c458309 1012 B Updated

File contents

Error Handling

Error Handling

Common Errors

Error Cause Solution
UnicodeDecodeError Wrong encoding Use DataReader with encoding fallback
KeyError Missing column Check column names in config
ValueError Type conversion failed Use errors='coerce' or validate first
MemoryError File too large Use chunked reading
FileNotFoundError Input file missing Verify file path

Error Template

def safe_pipeline_run(config: PipelineConfig) -> dict:
    """Run pipeline with comprehensive error handling."""
    try:
        # Validate input exists
        if not Path(config.input_path).exists():
            return {'status': 'error', 'stage': 'input', 'message': 'File not found'}

        pipeline = DataPipeline(config)
        return pipeline.run()

*See sub-skills for full details.*

vamseeachanta/workspace-hub/tree/main/.agents/skills/_archive/development/data-pipeline-processor/error-handling commit c4583092e3

Frequently asked questions

npx skillmds@latest add vamseeachanta/data-pipeline-processor-error-handling