534 Vastai Data Handling 2daac9ac

vastai-data-handling

tools-only Updated 7 repo stars

File contents

vastai-data-handling

Efficiently transfer large datasets to/from Vast.ai instances using rsync, rclone, or cloud storage integration

Directory Structure

vastai-data-handling/
├── SKILL.md
└── examples/
    └── data_sync_pipeline.py

File Descriptions

File Type Purpose
SKILL.md Markdown Guide for high-performance data transfer patterns and persistent storage configuration
examples/data_sync_pipeline.py Python Automated data synchronization script with integrity verification and progress tracking

Summary

Category: Operations Target Audience: ML engineers managing training datasets, data engineers building GPU pipelines Trigger Phrases: "vast data transfer", "upload dataset vast", "vast rsync", "vast rclone", "vast persistent storage", "vast s3 sync"

Version: 1.0.0 License: MIT Author: Jeremy Longshore jeremy@intentsolutions.io

tools-only/X-Skills/tree/main/automation/workflow/534-vastai-data-handling_2daac9ac commit fb24442398

Frequently asked questions

npx skillmds@latest add tools-only/534-vastai-data-handling-2daac9ac