Packs

2 packs

Azure Data Analytics

For data engineers to query and manage big data on Azure with Kusto and Data Lake.

4 skills · pack

Azure Storage Python SDK

For Python developers managing Azure Blob, File Share, and Data Lake Storage Gen2 using the official SDK.

4 skills · pack

Results for “data-lake”

5 skills

Designs and implements big data architectures, processes large-scale datasets with distributed systems, and optimizes data pipelines for throughput using Hadoop, Spark, and cloud platforms.

More results

data-scraper-agent

Builds a scheduled, AI-powered data collection agent that scrapes public sources, enriches results with Gemini Flash, and stores them in Notion, Sheets, or Supabase.

data-scraper-agent

Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions.

Process large ML datasets in parallel across CPU or GPU clusters, with streaming execution, multi-format I/O, and integration with Ray Train, PyTorch, and TensorFlow for batch inference and preprocessing pipelines.

connect-cdc-mysql

Streams MySQL or MariaDB row-level changes into Redpanda or Kafka via the mysql_cdc input, covering binlog setup, snapshots, checkpointing, per-table routing, AWS RDS IAM auth, and Enterprise lakehouse destinations.