ETL & Pipelines

Compare identical tables across two SQL Server instances using Python with mssql-python and Apache Arrow, detecting missing rows, column mismatches, schema drift, and generating a reconciliation report.

Generate production-ready Python code for Dataverse SDK with advanced patterns including error handling, batch operations, OData optimization, and Pandas integration.

Write, optimize, and debug Apache Spark jobs for high-performance distributed data processing, ETL pipelines, and big data workloads.

Extract, score, and backlog skill idea candidates from Claude Code session logs for a weekly skill generation pipeline.

Convert daily market observations into structured research tickets and export validated candidate specs for a trading strategy pipeline.

Clusters raw detection tickets into reusable edge concepts with thesis, invalidation signals, and strategy playbooks before strategy design.

Diagnoses and validates Redpanda Connect pipelines using linting, dry-run connection tests, logging, metrics, tracing, and health endpoints, including enterprise feature troubleshooting.

Streams Salesforce change data capture and platform events into Redpanda or Kafka using Redpanda Connect's salesforce_cdc input, covering setup, configuration, and operational details.

Maps FHIR R4 clinical resources (Patient, Observation, Condition, CarePlan, CodeableConcept) to Salesforce Health Cloud objects, including prerequisite configuration and cardinality handling.

Administra bases de datos PostgreSQL, MySQL, Redis y SQLite: diseña esquemas, optimiza queries, configura migraciones, replicación y backups.

Sets up Git-based version control for data science projects, handling notebooks, datasets, and pipelines with DVC and nbstripout.

Guides database design, implementation, optimization, migration, pipeline development, and operations across SQL and NoSQL platforms.

Ingests music into a LanceDB via ncmdump-rs and sf-cli, searching and downloading from Netease Cloud Music or Bilibili, decrypting local NCM files, and extracting metadata, lyrics, and cover art.

Provides a discovery stub for the Wren CLI, a semantic SQL layer over 22+ databases, with commands to install, set up, connect data sources, generate MDL projects, enrich context, and deploy GenBI dashboards.

Takes raw whole-genome sequencing FASTQ files or a pre-existing VCF through variant calling, quality control, and polygenic risk score computation using the PGS Catalog.

Authenticate, browse pipelines, samples, and projects, upload data, launch pipeline executions, and check run status on any Flow.bio instance via CLI.

Discovers and executes bioinformatics tools from the Galaxy ecosystem via natural language, with multi-signal scoring, workflow templates, and reproducibility bundles.

Converts code repositories and document directories into semantically-chunked text files optimized for NotebookLM ingestion, with support for config files and incremental processing.

Orchestrates Python data pipelines with Prefect flows, tasks, retries, caching, parallel execution, and deployments to work pools.

Provides Python bindings to interact with the DNAnexus platform, enabling file uploads, job management, and API calls.

Write, review, debug, test, or optimize Python code using PyArrow arrays, schemas, tables, compute kernels, datasets, Parquet, and Arrow IPC.

Generates phrase-grounded bounding box annotations from image-caption pairs using a VLM, producing cleaned captions, referring expressions, and pixel-space bounding boxes.

Curates clinical-specialty term lists, generates IPA-tagged synthetic audio via TTS, and produces NeMo-format manifests for ASR benchmark evaluation.

Import a single webpage from any URL into canonical EDS block format — structured HTML that authors edit in DA. Scrapes the page, analyzes structure, maps to existing blocks, and generates HTML for immediate local preview.

Guides installation of dbt Core or dbt Cloud CLI and points to official documentation for getting started with dbt.

Streams MySQL or MariaDB row-level changes into Redpanda or Kafka via the mysql_cdc input, covering binlog setup, snapshots, checkpointing, per-table routing, AWS RDS IAM auth, and Enterprise lakehouse destinations.

Query external data from Oxla — Kafka topics via catalogs, Apache Iceberg tables, and S3/GCS/Azure parquet/ORC files — alongside native Oxla tables. Use when querying Kafka topics with CREATE KAFKA CATALOG or CREATE REDPANDA CATALOG, reading Apache Iceberg tables with the catalog=>path.table syntax, loading or.

Implements Bulk API 2.0 REST calls for ingest and query jobs, covering CSV format requirements, locator pagination, and v1 vs v2 selection.

Routes to the right Salesforce data skill package for data model, migration, bulk loads, query optimization, deduplication, and archival tasks.

Migrates historical donation or gift records into Salesforce NPSP using the NPSP Data Importer (BDI), covering DataImport__c staging, payment mapping, soft credits via Opportunity Contact Roles, GAU allocation, and campaign attribution.

Documenta, versiona y cierra proyectos de análisis de datos para que queden ordenados y reproducibles en el futuro.

Extracts clean, LLM-optimized markdown from any URL, including JavaScript-rendered SPAs, with support for concurrent scraping of multiple URLs and options like main-content-only extraction and custom output formats.

Converts files and office documents to Markdown, supporting PDF, DOCX, PPTX, XLSX, images with OCR, audio with transcription, HTML, CSV, JSON, XML, ZIP, YouTube URLs, and EPubs.

Collects Chinese A-share stock data, fetching stock lists and daily, weekly, and monthly K-line history into a local SQLite database for quantitative analysis.

Creates, edits, converts, and automates LibreOffice Calc spreadsheets in ODS format, including formulas, charts, and batch processing.

Guides database design, implementation, optimization, migration, pipeline development, quality, and operations across SQL and NoSQL platforms.