Results for “pyspark”

Design, build, and optimize Microsoft Fabric Lakehouse solutions with guidance on core concepts, components, security, shortcuts, and performance optimization.

Scales pandas and NumPy workflows to datasets larger than memory using parallel and distributed computing, with support for dataframes, arrays, bags, and custom task graphs.

Write, review, debug, test, and optimize Python Polars code with version-grounded object types, schemas, and execution boundaries.

Scale pandas and NumPy workflows to larger-than-memory datasets using parallel and distributed computing.

Read, write, and manipulate genomic datasets including SAM/BAM/CRAM alignments, VCF/BCF variants, and FASTA/FASTQ sequences using a Pythonic interface to htslib.

Process large-scale ML datasets with distributed streaming execution across CPU/GPU, supporting Parquet, CSV, JSON, images, and integration with PyTorch, TensorFlow, and Ray Train.

Write, optimize, and debug Apache Spark jobs for high-performance distributed data processing, ETL pipelines, and big data workloads.