Results for “distributed-compute”
4 skillsdask
Scale pandas and NumPy workflows to larger-than-memory datasets using parallel and distributed computing.
30.2k · bundle
big-data
Designs and implements big data architectures, processes large-scale datasets with distributed systems, and optimizes data pipelines for throughput using Hadoop, Spark, and cloud platforms.
1
spark-engineer
Write, optimize, and debug Apache Spark jobs for high-performance distributed data processing, ETL pipelines, and big data workloads.
10.4k · bundle
ray-data
Process large-scale ML datasets with distributed streaming execution across CPU/GPU, supporting Parquet, CSV, JSON, images, and integration with PyTorch, TensorFlow, and Ray Train.
10.4k · bundle