Plugins
1 pluginResults for “batch”
13 skills
samyakjhaveri Eval Run
Launches a model evaluation batch with parameter collection, pre-flight checks, execution, and post-run analysis for interactive or foreground runs.
0
lord1egypt Modal Serverless Gpu
Run ML workloads on Modal's serverless GPU cloud: deploy models as auto-scaling APIs, run batch jobs, and schedule tasks with pay-per-second GPU pricing.
2
orchestra-research Serving Llms Vllm
Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.
10.4k · bundle
qhjqhj00 Ray Data
Process large ML datasets in parallel across CPU or GPU clusters, with streaming execution, multi-format I/O, and integration with Ray Train, PyTorch, and TensorFlow for batch inference and preprocessing pipelines.
3 · bundle
samyakjhaveri Overnight Eval
Launches long-running evaluation batches in isolated tmux sessions with pre-flight verification, monitoring, and post-flight analysis for unattended runs.
0
ecnu-icalk CSV
Generates Python code to batch-translate the English column of tab-separated CSV files while preserving the original Chinese column and output format.
559
More results
orchestra-research Modal Serverless Gpu
Run ML workloads on Modal's serverless GPU cloud platform with auto-scaling, pay-per-second pricing, and Python-native infrastructure.
10.4k · bundle
k-dense-ai Modal
Deploy and serve AI/ML models on Modal's serverless cloud platform with on-demand GPUs, autoscaling containers, persistent storage, and scheduled jobs.
30.2k · bundle
orchestra-research Skypilot Multi Cloud Orchestration
Run ML training and batch jobs across multiple clouds with automatic cost optimization, spot instance recovery, and unified orchestration.
10.4k · bundle
k-dense-ai Scvi Tools
Provides deep generative models for single-cell omics analysis, including probabilistic batch correction, transfer learning, differential expression, and multi-modal integration.
30.2k · bundle
qhjqhj00 Runtime
Benchmarks inference latency and computational runtime of transformer models and MLX operations across Apple Silicon and NVIDIA GPU backends, with configurable input lengths and batch sizes.
3
nvidia Nemo Mbridge Perf Sequence Packing
Validate and configure packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs with correct context parallelism constraints.
2.2k · bundle
huggingface Hf Cloud Sagemaker Deployment Planner
Plans and coordinates the deployment of a model to Amazon SageMaker AI, selecting the appropriate pathway (real-time, serverless, async, batch, or Bedrock CMI) based on model type, traffic, latency, and cost constraints.
10.8k