Plugins
1 pluginResults for “language-models”
48 skillsSpeech To Text
Transcribe audio to text using ElevenLabs Scribe and Whisper models via the inference.sh CLI, supporting timestamps, speaker diarization, translation, and multi-language transcription.
584
Hqq Quantization
Quantize large language models to 8/4/3/2/1-bit precision without calibration data, using multiple optimized backends for deployment with vLLM or HuggingFace Transformers.
10.4k · bundle
Distributed LLM Pretraining Torchtitan
Pretrains large language models from scratch using PyTorch-native distributed training with 4D parallelism (FSDP2, TP, PP, CP) and Float8 support on H100 GPUs.
10.4k · bundle
Vgl
Define every visual attribute as structured VGL JSON for deterministic, reproducible image generation with Bria FIBO models, covering objects, lighting, camera settings, composition, and style.
17 · bundle
Abc Eval
Benchmarks large language models on symbolic music understanding and instruction following using text-based ABC notation, covering syntax parsing, error detection, segment-level reasoning, and sequence-level musical analysis.
3
Nemo Mbridge Perf Moe Vlm Training
Provides practical guidance for training Mixture-of-Experts Vision-Language Models in Megatron Bridge, comparing FSDP and 3D-parallel approaches with lessons from recent multimodal experiments.
2.2k · bundle
Caa Eval
Benchmarks large audio-language models against adversarial audio attacks using the CAA dataset, computing WER, ROUGE-L, cosine similarity, and coherence scores to assess robustness in conversational settings.
3
L Eval
Benchmarks long-context language models across 20 sub-tasks spanning 3k–200k tokens, covering retrieval, reasoning, summarization, and instruction understanding, with exact-match accuracy as the primary metric.
3
Model Pruning
Compress large language models by 40-60% with minimal accuracy loss using one-shot pruning techniques like Wanda and SparseGPT, enabling faster inference and deployment on constrained hardware.
10.4k · bundle
Huggingface LLM Trainer
Train or fine-tune language and vision models using TRL or Unsloth on Hugging Face Jobs cloud infrastructure, with support for SFT, DPO, GRPO, and reward modeling, plus GGUF conversion for local deployment.
10.8k · bundle
Happyhorse
Generate and edit videos using Alibaba HappyHorse 1.0 models via the inference.sh CLI, supporting text-to-video, image-to-video, reference-to-video, and video editing with natural language.
584
Posh
Evaluates automated metrics and vision-language models on identifying granular errors in detailed image descriptions and ranking paired descriptions against human judgments, using macro F1, pairwise accuracy, Spearman rank ρ, and Kendall's τ.
3