Results for “sglang”
21 skills
orchestra-research Sglang
Serve LLMs and VLMs with structured outputs, prefix caching, and high throughput using RadixAttention.
10.4k · bundle
nvidia Jetson LLM Serve
Serve LLMs and VLMs on NVIDIA Jetson devices using vLLM or SGLang with optimized Docker containers and quantization presets.
2.2k · bundle
graphsignal Graphsignal Profiler
Set up GPU profiling, tracing, and monitoring for inference workloads using vLLM, SGLang, PyTorch, and dstack services via the Graphsignal Profiler sidecar.
242 · bundle
orchestra-research Slime Rl Training
Post-train LLMs with reinforcement learning using the slime framework, which integrates Megatron-LM for training and SGLang for rollout generation.
10.4k · bundle
lord1egypt Slime Rl Training
Guides LLM post-training with RL using slime, a Megatron+SGLang framework for training GLM, Qwen, DeepSeek, and Llama models with GRPO, async, and multi-turn workflows.
2
tianhao909 Slime Rl Training
Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.
1 · bundle
More results
qcmuu Slime Rl Training
Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.
0 · bundle
jackychenlu Sglang
Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.
0 · bundle
tianhao909 Sglang
Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.
1 · bundle
qcmuu Sglang
Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.
0 · bundle
aniruddhaadak80 Slime Rl Training
Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.
0 · bundle
github Slang Shader Engineer
Write, review, refactor, and optimize Slang shader code for graphics, compute, tessellation, and ray tracing pipelines with cross-compilation support.
36.2k · bundle
kbarbel640-del Sag
Generates speech from text using ElevenLabs text-to-speech with a command-line interface and local playback.
1 · bundle
comeonoliver Sag
Generates speech from text using ElevenLabs TTS with local playback, supporting voice selection, pronunciation rules, and audio tags.
61
orchestra-research Experiment Tracking Swanlab
Track ML experiments with open-source run logging, local or self-hosted dashboards, and media visualization using SwanLab.
10.4k · bundle
claude-dev-suite RAG Caching
Caching strategies across the RAG stack. Semantic caching with GPTCache and LangChain, Redis-based embedding-similarity cache, cache key design, TTL/invalidation, partial caching (cache retrieval only), provider-native prompt caching (Anthropic, OpenAI), and hierarchical L1/L2 caches. USE WHEN: user mentions "semantic cache", "GPTCache", "LLM cache", "prompt caching", "Redis vector cache", "cache invalidation for RAG", "reduce LLM cost", "latency reduction LLM" DO NOT USE FOR: retrieval accuracy - use `rag-patterns`; groundedness checks - use `rag-guardrails`; incremental indexing - use `rag-production`
28
maros112358 Scepticagent Architecture
ScepticAgent internal architecture reference. Use whenever the user asks how the extension works, wants to add a new AI provider, add a new highlight category, debug communication between components, understand the agent loop or streaming, or work with provider routing and the Gemini CORS proxy.
2
peteedoo Slime Rl Training
Provides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework. Use when training GLM models, implementing custom data generation workflows, or needing tight Megatron-LM integration for RL scaling.
0 · bundle
tools-only 007 File 265f6921
Converts documentation websites, GitHub repositories, and PDF files into AI-ready skills for multiple LLM platforms.
7 · bundle
machenjie Observability
`analysis-agent`/`task-agent`/`review-agent`: primary-Skill-selected for logs, metrics, traces, alerts, SLI/SLO, or diagnostics; never task owner; skip without signal impact.
4 · bundle
nvidia Jetson Inference Mem Tune
Recommends an inference runtime and memory-related launch flags for LLM/VLM workloads on NVIDIA Jetson devices, based on a live memory audit snapshot.
2.2k · bundle