Results for “tail-latency”

14 skills
brycewang-stanford
Stata Log
Tail, read, or search a Stata log file from a previous command or background task.
1k · bundle
nvidia
Tao Train Mask Auto Label
Trains, evaluates, and runs inference for Mask Auto-Label (MAL) weakly-supervised segmentation models using ViT-MAE backbones with minimal point or box annotations.
2.2k · bundle
nvidia
Jetson Speculative Decoding
Reduce per-token latency on Jetson vLLM servers by appending speculative decoding configuration, with guidance on when to enable and how to benchmark the improvement.
2.2k · bundle
muratcankoylan
Latent Briefing
Shares memory between agents at the representation level by compacting the orchestrator's KV cache for efficient worker handoff, reducing token costs without summarization or retrieval.
16.9k · bundle
snoodleboot-io
Model Monitoring
The layers trade timeliness against definitiveness.
2
claude-dev-suite
RAG Caching
Caching strategies across the RAG stack. Semantic caching with GPTCache and LangChain, Redis-based embedding-similarity cache, cache key design, TTL/invalidation, partial caching (cache retrieval only), provider-native prompt caching (Anthropic, OpenAI), and hierarchical L1/L2 caches. USE WHEN: user mentions "semantic cache", "GPTCache", "LLM cache", "prompt caching", "Redis vector cache", "cache invalidation for RAG", "reduce LLM cost", "latency reduction LLM" DO NOT USE FOR: retrieval accuracy - use `rag-patterns`; groundedness checks - use `rag-guardrails`; incremental indexing - use `rag-production`
28
seb1n
Agent Observability
Design privacy-aware observability for AI agents using traces, spans, structured events, metrics, cost attribution, dashboards, alerts, and investigation workflows. Use when instrumenting an agent, debugging intermittent tool or model failures, defining service-level objectives, analyzing latency or spend, auditing agent decisions, or preparing production monitoring.
159 · bundle
delorenj
Bmad Advanced Elicitation
Push the LLM to reconsider, refine, and improve its recent output. Use when user asks for deeper critique or mentions a known deeper critique method, e.g. socratic, first principles, pre-mortem, red team.
1 · bundle
enuno
Tiger Strategy
TIGER v2 — Multi-scanner trading system for Hyperliquid perps via Senpi MCP. 5 signal patterns (BB compression breakout, BTC correlation lag, momentum breakout, mean reversion, funding rate arb), DSL v4 trailing stops, goal-based aggression engine, and risk guardrails. Configurable profit target over deadline. 12-cron architecture (10 TIGER + prescreener + ROAR meta-optimizer). Pure Python analysis. Requires Senpi MCP, python3, mcporter CLI, and OpenClaw cron system.
1 · bundle
machenjie
Message Queue Design
`task-agent`/`review-agent`: use when broker delivery, ordering, acknowledgement, DLQ, backpressure, or replay changes; skip synchronous retry without message semantics.
4 · bundle
monasprox
Total Recall
Watches conversations continuously and compresses them into prioritized notes, consolidating and recovering missed sessions with multiple redundancy layers.
1 · bundle
qhjqhj00
Latency
Measures inference latency of binarized, 8-bit, and 32-bit convolutional layers on edge devices to evaluate the efficiency and speedup of the Larq Compute Engine framework compared to standard implementations.
3
nvidia
Tao Train Pose Classification
Train, evaluate, export, and run inference for pose classification models using ST-GCN on skeleton keypoint sequences.
2.2k · bundle
enuno
Wolf Howl
Runs a nightly automated retrospective on autonomous trading strategy performance, computing win rates, fee drag, holding period buckets, direction bias, and producing data-driven improvement suggestions.
1 · bundle