← all publishers

futuremls-lab

@futuremls-lab source repo

Report this profile Claim this profile

• 12 skills
• 0 followers
• 6 hours ago last updated

1. ▌
   Sglang Bisect CI Regression · futuremls-lab

   SGLang Bisect CI Regression
   0
   installs
2. ▌
   Add Jit Kernel · futuremls-lab

   Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jit_kernel module
   0
   installs
3. ▌
   Add Sgl Kernel · futuremls-lab

   Step-by-step tutorial for adding a heavyweight AOT CUDA/C++ kernel to sgl-kernel (including tests & benchmarks)
   0
   installs
4. ▌
   Generate Profile · futuremls-lab

   Generate an e2e profiling trace of an SGLang server run. Launches a server, validates accuracy, captures a Chrome-compatible trace, and returns the profile path.
   0
   installs
5. ▌
   CI Workflow Guide · futuremls-lab

   Guide to SGLang CI workflow orchestration — stage ordering, fast-fail, gating, partitioning, execution modes, and debugging CI failures. Use when modifying CI workflows, adding stages, debugging CI pipeline issues, or understanding how tests are dispatched and gated across stages.
   0
   installs
6. ▌
   Write Sglang Test · futuremls-lab

   Guide for writing SGLang CI/UT tests. Covers CustomTestCase, CI registration, server fixtures, model selection, mock testing, and test placement. Always read test/README.md for the full CI layout, how to run tests, and extra tips. Use when creating new tests, adding CI test cases, writing unit tests, or when the user asks to add tests for SGLang features.
   0
   installs
7. ▌
   Sglang Auto Benchmark · futuremls-lab bundle

   Run SGLang auto benchmark searches with tiered server-flag sweeps, canonical dataset preparation, ShareGPT auto-download, custom-data conversion/validation, SLA or fixed-QPS benchmarking, CSV export, and optional second-stage speculative/EAGLE tuning. Use when the user wants an AI-operated benchmark workflow rather than a one-off bench_serving command.
   0
   installs
8. ▌
   Sglang Torch Profiler Analysis · futuremls-lab bundle

   Compact SGLang torch-profiler triage skill. Use when Codex should inspect an existing `trace.json(.gz)` or profile directory, trigger `sglang.profiler` against a live server, and return one compact report with kernel, overlap-opportunity, and fuse-pattern tables. Single-trace triage is enough for quick diagnosis; mapping+formal two-trace triage gives stronger overlap conclusions.
   0
   installs
9. ▌
   Sglang Diffusion Add Model · futuremls-lab

   Use when adding a new diffusion model or Diffusers pipeline to SGLang.
   0
   installs
10. ▌
    Sglang Diffusion Performance · futuremls-lab

    Use when choosing the fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.
    0
    installs
11. ▌
    Sglang Diffusion Ako4all Kernel · futuremls-lab bundle

    Use when optimizing an existing SGLang diffusion kernel with AKO4ALL, including AKO4ALL repo hygiene, custom microbench setup, ncu-guided iteration, and end-to-end denoise validation. Also use when a sibling AKO4ALL repo must be cloned or refreshed before starting kernel tuning work.
    0
    installs
12. ▌
    Sglang Diffusion Benchmark Profile · futuremls-lab bundle

    Use when benchmarking denoise latency or profiling a diffusion bottleneck in SGLang.
    0
    installs