all publishers

lmcache

@lmcache source repo

5 published skills

  1. ▌
    Upgrade Lmcache Ascend Version · lmcache
    Upgrade LMCache-Ascend to be compatible with a new upstream LMCache version. This skill takes the current LMCache-Ascend monkey patches, re-derives them by comparing against the old LMCache version, and applies them to the new LMCache version's structure. Use whenever the user wants to upgrade the plugin for a new LMCache release, e.g. "upgrade to LMCache v0.5.0", "bump upstream version", "adapt to LMCache v0.6.0", "new LMCache version requires updates".
    0 installs
  2. ▌
    Create Pr · lmcache
    Create a GitHub pull request from the current branch to the upstream repo, using the repo's PR template
    4 installs
  3. ▌
    Pr Review · lmcache
    Review a GitHub pull request against the LMCache coding standards
    2 installs
  4. ▌
    Pre Pr Check · lmcache
    Check local changes against the LMCache coding standards and fix issues before creating a PR
    3 installs
  5. ▌
    Hybrid Benchmarking · lmcache
    Benchmark a hybrid-attention model across the LMCache performance ladder (vLLM no-hybrid-allocator → hybrid allocator + prefix caching → hybrid allocator + LMCache) and produce a decode-throughput / TTFT / cache-hit-rate comparison. Use when asked to benchmark, demo, or quantify the value of LMCache caching for a hybrid model.
    2 installs