lmcache
- 5 skills
- 0 followers
- 7 hours ago last updated
- ▌ Upgrade Lmcache Ascend Version · lmcacheUpgrade LMCache-Ascend to be compatible with a new upstream LMCache version. This skill takes the current LMCache-Ascend monkey patches, re-derives them by comparing against the old LMCache version, and applies them to the new LMCache version's structure. Use whenever the user wants to upgrade the plugin for a new LMCache release, e.g. "upgrade to LMCache v0.5.0", "bump upstream version", "adapt to LMCache v0.6.0", "new LMCache version requires updates".
- ▌ Create Pr · lmcacheCreate a GitHub pull request from the current branch to the upstream repo, using the repo's PR template
- ▌
- ▌ Pre Pr Check · lmcacheCheck local changes against the LMCache coding standards and fix issues before creating a PR
- ▌ Hybrid Benchmarking · lmcacheBenchmark a hybrid-attention model across the LMCache performance ladder (vLLM no-hybrid-allocator → hybrid allocator + prefix caching → hybrid allocator + LMCache) and produce a decode-throughput / TTFT / cache-hit-rate comparison. Use when asked to benchmark, demo, or quantify the value of LMCache caching for a hybrid model.