Inference Precision Tensor Dump Compare

模型层 Tensor 打点与精度对比工具。用于在模型 forward 过程中捕获模型各层中间 tensor,实现 GPU/NPU 精度对比调试。支持 vLLM、SGLang 推理框架。When to use: When you need to debug precision issues between GPU and NPU,or validate layer-wise tensor outputs during inference.

ascend-ai-coding Updated 182 repo stars
image

File contents

ascend-ai-coding/awesome-ascend-skills commit d1a7ce88f7

Frequently asked questions

npx get-skill add ascend-ai-coding/inference-precision-tensor-dump-compare