Kebab GEMM Config Tuning
When to Use This Skill
- User asks to change GEMM benchmark parameters
- User asks to compare layout modes (
RR,RC,CR,CC) - User asks to test precision (
float16,bfloat16,float32) or kernel version lists - User asks for tile-size and occupancy-oriented tuning plans
Key Configuration Surface
Main file: config.yaml
Important keys under operators.gemm:
implversionsmatrix_sizesmodesprecisionstile_sizesinit_method
Step-by-Step Workflow
- Edit
config.yamlwith one controlled change at a time. - Build and run benchmark:
make buildmake bench-gemm
- For deeper analysis, run:
make tune-gemm-cute(or cuda/ref)
- Save and compare outputs from
bench_results/,profiling/, andreports/.
Tuning Rules from Repository Context
- Hopper/WGMMA paths generally expect
sm_90a. - The documented tile constraint notes K dimension compatibility requirements for GMMA pathways.
- Keep experiment dimensions and precision explicit to ensure reproducibility.
Troubleshooting
| Issue | Mitigation |
|---|---|
| Unexpected perf regression | Revert to previous versions/tile_sizes baseline and isolate one variable |
| Precision mismatch | Verify selected kernel path supports requested precision |
| Layout-specific anomaly | Test all modes and compare independently |
References
config.yamldocs/optimization_plan.mddocs/TILE_SIZE_CONFIGURATION.mdMakefileGEMM benchmark/profile targets
Converted and distributed by TomeVault — claim your Tome and manage your conversions.