SkillMD SkillMD
light-dark-mode
Profile My skills Saved Collections Preferences Submit a skill

Results for “int4”

2 skills
orchestra-research
miles-rl-training
Train large-scale MoE models with FP8/INT4 low-precision RL, speculative decoding, and train-inference alignment using the miles framework.
10.4k · bundle
More results
orchestra-research
quantizing-models-bitsandbytes
Quantize LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss using bitsandbytes. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers.
10.4k · bundle