Results for “gguf”
5 skills
huggingface Hf Mem
Estimates the memory required to load Safetensors or GGUF model weights for inference from the Hugging Face Hub, using HTTP Range requests without downloading weights.
10.8k
huggingface Huggingface Local Models
Search the Hugging Face Hub for llama.cpp-compatible GGUF models, select the right quantization, and run them locally with llama-cli or llama-server.
10.8k · bundle
More results
huggingface Huggingface LLM Trainer
Train or fine-tune language and vision models using TRL or Unsloth on Hugging Face Jobs cloud infrastructure, with support for SFT, DPO, GRPO, and reward modeling, plus GGUF conversion for local deployment.
10.8k · bundle
github Geofeed Tuner
Create, validate, and improve IP geolocation feeds in CSV format with RFC 8805 compliance and opinionated best practices for network operators.
36.2k · bundle
nvidia Jetson LLM Benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle