Results for “local-llm”
14 skillsMore results
huggingface Huggingface LLM Trainer
Train or fine-tune language and vision models using TRL or Unsloth on Hugging Face Jobs cloud infrastructure, with support for SFT, DPO, GRPO, and reward modeling, plus GGUF conversion for local deployment.
10.8k · bundle
huggingface Huggingface Community Evals
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware, with backend selection between vLLM, Transformers, and accelerate.
10.8k · bundle
oyi77 LLM Deployment
Deploy and serve LLMs in production with vLLM, Ollama, TGI, and llama.cpp, including quantization and GPU optimization.
10
orchestra-research Serving Llms Vllm
Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.
10.4k · bundle
google-gemma Gemma Trainer
Fine-tune Gemma models locally using QLoRA, Unsloth, or TRL for SFT, DPO, and reward modeling, with dataset preparation and conversion to GGUF or LiteRT-LM.
· bundle
nvidia Jetson LLM Benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle
huggingface Huggingface Local Models
Search the Hugging Face Hub for llama.cpp-compatible GGUF models, select the right quantization, and run them locally with llama-cli or llama-server.
10.8k · bundle
orchestra-research Implementing Llms Litgpt
Train, fine-tune, and deploy LLMs using LitGPT's clean implementations of 20+ architectures like Llama, Gemma, and Phi.
10.4k · bundle
majiayu000 Ml
Guides machine learning development with experiment tracking, hyperparameter optimization, model registry, and MLOps pipeline integration.
567 · bundle
orchestra-research Tensorrt LLM
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency on NVIDIA GPUs (A100/H100).
10.4k · bundle
orchestra-research Knowledge Distillation
Compress large language models using knowledge distillation from teacher to student models, covering temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.
10.4k · bundle
infinition Llama Cpp
Run GGUF models locally with llama.cpp, including finding the right file on the Hugging Face Hub, installing, quantizing, serving, and using Python bindings.
2 · bundle
nvidia Tao Finetune Huggingface Model
Fine-tune HuggingFace CV, VLM, or LLM models on local NVIDIA GPUs using an NGC PyTorch container, with support for full or LoRA training, dataset handling, and optional model push to the Hub.
2.2k · bundle