Results for “llama”
6 skills
huggingface Huggingface Local Models
Search the Hugging Face Hub for llama.cpp-compatible GGUF models, select the right quantization, and run them locally with llama-cli or llama-server.
10.8k · bundle
nvidia Jetson LLM Benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle
nvidia Nemo Mbridge Recipe Recommender
Indexes Megatron Bridge recipes and recommends the best starting config based on model, GPU count, and training goal.
2.2k · bundle
More results
nvidia Nemo Mbridge Perf Memory Tuning
Reduces peak GPU memory in Megatron Bridge training by applying expandable segments, parallelism resizing, activation recompute, and CPU offloading constraints.
2.2k · bundle
nvidia Jetson Inference Mem Tune
Recommends an inference runtime and memory-related launch flags for LLM/VLM workloads on NVIDIA Jetson devices, based on a live memory audit snapshot.
2.2k · bundle
google Agent Platform Inference
Authenticates and connects to Google Cloud Agent Platform for inference with Gemini and third-party OpenMaaS models (Llama, DeepSeek, Qwen). Generates code for multiple SDKs, configures endpoints, and troubleshoots common errors.
14.4k · bundle