Results for “llama”
6 skills
huggingface huggingface-local-models
Search the Hugging Face Hub for llama.cpp-compatible GGUF models, select the right quantization, and run them locally with llama-cli or llama-server.
10.8k · bundle
nvidia jetson-llm-benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle
nvidia nemo-mbridge-recipe-recommender
Indexes Megatron Bridge recipes and recommends the best starting config based on model, GPU count, and training goal.
2.2k · bundle
More results
nvidia nemo-mbridge-perf-memory-tuning
Reduces peak GPU memory in Megatron Bridge training by applying expandable segments, parallelism resizing, activation recompute, and CPU offloading constraints.
2.2k · bundle
nvidia jetson-inference-mem-tune
Recommends an inference runtime and memory-related launch flags for LLM/VLM workloads on NVIDIA Jetson devices, based on a live memory audit snapshot.
2.2k · bundle
google agent-platform-inference
Authenticates and connects to Google Cloud Agent Platform for inference with Gemini and third-party OpenMaaS models (Llama, DeepSeek, Qwen). Generates code for multiple SDKs, configures endpoints, and troubleshoots common errors.
14.4k · bundle