Results for “gsm8k”
55 skillsevaluating-llms-harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) using standardized prompts and metrics. Supports HuggingFace, vLLM, and API backends.
10.4k · bundle
nemo-evaluator-sdk
Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution on local Docker, Slurm HPC, or cloud platforms.
10.4k · bundle
evaluating-llms-harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
1 · bundle
More results
evaluating-llms-harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
0 · bundle
gke-inference
Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.
14.4k
gke-app-onboarding
Containerizes applications and deploys them to Google Kubernetes Engine (GKE) with Dockerfiles, manifests, and best practices.
14.4k · bundle
gke-storage
Configures GKE storage including PVCs, PersistentVolumes, Filestore, and GCS FUSE with best practices for production workloads.
14.4k
gke-multitenancy
Plans and configures multi-tenancy on GKE, covering namespace isolation, RBAC planning, resource quotas, LimitRanges, network isolation, and cost allocation.
14.4k
gke-cost
Optimize GKE costs by rightsizing workloads, configuring Spot VMs, selecting machine types, and using Committed Use Discounts.
14.4k
gke-scaling
Configures GKE autoscaling with HPA, VPA, and Node Auto-Provisioning using golden path defaults for cost optimization.
14.4k · bundle
gke-batch-hpc
Runs batch processing and high-performance computing (HPC) workloads on Google Kubernetes Engine (GKE), including job queues, parallel processing, and MPI workloads.
14.4k
gke-networking
Plans, configures, and manages GKE networking including private clusters, VPC-native configurations, Gateway API, DNS, ingress/egress, Dataplane V2, and IP planning.
14.4k
evaluating-llms-harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
0 · bundle
8k4
Checks on-chain agent trustworthiness, discovers agents for tasks, profiles agents, looks up wallet/identity records, contacts or dispatches agents, and reads or writes hosted metadata via the 8K4 Protocol (ERC-8004).
2
gtm-motions
Identify and evaluate the best go-to-market motions for your product across seven proven approaches, with tools and tactics to build a balanced acquisition strategy.
22.6k
ivx-om-gemini-omni
Generate and conversationally edit short videos with Google Gemini Omni Flash (`gemini-omni-flash-preview`). Use when: (1) iterating on a clip with natural-language edits instead of regenerating ("make the phone invisible, keep everything else the same"), (2) generating 3-10s 720p clips with synthesized audio, rendered on-screen text, or timecoded beats, (3) binding reference images to roles with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags, (4) editing an existing uploaded video. Accessed via the `gemini_omni_video` tool using the project's GEMINI_API_KEY/GOOGLE_API_KEY — the same key as Imagen and Google TTS.
0 · bundle
llm-router
Unified LLM Gateway - One API for 70+ AI models. Route to GPT, Claude, Gemini, Qwen, Deepseek, Grok and more with a single API key. Use when: the user needs model routing, provider setup, or Chinese LLM access guidance.
1 · bundle
gtm-motions
Identify the best GTM motions and tools across 7 motion types: Inbound, Outbound, Paid Digital, Community, Partners, ABM, and PLG. Use when selecting marketing channels, choosing between inbound and outbound strategy, or planning cross-channel campaigns.
0
gke-storage
**Trigger**: Use when working with GKE Storage — Google Kubernetes Engine configuration and management.
1
glamm-pixel-grounding-large-multimodal-model-arxiv-2311-0335
GLaMM: Pixel Grounding Large Multimodal Model
6
deepstream-generate-pipeline
Builds and validates DeepStream GStreamer pipelines through an interactive questionnaire and a BM25 retrieval engine over 270+ verified pipelines.
2.2k · bundle
gemini-api
Guides usage of the Gemini API on Agent Platform with the Google Gen AI SDK, covering SDK usage (Python, JS/TS, Go, Java, C#), capabilities like multimodal inputs, tools, media generation, caching, batch prediction, and Live API.
14.4k · bundle
gemini-api-dev
Build applications with Gemini API hosted models, including Gemini and Gemma 4, using multimodal content, function calling, structured outputs, and current SDKs for Python, JavaScript, Go, and Java.
3.8k
gke-observability
Configures GKE observability with Cloud Logging, Cloud Monitoring, and managed Prometheus for monitoring, logging, and metrics collection.
14.4k
akm
Decode AKM (Asahi Kasei Microdevices) part numbers, including series, package, interface, and resolution, with guidance for identifying compatible replacements.
567 · bundle
awq-quantization
Quantize large language models to 4-bit precision using activation-aware weight quantization, reducing memory footprint and speeding up inference with minimal accuracy loss.
567 · bundle
gemini-api-dev
Build applications with Gemini API hosted models, including multimodal content, function calling, and structured outputs, using the latest SDKs and model specifications.
0
minicpm-v-a-gpt-4v-level-mllm-on-your-phone-arxiv-2408-01800
MiniCPM-V: A GPT-4V Level MLLM on Your Phone
6
gptq
Quantize large language models to 4-bit with minimal accuracy loss using GPTQ, enabling deployment of 70B+ models on consumer GPUs with 4× memory reduction and 3-4× faster inference.
10.4k · bundle
gog
Google Workspace CLI for Gmail, Calendar, Drive, Contacts, Sheets, and Docs.
0 · bundle
slack-gif-creator
Create animated GIFs optimized for Slack with validators for size constraints and composable animation primitives.
66.9k · bundle
gtm
Provides a complete toolkit for go-to-market activities, including installation via npx.
10 · bundle
grok-designer
Delegates UI, UX, and visual design tasks to Grok 4.5 through a dedicated CLI, covering critique, art direction, HTML mockups, and SVG assets.
57 · bundle
ce-gemini-imagegen
This skill should be used when generating and editing images using the Gemini API (Nano Banana Pro). It applies when creating images from text prompts, editing existing images, applying style transfers, generating logos with text, creating stickers, product mockups, or any image generation/manipulation task. Supports text-to-image, image editing, multi-turn refinement, and composition from multiple reference images.
0 · bundle
awq-quantization
Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.
0 · bundle
grok
Regex/parser/DSL design specialist for grammar authoring and ReDoS-safe regex. Not for REST APIs (Gateway) or DB schemas (Schema).
3 · bundle