Inference

NeMo Platform inference provider registration lifecycle through the platform SDK (secret -> create temp provider -> verify -> delete -> create final provider).

NVIDIA NeMo 29e7fb8 668 B Updated

File contents

Inference provider tasks

  • For provider registration tasks, use this sequence:
    1. Create API key secret
    2. Create temporary provider
    3. List providers
    4. Get provider details
    5. Delete temporary provider
    6. Create final verification provider
  • Use nemo_api with resource secrets for the API key secret.
  • Use nemo_api with resource inference.providers for provider CRUD.
  • Ensure final provider uses exactly the requested host URL and description.

nvidia-nemo/nemo-platform/tree/main/agents/nemo-studio-assistant/src/nemo_studio_assistant/skills/inference commit 29e7fb8295

Frequently asked questions

npx skillmds@latest add nvidia-nemo/inference-4