Nemotron 3 Ultra Text2sql Lora

Run the Nemotron-3 Ultra Text2SQL LoRA fine-tuning tutorial (NeMo Megatron-Bridge) end-to-end for the user on their SLURM cluster: data prep, distributed checkpoint conversion, and packed LoRA fine-tuning of the 550B hybrid Mamba-Transformer MoE, ending at a saved adapter. Use when the user wants to run this cookbook, fine-tune Nemotron-3 Ultra with LoRA, or adapt the notebook to their own cluster.

NVIDIA NeMo Updated 2.3k repo stars
Watch the Nemotron Overview

File contents

nvidia-nemo/nemotron commit 2440a6cfb9

Frequently asked questions

npx get-skill add nvidia-nemo/nemotron-3-ultra-text2sql-lora