Litert Conversion Workflow

Convert a Hugging Face LLM or vision-language model checkpoint into a .litertlm bundle that runs on the LiteRT-LM runtime with verified quality - classify the architecture against known runtime walls, pick the recipe family (dense, reasoning, hybrid SSM, VLM), export, quantize, gate the result against the source model, and publish. Use when converting a new LLM or VLM to LiteRT-LM, when a converted bundle crashes on the first message or dies at engine creation, when a quantized model answers worse than its source, or when deciding whether a model is convertible at all.

google-ai-edge Updated 25.3k repo stars

File contents

google-ai-edge/litert-samples commit c99398779e

Frequently asked questions

npx get-skill add google-ai-edge/litert-conversion-workflow