# Edge AI

> Edge AI: TensorRT and ONNX

- Skill: `j4flmao/edge-ai` (Agent Skill)
- Install (CLI): `npx skillmds@latest add j4flmao/edge-ai`
- Raw SKILL.md: https://api.skillmd.com/api/skills/j4flmao/edge-ai/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: j4flmao (https://skillmd.com/u/j4flmao)
- Updated: 2026-09-21
- Page: https://skillmd.com/skills/j4flmao/edge-ai

---

# Edge AI: TensorRT and ONNX

Deploying deep learning models on edge devices with limited compute requires rigorous optimization. NVIDIA TensorRT performs graph optimizations, layer fusion (e.g., merging convolution, bias, and ReLU layers), and precision calibration (quantizing FP32 weights to FP16 or INT8 without significant accuracy loss). 

ONNX (Open Neural Network Exchange) provides an interoperable format. The ONNX Runtime acts as the execution engine, utilizing execution providers (like TensorRT or CUDA) to map model operators to hardware-accelerated kernels.

```mermaid
%%{init: {"theme": "default", "flowchart": {"useMaxWidth": true}}}%%
flowchart TD
    subgraph ModelModelExport ["Model Export<br><br><br>"]
        A[PyTorch] -->|"Export()"| B[ONNX Graph]
    end
    subgraph ExecEdgeRuntime ["Edge Runtime<br><br><br>"]
        B -->|"Optimize()"| C[TensorRT Engine]
        C -->|"ExecuteInference()"| D[GPU Cores]
    end
```