AI Engineering Skills
Comprehensive skills for building AI applications with Foundation Models.
AI Engineering Stack
┌─────────────────────────────────────────────────────┐
│ APPLICATION LAYER │
│ Prompt Engineering, RAG, Agents, Guardrails │
├─────────────────────────────────────────────────────┤
│ MODEL LAYER │
│ Model Selection, Finetuning, Evaluation │
├─────────────────────────────────────────────────────┤
│ INFRASTRUCTURE LAYER │
│ Inference Optimization, Caching, Orchestration │
└─────────────────────────────────────────────────────┘
12 Core Skills
| Skill |
Description |
Guide |
| Foundation Models |
Model architecture, sampling, structured outputs |
foundation-models/ |
| Evaluation Methodology |
Metrics, AI-as-judge, comparative evaluation |
evaluation-methodology/ |
| AI System Evaluation |
End-to-end evaluation, benchmarks, model selection |
ai-system-evaluation/ |
| Prompt Engineering |
System prompts, few-shot, chain-of-thought, defense |
prompt-engineering/ |
| RAG Systems |
Chunking, embedding, retrieval, reranking |
rag-systems/ |
| AI Agents |
Tool use, planning strategies, memory systems |
ai-agents/ |
| Finetuning |
LoRA, QLoRA, PEFT, model merging |
finetuning/ |
| Dataset Engineering |
Data quality, curation, synthesis, annotation |
dataset-engineering/ |
| Inference Optimization |
Quantization, batching, caching, speculative decoding |
inference-optimization/ |
| AI Architecture |
Gateway, routing, observability, deployment |
ai-architecture/ |
| Guardrails & Safety |
Input/output guards, PII protection, injection defense |
guardrails-safety/ |
| User Feedback |
Explicit/implicit signals, feedback loops, A/B testing |
user-feedback/ |
Development Process
1. Use Case Evaluation → 2. Model Selection → 3. Evaluation Pipeline
↓
4. Prompt Engineering → 5. Context (RAG/Agents) → 6. Finetuning (if needed)
↓
7. Inference Optimization → 8. Deployment → 9. Monitoring & Feedback
Quick Decision Guide
| Need |
Start With |
| Improve output quality |
prompt-engineering |
| Add external knowledge |
rag-systems |
| Multi-step reasoning |
ai-agents |
| Reduce latency/cost |
inference-optimization |
| Measure quality |
evaluation-methodology |
| Protect system |
guardrails-safety |
Reference
Based on "AI Engineering" by Chip Huyen (O'Reilly, 2025).
Converted and distributed by TomeVault — claim your Tome and manage your conversions.
1---2name: ai-engineering3description: Building production AI applications with Foundation Models. Covers prompt engineering, RAG, agents, finetuning, evaluation, and deployment. Use when working with LLMs, building AI features, or architecting AI systems. Use when this capability is needed.4---56# AI Engineering Skills78Comprehensive skills for building AI applications with Foundation Models.910## AI Engineering Stack1112```13┌─────────────────────────────────────────────────────┐14│ APPLICATION LAYER │15│ Prompt Engineering, RAG, Agents, Guardrails │16├─────────────────────────────────────────────────────┤17│ MODEL LAYER │18│ Model Selection, Finetuning, Evaluation │19├─────────────────────────────────────────────────────┤20│ INFRASTRUCTURE LAYER │21│ Inference Optimization, Caching, Orchestration │22└─────────────────────────────────────────────────────┘23```2425## 12 Core Skills2627| Skill | Description | Guide |28|-------|-------------|-------|29| Foundation Models | Model architecture, sampling, structured outputs | [foundation-models/](foundation-models/SKILL.md) |30| Evaluation Methodology | Metrics, AI-as-judge, comparative evaluation | [evaluation-methodology/](evaluation-methodology/SKILL.md) |31| AI System Evaluation | End-to-end evaluation, benchmarks, model selection | [ai-system-evaluation/](ai-system-evaluation/SKILL.md) |32| Prompt Engineering | System prompts, few-shot, chain-of-thought, defense | [prompt-engineering/](prompt-engineering/SKILL.md) |33| RAG Systems | Chunking, embedding, retrieval, reranking | [rag-systems/](rag-systems/SKILL.md) |34| AI Agents | Tool use, planning strategies, memory systems | [ai-agents/](ai-agents/SKILL.md) |35| Finetuning | LoRA, QLoRA, PEFT, model merging | [finetuning/](finetuning/SKILL.md) |36| Dataset Engineering | Data quality, curation, synthesis, annotation | [dataset-engineering/](dataset-engineering/SKILL.md) |37| Inference Optimization | Quantization, batching, caching, speculative decoding | [inference-optimization/](inference-optimization/SKILL.md) |38| AI Architecture | Gateway, routing, observability, deployment | [ai-architecture/](ai-architecture/SKILL.md) |39| Guardrails & Safety | Input/output guards, PII protection, injection defense | [guardrails-safety/](guardrails-safety/SKILL.md) |40| User Feedback | Explicit/implicit signals, feedback loops, A/B testing | [user-feedback/](user-feedback/SKILL.md) |4142## Development Process4344```451. Use Case Evaluation → 2. Model Selection → 3. Evaluation Pipeline46 ↓474. Prompt Engineering → 5. Context (RAG/Agents) → 6. Finetuning (if needed)48 ↓497. Inference Optimization → 8. Deployment → 9. Monitoring & Feedback50```5152## Quick Decision Guide5354| Need | Start With |55|------|------------|56| Improve output quality | prompt-engineering |57| Add external knowledge | rag-systems |58| Multi-step reasoning | ai-agents |59| Reduce latency/cost | inference-optimization |60| Measure quality | evaluation-methodology |61| Protect system | guardrails-safety |6263## Reference6465Based on "AI Engineering" by Chip Huyen (O'Reilly, 2025).6667---68> Converted and distributed by [TomeVault](https://tomevault.io/claim/doanchienthangdev) — claim your Tome and manage your conversions.69<!-- tomevault:4.0:skill_md:2026-04-13 -->