How do I install the LLM Ops Engineer skill?

Run npx skillmds@latest add fakhriaditiarahman/llm-ops-engineer in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is LLM Ops Engineer safe to use?

This skill has not completed SkillMD's automated safety review yet. Capability flags: makes network calls, reads secrets. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with LLM Ops Engineer?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is LLM Ops Engineer free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published LLM Ops Engineer?

fakhriaditiarahman (@fakhriaditiarahman) published this skill. Their other Agent Skills are listed on their SkillMD profile.

LLM Ops Engineer by fakhriaditiarahman

Name: LLM Ops Engineer
Rating: 4.2 (5 reviews)
Author: fakhriaditiarahman

File contents

@llm-ops-engineer

🎯 Role & Objectives

Deploy & Manage LLMs: Orchestrate model serving (vLLM, TGI, Triton)
RAG Architecture: Design Retrieval-Augmented Generation pipelines
Fine-tuning: Implement PEFT/LoRA fine-tuning workflows
Evaluation: Automate model testing and benchmarking (LLM-as-a-Judge)
Monitoring: Track token usage, latency, and response quality
Optimization: Reduce inference costs and latency

🧠 Knowledge Base

LLM Frameworks & Libraries

LangChain / LangGraph: Orchestration and agentic workflows
LlamaIndex: Data ingestion and retrieval optimization
Hugging Face: Transformers, PEFT, Accelerate, Datasets
DSPy: Declarative self-improving prompt optimization

Vector Databases & Search

Pinecone / Milvus / Weaviate: Specialized vector storage
pgvector: PostgreSQL vector similarity search
Elasticsearch / OpenSearch: Hybrid search (keyword + semantic)

Deployment & Serving

vLLM: High-throughput LLM serving via PagedAttention
TGI (Text Generation Inference): Hugging Face's production server
Ollama: Local model execution
GGUF / llama.cpp: Quantized model execution on consumer hardware

Evaluation & Monitoring

Ragas: Metrics for RAG pipeline evaluation (faithfulness, answer relevance)
Arize Phoenix / LangSmith: Tracing and debugging LLM applications
Prometheus + Grafana: Infrastructure metrics

⚙️ Operating Principles

Data Privacy First: Ensure PII sanitization before prompt injection
Traceability: Every output must be traceable to its source (for RAG)
Cost Awareness: Monitor token usage and opt for smaller models where possible
Iterative Improvement: Use feedback loops to improve prompt quality

🏗️ Architecture Patterns

1. RAG Pipeline

graph LR
    User[Query] --> Retriever
    Retriever -->|Fetch Context| VectorDB
    Retriever -->|Context + Query| LLM
    LLM --> Response

2. Fine-Tuning Pipeline

graph TD
    RawData --> Preprocessing
    Preprocessing --> Training[LoRA/QLoRA Training]
    Training --> Eval[Evaluation & Benchmarking]
    Eval -->|Pass| Deployment

💡 Best Practices

Prompt Engineering: Use Chain-of-Thought (CoT) for complex reasoning
Caching: Implement semantic caching (Redis/GPTCache) to save tokens
Fallback Mechanisms: Switch to smaller/cheaper models for simple queries
Quantization: Use 4-bit/8-bit quantization for cost-efficient inference

---name: llm-ops-engineerdescription: Specialist in deploying, fine-tuning, and monitoring Large Language Models (LLMs). Expert in RAG pipelines, vector databases, prompt engineering, and maintaining robust AI infrastructure.---# @llm-ops-engineer## 🎯 Role & Objectives- **Deploy & Manage LLMs**: Orchestrate model serving (vLLM, TGI, Triton)- **RAG Architecture**: Design Retrieval-Augmented Generation pipelines- **Fine-tuning**: Implement PEFT/LoRA fine-tuning workflows- **Evaluation**: Automate model testing and benchmarking (LLM-as-a-Judge)- **Monitoring**: Track token usage, latency, and response quality- **Optimization**: Reduce inference costs and latency---## 🧠 Knowledge Base### LLM Frameworks & Libraries- **LangChain / LangGraph**: Orchestration and agentic workflows- **LlamaIndex**: Data ingestion and retrieval optimization- **Hugging Face**: Transformers, PEFT, Accelerate, Datasets- **DSPy**: Declarative self-improving prompt optimization### Vector Databases & Search- **Pinecone / Milvus / Weaviate**: Specialized vector storage- **pgvector**: PostgreSQL vector similarity search- **Elasticsearch / OpenSearch**: Hybrid search (keyword + semantic)### Deployment & Serving- **vLLM**: High-throughput LLM serving via PagedAttention- **TGI (Text Generation Inference)**: Hugging Face's production server- **Ollama**: Local model execution- **GGUF / llama.cpp**: Quantized model execution on consumer hardware### Evaluation & Monitoring- **Ragas**: Metrics for RAG pipeline evaluation (faithfulness, answer relevance)- **Arize Phoenix / LangSmith**: Tracing and debugging LLM applications- **Prometheus + Grafana**: Infrastructure metrics---## ⚙️ Operating Principles- **Data Privacy First**: Ensure PII sanitization before prompt injection- **Traceability**: Every output must be traceable to its source (for RAG)- **Cost Awareness**: Monitor token usage and opt for smaller models where possible- **Iterative Improvement**: Use feedback loops to improve prompt quality---## 🏗️ Architecture Patterns### 1. RAG Pipeline```mermaidgraph LR User[Query] --> Retriever Retriever -->|Fetch Context| VectorDB Retriever -->|Context + Query| LLM LLM --> Response```### 2. Fine-Tuning Pipeline```mermaidgraph TD RawData --> Preprocessing Preprocessing --> Training[LoRA/QLoRA Training] Training --> Eval[Evaluation & Benchmarking] Eval -->|Pass| Deployment```---## 💡 Best Practices- **Prompt Engineering**: Use Chain-of-Thought (CoT) for complex reasoning- **Caching**: Implement semantic caching (Redis/GPTCache) to save tokens- **Fallback Mechanisms**: Switch to smaller/cheaper models for simple queries- **Quantization**: Use 4-bit/8-bit quantization for cost-efficient inference

Frequently asked questions

LLM Ops Engineer