# AI Gateway

> Build AI gateway services for routing and managing LLM requests. Use when implementing API proxies, rate limiting, or multi-provider AI services.

- Skill: `diegosouzapw/ai-gateway` (Agent Skill, multi-file: 2 files)
- Install (CLI): `npx skillmds@latest add diegosouzapw/ai-gateway`
- Raw SKILL.md: https://api.skillmd.com/api/skills/diegosouzapw/ai-gateway/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: diegosouzapw (https://skillmd.com/u/diegosouzapw)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/diegosouzapw/ai-gateway

---


# AI Gateway Provider Switching Skill

Multi-provider AI configuration for Cloodle platform.

## Trigger
- AI provider configuration
- Model switching requests
- API key setup

## Supported Providers

### Local (Ollama/LM Studio)
```env
AI_PROVIDER=ollama
OLLAMA_BASE_URL=http://localhost:11434
OLLAMA_MODEL=llama3.2
```

### Anthropic (Sonnet/Haiku)
```env
AI_PROVIDER=anthropic
ANTHROPIC_API_KEY=sk-ant-...
ANTHROPIC_MODEL=claude-sonnet-4-20250514
```

### HuggingFace (GPT-OSS)
```env
AI_PROVIDER=huggingface
HF_API_KEY=hf_...
HF_MODEL=gpt-oss-20b
```

## Provider Switching Logic
```python
def get_llm():
    provider = os.getenv("AI_PROVIDER", "ollama")

    if provider == "ollama":
        from langchain_ollama import ChatOllama
        return ChatOllama(
            base_url=os.getenv("OLLAMA_BASE_URL"),
            model=os.getenv("OLLAMA_MODEL", "llama3.2")
        )
    elif provider == "anthropic":
        from langchain_anthropic import ChatAnthropic
        return ChatAnthropic(
            model=os.getenv("ANTHROPIC_MODEL")
        )
    elif provider == "huggingface":
        from langchain_huggingface import HuggingFaceEndpoint
        return HuggingFaceEndpoint(
            repo_id=os.getenv("HF_MODEL")
        )
```

## Model Recommendations
| Use Case | Provider | Model |
|----------|----------|-------|
| Development | Ollama | llama3.2 |
| Production Chat | Anthropic | claude-sonnet |
| Cost Sensitive | HuggingFace | gpt-oss-20b |
| High Quality | Anthropic | claude-opus |

## Environment File Location
`/opt/cloodle/tools/ai/multi_agent_rag_system/.env`

## Test Provider
```bash
curl http://localhost:11434/api/tags  # Ollama
```