LLM Integration

LLM Integration SKILL

majiayu000 Updated 567 repo stars

File contents

LLM Integration SKILL

Provider Abstraction

from langchain_openai import ChatOpenAI
from langchain_anthropic import ChatAnthropic

llm = ChatOpenAI(model="gpt-4")
# or
llm = ChatAnthropic(model="claude-3-sonnet-20240229")

Fallback Chain

from langchain.chat_models import init_chat_model

llm = init_chat_model(
    "gpt-4",
    fallbacks=["claude-3-sonnet-20240229", "ollama/llama2"]
)

Streaming

for chunk in llm.stream("What is RAG?"):
    print(chunk.content, end="", flush=True)

majiayu000/claude-skill-registry-data/tree/main/ai-llm/llm-integration-skill commit fbecf1b9ac

Frequently asked questions

npx skillmds@latest add majiayu000/llm-integration-3