Agentsop LLM Engine Selection

Cross-engine decision rubric for self-hosting or recommending an LLM serving stack. Picks among vLLM, SGLang, TensorRT-LLM, TGI, llama.cpp, Ollama, and MLX as a function of (hardware × workload × constraint), not "which is fastest". Activates whenever a coder-agent must choose, defend, or migrate a serving runtime.

agentsope Updated 483 repo stars

File contents

agentsope/SkillAlchemy commit 1605411150

Frequently asked questions

npx get-skill add agentsope/agentsop-llm-engine-selection