tools-only import Image from '@theme/IdealImage';
Enterprise
:::info
- ✨ SSO is free for up to 5 users. After that, an enterprise license is required. Get Started with Enterprise here
- Who is Enterprise for? Companies giving access to 100+ users OR 10+ AI use-cases. If you're not sure, get in touch with us to discuss your needs. :::
For companies that need SSO, user management and professional support for LiteLLM Proxy
:::info Get free 7-day trial key here :::
Enterprise Features
Includes all enterprise features.
<Image img={require('../img/enterprise_vs_oss_2.png')} />
Procurement available via AWS / Azure Marketplace
This covers:
- Enterprise Features
- ✅ Feature Prioritization
- ✅ Custom Integrations
- ✅ Professional Support - Dedicated Slack/Teams channel
Self-Hosted
Manage Yourself - you can deploy our Docker Image or build a custom image from our pip package, and manage your own infrastructure. In this case, we would give you a license key + provide support via a dedicated support channel.
What’s the cost of the Self-Managed Enterprise edition?
Self-Managed Enterprise deployments require our team to understand your exact needs. Get in touch with us to learn more
How does deployment with Enterprise License work?
You just deploy our docker image and get an enterprise license key to add to your environment to unlock additional functionality (SSO, etc.).
LITELLM_LICENSE="eyJ..."
No data leaves your environment.
Hosted LiteLLM Proxy
LiteLLM maintains the proxy, so you can focus on your core products.
We provide a dedicated proxy for your team, and manage the infrastructure.
Status: GA
Our proxy is already used in production by customers.
See our status page for live reliability
Benefits
- No Maintenance, No Infra: We'll maintain the proxy, and spin up any additional infrastructure (e.g.: separate server for spend logs) to make sure you can load balance + track spend across multiple LLM projects.
- Reliable: Our hosted proxy is tested on 1k requests per second, making it reliable for high load.
- Secure: LiteLLM is SOC-2 Type 2 and ISO 27001 certified, to make sure your data is as secure as possible.
Supported data regions for LiteLLM Cloud
You can find supported data regions litellm here
Frequently Asked Questions
How to set up and verify your Enterprise License
- Add your license key to the environment:
LITELLM_LICENSE="eyJ..."
Restart LiteLLM Proxy.
Open
http://<your-proxy-host>:<port>/— the Swagger page should show "Enterprise Edition" in the description. If it doesn't, check that the key is correct, unexpired, and that the proxy was fully restarted.
SLA's + Professional Support
Professional Support can assist with LLM/Provider integrations, deployment, upgrade management, and LLM Provider troubleshooting. We can’t solve your own infrastructure-related issues but we will guide you to fix them.
- 1 hour for Sev0 issues - 100% production traffic is failing
- 6 hours for Sev1 - < 100% production traffic is failing
- 24h for Sev2-Sev3 between 7am – 7pm PT (Monday through Saturday) - setup issues e.g. Redis working on our end, but not on your infrastructure.
- 72h SLA for patching vulnerabilities in the software.
We can offer custom SLAs based on your needs and the severity of the issue
Data Security / Legal / Compliance FAQs
Data Security / Legal / Compliance FAQs
Pricing
Pricing is based on usage. We can figure out a price that works for your team, on the call.
Screenshots
1. Create keys
<Image img={require('../img/litellm_hosted_ui_create_key.png')} />
2. Add Models
<Image img={require('../img/litellm_hosted_ui_add_models.png')}/>
3. Track spend
<Image img={require('../img/litellm_hosted_usage_dashboard.png')} />
4. Configure load balancing
<Image img={require('../img/litellm_hosted_ui_router.png')} />