📄️ Getting Started Tutorial
End-to-End tutorial for LiteLLM Proxy to:
🗃️ Agent & MCP Gateway
4 items
🗃️ Config.yaml
3 items
🗃️ Setup & Deployment
15 items
🔗 Demo LiteLLM Cloud
🗃️ Admin UI
6 items
🗃️ Architecture
12 items
🔗 All Endpoints (Swagger)
🗃️ Authentication
10 items
🗃️ Budgets + Rate Limits
12 items
📄️ Caching
For OpenAI/Anthropic Prompt Caching, go here
📄️ Memory Management
Store user preferences and feedback so your LLM remembers them across sessions. Scoped per user and team, with built-in access control.
🗃️ Guardrails
8 items
🗃️ Policies
4 items
🗃️ Create Custom Plugins
Modify requests, responses, and more
📄️ LiteLLM Proxy CLI
The lite CLI is a command-line tool for managing your LiteLLM proxy
🔗 Load Balancing, Routing, Fallbacks
📄️ A/B Testing - Traffic Mirroring
Traffic mirroring allows you to "mimic" production traffic to a secondary (silent) model for evaluation purposes. The silent model's response is gathered in the background and does not affect the latency or result of the primary request.
🗃️ Logging, Alerting, Metrics
5 items
🗃️ Making LLM Requests
6 items
🗃️ Model Access
6 items
🗃️ Secret Managers
10 items
🗃️ Spend Tracking
10 items
🗃️ Cost Optimization
4 items