Quickstart for LiteLLM

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, load balancing, and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Hugging Face, VLLM, NVIDIA NIM]

Deploy LiteLLM on Elestio

1. Open the LiteLLM deployment page and sign in, or create an account.
2. Choose a cloud provider, a region and a data center. Pick the region closest to your users for the lowest latency.
3. Choose an instance size. Elestio only lists the sizes that can run LiteLLM properly (at least 1 vCPU and 2 GB of RAM).
4. Choose your support plan and the maintenance window for system and software updates (times are in UTC).
5. Click Create Service. LiteLLM is deployed and ready in a few minutes, and you receive an email with the access details.

The full walkthrough with screenshots is in the installation guide.

Access LiteLLM

Open your service in the Elestio dashboard and go to the Overview tab. Click Display Admin UI to reveal the URL, username and password of your LiteLLM instance.

If the password field is blank, LiteLLM does not ship with a pre-created admin user: open the admin URL to start its setup. Software without a web interface, such as databases, is reached with the credentials and port listed in the same tab. See Admin UI and credentials.

Next steps

• Custom domain and SSL: point your own domain to LiteLLM (guide).
• Backups: new services follow a 3-2-1 backup strategy by default (backups).
• Updates: manage the LiteLLM version and update policy (software versions and updates).
• Learn LiteLLM: read the official LiteLLM documentation.