LiteLLM on Ubuntu 24.04 LTS

LiteLLM on Ubuntu 24.04 LTS by cloudimg

LiteLLM is the open-source proxy and gateway that puts a single OpenAI-compatible API in front of 100+ LLM providers (OpenAI, Anthropic, Azure OpenAI, Bedrock, Vertex AI, Mistral, Ollama and more). Point your applications at one endpoint and switch or load-balance providers without changing client code, with virtual keys, per-key budgets, rate limits and request logging. The cloudimg image installs LiteLLM 1.88 in a Python virtual environment, fronts it with an nginx reverse proxy on port 80, and generates a unique master key on the first boot of every VM. The image ships no model weights and is CPU-only. Backed by 24/7 expert support.

Secure By Default

The master key is unique per VM and stored in a root-only file; callers pass it as a Bearer token. Use it to mint scoped virtual keys per application so you never share the master key. nginx fronts the loopback proxy so only port 80 is exposed; front it with TLS for public access.

Why Choose cloudimg?

• 24/7 Expert Support with guaranteed 24 hour response. Contact support@cloudimg.co.uk
• Production Ready from Launch Pre configured, security patched, and validated before publication
• Azure Native Integration Built with Azure Linux Agent, cloud init, and Gen2 Hyper V

Use Cases

A single gateway for all your LLM providers, cost control and rate limiting across teams, provider failover and load balancing, and request logging and spend tracking.

All product and company names are trademarks or registered trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.