Ollama with Open WebUI on Ubuntu 24.04 LTS by ProvenCloud

Ollama on Azure, ready in minutes. Deploy the virtual machine, open its public IP address in a browser and you are ready to go. There is no installer to run and nothing to configure.

Ollama runs open large language models on your own server, and Open WebUI gives them a familiar ChatGPT-style chat page. Your prompts, documents and chat history stay on your Azure VM and are never sent to an outside AI service. A small open model is already installed, so you can start chatting a few minutes after deployment and add bigger models with one command.

Why teams choose this image

• Private AI chat: upload documents, keep chat history and switch between models, with nothing sent to a third-party AI service.
• No account ships in the image: the first person to sign up becomes the administrator. Every VM gets its own Open WebUI signing key on first boot, and the Ollama API is reachable only from the VM itself.
• Up to date: every component is on its latest stable release and the image carries all Ubuntu 24.04 LTS security updates, with nothing pending.
• Supports Trusted Launch with Secure Boot and vTPM. No build-time SSH keys or shell history are left in the image.

What is included

• Ollama 0.40.13
• Open WebUI v0.12.5
• qwen2.5:1.5b model already downloaded
• Docker 29.9 running both services
• Webmin 2.670 for server administration
• Ubuntu 24.04 LTS, fully patched

Getting started

Use a 4 vCPU size or larger. Open http://<vm-public-ip>/ about four minutes after the VM starts and create your account: the first account becomes the administrator and public sign-up then closes. Add models with sudo bash ~/iscripts/ai-model.sh pull llama3.2:3b. Webmin is on port 8000 (user admin, password: your VM ID (Azure portal > the virtual machine > Properties > VM ID)).

Ports opened for you: SSH 22 and 80, 8000. For production, limit admin ports to your own IP address and add your domain with an SSL certificate. Step-by-step guide: provencloud.io/catalog/azure-ollama-open-webui-ubuntu-24-04

Who it is for

Teams, schools and businesses that want private AI chat on their own server without per-user AI subscriptions.

Pricing

The price shown is the software and packaging fee. Azure infrastructure charges for the virtual machine, disk and network are billed separately by Microsoft.

Support

ProvenCloud supports the image, its first-boot setup and its access tools. Email support@provencloud.io and we reply within one business day.

Ollama is open source software licensed under MIT, Open WebUI under its own open source licence, and the bundled Qwen2.5 model under Apache-2.0. All trademarks belong to their respective owners. This image is an independent build by ProvenCloud.