AnythingLLM on Ubuntu 24.04 LTS
par cloudimg
AnythingLLM on Ubuntu 24.04 LTS by cloudimg
AnythingLLM on Ubuntu 24.04 LTS by cloudimg
AnythingLLM is an all-in-one AI application from Mintplex Labs that lets you chat with your documents using retrieval-augmented generation (RAG), organise conversations into workspaces and share access across a team with full multi-user controls. This cloudimg image installs AnythingLLM 1.14.1 on Node.js 20 LTS, runs it behind an nginx reverse proxy on port 80, stores its database, vectors and uploads on a dedicated Azure data disk, and generates a unique admin account on the first boot of every VM. Backed by 24/7 expert support.
Chat With Your Documents
Retrieval-augmented generation over your own documents, organised into workspaces, with full multi-user controls. A built-in native embedder means upload and search work without any external provider.
Bring Your Own LLM
The app and admin panel are fully functional out of the box; chat needs an LLM provider, which you supply on first use - choose OpenAI, Anthropic or a local Ollama in Settings, LLM Preference.
Dedicated Data Disk
The LanceDB vector store, the SQLite metadata store and uploaded documents live on a dedicated, independently resizable Azure data disk mounted at /var/lib/anythingllm, re-provisioned with every VM.
Secure First Boot
Multi-user mode is enabled with a unique admin account generated on the first boot of every VM, written to a root-only credentials file. No shared credentials ship in the image.
Why Choose cloudimg?
- 24/7 Expert Support with guaranteed 24 hour response. Contact support@cloudimg.co.uk
- Production Ready from Launch Pre configured, security patched, and validated before publication
- Azure Native Integration Built with Azure Linux Agent, cloud init, and Gen2 Hyper V
What is Included
- AnythingLLM 1.14.1 served on port 80 via nginx (WebSocket upgrade, 1 GB upload limit)
- Built-in LanceDB vector store and SQLite metadata store
- A dedicated Azure data disk at /var/lib/anythingllm for the database, vectors and uploads
- Multi-user mode with a unique per-VM admin generated on first boot
- anythingllm.service, anythingllm-collector.service and nginx.service as systemd units
Getting Started
Retrieve the per-VM admin password with sudo cat /root/anythingllm-credentials.txt, browse to your VM on port 80 and sign in as admin. For public exposure, front port 80 with TLS and your own domain.
Use Cases
Self-hosted document Q&A and RAG, a private team AI workspace, knowledge-base chat over your own files, and an on-prem AI app that keeps your documents in your environment.
Visit www.cloudimg.co.uk/guides/anythingllm-on-ubuntu-24-04-azure for the full user guide.
AnythingLLM is a trademark of Mintplex Labs Inc.; cloudimg is not affiliated with or endorsed by Mintplex Labs. All trademarks are the property of their respective holders.