Skip to main content
Don’t miss what’s next at Microsoft Ignite
Don’t miss what’s next at Microsoft IgniteGet direct access to the people, products, and expertise behind Microsoft technology, with opportunities to ask questions, build skills, and learn alongside the community.
Register now
Microsoft
separator
https://catalogartifact.azureedge.net/publicartifacts/bcloudllc1671615348068.textgen-f47d2897-ef92-4326-a99e-a2d33bafd56b/image1_bCloudlog.png

Text Generation WebUI

by bCloud LLC

(1 ratings)

Version 4.9.0 + Free Support on Ubuntu 26.04

Text Generation WebUI is an open-source web interface for running, managing, and interacting with large language models (LLMs). It provides an intuitive browser-based interface for loading AI models, generating text, chatting with AI assistants, and configuring inference settings, supporting both CPU- and GPU-based deployments.

Features of Text Generation WebUI:
  • Run and interact with a wide range of large language models through an easy-to-use web interface.
  • Supports CPU- and GPU-based inference with configurable generation parameters.
  • Provides chat, text completion, prompt engineering, and conversation history features.
  • Compatible with multiple model formats and inference backends for flexible deployment.
  • Includes extension support, API integration, and model management capabilities for AI development and experimentation.

Text Generation WebUI usage:

$ sudo su
$ apt update
$ cd /opt
$ cd textgen
$ source /opt/textgen/venv/bin/activate
$ python -c "import gradio, torch; print('Torch:', torch.__version__); print('Gradio:', gradio.__version__); print('Text Generation WebUI loaded successfully')"

$ Start Text Generation WebUI in CPU-only mode:
# python server.py --cpu --listen --listen-host 0.0.0.0 --listen-port 7860

$ Access it's working in your browser:
# http://SERVER_IP:7860
  
Disclaimer: Text Generation WebUI is an open-source software distributed under its respective open-source license. It is not affiliated with, endorsed by, or sponsored by any other company or organization. Text Generation WebUI is provided "as is," without any warranty, express or implied. Users utilize this software at their own risk. The developers and contributors are not responsible for any damages, losses, or consequences resulting from the use of this software. Users are encouraged to review and comply with the applicable licensing terms and regulations when deploying and using the software.
English (Canada)
Your Privacy Choices Opt-Out Icon Your Privacy Choices
Consumer Health Privacy Sitemap Contact Us Privacy & Cookies Terms of Use About our ads Manage cookies