📄️ Tools
WIP 🚧
📄️ Functions
WIP 🚧
📄️ OpenAI API Endpoints
In this tutorial, we will demonstrate how to configure multiple OpenAI (or compatible) API endpoints using environment variables. This setup allows you to easily switch between different API providers or use multiple providers simultaneously, while keeping your configuration between container updates, rebuilds or redeployments.
📄️ Image Generation
Open WebUI supports image generation through three backends: AUTOMATIC1111, ComfyUI, and OpenAI DALL·E. This guide will help you set up and use either of these options.
📄️ Web Search
SearXNG (Docker)
📄️ LiteLLM Configuration
Bundled LiteLLM support has been deprecated from 0.2.0
📄️ Ollama Load Balancing
This guide demonstrates how to configure Open WebUI to connect to multiple Ollama instances for load balancing within your deployment. This approach enables you to distribute processing loads across several nodes, enhancing both performance and reliability. The configuration leverages environment variables to manage connections between container updates, rebuilds, or redeployments seamlessly.
📄️ Model Whitelisting
Open WebUI allows you to filter specific models for use in your instance. This feature is especially useful for administrators who want to control which models are available to users. Filtering can be done through the WebUI or by adding environment variables to the backend.
📄️ Monitoring with Langfuse
Bundled LiteLLM support has been deprecated from 0.2.0
📄️ Hosting UI and Models separately
If you plan to expose this to the wide area network, consider implementing security like a network firewall, web application firewall, and threat intelligence.
📄️ Retrieval Augmented Generation (RAG)
Retrieval Augmented Generation (RAG) is a a cutting-edge technology that enhances the conversational capabilities of chatbots by incorporating context from diverse sources. It works by retrieving relevant information from a wide range of sources such as local and remote documents, web content, and even multimedia sources like YouTube videos. The retrieved text is then combined with a predefined RAG template and prefixed to the user's prompt, providing a more informed and contextually relevant response.
📄️ Federated Authentication Support
Open WebUI supports several forms of federated authentication:
📄️ Local LLM Setup with IPEX-LLM on Intel GPU
This guide is verified with Open WebUI setup through Manual Installation.
📄️ TTS - OpenedAI-Speech using Docker
What is openedai-speech?
📄️ Continue.dev VSCode Extension with Open WebUI
Download Extension