📄️ Ollama Load Balancing
This guide demonstrates how to configure Open WebUI to connect to multiple Ollama instances for load balancing within your deployment. This approach enables you to distribute processing loads across several nodes, enhancing both performance and reliability. The configuration leverages environment variables to manage connections between container updates, rebuilds, or redeployments seamlessly.
📄️ OpenAI API Endpoints
In this tutorial, we will demonstrate how to configure multiple OpenAI (or compatible) API endpoints using environment variables. This setup allows you to easily switch between different API providers or use multiple providers simultaneously, while keeping your configuration between container updates, rebuilds or redeployments.
📄️ Image Generation
Open WebUI now supports image generation through two backends: AUTOMATIC1111 and OpenAI DALL·E. This guide will help you set up and use both options.
📄️ LiteLLM Configuration
LiteLLM supports a variety of APIs, both OpenAI-compatible and others. To integrate a new API model, follow these instructions:
📄️ Model Whitelisting
Open WebUI allows you to filter specific models for use in your instance. This feature is especially useful for administrators who want to control which models are available to users. Filtering can be done through the WebUI or by adding environment variables to the backend.
📄️ Monitoring with Langfuse
Integrating Langfuse with LiteLLM allows for detailed observation and recording of API calls.
📄️ Hosting UI and Models separately
If you plan to expose this to the wide area network, consider implementing security like a network firewall, web application firewall, and threat intelligence.
📄️ Retrieval Augmented Generation (RAG)
Retrieval Augmented Generation (RAG) allows context from other diverse sources to be included in chats. Text from different sources is combined with the RAG template and prefixed to the user's prompt.
📄️ Federated Authentication Support
Open WebUI itself does not have support for federated authentication schemes such as SSO, OAuth, SAML, or OIDC.