ποΈ Functions
What are Functions?
ποΈ OpenAI API Endpoints
In this tutorial, we will demonstrate how to configure multiple OpenAI (or compatible) API endpoints using environment variables. This setup allows you to easily switch between different API providers or use multiple providers simultaneously, while keeping your configuration between container updates, rebuilds or redeployments.
ποΈ Image Generation
Open WebUI supports image generation through three backends: AUTOMATIC1111, ComfyUI, and OpenAI DALLΒ·E. This guide will help you set up and use either of these options.
ποΈ Web Search
Overview
ποΈ LiteLLM Configuration
Bundled LiteLLM support has been deprecated from 0.2.0
ποΈ Ollama Load Balancing
This guide demonstrates how to configure Open WebUI to connect to multiple Ollama instances for load balancing within your deployment. This approach enables you to distribute processing loads across several nodes, enhancing both performance and reliability. The configuration leverages environment variables to manage connections between container updates, rebuilds, or redeployments seamlessly.
ποΈ Tools
What are Tools?
ποΈ Model Whitelisting
Open WebUI allows you to filter specific models for use in your instance. This feature is especially useful for administrators who want to control which models are available to users. Filtering can be done through the WebUI or by adding environment variables to the backend.
ποΈ Monitoring with Langfuse
Bundled LiteLLM support has been deprecated from 0.2.0
ποΈ Hosting UI and Models separately
If you plan to expose this to the wide area network, consider implementing security like a network firewall, web application firewall, and threat intelligence.
ποΈ Retrieval Augmented Generation (RAG)
Retrieval Augmented Generation (RAG) is a a cutting-edge technology that enhances the conversational capabilities of chatbots by incorporating context from diverse sources. It works by retrieving relevant information from a wide range of sources such as local and remote documents, web content, and even multimedia sources like YouTube videos. The retrieved text is then combined with a predefined RAG template and prefixed to the user's prompt, providing a more informed and contextually relevant response.
ποΈ Federated Authentication Support
Open WebUI supports several forms of federated authentication:
ποΈ Reduce RAM usage
If you are deploying this image in a RAM-constrained environment, there are a few things you can do to slim down the image.
ποΈ Local LLM Setup with IPEX-LLM on Intel GPU
This guide is verified with Open WebUI setup through Manual Installation.
ποΈ TTS - OpenedAI-Speech using Docker
What is openedai-speech?
ποΈ Continue.dev VSCode Extension with Open WebUI
Download Extension
ποΈ Setting up with custom CA store
If you get an [SSL: CERTIFICATEVERIFYFAILED] error when trying to run OI, most likely the issue is that you are on a network which intercepts HTTPS traffic (e.g. a corporate network).
ποΈ Browser Search Engine
Open WebUI allows you to integrate directly into your web browser. This tutorial will guide you through the process of setting up Open WebUI as a custom search engine, enabling you to execute queries easily from your browser's address bar.
ποΈ Workspace - Models
The Models section of the Workspace within Open WebUI is a powerful tool that allows you to create and manage custom models tailored to specific purposes. This section serves as a central hub for all your modelfiles, providing a range of features to edit, clone, share, export, and hide your models.