Open WebUI Integration¶

Connect Open WebUI to stdapi.ai as an OpenAI-compatible backend. Access AWS Bedrock models through Open WebUI's chat interface—it works out of the box as a private ChatGPT alternative running on your AWS infrastructure.

About Open WebUI¶

🔗 Links: Website | GitHub | Documentation

Open WebUI is the leading open-source ChatGPT alternative. It provides a feature-rich, self-hosted web interface that operates entirely under your control, offering a ChatGPT-like experience while maintaining complete data privacy.

Key Features:

⭐ 100,000+ GitHub stars - Most popular open-source AI chat interface
ChatGPT-like UI - Familiar interface your team already knows
Multi-modal capabilities - Text, voice, images, and document processing
RAG & embeddings - Upload documents, search with semantic understanding
Extensible platform - Plugins, custom functions, and community tools
Complete privacy - Self-hosted, all data stays in your infrastructure

Why Open WebUI + stdapi.ai?¶

Zero Configuration Changes
stdapi.ai provides OpenAI-compatible API. Just update the endpoint URL—Open WebUI works immediately with AWS Bedrock models.
Access AWS Bedrock Models
Claude 4.6+ with reasoning, Nova 2, Llama 4, DeepSeek v3.2, Stable Diffusion, and 80+ models through Open WebUI's familiar chat interface.
Full Multi-Modal Support
Text chat, voice input/output, image generation/editing, document RAG—all AWS AI services unified through one interface.
Enterprise Data Privacy
All processing stays in your AWS account. Complete infrastructure control with AWS security, compliance, and data sovereignty.
Pay-Per-Use Pricing
No ChatGPT subscriptions. Pay only AWS Bedrock rates for actual usage—no monthly minimums or per-user fees.

%%{init: {'flowchart': {'htmlLabels': true}} }%%
flowchart LR
  openwebui["<img src='../styles/logo_openwebui.svg' style='height:64px;width:auto;vertical-align:middle;' /> Open WebUI"] --> stdapi["<img src='../styles/logo.svg' style='height:64px;width:auto;vertical-align:middle;' /> stdapi.ai"]
  stdapi --> bedrock["<img src='../styles/logo_amazon_bedrock.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Bedrock"]
  stdapi --> transcribe["<img src='../styles/logo_amazon_transcribe.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Transcribe"]
  stdapi --> polly["<img src='../styles/logo_amazon_polly.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Polly"]

✅ Prerequisites¶

What You'll Need

✓ stdapi.ai deployed - See deployment guide
✓ Your stdapi.ai URL - e.g., https://api.example.com
✓ Your API key - From Terraform output or configuration
✓ Open WebUI instance - Running or ready to deploy (see Deployment section below)

⚙️ Configuration¶

Open WebUI is configured entirely through environment variables. The sections below focus on the stdapi.ai integration. Use the same stdapi.ai key for all *_OPENAI_API_KEY entries. For more details on Open WebUI settings, refer to the official Open WebUI Environment Variable Configuration documentation.

💬 Core connection¶

Enables: Chat completions and Open WebUI background tasks (titles, summarization).

Environment Variables

OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
OPENAI_API_KEY=YOUR_STDAPI_KEY
TASK_MODEL_EXTERNAL=amazon.nova-micro-v1:0

Use a fast, low-cost chat model for TASK_MODEL_EXTERNAL. Open WebUI calls POST /v1/chat/completions for chat and background tasks (see Chat Completions API), so the model must be a text/chat-capable model from the correct family for your Bedrock region.

📚 RAG embeddings¶

Enables: Document ingestion and semantic search for RAG.

Environment Variables

RAG_EMBEDDING_ENGINE=openai
RAG_OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
RAG_OPENAI_API_KEY=YOUR_STDAPI_KEY
RAG_EMBEDDING_MODEL=cohere.embed-v4:0

Pick any embedding model you prefer. Open WebUI calls POST /v1/embeddings (see Embeddings API), so the model must be an embeddings-capable model from the correct family.

🎨 Image generation¶

Enables: Text-to-image creation inside chats.

Environment Variables

ENABLE_IMAGE_GENERATION=true
IMAGE_GENERATION_ENGINE=openai
IMAGES_OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
IMAGES_OPENAI_API_KEY=YOUR_STDAPI_KEY
IMAGE_GENERATION_MODEL=stability.stable-image-core-v1:1

Choose any image generation model you prefer. Open WebUI calls POST /v1/images/generations (see Images Generations API), so the model must be an image-generation model from the correct family.

🖼️ Image editing¶

Use Open WebUI's image editor to upload an image and describe the change. Masking is not configured.

Enables: Image edits and transformations in the editor.

Environment Variables

ENABLE_IMAGE_EDIT=true
IMAGE_EDIT_ENGINE=openai
IMAGES_EDIT_OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
IMAGES_EDIT_OPENAI_API_KEY=YOUR_STDAPI_KEY
IMAGE_EDIT_MODEL=stability.stable-image-control-structure-v1:0

Pick any image-editing model that supports edits without a mask. Open WebUI calls POST /v1/images/edits (see Images Edits API), so the model must be an image-editing model from the correct family.

🎙️ Speech to text (STT)¶

Enables: Voice input and audio transcription.

Environment Variables

AUDIO_STT_ENGINE=openai
AUDIO_STT_OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
AUDIO_STT_OPENAI_API_KEY=YOUR_STDAPI_KEY
AUDIO_STT_MODEL=amazon.transcribe

Choose any STT model you prefer. Open WebUI calls POST /v1/audio/transcriptions (see Audio Transcriptions API), so the model must match the speech-to-text modality and family.

🔊 Text to speech (TTS)¶

Enables: Spoken responses from chat outputs.

Environment Variables

AUDIO_TTS_ENGINE=openai
AUDIO_TTS_OPENAI_API_BASE_URL=https://YOUR_STDAPI_URL/v1
AUDIO_TTS_OPENAI_API_KEY=YOUR_STDAPI_KEY
AUDIO_TTS_MODEL=amazon.polly-neural

Choose any TTS model you prefer. Open WebUI calls POST /v1/audio/speech (see Audio Speech API), so the model must match the text-to-speech modality and family.

TTS language detection

Open WebUI generates audio in small chunks, which makes language auto-detection inconsistent. Disable auto-detection by setting the stdapi.ai environment variable DEFAULT_TTS_LANGUAGE to a fixed language (for example, en-US).

🚀 Terraform deployment¶

Deploy Open WebUI + stdapi.ai together with production infrastructure:

📦 stdapi-ai/samples/getting_started_openwebui

What's included:

Open WebUI on ECS Fargate with auto-scaling
stdapi.ai gateway connected to AWS Bedrock
ElastiCache Valkey for caching
Aurora PostgreSQL with pgvector extension for RAG
SearXNG for web search integration
Playwright for web scraping
HTTPS with ALB and optional WAF
All environment variables pre-configured

Deploy:

git clone https://github.com/stdapi-ai/samples.git
cd samples/getting_started_openwebui/terraform
terraform init
terraform apply

⚠️ Known issues¶

Open WebUI may list all available models in the chat model selector, including models that do not support chat completions (Like image or embedding models). Disable incompatible models in the Open WebUI admin panel.