Skip to content

Deploy Your Own Private ChatGPT on AWS in 30 Minutes

Deploy Your Own Private ChatGPT on AWS in 30 Minutes

What if you could deploy a fully private ChatGPT alternative — on your own AWS infrastructure, with your own data sovereignty rules — in 30 minutes?

No third party between your users and your models. No per-seat fees. Two Terraform commands, once you have a domain, a certificate and the model access you want.

Here's how.

Published February 2026 — capability claims reviewed for v1.17.0 (September 2026)

The gateway has gained API surfaces and dialects since this post was written. See the release notes for everything that shipped after it.

The Stack

Component Role
Open WebUI ChatGPT-like interface (100,000+ ⭐ on GitHub)
stdapi.ai OpenAI-compatible API gateway for AWS
AWS Bedrock Access to 100+ foundation models

stdapi.ai sits between Open WebUI and AWS Bedrock, translating OpenAI API calls into native AWS requests. Standard SDKs connect on the base URL alone — Open WebUI, n8n, VS Code AI assistants, custom apps.

User → Open WebUI → stdapi.ai → AWS Bedrock → Claude Opus 4.6, DeepSeek, Kimi, Mistral…
                                             → AWS Polly (text-to-speech)
                                             → AWS Transcribe (speech-to-text)

What You Get

  • 100+ AI models — Claude, DeepSeek, Kimi, Mistral, Cohere, Stability AI, and more
  • Full multi-modal support — Chat, voice input/output, image generation/editing, document RAG
  • Multi-region access — Configure multiple AWS regions for the widest model selection and availability
  • Pay-per-use — No ChatGPT subscriptions, no per-seat fees. You pay only for actual AWS Bedrock usage
  • Production-ready infrastructure — ECS Fargate with auto-scaling, Aurora PostgreSQL + pgvector for RAG, ElastiCache Valkey, dedicated VPC, HTTPS with ALB

Data Sovereignty & Compliance

This is where it gets interesting for regulated industries:

  • Region allow-lists — Pin inference to the AWS regions you approve. Whether that satisfies a given obligation is a judgement for you and your advisers; the gateway supplies the control, not the conclusion
  • No data shared with model providers — AWS Bedrock does not share your inference data with model providers
  • No training on your data — Your prompts and responses are never used for model training
  • Two models are an exception worth knowing — Claude Fable 5 and Claude Fable 5.1 require your account to allow AWS's own human review of retained traffic, within the AWS boundary and for up to 30 days; the compliance guide covers every retention mode in full
  • No third party in the request path — traffic goes from your application to your own deployment to AWS
  • Dedicated VPC — Isolated network for your AI workloads

Whether you need to keep data in the EU, in specific US regions, or within national boundaries for government requirements — you configure the allowed regions and stdapi.ai enforces it.

Deploy in 30 Minutes

git clone https://github.com/stdapi-ai/samples.git
cd samples/getting_started_openwebui/terraform

# ⚙️ Customize your settings (regions, models, scaling…)
# → Check the full documentation in the repo to tailor the deployment to your needs

terraform init && terraform apply

That's it.

What Terraform deploys for you:

  • Open WebUI on ECS Fargate with auto-scaling
  • stdapi.ai as the OpenAI-compatible AI gateway
  • Aurora PostgreSQL with pgvector extension for RAG
  • ElastiCache Valkey for caching
  • Dedicated, isolated VPC with HTTPS via ALB
  • All environment variables pre-configured and ready to go

How stdapi.ai Works Under the Hood

stdapi.ai is more than a simple proxy. It's an AI gateway purpose-built for AWS that:

  • Translates the OpenAI API — Chat completions, responses, conversations, embeddings, images (generation/editing/variations), audio (speech/transcription/translation), batches, vector stores, realtime speech, and model listing (as of v1.17.0, September 2026)
  • Speaks other dialects on the same deployment — Anthropic, Cohere and Ollama clients each connect on their own route prefix
  • Handles multi-region routing — Automatically selects the best region and inference profile for each model
  • Exposes advanced Bedrock features — Prompt caching, reasoning modes (extended thinking), guardrails, service tiers, and model-specific parameters
  • Integrates native AWS AI services — Amazon Polly for TTS, Amazon Transcribe for STT with speaker diarization, Amazon Translate

Your existing OpenAI-powered tools work without modification. Change the base URL, and you're on AWS.

Who Is This For?

  • Teams that want a private ChatGPT with full data control
  • Regulated industries (finance, healthcare, government) that need data residency guarantees
  • Companies tired of paying per-seat ChatGPT subscriptions when usage varies wildly
  • Developers who want to use the OpenAI ecosystem on AWS infrastructure
  • Ops engineers who want production-grade AI infrastructure as code

Get Started

📦 Deployment repo: github.com/stdapi-ai/samples

📖 Documentation: stdapi.ai

📩 Need help? We can help you deploy and customize this solution for your needs. Reach out to us.


Two Terraform commands, and a private ChatGPT running in your own AWS account.