Deploy stdapi.ai on AWS¶
Get a production-grade OpenAI-compatible AI gateway running on AWS in 5 minutes. Terraform handles everything — ECS Fargate, HTTPS, WAF, auto-scaling, and monitoring.
14-Day Free Trial
The AWS Marketplace subscription includes a 14-day free trial. Test the full production stack in your environment risk-free.
Prefer a hands-off setup?
A managed deployment service is available to deploy stdapi.ai into your AWS account.
Quick Start¶
Prerequisites¶
- Subscribe to stdapi.ai on AWS Marketplace (14-day free trial included)
- Install Terraform or OpenTofu >= 1.5
- Configure AWS credentials
Deploy¶
git clone https://github.com/stdapi-ai/samples.git
cd samples/getting_started_production/terraform
terraform init
terraform apply
That's it. In ~5 minutes you have:
- Production-grade ECS Fargate deployment with HTTPS
- WAF protection with rate limiting
- CloudWatch alarms and monitoring
- Auto-scaling and API key authentication
- Interactive API documentation at
/docs - IP-restricted access (your IP only)
%%{init: {'flowchart': {'htmlLabels': true}} }%%
flowchart LR
openai["<img src='../styles/logo_openai.svg' style='height:64px;width:auto;vertical-align:middle;' /> OpenAI SDK"] -->|HTTPS| alb["<img src='../styles/logo_amazon_load_balancing.svg' style='height:64px;width:auto;vertical-align:middle;' /> ALB + WAF"]
anthropic["<img src='../styles/logo_anthropic.svg' style='height:64px;width:auto;vertical-align:middle;' /> Anthropic SDK"] -->|HTTPS| alb
alb --> ecs["<img src='../styles/logo.svg' style='height:64px;width:auto;vertical-align:middle;' /> stdapi.ai<br/>ECS Fargate"]
ecs --> bedrock["<img src='../styles/logo_amazon_bedrock.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Bedrock"]
ecs --> polly["<img src='../styles/logo_amazon_polly.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Polly"]
ecs --> transcribe["<img src='../styles/logo_amazon_transcribe.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Transcribe"]
ecs --> s3["<img src='../styles/logo_amazon_s3.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS S3"]
ecs --> cloudwatch["<img src='../styles/logo_amazon_cloudwatch.svg' style='height:64px;width:auto;vertical-align:middle;' /> CloudWatch"]
Get Your Credentials¶
terraform output -raw api_key
terraform output api_endpoint
terraform output docs_url
Ready-to-use Terraform example on GitHub
Single region — getting_started_production
Make Your First API Call¶
stdapi.ai is compatible with both OpenAI and Anthropic SDKs. If you've used either before, you already know how to use it.
from openai import OpenAI
client = OpenAI(
api_key="your-api-key-here", # From terraform output
base_url="https://your-endpoint/v1" # From terraform output
)
response = client.chat.completions.create(
model="anthropic.claude-opus-4-6-v1",
messages=[{"role": "user", "content": "Hello! Tell me a joke."}]
)
print(response.choices[0].message.content)
from anthropic import Anthropic
client = Anthropic(
api_key="your-api-key-here", # From terraform output
base_url="https://your-endpoint/anthropic" # From terraform output
)
message = client.messages.create(
model="anthropic.claude-opus-4-6-v1",
messages=[{"role": "user", "content": "Hello! Tell me a joke."}]
)
print(message.content[0].text)
No API key configured? stdapi.ai runs without authentication by default for quick testing. Add api_key_create = true to your Terraform config to enable it.
Available models: All AWS Bedrock models available in your configured regions are automatically discovered and exposed.
Next Steps¶
- API Overview — Endpoints, parameters, and usage examples
- Configuration — All environment variables and options
- Advanced Deployment — VPC integration, multi-region, cost optimization, manual ECS
- Resilience & Failover — Multi-region routing and quota multiplication
- Data Sovereignty & Compliance — GDPR-compliant region configuration
- Use Cases — Open WebUI, n8n, coding assistants, and more
- Licensing — AGPL vs commercial options