Deploy stdapi.ai on AWS¶

Get a production-grade OpenAI-compatible AI gateway running on AWS in 5 minutes. Terraform handles everything — ECS Fargate, HTTPS, WAF, auto-scaling, and monitoring.

Quick Start¶

Prerequisites¶

1. Subscribe to stdapi.ai on AWS Marketplace (14-day free trial included)
2. Install Terraform or OpenTofu >= 1.5
3. Configure AWS credentials

Deploy¶

git clone https://github.com/stdapi-ai/samples.git
cd samples/getting_started_production/terraform
terraform init
terraform apply

That's it. In ~5 minutes you have:

• Production-grade ECS Fargate deployment with HTTPS
• WAF protection with rate limiting
• CloudWatch alarms and monitoring
• Auto-scaling and API key authentication
• Interactive API documentation at /docs
• IP-restricted access (your IP only)

%%{init: {'flowchart': {'htmlLabels': true}} }%%
flowchart LR
  openai["<img src='../styles/logo_openai.svg' style='height:64px;width:auto;vertical-align:middle;' /> OpenAI SDK"] -->|HTTPS| alb["<img src='../styles/logo_amazon_load_balancing.svg' style='height:64px;width:auto;vertical-align:middle;' /> ALB + WAF"]
  anthropic["<img src='../styles/logo_anthropic.svg' style='height:64px;width:auto;vertical-align:middle;' /> Anthropic SDK"] -->|HTTPS| alb
  alb --> ecs["<img src='../styles/logo.svg' style='height:64px;width:auto;vertical-align:middle;' /> stdapi.ai<br/>ECS Fargate"]
  ecs --> bedrock["<img src='../styles/logo_amazon_bedrock.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Bedrock"]
  ecs --> polly["<img src='../styles/logo_amazon_polly.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Polly"]
  ecs --> transcribe["<img src='../styles/logo_amazon_transcribe.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS Transcribe"]
  ecs --> s3["<img src='../styles/logo_amazon_s3.svg' style='height:64px;width:auto;vertical-align:middle;' /> AWS S3"]
  ecs --> cloudwatch["<img src='../styles/logo_amazon_cloudwatch.svg' style='height:64px;width:auto;vertical-align:middle;' /> CloudWatch"]

Get Your Credentials¶

terraform output -raw api_key
terraform output api_endpoint
terraform output docs_url

Make Your First API Call¶

stdapi.ai is compatible with both OpenAI and Anthropic SDKs. If you've used either before, you already know how to use it.

from openai import OpenAI

client = OpenAI(
    api_key="your-api-key-here",           # From terraform output
    base_url="https://your-endpoint/v1"    # From terraform output
)

response = client.chat.completions.create(
    model="anthropic.claude-opus-4-6-v1",
    messages=[{"role": "user", "content": "Hello! Tell me a joke."}]
)

print(response.choices[0].message.content)

from anthropic import Anthropic

client = Anthropic(
    api_key="your-api-key-here",                  # From terraform output
    base_url="https://your-endpoint/anthropic"    # From terraform output
)

message = client.messages.create(
    model="anthropic.claude-opus-4-6-v1",
    messages=[{"role": "user", "content": "Hello! Tell me a joke."}]
)

print(message.content[0].text)

No API key configured? stdapi.ai runs without authentication by default for quick testing. Add api_key_create = true to your Terraform config to enable it.

Available models: All AWS Bedrock models available in your configured regions are automatically discovered and exposed.

Verify the deployment is healthy:

curl https://your-endpoint/health
# → {"status": "ok"}

The /health endpoint requires no authentication and is used by the ALB health check.

Troubleshooting¶

Common issues encountered when deploying for the first time:

Next Steps¶