Features — AI Gateway for AWS Bedrock¶

stdapi.ai is an AI gateway purpose-built for AWS. It brings full OpenAI and Anthropic API compatibility to AWS Bedrock and AWS AI services — so any tool, SDK, or application your team already uses connects instantly, without code changes.

How It Works¶

stdapi.ai sits between your applications and AWS services, translating OpenAI and Anthropic API calls into native AWS requests. Any tool or SDK that speaks either protocol connects instantly — no plugins, no custom integrations.

%%{init: {'flowchart': {'htmlLabels': true}} }%%
flowchart LR
  openwebui["<img src='../styles/logo_openwebui.svg' style='height:48px;width:auto;vertical-align:middle;' /> Open WebUI"] --> stdapi["<img src='../styles/logo.svg' style='height:64px;width:auto;vertical-align:middle;' /> stdapi.ai"]
  n8n["<img src='../styles/logo_n8n.svg' style='height:48px;width:auto;vertical-align:middle;' /> n8n"] --> stdapi
  ide["<img src='../styles/logo_vscode.svg' style='height:48px;width:auto;vertical-align:middle;' /> IDE + AI Assistant"] --> stdapi
  openai_app["<img src='../styles/logo_openai.svg' style='height:48px;width:auto;vertical-align:middle;' /> Any OpenAI App"] --> stdapi
  anthropic_app["<img src='../styles/logo_anthropic.svg' style='height:48px;width:auto;vertical-align:middle;' /> Any Anthropic App"] --> stdapi
  stdapi --> bedrock["<img src='../styles/logo_amazon_bedrock.svg' style='height:48px;width:auto;vertical-align:middle;' /> AWS Bedrock"]
  bedrock --> claude["<img src='../styles/logo_anthropic_claude.svg' style='height:36px;width:auto;vertical-align:middle;' /> Claude"]
  bedrock --> qwen["<img src='../styles/logo_qwen.svg' style='height:36px;width:auto;vertical-align:middle;' /> Qwen"]
  bedrock --> mistral["<img src='../styles/logo_mistralai.svg' style='height:36px;width:auto;vertical-align:middle;' /> Mistral"]
  bedrock --> stability["<img src='../styles/logo_stabilityai.svg' style='height:36px;width:auto;vertical-align:middle;' /> Stability AI"]
  bedrock --> more["✨ and more..."]
  stdapi --> transcribe["<img src='../styles/logo_amazon_transcribe.svg' style='height:48px;width:auto;vertical-align:middle;' /> AWS Transcribe"]
  stdapi --> polly["<img src='../styles/logo_amazon_polly.svg' style='height:48px;width:auto;vertical-align:middle;' /> AWS Polly"]
  stdapi --> s3["<img src='../styles/logo_amazon_s3.svg' style='height:48px;width:auto;vertical-align:middle;' /> Amazon S3"]

Why stdapi.ai?¶

API Compatibility¶

Your existing applications, SDKs, and tools work immediately — no plugins or client changes needed.

Supported Endpoints¶

OpenAI-Compatible:

Anthropic-Compatible:

Parameter Coverage¶

stdapi.ai maps as many parameters as possible to Bedrock equivalents — across all routes, not just chat:

• Generation controls — temperature, max_tokens, top_p, top_k, stop, seed, frequency_penalty, presence_penalty, logit_bias, top_logprobs, streaming via SSE, token usage reporting
• Reasoning — reasoning_effort (minimal/low/medium/high/xhigh), enable_thinking, thinking_budget
• Tool / function calling — Full OpenAI and Anthropic schemas, parallel tool calls, tool choice modes
• All content types — System, developer, user, assistant, and tool roles; text, image, audio, video, and document content
• Response formats — JSON object, JSON schema, streaming chunks, reasoning_content, annotations
• Model-specific extras — Any parameter beyond the standard API via extra_body or top-level request fields

80+ Models Across 10+ Providers¶

Access every model available on AWS Bedrock through a single, consistent API.

Model Management¶

• Automatic model discovery — Scans configured regions at startup; no manual model list to maintain
• Model aliases — Map custom names to Bedrock model IDs; Claude and OpenAI names resolve automatically
• Deprecated model failover — Requests to retired models transparently redirect to their replacements
• Legacy model filtering — Optionally hide deprecated models from the models list

Multi-Modal Capabilities¶

Text & Conversational AI¶

• All message roles: system, developer, user, assistant, tool
• Multi-turn conversations with full history
• Tool / function calling with parallel execution
• Structured JSON output (JSON object and JSON schema modes)
• Streaming via Server-Sent Events with real-time token delivery
• Reasoning content blocks (thinking, reasoning_content) for supported models
• Web search results as context (search_result content blocks)

Images¶

Generation — Text-to-image with:

• Multiple output formats: PNG, JPEG, WebP with adjustable quality and compression
• Flexible sizes and aspect ratios
• Streaming generation with partial image previews
• Style presets (model-specific)

Editing — Powerful inpainting and transformation:

• Mask-based inpainting (define edit regions precisely)
• Image-to-image transformation (style, structure conditioning)
• Background removal, object search & replace, object recolor
• Creative and conservative upscaling

Variations — Create alternative versions of existing images

JSON body format — Reference images via Files API file_id or URL instead of re-uploading

Audio¶

Text-to-Speech (Amazon Polly):

• 60+ voices across 30+ languages
• Multiple engine tiers: Standard, Neural, Long-Form, Generative
• SSML support — control pronunciation, emphasis, pauses, prosody
• Output formats: MP3, PCM, Opus, AAC, FLAC, OGG Vorbis
• Speed control (0.25× to 4×)
• Automatic language detection via Amazon Comprehend

Speech-to-Text (Amazon Transcribe):

• 100+ languages
• Speaker diarization — automatic speaker separation and labeling
• Word-level and segment-level timestamps
• Subtitle export: SRT and VTT formats
• Vocabulary customization and custom language models
• Automatic language detection

Speech Translation — Transcribe audio and translate to English in a single request

Documents & Files¶

• PDF input with optional citation support (precise source references in responses)
• Plain text and structured content blocks as context
• File storage via the Files API — upload once, reference by ID across multiple requests
• Multipart uploads for large files via the Uploads API (S3 native multipart)
• File expiry with configurable TTL (1 hour – 30 days)

Video¶

• Video input in chat completions for supported models (e.g., Amazon Nova)
• S3 URLs as direct video input for multimodal embeddings

Embeddings¶

• Text embeddings — single and batch processing
• Multimodal embeddings — images, audio, video, PDF documents
• Dimension control (model-specific reduction)
• Float or Base64 output encoding
• S3 URL input for large files; oversized base64 payloads auto-uploaded to S3

Purpose-Built for AWS¶

Multi-Region & Quota Multiplication¶

Configure multiple AWS regions to scale your throughput and maximize availability:

• 3 regions ≈ 3× your tokens-per-minute — each region has its own independent quota
• Automatic failover — transparent region switching on throttle, quota, or service errors
• Exponential backoff — doubles per consecutive error, capped at 1 hour
• Region health tracking — per-model health status with configurable recovery delays

Resilience & Failover

Advanced Bedrock Features¶

AWS AI Services Integration¶

Amazon S3 Integration¶

S3 is woven into the entire API surface — not just file storage:

• Files API — Full CRUD at /v1/files with no artificial size limit (up to S3's ~5 TB), optional expiry, S3 Lifecycle backstop; file IDs work across both OpenAI and Anthropic endpoints
• Multipart uploads — /v1/uploads backed by S3 native multipart; stream large files without buffering
• Direct s3:// image references — Use s3://bucket/key in chat completions and Anthropic Messages; the gateway reads from S3 via IAM role — no pre-signed URLs
• Files API in image operations — Reference uploaded files by file_id in image edits and variations
• Multimodal embeddings — Pass s3:// URLs directly; oversized base64 payloads auto-uploaded and invoked asynchronously
• Regional buckets — One bucket per Bedrock region; S3 region routing is automatic
• Transfer Acceleration — Faster downloads via generated HTTP links

Security & Compliance¶

Authentication¶

stdapi.ai supports multiple authentication strategies to fit your architecture:

Authentication & Security

Security Features¶

Compliance & Data Sovereignty¶

Data never leaves your AWS account — every AWS service call is restricted to the regions you configure. All AWS services used by stdapi.ai (Bedrock, S3, Polly, Transcribe, and more) are in scope for GDPR, ISO 27001/27017/27018, SOC 1/2/3, HIPAA, FedRAMP, PCI-DSS, and CSA STAR Level 2. The commercial Terraform module adds VPC endpoints (no internet egress), Customer Managed KMS keys, and region-pinned cross-region profiles for strict data residency.

Data Sovereignty & Compliance

Works with Your Existing Tools¶

stdapi.ai is a drop-in replacement in hundreds of applications and frameworks. Change the API endpoint — nothing else.

See all use cases

Observability & Operations¶

Structured Logging¶

• JSON logs to stdout — natively ingested by CloudWatch Logs
• Every request logs: method, path, status, model ID, region(s) used, execution time
• Optional: full request/response payloads, client IP (disabled by default)
• Configurable log levels (info, warning, error, critical, disabled)

OpenTelemetry Integration¶

• Export traces and metrics to AWS X-Ray, Datadog, Jaeger, or any OTLP-compatible backend
• Configurable sampling rate
• Root span per request with full correlation IDs

Token Usage Tracking¶

• Input, output, reasoning, and cached token counts in every API response
• Consistent reporting across all endpoints (chat, messages, embeddings, images, audio)

Developer Tools¶

• Swagger UI at /docs — test endpoints directly in your browser
• ReDoc at /redoc — clean, searchable API reference
• OpenAPI schema at /openapi.json — import into Postman, generate client code

Quality of Life¶

• Model aliases — Map custom names to Bedrock IDs; Claude model names resolve automatically
• Model auto-detection — Discovers available models across all configured regions at startup
• Model list caching — Fast model listing without repeated AWS API calls
• Token estimation — Optional pre-flight token count via tiktoken (without calling Bedrock); useful for client-side budgeting and routing decisions
• Safety identifier — safety_identifier field in requests as an alias to user for abuse tracking and audit trails
• Zero-configuration startup — Automatic region and model detection; warnings on missing config
• Deprecated model failover — Requests to retired models silently redirect to their replacements

Deployment¶

Community vs Commercial¶

How stdapi.ai Compares¶

All four solutions below expose an OpenAI-compatible API in front of AWS Bedrock. The comparison focuses on the AWS deployment context — LiteLLM is evaluated with AWS services as the backend provider (Bedrock, Polly, Transcribe), not as a multi-cloud proxy. Bedrock Access Gateway is the official AWS-maintained open-source sample. Bedrock Mantle is AWS's own managed OpenAI-compatible endpoint, requiring no self-hosting.

Ready to Get Started?¶