Roadmap & Changelog
What's Next
The following features may be implemented in future releases based on community demand and feedback. Implementation priority is determined by user requests, use case requirements, and alignment with the project's goals. All features can be implemented using AWS services as backends. If you need a specific feature, submit feedback or contribute to discussions.
💬 Chat Completions
| Provider |
Endpoint/Feature |
AWS Backend |
 OpenAI |
/v1/completions |
 Amazon Bedrock - foundation models |
| OpenAI |
/v1/responses |
Amazon Bedrock - foundation models |
 Claude |
/v1/messages |
Amazon Bedrock - foundation models |
|
Prompt caching |
Amazon Bedrock - prompt caching |
| Claude |
Extended thinking mode |
Amazon Bedrock - Claude thinking |
 Ollama |
/api/generate |
Amazon Bedrock - foundation models |
| Ollama |
/api/chat |
Amazon Bedrock - foundation models |
 Cohere |
/v1/chat |
Amazon Bedrock - foundation models |
 Qwen |
/v1/chat/completions translation_options |
 Amazon Translate |
🌐 Translation
| Provider |
Endpoint/Feature |
AWS Backend |
| DeepL |
/v2/translate |
Amazon Translate |
🧠 Embeddings
| Provider |
Endpoint/Feature |
AWS Backend |
| Ollama |
/api/embeddings |
Amazon Bedrock - embedding models |
| Cohere |
/v1/embed |
Amazon Bedrock - embedding models |
🔍 Semantic Search & Ranking
| Provider |
Endpoint/Feature |
AWS Backend |
| Cohere |
/v1/rerank |
Amazon Bedrock - rerank models |
📋 Model Discovery
| Provider |
Endpoint/Feature |
AWS Backend |
| Ollama |
/api/tags |
Amazon Bedrock - model listing |
| Ollama |
/api/show |
Amazon Bedrock - model details |
 Stability AI |
/v1/engines/list |
Amazon Bedrock - model catalog |
|
Model selection wildcards (To automatically latest model versions) |
Amazon Bedrock - model catalog |
🎙️ Speech & Audio
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/realtime/sessions |
 Amazon Nova Sonic |
| OpenAI |
/v1/realtime/transcription_sessions |
Amazon Nova Sonic |
|
Transcriptions with Nova Sonic |
Amazon Nova Sonic |
|
Translations with Nova Sonic |
Amazon Nova Sonic |
|
Long-form speech (async) |
 Amazon Polly - async tasks |
|
Streaming transcription |
 Amazon Transcribe - streaming |
|
Speaker diarization |
Amazon Transcribe - diarization |
|
Custom vocabularies |
Amazon Transcribe - custom vocab |
🎨 Image Generation
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/images/edits |
Amazon Bedrock - image models |
| OpenAI |
/v1/images/variations |
Amazon Bedrock - image models |
| Stability AI |
/v1/generation/text-to-image |
Amazon Bedrock - image models |
| Stability AI |
/v1/generation/image-to-image |
Amazon Bedrock - image models |
| Stability AI |
/v1/generation/image-to-image/masking |
Amazon Bedrock - image models |
| Stability AI |
/v2/stable-image/generate |
Amazon Bedrock - image models |
| Stability AI |
/v2/stable-image/upscale |
Amazon Bedrock - image models |
| Stability AI |
/v2/stable-image/edit |
Amazon Bedrock - image models |
🎯 Model-Specific Features
| Provider |
Endpoint/Feature |
AWS Backend |
|
Running application inference profiles |
Amazon Bedrock - application inference profiles |
|
Running Provisioned throughput |
Amazon Bedrock - provisioned models |
🤖 AWS Bedrock Advanced Features
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/agents |
Amazon Bedrock - Agents |
| OpenAI |
/v1/vector_stores |
Amazon Bedrock - Knowledge Bases |
| OpenAI |
/v1/evals |
Amazon Bedrock - Model Evaluation |
| OpenAI |
/v1/fine_tuning/jobs |
Amazon Bedrock - custom models |
📦 Batch & Async Processing
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/batches |
Amazon Bedrock - batch inference |
| Claude |
/v1/messages/batches |
Amazon Bedrock - batch inference |
🛡️ Content Safety & Moderation
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/moderations |
 Amazon Comprehend - toxicity |
📁 Files & Storage
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/files |
 Amazon S3 |
📊 Usage & Analytics
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/usage |
 Amazon CloudWatch |
| OpenAI |
/v1/organization/usage |
Amazon CloudWatch |
🔐 Authentication & Access Control
| Provider |
Endpoint/Feature |
AWS Backend |
|
User authentication |
 Amazon Cognito |
|
Multi-tenant API keys |
 Amazon DynamoDB |
|
API key rotation |
 AWS Secrets Manager |
|
Rate limiting |
Amazon DynamoDB |
|
AWS Bedrock API keys |
AWS Bedrock |
✨ Release History
v1.0.0 – Foundation Release
The initial release establishes core OpenAI API compatibility with AWS Bedrock backing.
💬 Chat Completions
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/chat/completions |
Amazon Bedrock - foundation models |
|
All models supporting Converse/ConverseStream APIs |
Amazon Bedrock - Converse API |
 Deepseek |
/v1/chat/completions reasoning_content |
Amazon Bedrock - foundation models |
| Qwen |
enable_thinking + thinking_budget parameter |
Amazon Bedrock - foundation models |
| Qwen |
top_k parameter |
Amazon Bedrock - foundation models |
🧠 Embeddings
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/embeddings |
Amazon Bedrock - embedding models |
| Cohere |
Embed V3 & V4 models |
|
 Twelve Labs |
Marengo V2 models |
|
 Amazon Titan |
Embed V1 & V2 models |
|
🎙️ Speech & Audio
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/audio/speech |
Amazon Polly + Amazon Comprehend |
| OpenAI |
/v1/audio/transcriptions |
Amazon Transcribe |
| OpenAI |
/v1/audio/translations |
Amazon Transcribe + Amazon Translate |
🎨 Image Generation
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/images/generations |
Amazon Bedrock - image models |
| Amazon Nova |
Canvas V1 models |
|
| Amazon Titan |
Image Generator V1 & V2 models |
|
| Stability AI |
Image Core, Ultra et SD3.5 Large models |
|
📋 Model Discovery
| Provider |
Endpoint/Feature |
AWS Backend |
| OpenAI |
/v1/models |
Amazon Bedrock - model catalog |
| Feature |
AWS Backend |
| 🤖 Bedrock Features |
|
| Content filtering and safety |
Amazon Bedrock Guardrails |
| Cross-region inference |
Amazon Bedrock - global/regional |
| Application inference profiles |
Amazon Bedrock - inference profiles |
| Model parameters (temperature, top_p, etc.) |
Amazon Bedrock - native parameters |
| Multi-region failover |
Amazon Bedrock - multi-region |
| Bedrock guardrails |
Amazon Bedrock Guardrails |
| ☁️ AWS Services |
|
| File storage |
Amazon S3 - presigned URLs, Transfer Acceleration |
| 🔐 Authentication |
|
| Static token authentication |
 AWS SSM Parameter Store / Secrets Manager |
| Development mode (no auth) |
|
| 📊 Observability |
|
| Distributed tracing |
 AWS X-Ray + OpenTelemetry |
| Structured logging |
Amazon CloudWatch (When running on ECS/EKS) |
| ❤Health check endpoint |
|
| 🔒 HTTP/Security |
|
| CORS support |
|
| Trusted host validation |
|
| Proxy headers (X-Forwarded-*) |
|
| GZip compression |
|
| 📚 Documentation |
|
| Interactive API docs & OpenAPI schema |
|
| 🔌 Compatibility |
|
| Provider-specific parameters |
|