Skip to content

Get Started

Pick the path that fits where you are right now. Both use the same OpenAI and Anthropic-compatible API — you can graduate from one to the other without changing your application code.

  • 30 seconds — Try locally with Docker

    Best for: First look, local development, evaluation, open-source projects.

    • One docker run command — no AWS infrastructure to provision
    • Uses your local AWS credentials to reach Bedrock
    • Free community image (AGPL-3.0)
    • Full API compatibility — same endpoints as production

    Run Locally with Docker

  • 5 minutes — Deploy on AWS with Terraform

    Best for: Production workloads, team access, internal tools, SaaS.

    • 3 Terraform commands → ECS Fargate with HTTPS, WAF, auto-scaling
    • Hardened container image from AWS Marketplace (14-day free trial)
    • IP-restricted by default — safe to test right away
    • Multi-region variants available (EU / US) for data residency

    Deploy on AWS

Not sure which to pick?

You are... Go with Why
A developer evaluating for the first time Docker (local) Fastest feedback loop, no cloud resources to tear down.
A team lead validating for production use AWS (Terraform) Mirrors real deployment. 14-day free trial covers evaluation.
Already running a production workload elsewhere AWS (Terraform) Jump straight to the stack you'll operate long-term.
Contributing to an open-source project Docker (local) AGPL-3.0 community image is free to use and redistribute.

You can start local and migrate to AWS later — your client code doesn't change.

Before you start

Both paths need:

The AWS Terraform path additionally needs:

  • Administrator-level AWS permissions — the module provisions IAM roles, KMS keys, ECS, ALB, WAF, and networking. A restricted developer profile will fail.
  • A sandbox AWS account is strongly recommended for evaluation. Replicate into your target account once you've validated the stack.
  • Terraform or OpenTofu >= 1.5.
  • An AWS Marketplace subscription (14-day free trial).

After your first call