Skip to content

Model Providers

Agentwerke selects its model provider through the Anthropic configuration section. The section name remains Anthropic for compatibility, but it can select Anthropic, OpenAI-compatible endpoints, LiteLLM, Azure OpenAI through LiteLLM or OpenAI-compatible routing, the mock provider, or automatic behavior.

Provider choices

ProviderUse when
mockYou need deterministic, tokenless demos, local development, or CI.
anthropicYou are using Anthropic directly.
openaiYou are using an OpenAI Chat Completions-compatible endpoint.
litellmYou route model traffic through LiteLLM or another compatible proxy.
autoYou want Agentwerke to infer behavior from configured credentials.

When no usable provider is configured, Agentwerke uses a safe null client and agent steps report that no model is configured.

Configure a mock provider

Use this for local demos and tests:

bash
Anthropic__Provider=mock

Mock runs should produce deterministic output and zero model cost.

Configure a real provider

Set the provider, API key, model, and limits through environment variables, secret stores, appsettings, Helm values, or the Admin Settings page.

bash
Anthropic__Provider=anthropic
Anthropic__ApiKey=<secret>
Anthropic__Model=claude-sonnet-4-6
Anthropic__MaxTokens=4096
Anthropic__MaxToolIterations=10

For an OpenAI-compatible or LiteLLM endpoint:

bash
Anthropic__Provider=litellm
Anthropic__ApiBaseUrl=http://litellm:4000/v1
Anthropic__ApiKey=<secret>
Anthropic__Model=<model-name>

Configure run budgets

Use budgets to prevent runaway agent loops:

bash
Anthropic__MaxRunCostUsd=2.00
Anthropic__MaxRunTokens=100000

Set either value to 0 for unlimited. When a run reaches its budget, Agentwerke stops further model calls with a budget_exceeded status.

Rotate model secrets

Administrators can rotate supported model secrets from Settings. Secret inputs are write-only, the browser clears the value after save, and the API returns only configured/missing status, source, and fingerprint.

For production, prefer deployment-managed secrets over local file-backed settings writes:

bash
Settings__AllowLocalSecretWrites=false

Readiness checks

Use the Settings readiness check for model providers before running production workflows. The check validates local configuration completeness and writes a redacted audit record. It should not mutate external systems.

Apache-2.0 open core. Enterprise-only capabilities are labeled in context.