Agent Harness Tutorial · Tech stack
PS · Performance & scalability
Fast enough at the 95th percentile; more servers when load rises; the model quota is the real limit. Family: Act · around every turn.
Why our choiceStateless servers scale out with no code change. The real ceiling is the model quota.
| Option | Where from | Verdict | Why |
|---|---|---|---|
| Stateless Container Apps | ours | ✓ chosen | 0 to 1 replicas in dev |
| Per-turn time budget | ours | ✓ chosen | 60 s |
| Cache-friendly context order | ours | ✓ chosen | |
| Container Apps autoscaling | Azure | ✓ used | minimal |
| Azure Load Testing | Azure | ◐ planned | recommended |
| Managed Redis | Azure | · considered | optional |
| (none named) | open source | · considered |
How it works inside the harness: Core loop.
How it is done: the real code
Cut from the live repositories each time the site is built, so it always matches what runs.
scale: {
minReplicas: 0
maxReplicas: 1
rules: [