Agent Harness Tutorial · End to end · Zoom level 3
How we take care of it: rate limit
rate limit catches more than 30 calls a minute.
How we took care of it.
- APIM allows 30 calls a minute.
- Over that it answers 429; our layers call that Throttled, wait as told, and retry within the turn's 4 retries.
| It reads | calls per minute on the agent's APIM subscription |
| Kind | rule |
| Provided by | Azure APIM |
| If it fails | 429, wait, retry |
| Where in the code | infra/policies/groq-api.xml:35 · ResilientLLM |
| Runs at | 2 · Before the model |
Real exampleGroq's own free tier, 8,000 tokens a minute, is the tighter limit in practice: 3–5 loop turns a minute.
More on this: Layers around the call.
How it is done: the real code
Cut from the live repositories each time the site is built, so it always matches what runs.
<!-- Request rate per subscription key (the agent's): 30 calls a minute. -->
<rate-limit calls="30" renewal-period="60" remaining-calls-header-name="x-ratelimit-remaining" />