Advertised caps per model (API):
GET /v1/models. 429 response headers are documented on each inference endpoint in the API reference.Handling 429s
POST /v1/chat/completions, /v1/messages, /v1/responses.
Retry-After is seconds until the limit counter resets (minimum 1). Rolling windows for minute/hour/day; calendar UTC month for month.
403
entitlement_suspended — no Retry-After.
Example: Chat Completions / Responses (429)
Response headersExample: Messages (429)
Response headersStreaming
Before any stream bytes: JSON error + headers as above. After bytes start: HTTP 200 and the wait hint only in the stream error event (noRetry-After on the HTTP response).
Limit rejections are not metered as completions.