Skip to main content
Each key or team names the models it may use in models. A model outside the list is refused with 403, and GET {gateway_url}/v1/models lists only the models the key may use. A key or team without a list may use every model the instance serves.

Teams

A team is a model list, a budget, and rate limits that its keys share. Send POST /v2/agent_gateways/{id}/teams. name is required, and need not be unique. The team’s id identifies it.
A key joins the team with the team’s id in its team_id.

List Changes

PATCH /v2/agent_gateways/{id}/keys/{key_id} and PATCH /v2/agent_gateways/{id}/teams/{team_id} replace models without reissuing anything. "models": [] removes the list, and a key in a team then uses the team’s list.

Blocked Teams

"blocked": true on a team makes the instance refuse every key in it. The team keeps its settings and spend, and "blocked": false lets its keys through again. Like every change to a team, the block reaches its keys within a minute.

Team Deletion

DELETE /v2/agent_gateways/{id}/teams/{team_id} deletes a team that has no keys.