Models

An instance serves an OpenAI-compatible API at its gateway_url, and the Anthropic Messages API beside it. An OpenAI or Anthropic client works against it unchanged:

Path	What It Does
`GET {gateway_url}/v1/models`	Lists the models the instance serves.
`POST {gateway_url}/v1/chat/completions`	Chat completions, with streaming and tool use.
`POST {gateway_url}/v1/responses`	Responses, in the OpenAI Responses API format.
`POST {gateway_url}/v1/messages`	Messages, in the Anthropic Messages API format.

Beta. Every instance serves the models below, and models from other providers cannot be added.

Set Up

An instance serves models from Telnyx Inference as soon as it is ready, with nothing to add, and GET /v2/agent_gateways/{id}/models lists them. Requests name a model by the instance’s name for it, which differs from its Telnyx Inference model ID:

Model	Telnyx Inference Model	Reasoning
`GLM-5.3`	`zai-org/GLM-5.3`	Yes
`GLM-5.3-Flash`	`zai-org/GLM-5.3-Flash`	Yes
`DeepSeek-V4.1-Flash`	`deepseek-ai/DeepSeek-V4.1-Flash`	No
`Qwen3.8-27B`	`Qwen/Qwen3.8-27B`	Yes, at low effort
`Qwen3.8-27B-nothink`	`Qwen/Qwen3.8-27B`	No

A model has no settings of its own. Each key and team has:

An allow list of the models it may use.
A budget and rate limits for its requests.

A request sets its own retries, timeout, and fallbacks.

Use

A request comes from a host on the instance’s Network, goes to gateway_url, and carries a key as a bearer token. The commands below read both from the host’s environment, as GATEWAY_URL and AGW_KEY.

List the Models

Host

curl "$GATEWAY_URL/v1/models" \
  -H "Authorization: Bearer $AGW_KEY"

Output

{
  "data": [
    { "id": "GLM-5.3", "object": "model", "created": 1677610602, "owned_by": "openai" },
    { "id": "GLM-5.3-Flash", "object": "model", "created": 1677610602, "owned_by": "openai" },
    { "id": "DeepSeek-V4.1-Flash", "object": "model", "created": 1677610602, "owned_by": "openai" },
    { "id": "Qwen3.8-27B", "object": "model", "created": 1677610602, "owned_by": "openai" },
    { "id": "Qwen3.8-27B-nothink", "object": "model", "created": 1677610602, "owned_by": "openai" }
  ],
  "object": "list"
}

Send a Chat Completion

POST {gateway_url}/v1/chat/completions takes an OpenAI chat completion request:

Host

curl "$GATEWAY_URL/v1/chat/completions" \
  -H "Authorization: Bearer $AGW_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "GLM-5.3-Flash",
    "messages": [
      { "role": "user", "content": "In one sentence, what does a gateway do?" }
    ]
  }'

The instance answers in the OpenAI chat completion format:

Output

{
  "id": "chatcmpl-4ccb13b2-d225-4764-900e-76b44502de2e",
  "model": "GLM-5.3-Flash",
  "object": "chat.completion",
  "choices": [
    {
      "finish_reason": "stop",
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "A gateway is a network device or node that connects two networks using different protocols, translating and routing data between them so they can communicate—essentially serving as an entry and exit point between networks.",
        "reasoning_content": "The user is asking a simple question about what a gateway does, and they want ...",
        ...
      }
    }
  ],
  "usage": {
    "completion_tokens": 278,
    "prompt_tokens": 22,
    "total_tokens": 300,
    "completion_tokens_details": { "reasoning_tokens": 240 },
    ...
  },
  ...
}

The models behave as they do on Telnyx Inference, including reasoning, streaming, and function calling.

Get Started

Targets

Virtual Private Cloud

Outbound Authentication

Inbound Authentication

Authorization and Policy

Traffic Control

Audit and Observability

API Reference

For AI Agents

Set Up

Use

List the Models

Send a Chat Completion

​Set Up

​Use

​List the Models

​Send a Chat Completion

Set Up

Use

List the Models

Send a Chat Completion