​

Telnyx AI: Inference — Documentation Index

Inference documentation within the AI section of the Telnyx developer docs (https://developers.telnyx.com). This file: https://developers.telnyx.com/development/llms/ai-inference-llms-txt.md · Root index: https://developers.telnyx.com/llms.txt

​

Models

• Models: Open-weight LLMs available through the Telnyx Inference API, hosted on Telnyx GPUs and accessible via an OpenAI-compatible Chat Completions endpoint.
• Regions & Availability: GPU regions and routing behavior for the Telnyx Inference API, spanning five regions across four continents with automatic nearest-region routing.
• Pricing: Pay-per-token pricing for the Telnyx Inference API with no minimums or commitments. See current per-model rates and available regions.

​

Data Residency

• Data Residency & Compliance FAQ: How Telnyx handles processing location, storage at rest, self-hosted vs third-party STT/TTS/LLM providers, data retention, and model training across the Inference API and Voice AI Assistants.

​

Integrations

• Integrations: Use the OpenAI-compatible Telnyx Inference API with popular AI frameworks by swapping base_url and api_key — works with LangChain, LlamaIndex, and others.
• OpenAI Migration: Migrate from the OpenAI API to the Telnyx Inference API by changing two environment variables and a model name — no code rewrites required.
• Anthropic Migration: Migrate from the Anthropic API to the Telnyx Inference API by changing the base URL and passing your Telnyx API key in an Authorization header — no code rewrites required.
• LangChain: Use Telnyx Inference as an LLM provider in LangChain. Configure ChatOpenAI with the Telnyx base URL to power chains, agents, and retrieval pipelines.
• LlamaIndex: Use Telnyx Inference with LlamaIndex to build RAG applications. Configure the OpenAI-compatible client to index documents and run retrieval-augmented queries.
• CrewAI: Integrate Telnyx Inference with CrewAI to build multi-agent workflows. Use Telnyx as the LLM provider for autonomous agents and crew orchestration.
• LiveKit: Integrate Telnyx STT, TTS, and LLM services into LiveKit agents using the Telnyx LiveKit Plugin.

​

Tutorials

• Inference API: Quickstart for the Telnyx Inference API. Get an API key, send your first chat completion request, and explore models for text, embeddings, and audio.
• Function Calling: Use function calling with the Telnyx Inference API to let LLMs invoke your tools. Define JSON schemas, handle tool calls, and return structured outputs.
• Streaming and Parallel Calls: Stream tool calls and run multiple functions in parallel with the Telnyx Inference API. Handle partial JSON, deltas, and concurrent tool invocations.
• JSON Mode and Beyond: In this tutorial, you’ll learn how to: Start building on Telnyx today.
• Fine Tuning: Fine-tune open-source models on the Telnyx Inference platform. Upload a training dataset, run a job, and deploy your customized model for inference.
• Audio Language Models: Use Telnyx audio language models for speech-to-text, translation, and audio understanding. Send audio files or streams and receive transcripts and analysis.
• PR Reviewer - Github Action: Telnyx Inference tool for automatically reviewing Pull Requests at GitHub
• AI SMS Outfit Recommender with OpenMeteo: Telnyx Inference + AI offering SMS outfit recommendations using

​

API Reference (Inference)

​

OpenAI Chat

• Create a chat completion (OpenAI-compatible): Chat with a language model. This endpoint is consistent with the OpenAI Chat Completions API and may be used with the OpenAI JS or Python SDK by setting the ba…
• Get available models (OpenAI-compatible): Lists every model currently available to your account on Telnyx Inference, including SOTA open-source LLMs hosted on Telnyx GPUs (for example `moonshotai/Kimi-…
• Create an OpenAI-compatible response: Create a response using Telnyx’s OpenAI-compatible Responses API. This endpoint is compatible with the OpenAI Responses API and may be used with the OpenAI JS…

​

Fine Tuning

• List fine tuning jobs: Retrieve a list of all fine tuning jobs created by the user.
• Create a fine tuning job: Create a new fine tuning job.
• Get a fine tuning job: Retrieve a fine tuning job by job_id.
• Cancel a fine tuning job: Cancel a fine tuning job.

​

Anthropic Messages

• Create a message (Anthropic-compatible): Send a message to a language model using the Anthropic Messages API format. This endpoint is compatible with the Anthropic Messages API and may be used with th…

​

Chat

• Summarize file content: Generate a summary of a file’s contents.