Releasesby IbisWhat's new:
Beta2 days agoUnverifiedAdded Oct 24, 2026
- Dedicated model inference and GPU clusters out of beta : Manage dedicated model inference and GPU clusters with client.endpoints , client.models , and client.clusters , or with tg endpoints , tg models , and tg clusters in the CLI.
Topics: Security, Pricing, Developer tools, Performance
More Together AI platform releases
Every Together AI platform releaseNew serverless models
The following models are now available on serverless : MiniMaxAI/MiniMax-M3.1-Flash : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $0.15 input / $0.60 output / $0.015 cached input (per 1M tokens).
Together SDK and CLI 3.0
Together Python SDK 3.0, TypeScript SDK 1.0, and Together CLI 3.0 are now available.
Post-training: MiniMax M3.1 Flash
MiniMaxAI/MiniMax-M3.1-Flash is available for post-training : LoRA training on B200-SXM , a 262,144-token context for both training and sampling, rank up to 32, and up to three adapter sessions per resource. The cookbook renders its prompts with the MiniMax codec. See Supported models .
New serverless models
The following models are now available on serverless : deepseek-ai/DeepSeek-V4.1-Flash-1017 : 1,000,000 context length, FP8 quantization, function calling, and structured outputs. Pricing: $0.30 input / $1.20 output / $0.006 cached input (per 1M tokens).
New serverless models
The following models are now available on serverless : reflection/Beam-1.0-501B-A23B : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $0.40 input / $1.20 output / $0.04 cached input (per 1M tokens).
Geo-specific inference
You can now keep serverless inference processing in the United States or Canada. Set your client's base URL to https://us-api.together.ai/v1 for the United States or https://ca-api.together.ai/v1 for Canada, using your existing API key and model IDs. There are no GPUs to provision.
New serverless models
The following models are now available on serverless : meta-models/Muse-Spark-Open-816B-A42B : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $1.25 input / $4.25 output / $0.15 cached input (per 1M tokens).
Post-training
Post-training lets you write your own training loop and run it against Together AI GPUs. Your code builds each batch and chooses the loss function and learning rate, while the GPUs you provision run the forward and backward passes, optimizer steps, and sampling. It bills per GPU-minute.
Also shipped on Oct 22, 2026
Together AI in October 2026Trace and evaluate Cursor agents with Langfuse, powered by ClickHouse
Users can now connect Cursor to Langfuse to trace agent turns and analyze model and tool calls, with ClickHouse providing the underlying analytics infrastructure.
The AI.TRANSLATE function lets you translate text strings between languages
The AI.TRANSLATE function lets you translate text strings between languages. AI.TRANSLATE supports standard Neural Machine Translation (NMT) workloads and Translation LLM (TLLM) capabilities. This function is generally available (GA).
Replit Monitoring Agent: Your very own software engineering team
Replit Monitoring Agent is an autonomous tool that investigates production alerts, identifies causes, applies fixes, and deploys them to production for internal apps.
Microsoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
You can configure Direct VPC ingress for Cloud Run instances ( Preview )
You can configure Direct VPC ingress for Cloud Run instances ( Preview ). Direct VPC ingress lets Cloud Run instances on a VPC network use their own ephemeral private IP address to communicate with each other and with other resources on the VPC network.
Gemini Enterprise: Single-user quota limits
Gemini Enterprise administrators can configure single-user quota limits on the Usage & Spending > Usage page in the Google Cloud console to prevent an individual user from using all of an edition's shared subscription quota pool.