New serverless models
Update2 days agoUnverifiedAdded Oct 23, 2026
The following models are now available on serverless : MiniMaxAI/MiniMax-M3.1-Flash : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $0.15 input / $0.60 output / $0.015 cached input (per 1M tokens).
Topics: Pricing
More Together AI platform releases
Every Together AI platform releaseNew serverless models
The following models are now available on serverless : deepseek-ai/DeepSeek-V4.1-Flash-1017 : 1,000,000 context length, FP8 quantization, function calling, and structured outputs. Pricing: $0.30 input / $1.20 output / $0.006 cached input (per 1M tokens).
New serverless models
The following models are now available on serverless : reflection/Beam-1.0-501B-A23B : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $0.40 input / $1.20 output / $0.04 cached input (per 1M tokens).
New serverless models
The following models are now available on serverless : meta-models/Muse-Spark-Open-816B-A42B : 1,048,576 context length, NVFP4 quantization, function calling, and structured outputs. Pricing: $1.25 input / $4.25 output / $0.15 cached input (per 1M tokens).
Post-training
Post-training lets you write your own training loop and run it against Together AI GPUs. Your code builds each batch and chooses the loss function and learning rate, while the GPUs you provision run the forward and backward passes, optimizer steps, and sampling. It bills per GPU-minute.
What's included:
- Three training methods: Supervised fine-tuning (SFT) , direct preference optimization (DPO) , and reinforcement learning with group relative policy optimization (GRPO) . Each method trains a low-rank adapter (LoRA) or the full model weights. Custom loss functions : Train with any objective you compute in PyTorch from the model's log-probabilities.
New provisioned throughput models
The following models are now available on provisioned throughput : zai-org/GLM-5.3 . zai-org/GLM-5.3-Flash . deepseek-ai/DeepSeek-V4.1-Flash .
Dynamic rate limits for serverless retired
Serverless no longer applies dynamic rate limits that scale with your recent traffic. Most users will no longer encounter rate limits, though requests can still be limited during periods of high demand. If you get a 429 Too Many Requests response, reduce your request rate and spread out bursts.
Together Link beta
Together Link runs six coding agents on models hosted by Together AI: Claude Code, Codex, OpenCode, and Pi Code in the terminal, plus Claude Desktop (including Cowork) and ChatGPT Desktop. Install it with one command, launch your agent through it, and your normal agent configuration stays untouched. It's now in beta on macOS and Linux.
Also shipped on Oct 22, 2026
Together AI in October 2026Trace and evaluate Cursor agents with Langfuse, powered by ClickHouse
Users can now connect Cursor to Langfuse to trace agent turns and analyze model and tool calls, with ClickHouse providing the underlying analytics infrastructure.
The AI.TRANSLATE function lets you translate text strings between languages
The AI.TRANSLATE function lets you translate text strings between languages. AI.TRANSLATE supports standard Neural Machine Translation (NMT) workloads and Translation LLM (TLLM) capabilities. This function is generally available (GA).
Replit Monitoring Agent: Your very own software engineering team
Replit Monitoring Agent is an autonomous tool that investigates production alerts, identifies causes, applies fixes, and deploys them to production for internal apps.
Microsoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
You can configure Direct VPC ingress for Cloud Run instances ( Preview )
You can configure Direct VPC ingress for Cloud Run instances ( Preview ). Direct VPC ingress lets Cloud Run instances on a VPC network use their own ephemeral private IP address to communicate with each other and with other resources on the VPC network.
Gemini Enterprise: Single-user quota limits
Gemini Enterprise administrators can configure single-user quota limits on the Usage & Spending > Usage page in the Google Cloud console to prevent an individual user from using all of an edition's shared subscription quota pool.