Data and AI releases

548 this month · 176 companies

What's new:

UpdateNot yet verified

- Preemptible GPU targets: Set num_preemptible_gpus at cluster create or update from the console, CLI, or API. Together automatically provisions replacements toward the target after nodes are reclaimed.

PricingDeveloper tools

Read on docs.together.ai

Also shipped Sep 10, 2026Together AI in September 2026 →

External secret providers (Preview)

External secret providers are now in preview. If your organization already keeps API keys, database passwords, and similar values in AWS Secrets Manager, Azure Key Vault, or Google Cloud Secret Manager, Snowflake can read those values when a query needs them, so you don't have to maintain a second copy in a Snowflake secret .

Preview
Source ↗

More from Together AI platformEvery Together AI platform release →

Preemptible compute for GPU clusters

Preemptible compute is now in public preview for Kubernetes GPU clusters. Alongside standard nodes, you can set a preemptible GPU target, and Together provisions toward it as spare capacity becomes available, at a flat discounted rate relative to on-demand.

Preview
Source ↗

Together CLI v2.33.2

Version 2.33.2 of the Together CLI improves error reporting and upload feedback: Endpoint, fine-tuning, and model commands now print the API's error message when a request fails, rather than a generic failure notice. The same goes for a missing API key or command argument.

Beta
Source ↗

New serverless models

The following models are now available on serverless : deepseek-ai/DeepSeek-V4.1-Flash : 1,000,000 context length, FP8 quantization, function calling, and structured outputs. Pricing: $0.30 input / $1.20 output / $0.006 cached input (per 1M tokens).

Update
Source ↗

Rollouts for dedicated model inference

Rollouts shift live traffic from one deployment to another under the same endpoint, without changing the endpoint URL. Pick a canary, blue-green, or rolling strategy to determine how traffic moves, and optionally gate a canary rollout on live metrics so it pauses automatically if the new deployment regresses.

Beta
Source ↗

Together CLI v2.34.0

Version 2.34.0 of the Together CLI and Python SDK carries the rollouts release above (the SDK surface is client.beta.endpoints.rollouts ) and also adds: HIPAA placement : tg beta endpoints deploy accepts --placement.hipaa to restrict a deployment to HIPAA-attested clusters. The Python SDK takes the same policy as compliance_policy on inline placement.

Beta
Source ↗

Model deprecations

The following models have been deprecated and are no longer available on serverless: openai/gpt-oss-20b . Recommended replacement: Qwen/Qwen3.5-9B . Supported by on-demand dedicated endpoints. google/gemma-4-31B-it . Recommended replacement: zai-org/GLM-5.3-Flash . Supported by on-demand dedicated endpoints. thinkingmachines/Inkling-Small .

Deprecation
Source ↗