New serverless models
The following models are now available on serverless : Qwen/Qwen3.8-Flash : 1,000,000 context length. Pricing: $0.15 input / $0.47 output (per 1M tokens).
14 releases · 1 product · 1 Beta · 2 Deprecation
The following models are now available on serverless : Qwen/Qwen3.8-Flash : 1,000,000 context length. Pricing: $0.15 input / $0.47 output (per 1M tokens).
Dedicated endpoint autoscaling now accepts active_sessions , which targets concurrent open client WebSocket sessions per replica on a TTS deployment ( AVERAGE_VALUE only). The default inflight_requests metric also covers TTS handlers, so HTTP TTS traffic can keep scaling without a policy change. See Configure autoscaling .
The following models are now available on serverless : zai-org/GLM-5.3 : 1,000,000 context length, FP4 quantization, function calling and structured outputs. Pricing: $1.40 input / $4.40 output / $0.26 cached input (per 1M tokens).
GET /billing/usage returns organization-wide usage and cost line items, filterable by month. The endpoint is in beta and enabled per organization. See Get billing usage .
The Together CLI now includes a tg batches command group for batch inference : tg batches submit uploads a local JSONL file (or takes an existing file ID) and creates a job against chat.completions , audio.transcriptions , or audio.translations . tg batches list , retrieve , and cancel manage the job lifecycle, with ls and get as aliases.
The following models have been deprecated and are no longer available on serverless: google/gemma-3n-E4B-it . meta-llama/Llama-Guard-4-12B . These models are not supported by on-demand dedicated endpoints. See Deprecations for migration options.
Training quality has improved for fine-tuning on the following models: Qwen/Qwen3.5-0.8B . Qwen/Qwen3.5-2B . Qwen/Qwen3.5-4B . Qwen/Qwen3.5-9B . Qwen/Qwen3.5-27B . Qwen/Qwen3.5-35B-A3B . Qwen/Qwen3.5-35B-A3B-Base . Qwen/Qwen3.5-122B-A10B . Qwen/Qwen3.5-397B-A17B . Qwen/Qwen3.6-27B . Qwen/Qwen3.6-35B-A3B . nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 .