Amazon SageMaker AI now supports KV cache-aware routing for real-time inference endpoints
Amazon SageMaker AI now supports KV cache-aware routing for real-time inference endpoints. Working with engines like vLLM, SageMaker routes requests to endpoint instances holding matching prompt caches, reducing time to first token for workloads with shared system prompts or chat history.
Also shipped Nov 16, 2026AWS in November 2026 →
Deferred tier for asynchronous model calls on the Interactions API
Google Cloud announced general availability for the Deferred tier on the Gemini Enterprise Agent Platform. It offers a 50% discount compared to Standard PayGo rates for asynchronous Gemini model calls, providing a 24-hour completion window and 7-day state retention.
DeepSeek-V4.1-Flash-1017 is available in Public Preview
DeepSeek-V4.1-Flash-1017 is available in public preview as a fully managed model in Vertex AI Model Garden. The updated model features improved reasoning, coding, agentic, and visual capabilities, supporting multimodal inputs with up to 1M context tokens.
OpenAI CSAM Image Classifier is now available at no cost for approved organizations
OpenAI made its CSAM Image Classifier available at no cost to approved organizations. The tool returns separate classification signals for potential child sexual abuse material and potential AI-generated CSAM to assist human review processes.
Budget limit increased to 40,000 budgets per account
GitHub increased the maximum budget limit for GitHub Enterprise Cloud accounts from 10,000 to 40,000 budgets. The limit applies automatically on github.com and GHE.com to support organizations managing spending across many users and cost centers.
Workforce Identity Federation is GA for Looker Google Cloud core instances
Workforce Identity Federation is now generally available as the primary authentication method for Looker (Google Cloud core) instances using public secure, private, or hybrid connections. It can be configured using the Google Cloud console or gcloud CLI during instance creation or updates.
GitHub Copilot models deprecated on November 16, 2026
GitHub deprecated Claude Opus 4.8, Claude Opus 5, and GPT-5.6 Terra across most GitHub Copilot features. Alternative models including Claude Opus 5.5 and GPT-6 variants are automatically enabled for Copilot Enterprise and Business subscriptions under standard settings.
More from Amazon SageMakerEvery Amazon SageMaker release →
Amazon SageMaker now supports AI data preparation capabilities to build high-quality datasets for model development
Amazon SageMaker introduced AI data preparation features, including synthetic data generation, automated multi-task labeling, human review queues, and quality evaluation.
Amazon SageMaker HyperPod now supports cluster operations for tracking scaling and on-demand Deep Health Check requests
Amazon SageMaker HyperPod introduced cluster operations to provide tracking and diagnostic events for scaling and on-demand deep health check requests.
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for disaggregated and multi-node inference
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed, multi-node model serving. This allows users to run large models across multiple nodes and scale prefill and decode stages independently.
Amazon SageMaker AI now supports cross-Region inference routing
Amazon SageMaker AI added cross-Region inference routing to route endpoint traffic to healthy destinations in other AWS Regions and accounts during capacity shortages.
Amazon SageMaker HyperPod now supports higher pod density on EKS-orchestrated clusters
Amazon SageMaker HyperPod now supports higher pod density per node on EKS-orchestrated clusters to increase GPU, CPU, and memory utilization across workloads.
Amazon SageMaker AI now detects rising response times, idle GPUs, and missed optimizations on your generative AI inference endpoints
Amazon SageMaker AI introduced default monitoring on generative AI inference endpoints to automatically detect latency spikes, idle GPUs, and configuration optimization opportunities.
Amazon SageMaker Unified Studio now supports layout customization for designations
AWS added designation layout customization to Amazon SageMaker Unified Studio, enabling domain administrators to restrict visible tools and navigation items based on user roles.
Amazon SageMaker JumpStart now offers a model leaderboard to compare models on quality, speed, and cost
Amazon SageMaker JumpStart now includes a model leaderboard to compare foundation models based on reasoning benchmarks, latency, throughput, and deployment costs.