Enable Sub-Second Pipelines
You can now enable Sub-Second Pipelines on Airflow 3.2+ Deployments that use the Astro executor . Sub-Second Pipelines pair the Astro executor with a dedicated event-driven Event Scheduler that picks up and dispatches API-triggered Dag runs in under a second and sustains approximately 1,000 Dag runs per minute, where the Celery executor queues and falls...