Build and debug Airflow DAGs
Astronomer's toolkit for Apache Airflow and the data it moves. Ask for a pipeline, a fix or an answer from your warehouse, and the plugin follows the steps an Airflow engineer would. More
Skills 34 in the ChatGPT listing
airflow Queries, manages, and troubleshoots Apache Airflow using the `af` CLI. Airflow hitl Builds human-in-the-loop (HITL) Airflow workflows - approval gates, form input, and human-driven branching. Airflow plugins Builds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middleware, macros, and operator links directly into the Airflow UI. Airflow state store Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value stores (`task_state_store`, `asset_state_store`) and the crash-safe `ResumableJobMixin`. Analyzing data Queries the data warehouse with SQL and answers business questions about data. Annotating task lineage Annotate Airflow tasks with data lineage using inlets and outlets. Authoring dags Workflow and best practices for writing Apache Airflow DAGs. Authoring go sdk tasks Writes Airflow task logic in Go using the Airflow Go SDK. Authoring java sdk tasks Writes Airflow task logic in Java, Kotlin, or any JVM language using the Airflow Java SDK. Authoring language sdk tasks The language-neutral foundation for Airflow language SDKs — implement task logic in a non-Python language while the DAG stays in Python. blueprint Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML. Checking freshness Quick data freshness check. Configuring airflow language sdks Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime/artifact on workers, and tune coordinator options. Cosmos dbt core Turns a dbt Core project into an Airflow DAG/TaskGroup using Astronomer Cosmos. Cosmos dbt fusion Run a dbt Fusion project with Astronomer Cosmos. Creating openlineage extractors Create custom OpenLineage extractors for Airflow operators. Dag factory Authors Apache Airflow DAGs declaratively from dag-factory YAML configs. Debugging dags Comprehensive DAG failure diagnosis and root-cause analysis with structured investigation and prevention recommendations. Delegating to otto Drives Astronomer's Otto agent (`astro otto`) as a delegated sub-agent for Airflow, dbt, and data-engineering work. Deploying airflow Deploys Airflow DAGs and projects. Deploying go sdk bundles Builds, packs, and deploys compiled Airflow Go SDK bundles so the ExecutableCoordinator can run them. Deploying java sdk bundles Builds and deploys compiled Airflow Java SDK bundles so workers can run them. Managing astro deployments Manage Astronomer production deployments with Astro CLI. Managing astro local env Manage local Airflow environment with Astro CLI (Docker and standalone modes). Migrating ai sdk to common ai Migrates Airflow projects from airflow-ai-sdk to apache-airflow-providers-common-ai 0.4.0+. Migrating airflow 2 to 3 Guide for migrating Apache Airflow 2.x projects to Airflow 3.x. Migrating dagster to airflow Guide for migrating Dagster projects to Apache Airflow 3 on Astro. Profiling tables Deep-dive data profiling for a specific table. Setting up astro project Initialize and configure Astro/Airflow projects. Testing dags Complex DAG testing workflows with debugging and fixing cycles. Tracing downstream lineage Trace downstream data lineage and impact analysis. Tracing upstream lineage Trace upstream data lineage. Troubleshooting astro deployments Troubleshoot Astronomer production deployments with Astro CLI. Warehouse init Initialize warehouse schema discovery.