AIRFLOW INTEGRATION

Data observability for Airflow

Metaplane traces lineage from Airflow to your warehouse objects and catches long-running DAGs and tasks

How it works

Metaplane uses your provisioned API key to securely access your DAG and task execution runtimes from Airflow. We can also use any tags from your warehouse to understand what queries are being orchestrated through Airflow.

NO-MAINTENANCE MONITORING

Catch long-running DAGs and Tasks

Automated DAG duration monitors for everything 
in your Airflow instance
Configurable task duration monitors for granular insights into your DAGs
Understand when your orchestration tool is out of sync
VISUAL OVERVIEW

Column-level lineage

See the impact of issues and the DAG where the issue originated all in one graph
Understand the tables and fields impacted by your SQL operators
Automated tag imports from warehouses with recurring queries
CENTRALIZED INCIDENT MANAGEMENT

Single pane of glass for failures

Incorporate Airflow events, such as task failures, directly into Metaplane
Understand when Airflow errors lead to data quality incidents
Accelerate root cause analysis with upstream lineage

Monitor types

Row counts

Alerts on-changes to expected volume

Freshness

Alerts no longer than expected update times

Cardinality

Alerts on new or removed unique values

Nullness / Uniqueness

Alerts on changes to percentage nullness or uniqueness

Distribution

Alerts on changes to statistical properties like mean, min, max, standard deviation

Custom SQL

Alerts on anomalies for arbitrary SQL queries that return a number
DBT INTEGRATIONS

Start monitoring your data in minutes

Connect your warehouse and start generating a baseline in less than 10 minutes. Start for free, no credit-card required.