Hands-On Lab: Apply Data Observability to Airflow DAGs

Overview

Join us to get hands-on with subject matter experts from Fivetran and Databand. Participants have the ability follow along with the steps presented to apply data observability to their own Airflow DAGs during the workshop.

Loading data into a data warehouse from a variety of sources is time-consuming for data teams. Numerous sources also spell greater complexity in controlling the data quality. In this workshop, you will easily build your first Airflow data pipeline using Fivetran while also ensuring data observability from the get-go by using Databand.ai.

Key Takeaways

• Create data ingestion DAG in Airflow
• Load data using Fivetran into BigQuery data warehouse
• Implement and evolve your data quality framework into a data observability framework
• Observe pipeline health and dataset health using Databand.ai
• Notify stakeholders of data issues using Databand's Alert Engine

Agenda
11:00 - 11:30 - Welcome and Prerequisites
11:30 - 12:00 - Workshop Introduction
12:00 - 1:30 - Workshop

Details