Orchestrating Your Data Pipelines with Apache Airflow • Ricardo Sueiras • GOTO 2022

This presentation was recorded at GOTO Amsterdam 2022. #GOTOcon #GOTOams Ricardo Sueiras - Principal Advocate in Open Source at AWS & Experienced Coach & Mentor @ricardoasueiras RESOURCES GitHub Repo: ABSTRACT Apache Airflow continues to gain adoption for its ability to configure data pipelines as scripts, monitor them with a great user interface, and extend their functionality through a set of community-developed and custom plugins. In this session, Ricardo will introduce Apache Airflow and its key components and then dive into building some simple pipelines exploring these and so you can begin to get an idea of how you can use Apache Airflow to orchestrate your own data pipelines. [...] TIMECODES 00:00 Intro 01:10 What is in your data pipeline? 02:33 Introducing Apache Airflow 12:11 Demo 18:13 Building our data pipeline demo 20:23 Demo 30:52 Apache Airflow evolution 31:48 How to contribute 32:10 Outro Read the full abstract here: RECOMMENDED BOOKS Bas P. Harenslak & Julian Rutger de Ruiter • Data Pipelines with Apache Airflow • Danil Zburivsky & Lynda Partner • Designing Cloud Data Platforms • Gareth Eagar • Data Engineering with AWS • Martin Kleppmann • Designing Data-Intensive Applications • #ApacheAirflow #Airflow #AWS #Orchestrating #DataPipelines #OpenSource #AirflowDAG Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at Sign up for updates and specials at SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.