20 September 2018 London, Reply (Nova Office)
Apache Airflow is a really exciting tool and we want to help grow the community. With 363 members (and growing), this Meetup is started, organised and lead by our Data Engineer, Kaxil Naik. Kaxil is also a PMC Member, committer and contributor to Apache Airflow.
Two speakers were invited to the meet-up. The first guest speaker, Ash Berlin-Taylor, an Airflow Committer and PMC member, gave an introduction of what Apache Airflow is and how it is utilised from development to production. He covered what was new in Airflow 1.10 and where it might go from there, strategies for developing and testing DAGs as well as deploying DAGs. He then led the discussion of deploying and configuring Airflow for production .
The second speaker, Ben Marengo, Data Engineer from Just Eat, shared how Just Eat embarked upon a reinvention of their whole data infrastructure with Apache Airflow at the core of batch data ingestion, transformation, egress, and ML.
This accelerates their data pipeline development where facilitating local take-aways and online orders across 13 different countries is the heart of their business.
Learn more about the London Apache Airflow Meetup and Apache Airflow.