fbpx Tomasz Urbaszek | SG Buzz

Tomasz Urbaszek

Tomek is a Software engineer at Polidea, Apache Airflow committer and book lover. He fancies functional programming because he is graduated mathematician. Every day he tries to make the world a better place.

Introduction to Apache Airflow

Conferencista(s)

Apache Airflow is a tool created by community to programmatically author, schedule and monitor workflows. The biggest advantage of Airflow is the fact that it does not limit the scope of pipelines. Airflow can be used for building Machine Learning models, transferring data or managing the infrastructure. Because Airflow workflows are written in pure Python, there is no restriction on what a single task can do. It can execute a python callable, bash script or create a new Kubernetes pod.