Taller de contribución a Apache Airflow (inglés)

Ivett Sanchez — Tue, 19 Oct 2021 17:08:16 +0000

Evento

CCOSS 2021

Ivett Sanchez Tue, 10/19/2021 - 12:08

Conferencista(s)

Jarek Potiuk

Apache Airflow es una plataforma open source para gestionar workflows de datos. Airflow es la plataforma líder en este segmento y es ampliamente utilizado en empresas en todo el mundo y en distintas industrias.

En este taller aprenderás cómo contribuir al proyecto, incluyendo: cómo instalar tu ambiente local de desarrollo, ejecutar las pruebas y submitir versiones con cambios.

Fecha de sesión

Mon, 10/04/2021 - 12:00

Introduction to Apache Airflow

Ivett Sanchez — Mon, 27 Apr 2020 23:20:18 +0000

Introduction to Apache Airflow

Evento

SG Virtual Conference 2020

Ivett Sanchez Mon, 04/27/2020 - 18:20

Conferencista(s)

open source

Apache Airflow is a tool created by community to programmatically author, schedule and monitor workflows. The biggest advantage of Airflow is the fact that it does not limit the scope of pipelines. Airflow can be used for building Machine Learning models, transferring data or managing the infrastructure. Because Airflow workflows are written in pure Python, there is no restriction on what a single task can do. It can execute a python callable, bash script or create a new Kubernetes pod. Thanks to that, a single Airflow workflow can include tasks for both setup and teardown of external infrastructure, as well as operations that will be performed using the new resources.

During this talk Tomek Urbaszek and Jarek Potiuk, both Apache Airflow official committers, will provide an extensive introduction to Airflow, helping the audience understand the underlying concepts of Apache Airflow. They will also share best practices for developing workflows and provide a guide to when Airflow is the right choice and when other solutions should be considered.

Fecha de sesión

Wed, 04/22/2020 - 12:00