Code Migration: SAS to Python
Author(s): Vivek Chaudhary Originally published on Towards AI. Programming The objective of this article is to build a fundamental understanding of SAS programming and rewrite the feature in the Python programming language. As a part of the demo, I have to build …
Airflow Production Tips β Grouped Failures and Retries
Author(s): Guilherme Banhudo Originally published on Towards AI. Photo by Jackson Simmer on Unsplash Apache Airflow has become the de facto standard for Data Orchestration. However, throughout the years and versions, it accumulated a set of nuances and bugs which can hinder …
Airflow Production Tips β Proper Task (Not DAG) Catchup
Author(s): Guilherme Banhudo Originally published on Towards AI. Photo by Jackson Simmer on Unsplash Apache Airflow has become the de facto standard for Data Orchestration. However, throughout the years and versions, it accumulated a set of nuances and bugs which can hinder …
The Data Engineering Pipeline
Author(s): Rijul Singh Malik Originally published on Towards AI. A Blog about Discussing an in-depth discussion around building a data pipeline Photo by JJ Ying on Unsplash Data Engineers are at the heart of the engine room of any data-driven company. This …