Airflow

Testing

• Writing Unit Tests for Airflow Custom Operators and Hooks

How to Design Better DAGs in Apache Airflow

https://towardsdatascience.com/how-to-design-better-dags-in-apache-airflow-494f5cb0c9ab

• All or nothing: Atomicity
• Start, Stop, Rewind: Idempotency

Generating Airflow DAGs using Jinja

• https://medium.com/@alimasri1991/auto-generating-airflow-dags-3c8c4aa6ad11

Jungle Scout case study: Kedro, Airflow, and MLFlow use on production code

• https://junglescouteng.medium.com/jungle-scout-case-study-kedro-airflow-and-mlflow-use-on-production-code-150d7231d42e