undefined | Better HN

0 pointskingkonz15y ago0 comments

not OP, but I prefer https://github.com/azkaban/azkaban to airflow

0 comments

3 comments · 1 top-level

zmmmmm5y ago· 2 in thread

so, workflows described in yaml? I also am a bit ambivalent about Airflow and the way workflows are built up in it, but YAML seems really weak and unlikely to handle complexity well.

Also - it's entirely built around Hadoop from what I can see? Seems a limited use case compared to Airflow.

ttymck5y ago

You raise a good point, there is an apparent need for an application that retains the dags-as-code but radically simplifies the airflow architecture.

rywalker5y ago

if you like YAML-based DAGs, you can do that in Airflow with the dag-factory extension https://github.com/ajbosco/dag-factory

j / k navigate · click thread line to collapse