Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The one drawback I did note with Airflow was none of the mentioned ones, but this: It does not allow defining data dependencies at the data level. That is, in terms of individual inputs and outputs of a process or task.

I cover this issue in some detail in a blog post from a few years back: https://rillabs.org/posts/workflows-dataflow-not-task-deps



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: