Hi Daniel,

This article is not up-to-date at all. It was written on the December 15, 2020, i.e. 3 days before the release 2.0 of Airflow! See: https://airflow.apache.org/docs/apache-airflow/stable/release_notes.html#airflow-2-0-0-2020-12-18

And Airflow 2.0 solves most of the yellow and red boxes from the table you mention.

As example, please refer to the following articles (but there are many others):

 * Low latency scheduling:
   https://www.astronomer.io/blog/airflow-2-scheduler/
 * Event-driven workflows: one native solution is /Dataset /feature:
   
https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html
 * Parameterized workflows: https://docs.astronomer.io/learn/airflow-params
 * Native APIs:
   
https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html

I don't know how Argo evolved in the meantime, I don't know your requirements too, but I'm pretty sure that the latest versions of Airflow can be suitable for your use cases.

Cheers,
Hervé

Le 26/09/2023 à 13:00, Daniel Boeckenhoff a écrit :
Dear all,

I am currently investigating if airflow is the rigth solution for our problem.

I found https://medium.com/arthur-engineering/picking-a-kubernetes-orchestrator-airflow-argo-and-prefect-83539ecc69b and realized it was written by an argo developer.

I would like to get your opinion on the first table in that article. Is it biased due to its author, is it still up-to-date, are relevant categories not compared in order to let argo shine, ...?

I appreciate all comments.

Best,

Daniel

Reply via email to