potiuk commented on PR #43737: URL: https://github.com/apache/airflow/pull/43737#issuecomment-2469925701
Should we turn it into a devlist discussion? It seems that is a decision that shoudd be made about **now** - i.e. what we really want to do with executor and "task properties". I think we have two options: 1) we make any metadata we want to attach to task "executor specific" - like kubernetes executor so far 2) we try to make some common (well defined) "properties" of the task, exposed to executors so that they can adapt on how they are running tasks. Task "weight" seem to be a good candidate for that that we can also use elsewhere (i.e. pool slots). And indeed, we are at the right time to introduce breaking chnges (or variations) in the executor interface to acommodate to 2) if we choose to go this direction. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
