potiuk commented on issue #51545: URL: https://github.com/apache/airflow/issues/51545#issuecomment-2980492857
> Agreed on Providers relying on Task SDK alone apart from the Executors one. Can make it independent too but just need to think through the BaseExecutor interface which is used in the Scheduler too. I think we should have completely separate Executor Base distribution - and executor distributions should depend on it as well as on providers/task.sdk. I think this also can be achieve by having .... cncf-kubernetes-common distribution for example: * cncf.kubernetes.provider -> cncf.kubernetes.common + task.sdk * cncf.lunernetes.executor -> cncf.kubernetes.common (no task.sdk dependency). > Splitting API-server and Scheduler and other packages would be more involved and we can do that separately in my humble opinion, if you agree. I do - but I think we should design target architecture we want to achieve even we do it in steps, it will make it easier to make proper decisions if we know the "north star" we aspire to. I am a big fan of at least imagining where I am going when I make first step out of the door, that allows me to make decisions where I go next knowing whether it puts me closer to the goal or farther. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
