naturalett edited a comment on issue #14198: URL: https://github.com/apache/airflow/issues/14198#issuecomment-783716262
Thanks for your input. The plugin is a good way to tackle it. I understand the importance of the workers but I thought that workers should have the same libraries. DAGs can run autonomically on each one of the workers that I have. So basically all workers should have the same conf, libraries. no? My motivation came from our [incubator-liminal](https://github.com/apache/incubator-liminal/). An open source project that allows you to create simple ML pipelines. In this use case we've a liminal_dags.py that generates Yamls. I assume that the scheduler plays a role here so I do want to know what liminal version is got installed. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
