potiuk commented on issue #42824: URL: https://github.com/apache/airflow/issues/42824#issuecomment-2408733825
Currently custom code provided by DAG author cannot be executed in scheduler for securiy reasons - so what you want is not possible because it violates airflow security model - specifically capabilities of DAG authors https://airflow.apache.org/docs/apache-airflow/stable/security/security_model.html#dag-authors In Airflow 3.+ we will likely have a possibility to run different types of workflows, so we could potentially execute such condition somewhere else than in pre-execute of a task - and not occupy a pool slot for such a check. If you would like to work on it @pedro-cf - that would likely require discussion on the devlist and getting consensus on a scope of it - because this is quite a big change in architecture. And if you would like to come back to it after we know how task sdk and executing of non-task workflows will look like, because this is not likely anyone would even look at it before Airflow 3 is out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
