jonathanshir commented on pull request #8651:
URL: https://github.com/apache/airflow/pull/8651#issuecomment-624005459


   > I don't really understand it yet. Could you provide a practical example?
   
   So let's start with what exists today to give users more visibility and 
control into airflow's flow:
   The easiest way to interject into airflow's compile-time code: "Task Policy".
   In `airflow.settings.policy` you can see that the user can define his own 
policy to be called for every task object inside every executing DAG. This 
gives the user the option to alter task objects during compile time.
   Keeping this in mind, currently there is no real way to alter airflow 
variables during execution.
   Our use case in databand.ai is basically validating and running checks on 
every single task before it is executed, without changing every single airflow 
operator!
   It is important to mention that I think some confusion may have arose from 
the "bad name" in the configuration:
   This feature only allows you to define a contextmanager that is called 
before a task is executed. It **does not** alter airflow's context in any way, 
it only allows the user to do so. We have seen no clear use case for 
"replacing" airflow's context, so this is only an **addition**, hence will be 
renaming the feature to `additional_execute_contextmanager` instead of 
`user_defined_execute_context`


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to