mik-laj commented on issue #8291: Enforce Connections & Pools
URL: https://github.com/apache/airflow/issues/8291#issuecomment-613607028
 
 
   The cluster policy can make any modifications on the task or DAG after 
loading it. You can do any modification in the task, in particular check which 
operator it is, which connection it uses and on the basis of this set value in 
the `pool` attribute in the task.
   
https://github.com/apache/airflow/blob/master/airflow/models/dagbag.py#L322-L323
   
   There is no universal method for linking connection and pool, because 
conn_id can be specified dynamically during execution. Many operators support 
Jinje in the _conn_id parameter.
   
   You need to think about what operators your organization uses and create for 
them a policy that will read ``_conn_id`` from a specific task and set the pool.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to