kaxil commented on issue #6715: [AIRFLOW-5945] Make inbuilt OperatorLinks work 
when using Serialization
URL: https://github.com/apache/airflow/pull/6715#issuecomment-560795290
 
 
   > What do you think to save the generated links in a separate column in the 
database after Task execution? I think it will be nicer because it will not be 
storing additional partial data, but the final data that interests us. This 
could be realized independent of DAG serialization. In addition, it will 
simplify the logic of handling these links. Now it is not possible to download 
all links for a given task, but we download one link in one HTTP request. 
https://github.com/apache/airflow/blob/master/airflow/www/templates/airflow/dag.html#L492-L518
   
   This is actually the 1st solution I mentioned to Ash and I thought it was 
the way to go :) Unfortunately Ash mentioned a use-case that ruled it out which 
was I think "S3 signed URL can have an expiration date of 15 mins and change 
after that". @ashb can probably explain that in more detail but due to that 
use-case storing the links in DB wouldn't work. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to