potiuk commented on issue #14989:
URL: https://github.com/apache/airflow/issues/14989#issuecomment-808470146


   > If it is a third -party library, we download the inventory from the 
project documentation
   
   So I guess the solution is to : 
   
   1) Restore cache always from github's cache with restore-key: fallback when 
hash of constraints changed
   2) Try to download from 3rd-party to that cache (and if we can't load we 
just skip the download rather than fail the build)
   3) Build the docs from cache
   
   Then if the fallback cache has been chosen the new cache will be created 
using the newly updated cache
   
   We can even filter out the the constraint file to only contain the 
'relevant' libraries and base our hash on that filtered file. Then the cache 
will only get updated when we update to a newer version of relevant libraries 
only.
   
   That looks pretty sound to me @uranusjr @mik-laj  WDYT ?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to