zozo123 commented on PR #73182: URL: https://github.com/apache/airflow/pull/73182#issuecomment-5684915794
The main intent is to make a healthy prek cache hit actually cheap. Today, on a valid hit, prek install-hooks validates the restored cache in ~0.3s, but with save-cache=true we then spend about 4m42 recompressing ~6.7 GiB and ~1m20 uploading ~2.55 GB again: roughly 6 minutes of work after an already-successful hit. This PR changes that lifecycle to: clean hit → restore → validate → use miss / broken cache / scheduled refresh → rebuild → save As a same-day sanity check, Install prek went 7:31 → 3:19, while the actual static checks were essentially unchanged (14:40 → 14:33). I wouldn’t call 3:19 the steady-state warm-v11 number yet, since this run was populating v11. The concrete gain is removing the redundant multi-minute recompress/upload from healthy hits; the stronger cache identity and validation make that reuse safe. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
