bvolpato opened a new pull request, #29216:
URL: https://github.com/apache/beam/pull/29216

   There's a high volume of temp files being created, and there are frequent 
scenarios of full disk errors
   
   ```
   00:03:28 Caused by: java.lang.RuntimeException: java.io.IOException: No 
space left on device
   ```
   
   For example: 
https://ci-beam.apache.org/job/beam_PreCommit_Python_Commit/31256/console
   
   Based on recent cleanups, temp files are allocated really fast (~15gb per 
hour).
   
   So changing the retention to 24h, which should reduce the peak from ~700gb 
to ~350gb, as well as the frequency to run from every 12h to 8h, to make 
cleanups more consistent & faster.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to