Yida Wu created IMPALA-13798:
--------------------------------

             Summary: Cleanup of host-level remote scratch dir on exit
                 Key: IMPALA-13798
                 URL: https://issues.apache.org/jira/browse/IMPALA-13798
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.5.0
            Reporter: Yida Wu
            Assignee: Yida Wu


IMPALA-13677 introduces a way to clean up remote scratch files on startup, 
ensuring that leftover files from abnormal shutdowns are removed. It also 
introduces a host-level directory to do easier cleanup.

An empty host-level directory in remote storage does not use resources, but it 
can stay there forever if a host goes offline permanently. To improve this, 
this task is to remove the remote host-level temporary directory on shutdown 
after the shutdown deadline. This helps prevent too many empty directories left 
in the remote scratch path, especially for hosts that never restart.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to