wujinhu created HADOOP-18313: -------------------------------- Summary: AliyunOSS: AliyunOSSBlockOutputStream should not mark the temporary file for deletion Key: HADOOP-18313 URL: https://issues.apache.org/jira/browse/HADOOP-18313 Project: Hadoop Common Issue Type: Bug Components: fs/oss Affects Versions: 3.3.3, 3.2.3, 2.10.2 Reporter: wujinhu Assignee: wujinhu
AliyunOSSBlockOutputStream buffers data in local directory before uploading to OSS. It uses LocalDirAllocator.createTmpFileForWrite which will create a temp file on this directory and invoke DeleteOnExitHook.add to add the path to a set and will be deleted on VM exit through a shutdown hook. However, the size of set will be growing if the VM does not exit. -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org