BELUGA BEHR created HDFS-13988:
----------------------------------
Summary: Allow for Creating Temporary Files
Key: HDFS-13988
URL: https://issues.apache.org/jira/browse/HDFS-13988
Project: Hadoop HDFS
Issue Type: New Feature
Components: hdfs, hdfs-client
Affects Versions: 3.2.0
Reporter: BELUGA BEHR
Allow clients to create temporary files in HDFS.
{code:java|title=FileSystem.java}
public FSDataOutputStreamBuilder createFile(Path path);
public FSDataOutputStreamBuilder appendFile(Path path);
// New feature
public FSDataOutputStreamBuilder createTempFile(Path path, TimeUnit unit, long
ttl);
{code}
This would register the file with the NameNode to have a TTL. The NameNode
would be responsible for deleting the files after some custom TTL. This would
be helpful in the case that a MapReduce (or Spark) job fails during execution
and does not properly clean up after itself.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
