[
https://issues.apache.org/jira/browse/HDFS-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated HDFS-8250:
--------------------------------
Component/s: hdfs-client
Target Version/s: 2.8.0
Issue Type: New Feature (was: Improvement)
Oleg, thanks for filing the issue. +1 for the proposal. This could enable
some interesting new integrations with HDFS.
Oleg and I already had some conversation about this, so I'd like to recap for
the community. He has a working preliminary patch that created a binding of
{{org.apache.hadoop.hdfs.DistributedFileSystem}} to
{{org.apache.hadoop.fs.FileSystem}}. We'll iterate on that and get it to a
state where it can be contributed.
While working on it, I expect we'll identify some code to refactor up to Hadoop
Common. This would enable easy development of {{java.nio.file.FileSystem}}
bindings for alternative file systems (S3, Azure, etc.). As an end goal, I'd
like to aim for any {{org.apache.hadoop.fs.FileSystem}} to be accessible as a
{{java.nio.file.FileSystem}} too. This is likely to happen in phases with
distinct pieces of work tracked in separate issues.
We'll need to document any pieces of the {{java.nio.file.FileSystem}} interface
that we can't satisfy because of HDFS semantics. I believe it is considered
acceptable for an implementor to provide partial functionality. For example, I
know the JDK's own local file system implementation of
{{java.nio.file.FileSystem}} supports setting POSIX permissions on a Linux file
system, but those methods throw unchecked exceptions on Windows. There may be
some overlap with the work on Hadoop Compatible File System specification and
contract tests.
Thanks again, Oleg. I'm happy to help with this effort.
> Create HDFS bindings for java.nio.file.FileSystem
> -------------------------------------------------
>
> Key: HDFS-8250
> URL: https://issues.apache.org/jira/browse/HDFS-8250
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: hdfs-client
> Affects Versions: 2.7.0
> Reporter: Oleg Zhurakousky
> Assignee: Oleg Zhurakousky
>
> It's a nice to have feature as it would allow developers to have a unified
> programming model while dealing with various File Systems even though this
> particular issue only addresses HDFS.
> It has already been done in the unrelated project, so I just need to extract
> the code and provide a patch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
