[
https://issues.apache.org/jira/browse/HADOOP-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210374#comment-13210374
]
Daryn Sharp commented on HADOOP-8054:
-------------------------------------
I'd like to echo that the issue is not specific to hive so I recommend it for
23.1. Hive happened to expose the issue with one of their filesystems, but the
issue may break other non-core filesystems. This is a trivial patch to restore
former questionable behavior to avoid more unforeseen incompatibility issues.
Arguably it's a mistake for some filesystems to have exposed their default
ctors because it creates an un-configed & thus unusable fs instance. I feel a
fs should always be instantiated with a conf. FFS hid the problem by
re-initing the embedded fs, albeit with its own uri which is wrong. Ie. if the
uris don't match and/or the init performs what should be one-time operations.
> NPE with FilterFileSystem
> -------------------------
>
> Key: HADOOP-8054
> URL: https://issues.apache.org/jira/browse/HADOOP-8054
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.23.1
> Reporter: Amareshwari Sriramadasu
> Assignee: Daryn Sharp
> Priority: Critical
> Fix For: 0.23.2
>
> Attachments: HADOOP-8054.patch, HADOOP-8054.patch, HADOOP-8054.patch,
> HADOOP-8054.patch
>
>
> While running Hive tests, I'm seeing the following exception with 0.23.1,
> {noformat}
> ava.lang.NullPointerException
> at
> org.apache.hadoop.fs.FileSystem.getDefaultBlockSize(FileSystem.java:1901)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:447)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
> at
> org.apache.hadoop.fs.ProxyFileSystem.getFileStatus(ProxyFileSystem.java:247)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:351)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1165)
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:390)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:242)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:232)
> {noformat}
> Did not see this with 0.23.0, though.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
