getConetentSummary() for HarFileSystem throws IllegalArgumentException
----------------------------------------------------------------------
Key: MAPREDUCE-1877
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1877
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: harchive
Affects Versions: 0.22.0
Reporter: Paul Yang
As HarFileSystem does not implement getContentSummary(), the implementation
from FilterFileSystem is inherited by default. However,
FilterFileSystem.getContentSummary() does not work for the HarFileSystem
because the method attempts to use HarFileSystem's underlying FS to call
getContentSummary(). In the case where the the underlying filesystem is HDFS,
an exception similar to the following is thrown:
{code}
java.lang.IllegalArgumentException: Wrong FS:
har://hdfs-example.com:9000/tmp/data.har, expected: hdfs://example.com:9000
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:352)
at
org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:232)
at
org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)
at
org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)
{code}
One solution is to implement HarFileSystem.getContentSummary() using code
similar to FileSystem.getContentSummary().
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
