Mike Percy created FLUME-2027:
---------------------------------
Summary: Check for default replication fails on federated cluster
in hdfs sink
Key: FLUME-2027
URL: https://issues.apache.org/jira/browse/FLUME-2027
Project: Flume
Issue Type: Bug
Reporter: Mike Percy
Seeing the following exception when calling fs.getDefaultReplication() on a
federated fs:
{noformat}
13/04/26 08:52:12 ERROR hdfs.HDFSEventSink: process failed
org.apache.hadoop.fs.viewfs.NotInMountpointException:
getDefaultReplication on empty path is invalid
at
org.apache.hadoop.fs.viewfs.ViewFileSystem.getDefaultReplication(ViewFileSystem.java:509)
at
org.apache.flume.sink.hdfs.AbstractHDFSWriter.getFsDesiredReplication(AbstractHDFSWriter.java:104)
at
org.apache.flume.sink.hdfs.AbstractHDFSWriter.isUnderReplicated(AbstractHDFSWriter.java:73)
at
org.apache.flume.sink.hdfs.BucketWriter.shouldRotate(BucketWriter.java:486)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:421)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:392)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:722)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira