[ 
https://issues.apache.org/jira/browse/FLUME-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13554238#comment-13554238
 ] 

Brock Noland commented on FLUME-1844:
-------------------------------------

Here is the exception.

{noformat}
java.lang.IllegalArgumentException: Wrong FS: 
rawfile:/tmp/flume-rawfile/FlumeData.1358275526949.tmp, expected: file:///
        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:590)
        at 
org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:69)
        at 
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:464)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1332)
        at 
org.apache.flume.sink.hdfs.BucketWriter.renameBucket(BucketWriter.java:459)
        at 
org.apache.flume.sink.hdfs.BucketWriter.doClose(BucketWriter.java:319)
        at 
org.apache.flume.sink.hdfs.BucketWriter.access$400(BucketWriter.java:51)
        at org.apache.flume.sink.hdfs.BucketWriter$3.run(BucketWriter.java:281)
        at org.apache.flume.sink.hdfs.BucketWriter$3.run(BucketWriter.java:279)
        at 
org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:149)
        at org.apache.flume.sink.hdfs.BucketWriter.close(BucketWriter.java:279)
        at 
org.apache.flume.sink.hdfs.HDFSEventSink$4.call(HDFSEventSink.java:757)
        at 
org.apache.flume.sink.hdfs.HDFSEventSink$4.call(HDFSEventSink.java:755)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
{noformat}
                
> HDFSEventSink should have option to use RawLocalFileSystem
> ----------------------------------------------------------
>
>                 Key: FLUME-1844
>                 URL: https://issues.apache.org/jira/browse/FLUME-1844
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Priority: Minor
>
> Due to HADOOP-7844, we should have a way to use RawLocalFileSystem, which 
> does implement flush(), with HDFSEventSInk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to