william wang created FLUME-3204:
-----------------------------------
Summary: Spooling Directory Source and delete COMPLETED file in
subfolder
Key: FLUME-3204
URL: https://issues.apache.org/jira/browse/FLUME-3204
Project: Flume
Issue Type: Bug
Environment: Flume: 1.7.0 Spooling Directory Source &
recursiveDirectorySearch = true
Os : Centos 7.2
Reporter: william wang
Every day at 2am I deleted the COMPLETED file which created a week ago;
The error is as follows：
22 Dec 2017 02:00:02,988 ERROR [pool-6-thread-1]
(org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getCandidateFiles:265)
- I/O exception occurred while listing directories. Files already matched
will be returned. /data2/logs/freports-v2
java.nio.file.NoSuchFileException:
/data2/logs/freports-v2/2017-12/16/22:55:00.log.COMPLETED
at
sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at
sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
at
sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
at
sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
at java.nio.file.Files.readAttributes(Files.java:1737)
at java.nio.file.FileTreeWalker.getAttributes(FileTreeWalker.java:219)
at java.nio.file.FileTreeWalker.visit(FileTreeWalker.java:276)
at java.nio.file.FileTreeWalker.next(FileTreeWalker.java:372)
at java.nio.file.Files.walkFileTree(Files.java:2706)
at java.nio.file.Files.walkFileTree(Files.java:2742)
at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getCandidateFiles(ReliableSpoolingFileEventReader.java:234)
at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getNextFile(ReliableSpoolingFileEventReader.java:523)
at
org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:310)
at
org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:250)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
