baijun opened a new issue #4060: URL: https://github.com/apache/incubator-dolphinscheduler/issues/4060
我的工作流使用了依赖任务,但是我发现依赖任务检测时是通过日志文件的方式,那假如日志被清理后此处就永远无法完成了(除非补数,将日志重新修补回来),这个问题应该如何处理,做到定期清理日志文件。  14:43:14.219 [pool-2-thread-1] INFO org.apache.dolphinscheduler.server.log.LoggerRequestProcessor - received command : Command [type=ROLL_VIEW_LOG_REQUEST, opaque=27, bodyLen=88] 14:43:14.299 [pool-2-thread-1] ERROR org.apache.dolphinscheduler.server.log.LoggerRequestProcessor - read file error java.nio.file.NoSuchFileException: /hwdata/dolphinscheduler/logs/148/1523/12761.log at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) at java.nio.file.Files.newByteChannel(Files.java:361) at java.nio.file.Files.newByteChannel(Files.java:407) at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384) at java.nio.file.Files.newInputStream(Files.java:152) at java.nio.file.Files.newBufferedReader(Files.java:2784) at java.nio.file.Files.lines(Files.java:3744) at java.nio.file.Files.lines(Files.java:3785) at org.apache.dolphinscheduler.server.log.LoggerRequestProcessor.readPartFileContent(LoggerRequestProcessor.java:156) at org.apache.dolphinscheduler.server.log.LoggerRequestProcessor.process(LoggerRequestProcessor.java:80) at org.apache.dolphinscheduler.remote.handler.NettyServerHandler$1.run(NettyServerHandler.java:128) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 日志里的目录已被我清理掉,之后依赖此任务的其他任务都无法有效执行了 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
