jihoonson commented on issue #6517: Tasks got stuck when upload log files to hdfs URL: https://github.com/apache/incubator-druid/issues/6517#issuecomment-433146759 Hmm, I think timeout should be added to inside of `HdfsTaskLogs` if needed because other taskLogPusher implementations can have their own error handling mechanism which can cause blocking for a while. For example, `S3TaskLogs` retries on errors to avoid transient S3 errors. Timeout in `ForkingTaskRunner` can interrupt it before exhausting all retries. But before that, I think we need to check that other HDFS distributions have the similar issue. If it's common in various distributions, it's worth to handle it. Do you have any idea about this?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
