luohy15 commented on issue #3298: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3298#issuecomment-752056941
There are 2 solutions to this problem: 1. At the end of the task, the log is sent to distributed storage such as S3/HDFS and stored according to taskInstance id. A new LoggerService is added to obtain logs of completed tasks from distributed storage. 2. Added worker.id configuration in worker.properties, and added workerId field in taskInstance. When getting the log, get the corresponding worker according to the workerId and then get the log. Which solution is better? --- 这个问题有2种解决方案： 1. 任务结束时将日志发送至S3/HDFS等分布式存储，按taskInstance id存储。新增一个LoggerService实现从分布式存储获取已完成任务的日志。 2. worker.properties增加worker.id配置，taskInstance新增workerId字段。获取日志时根据workerId得到对应的worker再获取日志。 哪一种方案更好？ ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
