EricGao888 commented on issue #8543: URL: https://github.com/apache/dolphinscheduler/issues/8543#issuecomment-1060141848
> > @caishunfeng @dailidong Another question related to this issue is how does ds deal with workers' logs? If not logging into remote storage, how do we keep large amount of logs produced by workers? Is there a best practice for this? > > Now DS doesn't specifically dealt with task log file, and the user handles it by himself, which is unfriendly. It is a goold idea to write the task log into remote storage when keep running large amout tasks. And I think the two point: > > 1. How to write files? Specified by configuration or config in the process definition UI? > 2. How to read compatible local files and remote files? > > If you have some good idea, please let me know. Will take these points into consideration. Thx for the suggestions! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
