[
https://issues.apache.org/jira/browse/STORM-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051145#comment-15051145
]
ASF GitHub Bot commented on STORM-901:
--------------------------------------
Github user d2r commented on the pull request:
https://github.com/apache/storm/pull/822#issuecomment-163669693
@harshach
Use case:
A cluster admin shelling to a supervisor node and browsing all current logs
easily, without having to `cd` to other directories?
Are there other use cases? What makes this unacceptable to users? Maybe we
can come up with something better in general.
> We can let the supervisor to redirect(create) the worker-port.log symlink
to the topo/port/worker.log in launch-worker. Thanks for the explain. Btw, we
should care that some symlink may become dead link since its pointed file might
have been deleted by cleanup.
I am not excited about doing this, because it adds complexity to storm that
ought to be handled by either a logging system or shell environment. It seems
to me to make more sense to provide a tool for shells to make browsing logs
easier where they are, rather than adding complexity to storm to support the
shell.
> Worker Artifacts Directory
> --------------------------
>
> Key: STORM-901
> URL: https://issues.apache.org/jira/browse/STORM-901
> Project: Apache Storm
> Issue Type: New Feature
> Components: storm-core
> Reporter: Robert Joseph Evans
> Assignee: Zhuo Liu
> Fix For: 0.11.0
>
> Attachments: daemon-logs-view.png, worker-logs-view.png
>
>
> At Yahoo we have added in one separate directory that not only stores each
> topology's every worker's log files, but also provides a place where the
> worker can place other files which helps with debugging (gc logs and heap
> dump files). It is a new directory that soft-links to the current working
> directory of the worker process. The oldest files in each worker's artifacts
> directory are cleaned up if they get too large (exceeding the per-dir quota
> or the global quota).
> This work is already done, but needs to be put back into open source.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
