[
https://issues.apache.org/jira/browse/STORM-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050072#comment-15050072
]
ASF GitHub Bot commented on STORM-901:
--------------------------------------
Github user zhuoliu commented on the pull request:
https://github.com/apache/storm/pull/822#issuecomment-163488283
Hi @harshach , the main reasons we change log location are two-fold: 1) we
want to separate the daemon logs from worker logs for better namespace and
permission management; 2) the workers-artifacts directory are beyond "just
logs", it appears more like a drop-box for each worker, containing log files,
heapdump, gc files, and other possible files users may need to dump.
It will be one line change to "config/worker-artifacts-root" function if we
want to place worker-artifacts under storm-home/logs/. In that way it will look
as follows. In our opinion, it would be preferable to let workers-artifacts to
stay with storm-local/workers, worker-users.
We can discuss which one is more appropriate.
storm-home/logs/
------supervisor.log
------nimbus.log
------workers-artifacts/
-----------topo1/
------------------port1/
------------------port2/
------------------------worker.log
------------------------worker.log.err
------------------------gc.log
> Worker Artifacts Directory
> --------------------------
>
> Key: STORM-901
> URL: https://issues.apache.org/jira/browse/STORM-901
> Project: Apache Storm
> Issue Type: New Feature
> Components: storm-core
> Reporter: Robert Joseph Evans
> Assignee: Zhuo Liu
> Fix For: 0.11.0
>
> Attachments: daemon-logs-view.png, worker-logs-view.png
>
>
> At Yahoo we have added in one separate directory that not only stores each
> topology's every worker's log files, but also provides a place where the
> worker can place other files which helps with debugging (gc logs and heap
> dump files). It is a new directory that soft-links to the current working
> directory of the worker process. The oldest files in each worker's artifacts
> directory are cleaned up if they get too large (exceeding the per-dir quota
> or the global quota).
> This work is already done, but needs to be put back into open source.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
