[
https://issues.apache.org/jira/browse/STORM-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050109#comment-15050109
]
ASF GitHub Bot commented on STORM-901:
--------------------------------------
Github user zhuoliu commented on the pull request:
https://github.com/apache/storm/pull/822#issuecomment-163492846
On the contrary, say a supervisor has been running for a long period (say a
week), 24 workers * 10 restarting* 40 files per worker (10 worker.log.gz files,
10 gc log files, error files, out files and many other files). We will have
around 10000 files from all topologies' workers and all daemons in the single
storm-home directory, with tedious long file names. This may not be an ideal
status.
> Worker Artifacts Directory
> --------------------------
>
> Key: STORM-901
> URL: https://issues.apache.org/jira/browse/STORM-901
> Project: Apache Storm
> Issue Type: New Feature
> Components: storm-core
> Reporter: Robert Joseph Evans
> Assignee: Zhuo Liu
> Fix For: 0.11.0
>
> Attachments: daemon-logs-view.png, worker-logs-view.png
>
>
> At Yahoo we have added in one separate directory that not only stores each
> topology's every worker's log files, but also provides a place where the
> worker can place other files which helps with debugging (gc logs and heap
> dump files). It is a new directory that soft-links to the current working
> directory of the worker process. The oldest files in each worker's artifacts
> directory are cleaned up if they get too large (exceeding the per-dir quota
> or the global quota).
> This work is already done, but needs to be put back into open source.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
