Hi Mitchell,
worker.yaml and worker.pid are used by storm itself.
They will be put into {STORM_WORKERS_ARTIFACTS_DIR}/{worker id}/{worker port}
(see
https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/utils/ConfigUtils.java#L259-L261
<https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/utils/ConfigUtils.java#L259-L261>
https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/utils/ConfigUtils.java#L104-L114
<https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/utils/ConfigUtils.java#L104-L114>)
If you want to change their location, you can set this config:
“STORM_WORKERS_ARTIFACTS_DIR” (
https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/Config.java#L1751-L1757
<https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/Config.java#L1751-L1757>)
Ethan
> On Apr 18, 2018, at 1:12 PM, Mitchell Rathbun (BLOOMBERG/ 731 LEX)
> <[email protected]> wrote:
>
> I have noticed that when I run a topology, all the worker related logs are
> written by default to
> "${sys:workers.artifacts}/${sys:storm.id}/${sys:worker.port}/${sys:logfile.name}",
> as specified by the default worker.xml file. I have noticed that if I update
> the filename used in the worker.xml file, all of the logs are sent to the
> specified directory. However, the original specified path will still be
> populated with just worker.pid and worker.yaml files. What are these files
> used for? Is it possible to update the log directory specified by worker.xml
> and then have the worker.pid and worker.yaml files written to that same
> directory?