Daryn Sharp created YARN-7083:
---------------------------------
Summary: Log aggregation deletes/renames while file is open
Key: YARN-7083
URL: https://issues.apache.org/jira/browse/YARN-7083
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 2.8.2
Reporter: Daryn Sharp
Priority: Critical
YARN-6288 changes the log aggregation writer to be an autoclosable.
Unfortunately the try-with-resources block for the writer will either rename or
delete the log while open.
Assuming the NM's behavior is correct, deleting open files only results in
ominous WARNs in the nodemanager log and increases the rate of logging in the
NN when the implicit try-with-resource close fails. These red herrings
complicate debugging efforts.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
