Takanobu Asanuma created HDDS-12312:
---------------------------------------
Summary: NodeManager log aggregation to Ozone FileSystem fails
Key: HDDS-12312
URL: https://issues.apache.org/jira/browse/HDDS-12312
Project: Apache Ozone
Issue Type: Task
Reporter: Takanobu Asanuma
Assignee: Takanobu Asanuma
When running a YARN job to Ozone FileSystem, NullPointerException occurs and
NodeManagers fail to perform log aggregation.
{noformat}
2025-02-08 03:52:01,054 [NM ContainerManager dispatcher] INFO
logaggregation.AppLogAggregatorImpl
(AppLogAggregatorImpl.java:finishLogAggregation(590)) - Application just
finished : application_1738986708224_0001
2025-02-08 03:52:01,111 [LogAggregationService #0] ERROR
logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(481)) -
Error occurred while aggregating the log for the application
application_1738986708224_0001
java.lang.NullPointerException
at
org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogWriter.close(AggregatedLogFormat.java:566)
at
org.apache.hadoop.yarn.logaggregation.filecontroller.tfile.LogAggregationTFileController.closeWriter(LogAggregationTFileController.java:101)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.uploadLogsForContainers(AppLogAggregatorImpl.java:395)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.doAppLogAggregation(AppLogAggregatorImpl.java:525)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.run(AppLogAggregatorImpl.java:472)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService$1.run(LogAggregationService.java:295)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2025-02-08 03:52:01,113 [LogAggregationService #0] WARN
logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(486)) - Log
aggregation did not complete for application application_1738986708224_0001
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
