[
https://issues.apache.org/jira/browse/YARN-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18053343#comment-18053343
]
Edward Capriolo commented on YARN-11920:
----------------------------------------
Complete end-to-end using wordcount is possible now
{code:java}
WARNING: /tmp/nm1logs does not exist. Creating.
2026-01-21T14:34:46.998468160Z 2026-01-21 14:34:46,997 INFO
nodemanager.NodeManager: STARTUP_MSG:
2026-01-21T14:34:46.998506297Z
/************************************************************
2026-01-21T14:34:46.998514976Z STARTUP_MSG: Starting NodeManager
2026-01-21T14:34:46.998521669Z STARTUP_MSG: host = nm1/172.18.0.3
2026-01-21T14:34:46.998527951Z STARTUP_MSG: args = []
2026-01-21T14:34:46.998534039Z STARTUP_MSG: version = 3.4.2
2026-01-21T14:34:46.999011833Z STARTUP_MSG: classpath =
/hd_conf:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/azure-cosmosdb-2.4.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/azure-cosmosdb-commons-2.4.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/azure-cosmosdb-direct-2.4.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/azure-cosmosdb-gateway-2.4.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/commons-beanutils-1.9.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/commons-crypto-1.1.0.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/commons-csv-1.9.0.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/commons-digester-1.8.1.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/commons-validator-1.6.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/error_prone_annotations-2.21.1.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-client-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-common-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-hadoop-compat-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-hadoop2-compat-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-logging-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-metrics-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-metrics-api-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-protocol-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-protocol-shaded-2.5.8-hadoop3.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-shaded-gson-4.1.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-shaded-miscellaneous-4.1.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-shaded-netty-4.1.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-shaded-protobuf-4.1.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/hbase-unsafe-4.1.5.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/java-uuid-generator-3.1.4.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/joni-2.1.31.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/opentelemetry-api-1.15.0.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/opentelemetry-context-1.15.0.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/opentelemetry-semconv-1.15.0-alpha.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/protobuf-java-2.5.0.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/rxjava-1.3.8.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/rxjava-extras-0.8.0.17.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/rxjava-string-1.1.1.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/lib/rxnetty-0.4.20.jar:/opt/hadoop/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop/share/hadoop/common/lib/audience-annotations-0.12.0.jar:/opt/hadoop/share/hadoop/common/lib/avro-1.11.4.jar:/opt/hadoop/share/hadoop/common/lib/bcprov-jdk18on-1.78.1.jar:/opt/hadoop/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hadoop/share/hadoop/common/lib/commons-cli-1.9.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-codec-1.15.jar:/opt/hadoop/share/hadoop/common/lib/commons-collections4-4.4.jar:/opt/hadoop/share/hadoop/common/lib/commons-compress-1.26.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-configuration2-2.10.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/hadoop/common/lib/commons-io-2.16.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-lang3-3.17.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-logging-1.3.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-math3-3.6.1.jar:/opt/hadoop/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hadoop/share/hadoop/common/lib/commons-text-1.10.0.jar:/opt/hadoop/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hadoop/share/hadoop/common/lib/curator-framework-5.2.0.jar:/opt/hadoop/share/hadoop/common/lib/curator-recipes-5.2.0.jar:/opt/hadoop/share/hadoop/common/lib/dnsjava-3.6.1.jar:/opt/hadoop/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hadoop/share/hadoop/common/lib/gson-2.9.0.jar:/opt/hadoop/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-annotations-3.4.2.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-auth-3.4.2.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-shaded-guava-1.4.0.jar:/opt/hadoop/share/hadoop/common/lib/hadoop-shaded-protobuf_3_25-1.4.0.jar:/opt/hadoop/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/hadoop/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/hadoop/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hadoop/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hadoop/share/hadoop/common/lib/jackson-core-2.12.7.jar:/opt/hadoop/share/hadoop/common/lib/jackson-databind-2.12.7.1.jar:/opt/hadoop/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hadoop/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/share/hadoop/common/lib/jersey-core-1.19.4.jar:/opt/hadoop/share/hadoop/common/lib/jersey-json-1.22.0.jar:/opt/hadoop/share/hadoop/common/lib/jersey-server-1.19.4.jar:/opt/hadoop/share/hadoop/common/lib/jersey-servlet-1.19.4.jar:/opt/hadoop/share/hadoop/common/lib/jettison-1.5.4.jar:/opt/hadoop/share/hadoop/common/lib/jetty-http-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-io-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-security-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-server-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-servlet-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-util-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-util-ajax-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-webapp-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jetty-xml-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hadoop/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop/share/hadoop/common/lib/jul-to-slf4j-1.7.36.jar:/opt/hadoop/share/hadoop/common/lib/kerb-core-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerb-crypto-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerb-util-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerby-asn1-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerby-config-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerby-pkix-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/kerby-util-2.0.3.jar:/opt/hadoop/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop/share/hadoop/common/lib/netty-all-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-buffer-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-dns-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-haproxy-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-http-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-http2-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-memcache-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-mqtt-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-redis-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-smtp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-socks-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-stomp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-codec-xml-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-common-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-handler-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-handler-proxy-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-resolver-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-resolver-dns-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-resolver-dns-classes-macos-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-classes-epoll-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-classes-kqueue-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-epoll-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-native-unix-common-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-rxtx-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-sctp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/netty-transport-udt-4.1.118.Final.jar:/opt/hadoop/share/hadoop/common/lib/nimbus-jose-jwt-9.37.2.jar:/opt/hadoop/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/opt/hadoop/share/hadoop/common/lib/snappy-java-1.1.10.4.jar:/opt/hadoop/share/hadoop/common/lib/stax2-api-4.2.1.jar:/opt/hadoop/share/hadoop/common/lib/woodstox-core-5.4.0.jar:/opt/hadoop/share/hadoop/common/lib/zookeeper-3.8.4.jar:/opt/hadoop/share/hadoop/common/lib/zookeeper-jute-3.8.4.jar:/opt/hadoop/share/hadoop/common/hadoop-common-3.4.2.jar:/opt/hadoop/share/hadoop/common/hadoop-kms-3.4.2.jar:/opt/hadoop/share/hadoop/common/hadoop-nfs-3.4.2.jar:/opt/hadoop/share/hadoop/common/hadoop-registry-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/HikariCP-4.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop/share/hadoop/hdfs/lib/audience-annotations-0.12.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/avro-1.11.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-cli-1.9.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-codec-1.15.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-collections4-4.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-compress-1.26.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-configuration2-2.10.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-io-2.16.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-lang3-3.17.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-logging-1.3.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-math3-3.6.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-net-3.9.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/commons-text-1.10.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/curator-client-5.2.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/curator-framework-5.2.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/curator-recipes-5.2.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/dnsjava-3.6.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/gson-2.9.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/opt/hadoop/share/hadoop/hdfs/lib/hadoop-annotations-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/hadoop-auth-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/hadoop-shaded-guava-1.4.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/hadoop-shaded-protobuf_3_25-1.4.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/httpclient-4.5.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/httpcore-4.4.13.jar:/opt/hadoop/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-annotations-2.12.7.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-core-2.12.7.jar:/opt/hadoop/share/hadoop/hdfs/lib/jackson-databind-2.12.7.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jakarta.activation-api-1.2.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-core-1.19.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-json-1.22.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-server-1.19.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jersey-servlet-1.19.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jettison-1.5.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-http-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-io-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-security-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-server-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-servlet-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-util-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-webapp-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jetty-xml-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/opt/hadoop/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerb-core-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerb-crypto-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerb-util-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerby-asn1-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerby-config-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerby-pkix-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/kerby-util-2.0.3.jar:/opt/hadoop/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop/share/hadoop/hdfs/lib/metrics-core-3.2.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-all-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-buffer-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-dns-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-haproxy-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-http-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-http2-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-memcache-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-mqtt-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-redis-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-smtp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-socks-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-stomp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-codec-xml-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-common-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-handler-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-handler-proxy-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-handler-ssl-ocsp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-resolver-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-resolver-dns-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-resolver-dns-classes-macos-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-2026-01-21T14:34:46.999011833Z
transport-classes-epoll-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-classes-kqueue-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-native-unix-common-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-rxtx-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-sctp-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/netty-transport-udt-4.1.118.Final.jar:/opt/hadoop/share/hadoop/hdfs/lib/nimbus-jose-jwt-9.37.2.jar:/opt/hadoop/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/reload4j-1.2.22.jar:/opt/hadoop/share/hadoop/hdfs/lib/snappy-java-1.1.10.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/stax2-api-4.2.1.jar:/opt/hadoop/share/hadoop/hdfs/lib/woodstox-core-5.4.0.jar:/opt/hadoop/share/hadoop/hdfs/lib/zookeeper-3.8.4.jar:/opt/hadoop/share/hadoop/hdfs/lib/zookeeper-jute-3.8.4.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-3.4.2-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-3.4.2-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-client-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-3.4.2-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-native-client-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-nfs-3.4.2.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-rbf-3.4.2-tests.jar:/opt/hadoop/share/hadoop/hdfs/hadoop-hdfs-rbf-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.4.2-tests.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.4.2.jar:/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.4.2.jar:/opt/hadoop/share/hadoop/yarn:/opt/hadoop/share/hadoop/yarn/lib/FastInfoset-1.2.15.jar:/opt/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/asm-commons-9.7.1.jar:/opt/hadoop/share/hadoop/yarn/lib/asm-tree-9.7.1.jar:/opt/hadoop/share/hadoop/yarn/lib/bcpkix-jdk18on-1.78.1.jar:/opt/hadoop/share/hadoop/yarn/lib/bcutil-jdk18on-1.78.1.jar:/opt/hadoop/share/hadoop/yarn/lib/cache-api-1.1.1.jar:/opt/hadoop/share/hadoop/yarn/lib/codemodel-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/ehcache-3.8.2.jar:/opt/hadoop/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-4.2.3.jar:/opt/hadoop/share/hadoop/yarn/lib/guice-servlet-4.2.3.jar:/opt/hadoop/share/hadoop/yarn/lib/istack-commons-runtime-3.0.7.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-base-2.12.7.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.12.7.jar:/opt/hadoop/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.12.7.jar:/opt/hadoop/share/hadoop/yarn/lib/jakarta.xml.bind-api-2.3.2.jar:/opt/hadoop/share/hadoop/yarn/lib/javax-websocket-client-impl-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/javax-websocket-server-impl-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.activation-api-1.2.0.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/javax.websocket-client-api-1.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jaxb-runtime-2.3.1.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-client-1.19.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jersey-guice-1.19.4.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-annotations-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-client-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-jndi-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/jetty-plus-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/jline-3.9.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jna-5.2.0.jar:/opt/hadoop/share/hadoop/yarn/lib/jsonschema2pojo-core-1.0.2.jar:/opt/hadoop/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop/share/hadoop/yarn/lib/objenesis-2.6.jar:/opt/hadoop/share/hadoop/yarn/lib/snakeyaml-2.0.jar:/opt/hadoop/share/hadoop/yarn/lib/stax-ex-1.8.jar:/opt/hadoop/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/hadoop/share/hadoop/yarn/lib/txw2-2.3.1.jar:/opt/hadoop/share/hadoop/yarn/lib/websocket-api-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/websocket-client-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/websocket-common-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/websocket-server-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/lib/websocket-servlet-9.4.57.v20241219.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-api-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-mawo-core-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-client-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-registry-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-globalpolicygenerator-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-router-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-services-api-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-services-core-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-documentstore-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.4.2.jar:/opt/hadoop/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.4.2.jar
2026-01-21T14:34:46.999664504Z STARTUP_MSG: build =
https://github.com/apache/hadoop.git -r
84e8b89ee2ebe6923691205b9e171badde7a495c; compiled by 'ahmarsu' on
2025-08-20T10:30Z
2026-01-21T14:34:46.999692888Z STARTUP_MSG: java = 17.0.17
2026-01-21T14:34:46.999703813Z
************************************************************/
2026-01-21T14:34:47.018647092Z 2026-01-21 14:34:47,018 INFO
nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
2026-01-21T14:34:47.411388791Z 2026-01-21 14:34:47,411 WARN
util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
2026-01-21T14:34:47.591087458Z 2026-01-21 14:34:47,590 INFO
resourceplugin.ResourcePluginManager: No Resource plugins found from
configuration!
2026-01-21T14:34:47.591138397Z 2026-01-21 14:34:47,590 INFO
resourceplugin.ResourcePluginManager: Found Resource plugins from
configuration: null
2026-01-21T14:34:47.592512374Z 2026-01-21 14:34:47,592 INFO
resourceplugin.ResourcePluginManager: The pluggable device framework is not
enabled. If you want, please set true to
yarn.nodemanager.pluggable-device-framework.enabled
2026-01-21T14:34:47.608947484Z 2026-01-21 14:34:47,608 WARN
nodemanager.LinuxContainerExecutor:
yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users:
impersonation without authentication enabled
2026-01-21T14:34:47.643173189Z 2026-01-21 14:34:47,642 INFO
resources.ResourceHandlerModule: Using traffic control bandwidth handler
2026-01-21T14:34:47.855392304Z 2026-01-21 14:34:47,855 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2026-01-21T14:34:47.856230791Z 2026-01-21 14:34:47,856 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2026-01-21T14:34:47.857020390Z 2026-01-21 14:34:47,856 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper
2026-01-21T14:34:47.857538875Z 2026-01-21 14:34:47,857 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType
for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2026-01-21T14:34:47.858004299Z 2026-01-21 14:34:47,857 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2026-01-21T14:34:47.858445287Z 2026-01-21 14:34:47,858 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2026-01-21T14:34:47.858488065Z 2026-01-21 14:34:47,858 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler
2026-01-21T14:34:47.861597323Z 2026-01-21 14:34:47,861 INFO
tracker.NMLogAggregationStatusTracker: the rolling interval seconds for the
NodeManager Cached Log aggregation status is 600
2026-01-21T14:34:47.884494402Z 2026-01-21 14:34:47,884 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2026-01-21T14:34:47.885109521Z 2026-01-21 14:34:47,884 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class
org.apache.hadoop.yarn.server.nodemanager.NodeManager
2026-01-21T14:34:48.092624103Z 2026-01-21 14:34:48,092 INFO
health.NodeHealthScriptRunner: Missing location for the node health check
script "script".
2026-01-21T14:34:48.117941114Z 2026-01-21 14:34:48,117 INFO
nodemanager.DirectoryCollection: Disk Validator 'basic' is loaded.
2026-01-21T14:34:48.139064445Z 2026-01-21 14:34:48,138 INFO
nodemanager.DirectoryCollection: Disk Validator 'basic' is loaded.
2026-01-21T14:34:48.231244126Z 2026-01-21 14:34:48,231 INFO
nodemanager.NodeResourceMonitorImpl: Using ResourceCalculatorPlugin :
org.apache.hadoop.yarn.util.ResourceCalculatorPlugin@2e5c7f0b
2026-01-21T14:34:48.232971404Z 2026-01-21 14:34:48,232 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2026-01-21T14:34:48.234166485Z 2026-01-21 14:34:48,234 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService
2026-01-21T14:34:48.234238341Z 2026-01-21 14:34:48,234 INFO
containermanager.ContainerManagerImpl: AMRMProxyService is disabled
2026-01-21T14:34:48.234396544Z 2026-01-21 14:34:48,234 INFO
localizer.ResourceLocalizationService: per directory file limit = 8192
2026-01-21T14:34:48.277511319Z 2026-01-21 14:34:48,277 INFO
localizer.ResourceLocalizationService: usercache path :
file:/yarn-root/nm-local-dir/usercache_DEL_1769006088237
2026-01-21T14:34:48.300044010Z 2026-01-21 14:34:48,299 INFO
nodemanager.LinuxContainerExecutor: Deleting path :
file:/yarn-root/nm-local-dir/usercache_DEL_1769006088237/auser
2026-01-21T14:34:48.323347890Z 2026-01-21 14:34:48,323 INFO
event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType
for class
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2026-01-21T14:34:48.442552934Z 2026-01-21 14:34:48,442 INFO
containermanager.AuxServices: Initialized auxiliary service mapreduce_shuffle
2026-01-21T14:34:48.442603237Z 2026-01-21 14:34:48,442 INFO
containermanager.AuxServices: Adding auxiliary service mapreduce_shuffle
version null
2026-01-21T14:34:48.442778877Z 2026-01-21 14:34:48,442 INFO
monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin:
org.apache.hadoop.yarn.util.ResourceCalculatorPlugin@6aa648b9
2026-01-21T14:34:48.443534320Z 2026-01-21 14:34:48,443 INFO
monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree: null
2026-01-21T14:34:48.472305811Z 2026-01-21 14:34:48,471 INFO conf.Configuration:
resource-types.xml not found
2026-01-21T14:34:48.473141523Z 2026-01-21 14:34:48,472 INFO
resource.ResourceUtils: Unable to find 'resource-types.xml'.
2026-01-21T14:34:48.475759305Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: Setting the resources allocated to containers to
<memory:8192, vCores:8>
2026-01-21T14:34:48.475799554Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: Physical memory check enabled: true
2026-01-21T14:34:48.475870273Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: Virtual memory check enabled: true
2026-01-21T14:34:48.475916641Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: Elastic memory control enabled: false
2026-01-21T14:34:48.475955888Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: Strict memory control enabled: true
2026-01-21T14:34:48.476029128Z 2026-01-21 14:34:48,475 INFO
monitor.ContainersMonitorImpl: ContainersMonitor enabled: true
2026-01-21T14:34:48.476102461Z 2026-01-21 14:34:48,476 INFO
monitor.ContainersMonitorImpl: Container Log Monitor Enabled: false
2026-01-21T14:34:48.479874144Z 2026-01-21 14:34:48,479 WARN
monitor.ContainersMonitorImpl: NodeManager configured with 8 GB physical memory
allocated to containers, which is more than 80% of the total physical memory
available (7.6 GB). Thrashing might happen.
2026-01-21T14:34:48.480388342Z 2026-01-21 14:34:48,480 INFO
containermanager.ContainerManagerImpl: Not a recoverable state store. Nothing
to recover.
2026-01-21T14:34:48.482486318Z 2026-01-21 14:34:48,482 INFO conf.Configuration:
node-resources.xml not found
2026-01-21T14:34:48.482803601Z 2026-01-21 14:34:48,482 INFO
resource.ResourceUtils: Unable to find 'node-resources.xml'.
2026-01-21T14:34:48.484604286Z 2026-01-21 14:34:48,484 INFO
nodemanager.NodeStatusUpdaterImpl: Nodemanager resources is set to:
<memory:8192, vCores:8>.
2026-01-21T14:34:48.488192980Z 2026-01-21 14:34:48,487 INFO
nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager with :
physical-memory=8192 virtual-memory=17204 virtual-cores=8.
2026-01-21T14:34:48.529137457Z 2026-01-21 14:34:48,528 INFO
ipc.CallQueueManager: Using callQueue: class
java.util.concurrent.LinkedBlockingQueue, queueCapacity: 2000, scheduler: class
org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false, ipcFailOver:
false.
2026-01-21T14:34:48.547825398Z 2026-01-21 14:34:48,547 INFO ipc.Server:
Listener at 0.0.0.0:37669
2026-01-21T14:34:48.548910779Z 2026-01-21 14:34:48,548 INFO ipc.Server:
Starting Socket Reader #1 for port 0
2026-01-21T14:34:48.598758620Z 2026-01-21 14:34:48,598 INFO
pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2026-01-21T14:34:48.599282641Z 2026-01-21 14:34:48,599 INFO ipc.Server: IPC
Server Responder: starting
2026-01-21T14:34:48.599365724Z 2026-01-21 14:34:48,599 INFO ipc.Server: IPC
Server listener on 0: starting
2026-01-21T14:34:48.604014225Z 2026-01-21 14:34:48,603 INFO
security.NMContainerTokenSecretManager: Updating node address : nm1:37669
2026-01-21T14:34:48.608641799Z 2026-01-21 14:34:48,608 INFO
ipc.CallQueueManager: Using callQueue: class
java.util.concurrent.LinkedBlockingQueue, queueCapacity: 500, scheduler: class
org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false, ipcFailOver:
false.
2026-01-21T14:34:48.608910845Z 2026-01-21 14:34:48,608 INFO ipc.Server:
Listener at 0.0.0.0:8040
2026-01-21T14:34:48.609280290Z 2026-01-21 14:34:48,609 INFO ipc.Server:
Starting Socket Reader #1 for port 8040
2026-01-21T14:34:48.612675698Z 2026-01-21 14:34:48,612 INFO
pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the
server
2026-01-21T14:34:48.612898586Z 2026-01-21 14:34:48,612 INFO ipc.Server: IPC
Server Responder: starting
2026-01-21T14:34:48.612962592Z 2026-01-21 14:34:48,612 INFO ipc.Server: IPC
Server listener on 8040: starting
2026-01-21T14:34:48.613663829Z 2026-01-21 14:34:48,613 INFO
localizer.ResourceLocalizationService: Localizer started on port 8040
2026-01-21T14:34:48.626990524Z 2026-01-21 14:34:48,626 INFO mapred.IndexCache:
IndexCache created with max memory = 10485760
2026-01-21T14:34:48.717196710Z 2026-01-21 14:34:48,715 INFO
mapred.ShuffleHandler: mapreduce_shuffle listening on port 13562
2026-01-21T14:34:48.719291008Z 2026-01-21 14:34:48,719 INFO
containermanager.ContainerManagerImpl: ContainerManager started at
nm1/172.18.0.3:37669
2026-01-21T14:34:48.719392101Z 2026-01-21 14:34:48,719 INFO
containermanager.ContainerManagerImpl: ContainerManager bound to
0.0.0.0/0.0.0.0:0
2026-01-21T14:34:48.719650364Z 2026-01-21 14:34:48,719 WARN
tracker.NMLogAggregationStatusTracker: Log Aggregation is disabled.So is the
LogAggregationStatusTracker.
2026-01-21T14:34:48.727330773Z 2026-01-21 14:34:48,727 INFO webapp.WebServer:
Instantiating NMWebApp at 0.0.0.0:8044
2026-01-21T14:34:48.744921572Z 2026-01-21 14:34:48,744 INFO webapp.WebApps:
Loading standard ssl config
2026-01-21T14:34:48.765881407Z 2026-01-21 14:34:48,765 INFO util.log: Logging
initialized @2558ms to org.eclipse.jetty.util.log.Slf4jLog
2026-01-21T14:34:48.835009734Z 2026-01-21 14:34:48,834 WARN
server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider,
falling back to use random secrets. Reason: Could not read signature secret
file: /home/yarn/hadoop-http-auth-signature-secret
2026-01-21T14:34:48.862117223Z 2026-01-21 14:34:48,861 INFO http.HttpServer2:
Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2026-01-21T14:34:48.863975404Z 2026-01-21 14:34:48,863 INFO http.HttpServer2:
Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context node
2026-01-21T14:34:48.864014703Z 2026-01-21 14:34:48,863 INFO http.HttpServer2:
Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context logs
2026-01-21T14:34:48.864038018Z 2026-01-21 14:34:48,863 INFO http.HttpServer2:
Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context static
2026-01-21T14:34:48.865318017Z 2026-01-21 14:34:48,865 INFO http.HttpServer2:
Added filter authentication
(class=org.apache.hadoop.security.authentication.server.AuthenticationFilter)
to context node
2026-01-21T14:34:48.865378213Z 2026-01-21 14:34:48,865 INFO http.HttpServer2:
Added filter authentication
(class=org.apache.hadoop.security.authentication.server.AuthenticationFilter)
to context logs
2026-01-21T14:34:48.865434250Z 2026-01-21 14:34:48,865 INFO http.HttpServer2:
Added filter authentication
(class=org.apache.hadoop.security.authentication.server.AuthenticationFilter)
to context static
2026-01-21T14:34:48.868222807Z 2026-01-21 14:34:48,868 INFO http.HttpServer2:
ASYNC_PROFILER_HOME environment variable and async.profiler.home system
property not specified. Disabling /prof endpoint.
2026-01-21T14:34:49.288707177Z 2026-01-21 14:34:49,288 INFO webapp.WebApps:
Registered webapp guice modules
2026-01-21T14:34:49.289616205Z 2026-01-21 14:34:49,289 INFO http.HttpServer2:
Jetty bound to port 8044
2026-01-21T14:34:49.291138531Z 2026-01-21 14:34:49,290 INFO server.Server:
jetty-9.4.57.v20241219; built: 2025-01-08T21:24:30.412Z; git:
df524e6b29271c2e09ba9aea83c18dc9db464a31; jvm 17.0.17+10-alpine-r0
2026-01-21T14:34:49.315308799Z 2026-01-21 14:34:49,315 INFO server.session:
DefaultSessionIdManager workerName=node0
2026-01-21T14:34:49.315350154Z 2026-01-21 14:34:49,315 INFO server.session: No
SessionScavenger set, using defaults
2026-01-21T14:34:49.316933481Z 2026-01-21 14:34:49,316 INFO server.session:
node0 Scavenging every 600000ms
2026-01-21T14:34:49.332235933Z 2026-01-21 14:34:49,332 WARN
server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider,
falling back to use random secrets. Reason: Could not read signature secret
file: /home/yarn/hadoop-http-auth-signature-secret
2026-01-21T14:34:49.335914225Z 2026-01-21 14:34:49,335 INFO
handler.ContextHandler: Started
o.e.j.s.ServletContextHandler@112d1c8e{logs,/logs,file:///tmp/nm1logs/,AVAILABLE}
2026-01-21T14:34:49.336719612Z 2026-01-21 14:34:49,336 INFO
handler.ContextHandler: Started
o.e.j.s.ServletContextHandler@4da9f723{static,/static,jar:file:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-3.4.2.jar!/webapps/static,AVAILABLE}
2026-01-21T14:34:49.552941765Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
2026-01-21T14:34:49.552988199Z INFO: Registering
org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root
resource class
2026-01-21T14:34:49.553537450Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
2026-01-21T14:34:49.553579467Z INFO: Registering
org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
2026-01-21T14:34:49.554081026Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
2026-01-21T14:34:49.554115749Z INFO: Registering
org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a
provider class
2026-01-21T14:34:49.556272214Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
2026-01-21T14:34:49.556322501Z INFO: Initiating Jersey application, version
'Jersey: 1.19.4 05/24/2017 03:20 PM'
2026-01-21T14:34:49.624131181Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
2026-01-21T14:34:49.624194315Z INFO: Binding
org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to
GuiceManagedComponentProvider with the scope "Singleton"
2026-01-21T14:34:49.768792671Z Jan 21, 2026 2:34:49 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
2026-01-21T14:34:49.768840268Z INFO: Binding
org.apache.hadoop.yarn.webapp.GenericExceptionHandler to
GuiceManagedComponentProvider with the scope "Singleton"
2026-01-21T14:34:50.011487254Z Jan 21, 2026 2:34:50 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
2026-01-21T14:34:50.011532282Z INFO: Binding
org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to
GuiceManagedComponentProvider with the scope "Singleton"
2026-01-21T14:34:50.041827463Z 2026-01-21 14:34:50,041 INFO
handler.ContextHandler: Started
o.e.j.w.WebAppContext@23121d14{node,/,file:///tmp/jetty-0_0_0_0-8044-hadoop-yarn-common-3_4_2_jar-_-any-8254491602502727910/webapp/,AVAILABLE}{jar:file:/opt/hadoop/share/hadoop/yarn/hadoop-yarn-common-3.4.2.jar!/webapps/node}
2026-01-21T14:34:50.080251365Z 2026-01-21 14:34:50,080 INFO
ssl.SslContextFactory: x509=X509@5b0902b4(1,h=[nm1],a=[],w=[]) for
Server@9d3d54e[provider=null,keyStore=file:///mnt/pki-server/server.jks,trustStore=file:///mnt/pki-shared/myTruststore.jks]
2026-01-21T14:34:50.189221403Z 2026-01-21 14:34:50,189 INFO
server.AbstractConnector: Started ServerConnector@14d8444b{SSL, (ssl,
http/1.1)}{0.0.0.0:8044}
2026-01-21T14:34:50.189273789Z 2026-01-21 14:34:50,189 INFO server.Server:
Started @3982ms
2026-01-21T14:34:50.191654660Z 2026-01-21 14:34:50,191 INFO webapp.WebApps: Web
app node started at 8044
2026-01-21T14:34:50.192577038Z 2026-01-21 14:34:50,192 INFO
nodemanager.NodeStatusUpdaterImpl: Node ID assigned is : nm1:37669.
2026-01-21T14:34:50.193663416Z 2026-01-21 14:34:50,193 INFO
util.JvmPauseMonitor: Starting JVM pause monitor
2026-01-21T14:34:50.239977130Z 2026-01-21 14:34:50,239 INFO
nodemanager.NodeStatusUpdaterImpl: Running Applications Size : 0.
2026-01-21T14:34:50.311872334Z 2026-01-21 14:34:50,311 INFO
security.NMContainerTokenSecretManager: Rolling master-key for
container-tokens, got key with id 1567286254
2026-01-21T14:34:50.312209009Z 2026-01-21 14:34:50,312 INFO
security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got
key with id 2060245849
2026-01-21T14:34:50.312297136Z 2026-01-21 14:34:50,312 INFO
nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as nm1:37669
with total resource of <memory:8192, vCores:8>
2026-01-21T14:35:25.515338265Z 2026-01-21 14:35:25,514 INFO ipc.Server: Auth
successful for appattempt_1769004645901_0002_000001 (auth:SIMPLE) from
172.18.0.4:37578
2026-01-21T14:35:25.641596878Z 2026-01-21 14:35:25,641 INFO
containermanager.ContainerManagerImpl: Start request for
container_1769004645901_0002_01_000001 by user
appattempt_1769004645901_0002_000001 with resource <memory:2048, vCores:1>
2026-01-21T14:35:25.676794568Z 2026-01-21 14:35:25,676 INFO
containermanager.ContainerManagerImpl: Creating a new application reference for
app application_1769004645901_0002
2026-01-21T14:35:25.683468622Z 2026-01-21 14:35:25,683 INFO
application.ApplicationImpl: Application application_1769004645901_0002
transitioned from NEW to INITING
2026-01-21T14:35:25.683520198Z 2026-01-21 14:35:25,683 INFO
application.ApplicationImpl: Adding container_1769004645901_0002_01_000001 to
application application_1769004645901_0002
2026-01-21T14:35:25.686252214Z 2026-01-21 14:35:25,686 INFO
application.ApplicationImpl: Application application_1769004645901_0002
transitioned from INITING to RUNNING
2026-01-21T14:35:25.688229806Z 2026-01-21 14:35:25,688 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001 is
localizing:
[hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.splitmetainfo,
hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.jar,
hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.split,
hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.xml]
2026-01-21T14:35:25.688285035Z 2026-01-21 14:35:25,688 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001
transitioned from NEW to LOCALIZING
2026-01-21T14:35:25.688387564Z 2026-01-21 14:35:25,688 INFO
containermanager.AuxServices: Got event CONTAINER_INIT for appId
application_1769004645901_0002
2026-01-21T14:35:25.702398327Z 2026-01-21 14:35:25,702 INFO
localizer.ResourceLocalizationService: Created localizer for
container_1769004645901_0002_01_000001
2026-01-21T14:35:25.803607801Z 2026-01-21 14:35:25,803 INFO
localizer.ResourceLocalizationService: Writing credentials to the nmPrivate
file
/yarn-root/nm-local-dir/nmPrivate/container_1769004645901_0002_01_00000119be0fb5288.tokens
2026-01-21T14:35:27.746713475Z 2026-01-21 14:35:27,746 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001
transitioned from LOCALIZING to SCHEDULED
2026-01-21T14:35:27.746868133Z 2026-01-21 14:35:27,746 INFO
scheduler.ContainerScheduler: Starting container
[container_1769004645901_0002_01_000001]
2026-01-21T14:35:27.794712429Z 2026-01-21 14:35:27,794 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001
transitioned from SCHEDULED to RUNNING
2026-01-21T14:35:27.795197361Z 2026-01-21 14:35:27,795 INFO
monitor.ContainersMonitorImpl: Starting resource-monitoring for
container_1769004645901_0002_01_000001
2026-01-21T14:35:30.726526487Z 2026-01-21 14:35:30,726 INFO
monitor.ContainersMonitorImpl: container_1769004645901_0002_01_000001's ip =
172.18.0.3, and hostname = nm1
2026-01-21T14:35:30.735933181Z 2026-01-21 14:35:30,735 INFO
monitor.ContainersMonitorImpl: Skipping monitoring container
container_1769004645901_0002_01_000001 since CPU usage is not yet available.
2026-01-21T14:35:34.130923382Z 2026-01-21 14:35:34,130 INFO ipc.Server: Auth
successful for appattempt_1769004645901_0002_000001 (auth:SIMPLE) from
172.18.0.3:41918
2026-01-21T14:35:34.134229509Z 2026-01-21 14:35:34,134 INFO
containermanager.ContainerManagerImpl: Start request for
container_1769004645901_0002_01_000002 by user
appattempt_1769004645901_0002_000001 with resource <memory:1024, vCores:1>
2026-01-21T14:35:34.137382998Z 2026-01-21 14:35:34,137 INFO
application.ApplicationImpl: Adding container_1769004645901_0002_01_000002 to
application application_1769004645901_0002
2026-01-21T14:35:34.137888956Z 2026-01-21 14:35:34,137 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002 is
localizing:
[hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.jar,
hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.xml]
2026-01-21T14:35:34.138317383Z 2026-01-21 14:35:34,138 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002
transitioned from NEW to LOCALIZING
2026-01-21T14:35:34.138379365Z 2026-01-21 14:35:34,138 INFO
containermanager.AuxServices: Got event CONTAINER_INIT for appId
application_1769004645901_0002
2026-01-21T14:35:34.138531843Z 2026-01-21 14:35:34,138 INFO
containermanager.AuxServices: Got event APPLICATION_INIT for appId
application_1769004645901_0002
2026-01-21T14:35:34.138571048Z 2026-01-21 14:35:34,138 INFO
containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle
2026-01-21T14:35:34.141702815Z 2026-01-21 14:35:34,141 INFO
mapred.ShuffleHandler: Added token for job_1769004645901_0002
2026-01-21T14:35:34.142248758Z 2026-01-21 14:35:34,142 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002
transitioned from LOCALIZING to SCHEDULED
2026-01-21T14:35:34.142323468Z 2026-01-21 14:35:34,142 INFO
scheduler.ContainerScheduler: Starting container
[container_1769004645901_0002_01_000002]
2026-01-21T14:35:34.185040302Z 2026-01-21 14:35:34,184 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002
transitioned from SCHEDULED to RUNNING
2026-01-21T14:35:34.185070205Z 2026-01-21 14:35:34,184 INFO
monitor.ContainersMonitorImpl: Starting resource-monitoring for
container_1769004645901_0002_01_000002
2026-01-21T14:35:36.204229179Z 2026-01-21 14:35:36,203 INFO
launcher.ContainerLaunch: Container container_1769004645901_0002_01_000002
succeeded
2026-01-21T14:35:36.204920927Z 2026-01-21 14:35:36,204 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002
transitioned from RUNNING to EXITED_WITH_SUCCESS
2026-01-21T14:35:36.206261348Z 2026-01-21 14:35:36,206 INFO
launcher.ContainerCleanup: Cleaning up container
container_1769004645901_0002_01_000002
2026-01-21T14:35:36.207188410Z 2026-01-21 14:35:36,206 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000002
2026-01-21T14:35:36.209248419Z 2026-01-21 14:35:36,209 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000002
transitioned from EXITED_WITH_SUCCESS to DONE
2026-01-21T14:35:36.209353746Z 2026-01-21 14:35:36,209 INFO
application.ApplicationImpl: Removing container_1769004645901_0002_01_000002
from application application_1769004645901_0002
2026-01-21T14:35:36.210308306Z 2026-01-21 14:35:36,209 INFO
monitor.ContainersMonitorImpl: Stopping resource-monitoring for
container_1769004645901_0002_01_000002
2026-01-21T14:35:36.210355517Z 2026-01-21 14:35:36,209 INFO
containermanager.AuxServices: Got event CONTAINER_STOP for appId
application_1769004645901_0002
2026-01-21T14:35:36.232406485Z 2026-01-21 14:35:36,232 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000002/launch_container.sh
2026-01-21T14:35:36.235785536Z 2026-01-21 14:35:36,235 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000002/container_tokens
2026-01-21T14:35:36.239071476Z 2026-01-21 14:35:36,238 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000002/sysfs
2026-01-21T14:35:38.215855810Z 2026-01-21 14:35:38,215 INFO
nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM
context: [container_1769004645901_0002_01_000002].
2026-01-21T14:35:39.026595114Z 2026-01-21 14:35:39,026 INFO ipc.Server: Auth
successful for appattempt_1769004645901_0002_000001 (auth:SIMPLE) from
172.18.0.3:41928
2026-01-21T14:35:39.029269510Z 2026-01-21 14:35:39,029 INFO
containermanager.ContainerManagerImpl: Start request for
container_1769004645901_0002_01_000003 by user
appattempt_1769004645901_0002_000001 with resource <memory:1024, vCores:1>
2026-01-21T14:35:39.031052085Z 2026-01-21 14:35:39,030 INFO
application.ApplicationImpl: Adding container_1769004645901_0002_01_000003 to
application application_1769004645901_0002
2026-01-21T14:35:39.031442741Z 2026-01-21 14:35:39,031 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003 is
localizing:
[hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.jar,
hdfs://nn1:8020/tmp/hadoop-yarn/staging/auser/.staging/job_1769004645901_0002/job.xml]
2026-01-21T14:35:39.031682406Z 2026-01-21 14:35:39,031 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003
transitioned from NEW to LOCALIZING
2026-01-21T14:35:39.032142036Z 2026-01-21 14:35:39,031 INFO
containermanager.AuxServices: Got event CONTAINER_INIT for appId
application_1769004645901_0002
2026-01-21T14:35:39.032282004Z 2026-01-21 14:35:39,032 INFO
containermanager.AuxServices: Got event APPLICATION_INIT for appId
application_1769004645901_0002
2026-01-21T14:35:39.032301592Z 2026-01-21 14:35:39,032 INFO
containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle
2026-01-21T14:35:39.032573445Z 2026-01-21 14:35:39,032 INFO
mapred.ShuffleHandler: Added token for job_1769004645901_0002
2026-01-21T14:35:39.033210353Z 2026-01-21 14:35:39,032 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003
transitioned from LOCALIZING to SCHEDULED
2026-01-21T14:35:39.033293339Z 2026-01-21 14:35:39,033 INFO
scheduler.ContainerScheduler: Starting container
[container_1769004645901_0002_01_000003]
2026-01-21T14:35:39.079897172Z 2026-01-21 14:35:39,079 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003
transitioned from SCHEDULED to RUNNING
2026-01-21T14:35:39.079928895Z 2026-01-21 14:35:39,079 INFO
monitor.ContainersMonitorImpl: Starting resource-monitoring for
container_1769004645901_0002_01_000003
2026-01-21T14:35:39.740409111Z 2026-01-21 14:35:39,740 INFO
monitor.ContainersMonitorImpl: container_1769004645901_0002_01_000003's ip =
172.18.0.3, and hostname = nm1
2026-01-21T14:35:39.742325112Z 2026-01-21 14:35:39,742 INFO
monitor.ContainersMonitorImpl: Skipping monitoring container
container_1769004645901_0002_01_000003 since CPU usage is not yet available.
2026-01-21T14:35:41.304262860Z 2026-01-21 14:35:41,304 INFO
launcher.ContainerLaunch: Container container_1769004645901_0002_01_000003
succeeded
2026-01-21T14:35:41.304354144Z 2026-01-21 14:35:41,304 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003
transitioned from RUNNING to EXITED_WITH_SUCCESS
2026-01-21T14:35:41.304512921Z 2026-01-21 14:35:41,304 INFO
launcher.ContainerCleanup: Cleaning up container
container_1769004645901_0002_01_000003
2026-01-21T14:35:41.305187001Z 2026-01-21 14:35:41,305 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000003
2026-01-21T14:35:41.305996579Z 2026-01-21 14:35:41,305 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000003
transitioned from EXITED_WITH_SUCCESS to DONE
2026-01-21T14:35:41.306062930Z 2026-01-21 14:35:41,305 INFO
application.ApplicationImpl: Removing container_1769004645901_0002_01_000003
from application application_1769004645901_0002
2026-01-21T14:35:41.306205203Z 2026-01-21 14:35:41,306 INFO
monitor.ContainersMonitorImpl: Stopping resource-monitoring for
container_1769004645901_0002_01_000003
2026-01-21T14:35:41.306352238Z 2026-01-21 14:35:41,306 INFO
containermanager.AuxServices: Got event CONTAINER_STOP for appId
application_1769004645901_0002
2026-01-21T14:35:41.322785292Z 2026-01-21 14:35:41,322 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000003/launch_container.sh
2026-01-21T14:35:41.326727182Z 2026-01-21 14:35:41,326 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000003/container_tokens
2026-01-21T14:35:41.330709127Z 2026-01-21 14:35:41,330 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000003/sysfs
2026-01-21T14:35:41.450903614Z 2026-01-21 14:35:41,450 INFO ipc.Server: Auth
successful for appattempt_1769004645901_0002_000001 (auth:SIMPLE) from
172.18.0.3:48918
2026-01-21T14:35:41.456236750Z 2026-01-21 14:35:41,455 INFO
containermanager.ContainerManagerImpl: Stopping container with container Id:
container_1769004645901_0002_01_000003
2026-01-21T14:35:47.547345000Z 2026-01-21 14:35:47,547 INFO
launcher.ContainerLaunch: Container container_1769004645901_0002_01_000001
succeeded
2026-01-21T14:35:47.547448570Z 2026-01-21 14:35:47,547 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001
transitioned from RUNNING to EXITED_WITH_SUCCESS
2026-01-21T14:35:47.547598239Z 2026-01-21 14:35:47,547 INFO
launcher.ContainerCleanup: Cleaning up container
container_1769004645901_0002_01_000001
2026-01-21T14:35:47.548107761Z 2026-01-21 14:35:47,547 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000001
2026-01-21T14:35:47.548698172Z 2026-01-21 14:35:47,548 INFO
container.ContainerImpl: Container container_1769004645901_0002_01_000001
transitioned from EXITED_WITH_SUCCESS to DONE
2026-01-21T14:35:47.548760997Z 2026-01-21 14:35:47,548 INFO
application.ApplicationImpl: Removing container_1769004645901_0002_01_000001
from application application_1769004645901_0002
2026-01-21T14:35:47.548930334Z 2026-01-21 14:35:47,548 INFO
monitor.ContainersMonitorImpl: Stopping resource-monitoring for
container_1769004645901_0002_01_000001
2026-01-21T14:35:47.549100973Z 2026-01-21 14:35:47,548 INFO
containermanager.AuxServices: Got event CONTAINER_STOP for appId
application_1769004645901_0002
2026-01-21T14:35:47.558810315Z 2026-01-21 14:35:47,558 INFO ipc.Server: Auth
successful for appattempt_1769004645901_0002_000001 (auth:SIMPLE) from
172.18.0.4:60806
2026-01-21T14:35:47.560590788Z 2026-01-21 14:35:47,560 INFO
containermanager.ContainerManagerImpl: Stopping container with container Id:
container_1769004645901_0002_01_000001
2026-01-21T14:35:47.567163015Z 2026-01-21 14:35:47,566 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000001/launch_container.sh
2026-01-21T14:35:47.570655929Z 2026-01-21 14:35:47,570 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000001/container_tokens
2026-01-21T14:35:47.574044489Z 2026-01-21 14:35:47,573 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002/container_1769004645901_0002_01_000001/sysfs
2026-01-21T14:35:48.552528480Z 2026-01-21 14:35:48,552 INFO
nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM
context: [container_1769004645901_0002_01_000003,
container_1769004645901_0002_01_000001].
2026-01-21T14:35:48.554252760Z 2026-01-21 14:35:48,554 INFO
application.ApplicationImpl: Application application_1769004645901_0002
transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2026-01-21T14:35:48.554567838Z 2026-01-21 14:35:48,554 INFO
nodemanager.LinuxContainerExecutor: Deleting absolute path :
/yarn-root/nm-local-dir/usercache/auser/appcache/application_1769004645901_0002
2026-01-21T14:35:48.554601767Z 2026-01-21 14:35:48,554 INFO
containermanager.AuxServices: Got event APPLICATION_STOP for appId
application_1769004645901_0002
2026-01-21T14:35:48.555608619Z 2026-01-21 14:35:48,555 INFO
application.ApplicationImpl: Application application_1769004645901_0002
transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2026-01-21T14:35:48.558635601Z 2026-01-21 14:35:48,558 INFO
loghandler.NonAggregatingLogHandler: Scheduling Log Deletion for application:
application_1769004645901_0002, with delay of 10800 seconds
2026-01-21T14:44:48.608313610Z 2026-01-21 14:44:48,607 INFO
localizer.ResourceLocalizationService: Cache Size Before Clean: 0, Total
Deleted: 0, Public Deleted: 0, Private Deleted: 0
{code}
> linux-container-executor requires flexible directory permissions.
> -----------------------------------------------------------------
>
> Key: YARN-11920
> URL: https://issues.apache.org/jira/browse/YARN-11920
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Edward Capriolo
> Assignee: Edward Capriolo
> Priority: Major
> Labels: pull-request-available
>
> When running yarn node-manager directories are created which the node manager
> can not write to. I discussed this on the mailing list:
> {quote}Hello. I am trying to run linux-container-executor in a setup without
> kerberos. I want to see it "change user" and run a map reduce job.
> I have a fork of linux-container-executor with some gratuitous println:
> main : command provided 0
> 2026-01-12T19:51:25.467740715Z main : run as user is auser
> 2026-01-12T19:51:25.467750476Z main : requested yarn user is auser
> 2026-01-12T19:51:25.467760225Z main : validate_container_id
> 2026-01-12T19:51:25.467771148Z main : huh
> 2026-01-12T19:51:25.467784131Z validated command: INITIALIZE_CONTAINER
> 2026-01-12T19:51:25.467795274Z init : set_user
> 2026-01-12T19:51:25.467805332Z maybe free_user
> 2026-01-12T19:51:25.467815142Z going to check user
> 2026-01-12T19:51:25.467824798Z min id
> 2026-01-12T19:51:25.467833618Z min id 1000
> 2026-01-12T19:51:25.467842685Z Get user info
> 2026-01-12T19:51:25.467851066Z init : set_user done
> 2026-01-12T19:51:25.467860879Z initialize_app(
> 2026-01-12T19:51:25.467871118Z create user dirs
> 2026-01-12T19:51:25.467881131Z initialize_user.
> 2026-01-12T19:51:25.467890384Z created
> 2026-01-12T19:51:25.467900435Z create_log_dirs().
> 2026-01-12T19:51:25.467911090Z create container log
> 2026-01-12T19:51:25.467920790Z create_container_log_dirs
> 2026-01-12T19:51:25.467931683Z open_file_as_nm.
> 2026-01-12T19:51:25.467941717Z change_user
> 2026-01-12T19:51:25.467952667Z change_user.
> *2026-01-12T19:51:25.467962032Z Can't create directory
> /yarn-root/nm-local-dir/usercache/auser/appcache - Permission denied*
> 2026-01-12T19:51:25.467973350Z Did not create any app directories
> I am creating users like this:
> RUN addgroup -S hadoop
> RUN addgroup -S hdfs && adduser -S -G hdfs -H -D hdfs
> RUN addgroup -S yarn && adduser -S -G yarn -H -D yarn
> RUN addgroup yarn hadoop
> RUN addgroup -S auser && adduser -S -G auser -H -D auser
> I am launching a wordcount as "auser" like so:
> [https://github.com/edwardcapriolo/edgy-ansible/blob/main/imaging/hadoop/compositions/ha_rm_zk_pki_tls/enter_auser.sh]
> This is what teh directory inside the node manager looks like:
> nm1:/yarn-root/nm-local-dir/usercache# rm -rf auser/
> nm1:/yarn-root/nm-local-dir/usercache# ld -lahd /yarn-root/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lahd /yarn-root/
> drwxr-xr-x 1 yarn root 24 Jan 12 19:32 /yarn-root/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lahd /yarn-root/nm-local-dir/
> drwxr-xr-x 1 yarn hadoop 54 Jan 12 19:32
> /yarn-root/nm-local-dir/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lahd /yarn-root/nm-local-dir/
> filecache/ nmPrivate/ usercache/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lahd
> /yarn-root/nm-local-dir/usercache/
> drwxr-sr-x 1 yarn hadoop 10 Jan 12 20:38
> /yarn-root/nm-local-dir/usercache/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lahd
> /yarn-root/nm-local-dir/usercache/auser/
> drwxr-s--- 1 auser hadoop 0 Jan 12 20:38
> /yarn-root/nm-local-dir/usercache/auser/
> My node manager is running as yarn
> nm1:/$ ps -ef | grep yarn
> 1 yarn 0:20 /usr/bin/java -Dproc_nodemanager
> nm1:/$ id -u yarn
> 101
> nm1:/$ id -g yarn
> 103
> nm1:/$ id -G yarn
> 103 101
> nm1:/$ id -G yarn -n
> yarn hadoop
> nm1:/$ umask
> 0022
> I am guessing that the issue is
> drwxr-s--- 1 auser hadoop 0 Jan 12 20:38 auser
> Ths directory gets owned by auser/hadoop but the group write is off?
> My yarn config is here:
> [https://github.com/edwardcapriolo/edgy-ansible/blob/main/imaging/hadoop/compositions/ha_rm_zk_pki_tls/hd_conf/yarn-site.xml#L126]
> Also manually changing it it just gets put back
> nm1:/yarn-root/nm-local-dir/usercache# chmod g+w auser/
> nm1:/yarn-root/nm-local-dir/usercache# ls -lah
> total 0
> drwxr-sr-x 1 yarn hadoop 10 Jan 12 20:38 .
> drwxr-xr-x 1 yarn hadoop 54 Jan 12 19:32 ..
> drwxrws--- 1 auser hadoop 0 Jan 12 20:38 auser
> nm1:/yarn-root/nm-local-dir/usercache# ls -lah
> total 0
> drwxr-sr-x 1 yarn hadoop 10 Jan 12 20:38 .
> drwxr-xr-x 1 yarn hadoop 54 Jan 12 19:32 ..
> drwxr-s--- 1 auser hadoop 0 Jan 12 20:38 auser
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
