Hi, All! I tried to run Ignite on Yarn
My cluster properties: #IGNITE_HOME = /tmp/ignite # The HDFS path to the Apache Ignite config file. IGNITE_XML_CONFIG = /tmp/ignite/config/default-config.xml # The directory which will be used for saving Apache Ignite distribution. #IGNITE_WORKING_DIR = ./work # The HDFS directory which will be used for saving Apache Ignite distribution. #IGNITE_RELEASES_DIR = /tmp/ignite/releases/ # The HDFS path to libs which will be added to classpath. # IGNITE_USERS_LIBS = N/A #/opt/libs/ # The number of megabytes of RAM for each Apache Ignite node. # This is the size of the Java heap. # This includes on-heap caching if it is used. IGNITE_MEMORY_PER_NODE = 2048 # The amount of memory necessary for all data regions, with padding for JVM native overhead, interned Strings, etc. # This setting should always be adjusted for nodes that are used to store data, not just for pure computations. # Memory requested to YARN for containers running an Ignite node is the sum of IGNITE_MEMORY_PER_NODE and IGNITE_MEMORY_OVERHEAD_PER_NODE. IGNITE_MEMORY_OVERHEAD_PER_NODE = 16384 #IGNITE_MEMORY_PER_NODE * 0.10, with a minimum of 384 # The constraint on slave hosts. # IGNITE_HOSTNAME_CONSTRAINT = N/A #192.168.0.[1-100] # The number of nodes in the cluster. IGNITE_NODE_COUNT = 16 # The number of CPU Cores for each Apache Ignite node. IGNITE_RUN_CPU_PER_NODE = 2 # The version of Ignite which will be run on nodes. IGNITE_VERSION = 2.7.6 # The HDFS path to the Apache Ignite build. This property can be useful when the yarn # is cluster running in net without internet access. IGNITE_PATH = /tmp/ignite/apache-ignite-2.7.6-bin.zip # Location where Ignite binary distribution is stored to be downloaded for delivery. As per version 2.7, either IGNITE_PATH or IGNITE_URL is mandatory in practice. #IGNITE_URL = http://ambari1.dmz.loc:8888/filebrowser/view=/tmp/ignite/apache-ignite-2.7.6-bin.zip # Additional JVM options. IGNITE_JVM_OPTS = -Djava.net.preferIPv4Stack=true I also tried to add hdfs:// before paths, but result is the same. I created dir /tmp/ignite on local node fs and copied it to hdfs. apache-ignite-2.7.6-bin.zip cluster.properties commons-beanutils-1.9.3.jar commons-codec-1.11.jar commons-collections-3.2.2.jar config hadoop-common-2.7.3.jar hadoop-yarn-client-2.7.3.jar ignite-yarn-2.7.6.jar Then run yarn jar ignite-yarn-2.7.6.jar /tmp/ignite/ignite-yarn-2.7.6.jar /tmp/ignite/cluster.properties It prints in console: (I had to add some log.info to code) Feb 10, 2020 10:33:35 PM org.apache.ignite.yarn.IgniteYarnClient main INFO: ignite: hdfs:/tmp/ignite/apache-ignite-2.7.6-bin.zip Feb 10, 2020 10:33:35 PM org.apache.ignite.yarn.IgniteYarnClient main INFO: appJar: /ignite/workdir/ignite-yarn.jar Feb 10, 2020 10:33:35 PM org.apache.ignite.yarn.IgniteYarnClient main INFO: appMasterJar: scheme: "hdfs" host: "nmnode1.dmz.loc" port: 8020 file: "/ignite/workdir/ignite-yarn.jar" Feb 10, 2020 10:33:35 PM org.apache.ignite.yarn.IgniteYarnClient main INFO: Submitted application. Application id: application_1581322307764_0057 Feb 10, 2020 10:33:39 PM org.apache.ignite.yarn.IgniteYarnClient main INFO: Application application_1581322307764_0057 is RUNNING. (/ignite/workdir/ was created on hdfs with ignite-yarn.jar) But it's maximum that I got (Yarn application log) : Log Type: stderr Log Upload Time: Mon Feb 10 22:07:15 +0300 2020 Log Length: 7921 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/hdfs/v11/spill/usercache/root/appcache/application_1581322307764_0054/filecache/10/ignite-yarn.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 20/02/10 22:06:38 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 20/02/10 22:06:38 INFO client.RMProxy: Connecting to ResourceManager at ambari1.dmz.loc/10.254.62.127:8030 Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Application master registered. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. Feb 10, 2020 10:06:38 PM org.apache.ignite.yarn.ApplicationMaster run INFO: Making request. Memory: 18,432, cpu 2. 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn00.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn14.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn01.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn11.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn04.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn06.dmz.loc:45454 20/02/10 22:06:39 INFO impl.AMRMClientImpl: Received new token for : dn15.dmz.loc:45454 Feb 10, 2020 10:06:39 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000003. State: COMPLETE. Feb 10, 2020 10:06:39 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000004. State: COMPLETE. Feb 10, 2020 10:06:39 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000002. State: COMPLETE. 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn13.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn16.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn03.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn07.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn12.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn10.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn02.dmz.loc:45454 Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000006. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000008. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000007. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000005. State: COMPLETE. 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn17.dmz.loc:45454 20/02/10 22:06:40 INFO impl.AMRMClientImpl: Received new token for : dn05.dmz.loc:45454 Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000012. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000013. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000015. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000014. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000011. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000010. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000009. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000016. State: COMPLETE. Feb 10, 2020 10:06:40 PM org.apache.ignite.yarn.ApplicationMaster onContainersCompleted INFO: Container completed. Container id: container_e50_1581322307764_0054_01_000017. State: COMPLETE. I didn't find any errors in hadoop-yarn logs. I tried to complie for hadoop 2.7.3, but result is the same. P.S. Ignite started locally on any node without problems. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
