Hi, Please find below logs from Createcache and testmapper class.
Createcache log --------------------------- INFO: OS: Linux 2.6.32-431.el6.x86_64 amd64 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: OS user: p_hadoop Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: PID: 7251 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Language runtime: Java Platform API Specification ver. 1.8 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM information: Java(TM) SE Runtime Environment 1.8.0_121-b13 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.121-b13 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM total memory: 22.0GB Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Remote Management [restart: off, REST: on, JMX (remote: off)] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: IGNITE_HOME=null Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM arguments: [-Xmx25g] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: System cache's MemoryPolicy size is configured to 40 MB. Use MemoryConfiguration.systemCacheMemorySize property to change the setting. Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Configured caches [in 'default' memoryPolicy: ['ignite-sys-cache', 'ignite-atomics-sys-cache']] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Configured plugins: Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- None Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Successfully bound communication NIO server to TCP port [port=47100, locHost=0.0.0.0/0.0.0.0, selectorsCnt=12, selectorSpins=0, pairedConn=false] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Collision resolution is disabled (all jobs will be activated upon arrival). Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Security status [authentication=off, tls/ssl=off] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: No user-defined default MemoryPolicy found; system default of 1GB size will be used. Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Non-loopback local IPs: 10.10.10.138, fe80:0:0:0:225:b5ff:fe00:30%eth0 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Enabled local MACs: 0025B5000030 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Successfully bound to TCP port [port=47500, localHost=0.0.0.0/0.0.0.0, locNodeId=0802cff4-0a9e-43a1-bcf3-5f0c95e75007] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=ignite-sys-cache, memoryPolicyName=sysMemPlc, mode=REPLICATED] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=ignite-atomics-sys-cache, memoryPolicyName=sysMemPlc, mode=PARTITIONED] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, node=0802cff4-0a9e-43a1-bcf3-5f0c95e75007] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Performance suggestions for grid (fix if possible) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=<size>[g|G|m|M|k|K]' to JVM options) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Speed up flushing of dirty pages by OS (alter vm.dirty_expire_centisecs parameter by setting to 500) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Reduce pages swapping ratio (set vm.swappiness=10) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Disable NUMA memory reclaim (set vm.zone_reclaim_mode=0) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Avoid direct reclaim and page allocation failures (set vm.extra_free_kbytes=1240000) Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 2.0.0#20170430-sha1:d4eef3c68ff116ee34bc13648cd82c640b3ea072 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.el6.x86_64 amd64 >>> CPU(s): 24 >>> Heap: 22.0GB >>> VM name: 7251@HMCISPRDATAWARE >>> Local node [ID=0802CFF4-0A9E-43A1-BCF3-5F0C95E75007, order=1, >>> clientMode=false] >>> Local node addresses: [HMCISPRDATAWARE.CHM.INTRA/0:0:0:0:0:0:0:1%lo, >>> /10.10.10.138, /127.0.0.1] >>> Local ports: TCP:11211 TCP:47100 TCP:47500 Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Topology snapshot [ver=1, servers=1, clients=0, CPUs=24, heap=22.0GB] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=matchCache, memoryPolicyName=null, mode=REPLICATED] Jun 09, 2017 12:22:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=0802cff4-0a9e-43a1-bcf3-5f0c95e75007] Done....cache Jun 09, 2017 12:23:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: Metrics for local node (to disable set 'metricsLogFrequency' to 0) ^-- Node [id=0802cff4, name=null, uptime=00:01:00:008] ^-- H/N/C [hosts=1, nodes=1, CPUs=24] ^-- CPU [cur=0%, avg=0.1%, GC=0%] ^-- PageMemory [pages=3276] ^-- Heap [used=262MB, free=98.85%, comm=1454MB] ^-- Non heap [used=34MB, free=-1%, comm=35MB] ^-- Public thread pool [active=0, idle=0, qSize=0] ^-- System thread pool [active=0, idle=6, qSize=0] ^-- Outbound messages queue [size=0] Jun 09, 2017 12:23:28 AM org.apache.ignite.logger.java.JavaLogger info INFO: FreeList [name=null, buckets=256, dataPages=1, reusePages=0] Jun 09, 2017 12:23:38 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Failed to read message due to ClassNotFoundException (make sure same versions of all classes are available on all nodes) [rmtNodeId=0a0516db-8178-41b4-87a8-aaea87dbbd2d, err=o.a.i.i.processors.hadoop.HadoopAttributes] Jun 09, 2017 12:23:38 AM org.apache.ignite.logger.java.JavaLogger info INFO: Update status is not available. ----------------------------------------------------------------------------------------------- Testmapper Log ---------------------------------------------------------------------------------------------- 17/06/09 00:26:07 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/06/09 00:26:08 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id 17/06/09 00:26:08 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 17/06/09 00:26:08 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 17/06/09 00:26:08 INFO input.FileInputFormat: Total input paths to process : 1 17/06/09 00:26:08 INFO mapreduce.JobSubmitter: number of splits:1 17/06/09 00:26:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local2117899413_0001 17/06/09 00:26:08 INFO mapreduce.Job: The url to track the job: http://localhost:8080/ 17/06/09 00:26:08 INFO mapreduce.Job: Running job: job_local2117899413_0001 17/06/09 00:26:08 INFO mapred.LocalJobRunner: OutputCommitter set in config null 17/06/09 00:26:08 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1 17/06/09 00:26:08 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 17/06/09 00:26:08 INFO mapred.LocalJobRunner: Waiting for map tasks 17/06/09 00:26:08 INFO mapred.LocalJobRunner: Starting task: attempt_local2117899413_0001_m_000000_0 17/06/09 00:26:08 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1 17/06/09 00:26:08 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ] 17/06/09 00:26:08 INFO mapred.MapTask: Processing split: hdfs://localhost:9001/pravin/input/TestFileForPR.txt:0+4921 17/06/09 00:26:08 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584) 17/06/09 00:26:08 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100 17/06/09 00:26:08 INFO mapred.MapTask: soft limit at 83886080 17/06/09 00:26:08 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600 17/06/09 00:26:08 INFO mapred.MapTask: kvstart = 26214396; length = 6553600 17/06/09 00:26:08 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer setup called TcpDiscoveryVmIpFinder [addrs=[/127.0.0.1:0, /127.0.0.1:47500, /127.0.0.1:47501, /127.0.0.1:47502, /127.0.0.1:47503, /127.0.0.1:47504, /127.0.0.1:47505, /127.0.0.1:47506, /127.0.0.1:47507, /127.0.0.1:47508, /127.0.0.1:47509], super=TcpDiscoveryIpFinderAdapter [shared=false]] Jun 09, 2017 12:26:08 AM java.util.logging.LogManager$RootLogger log SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 2.0.0#20170430-sha1:d4eef3c6 >>> 2017 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: Config URL: n/a Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: Daemon mode: off Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: OS: Linux 2.6.32-431.el6.x86_64 amd64 Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: OS user: p_hadoop Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: PID: 12913 Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: Language runtime: Java Platform API Specification ver. 1.8 Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM information: Java(TM) SE Runtime Environment 1.8.0_121-b13 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.121-b13 Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM total memory: 18.0GB Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: Remote Management [restart: off, REST: on, JMX (remote: off)] Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: IGNITE_HOME=null Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: VM arguments: [-Xmx1000m, -Djava.net.preferIPv4Stack=true, -Dhadoop.log.dir=/home/p_hadoop/hadoop-2.7.3/logs, -Dhadoop.log.file=hadoop.log, -Dhadoop.home.dir=/home/p_hadoop/hadoop-2.7.3, -Dhadoop.id.str=p_hadoop, -Dhadoop.root.logger=INFO,console, -Dhadoop.policy.file=hadoop-policy.xml, -Djava.net.preferIPv4Stack=true, -Xmx4096m, -Xmx20g, -Dhadoop.security.logger=INFO,NullAppender] Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: System cache's MemoryPolicy size is configured to 40 MB. Use MemoryConfiguration.systemCacheMemorySize property to change the setting. Jun 09, 2017 12:26:08 AM org.apache.ignite.logger.java.JavaLogger info INFO: Configured caches [in 'default' memoryPolicy: ['ignite-sys-cache', 'ignite-hadoop-mr-sys-cache', 'ignite-atomics-sys-cache']] Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Configured plugins: Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- None Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Successfully bound communication NIO server to TCP port [port=47101, locHost=0.0.0.0/0.0.0.0, selectorsCnt=12, selectorSpins=0, pairedConn=false] Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Collision resolution is disabled (all jobs will be activated upon arrival). Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Security status [authentication=off, tls/ssl=off] Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: No user-defined default MemoryPolicy found; system default of 1GB size will be used. Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212] Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: HADOOP_HOME is set to /home/p_hadoop/hadoop-2.7.3 Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Resolved Hadoop classpath locations: /home/p_hadoop/hadoop-2.7.3, /home/p_hadoop/hadoop-2.7.3, /home/p_hadoop/hadoop-2.7.3 Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger warning WARNING: Hadoop libraries are found in Ignite classpath, this could lead to class loading errors (please remove all Hadoop libraries from Ignite classpath) [path=file:/home/p_hadoop/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar] Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Non-loopback local IPs: 10.10.10.138 Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Enabled local MACs: 0025B5000030 Jun 09, 2017 12:26:09 AM org.apache.ignite.logger.java.JavaLogger info INFO: Successfully bound to TCP port [port=47501, localHost=0.0.0.0/0.0.0.0, locNodeId=19853d56-72ea-4d8c-821c-7b4737cf7221] 17/06/09 00:26:09 INFO mapreduce.Job: Job job_local2117899413_0001 running in uber mode : false 17/06/09 00:26:09 INFO mapreduce.Job: map 0% reduce 0% Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=ignite-hadoop-mr-sys-cache, memoryPolicyName=sysMemPlc, mode=REPLICATED] Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=ignite-sys-cache, memoryPolicyName=sysMemPlc, mode=REPLICATED] Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=ignite-atomics-sys-cache, memoryPolicyName=sysMemPlc, mode=PARTITIONED] Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, node=19853d56-72ea-4d8c-821c-7b4737cf7221] Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Performance suggestions for grid (fix if possible) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=<size>[g|G|m|M|k|K]' to JVM options) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Speed up flushing of dirty pages by OS (alter vm.dirty_expire_centisecs parameter by setting to 500) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Reduce pages swapping ratio (set vm.swappiness=10) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Disable NUMA memory reclaim (set vm.zone_reclaim_mode=0) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: ^-- Avoid direct reclaim and page allocation failures (set vm.extra_free_kbytes=1240000) Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: >>> +----------------------------------------------------------------------+ >>> Ignite ver. 2.0.0#20170430-sha1:d4eef3c68ff116ee34bc13648cd82c640b3ea072 >>> +----------------------------------------------------------------------+ >>> OS name: Linux 2.6.32-431.el6.x86_64 amd64 >>> CPU(s): 24 >>> Heap: 18.0GB >>> VM name: [email protected] >>> Local node [ID=19853D56-72EA-4D8C-821C-7B4737CF7221, order=1, >>> clientMode=false] >>> Local node addresses: [HMCISPRDATAWARE.CHM.INTRA/10.10.10.138, >>> /127.0.0.1] >>> Local ports: TCP:11212 TCP:47101 TCP:47501 Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Topology snapshot [ver=1, servers=1, clients=0, CPUs=24, heap=18.0GB] Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Started cache [name=matchCache, memoryPolicyName=null, mode=PARTITIONED] cache name is matchCache Ignite started Jun 09, 2017 12:26:19 AM org.apache.ignite.logger.java.JavaLogger info INFO: Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, node=19853d56-72ea-4d8c-821c-7b4737cf7221] in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null in map null Cleanup called Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: Command protocol successfully stopped: TCP binary Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: Stopped cache: ignite-sys-cache Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: Stopped cache: ignite-hadoop-mr-sys-cache Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: Stopped cache: ignite-atomics-sys-cache Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: Stopped cache: matchCache Jun 09, 2017 12:26:20 AM org.apache.ignite.logger.java.JavaLogger info INFO: >>> +---------------------------------------------------------------------------------+ >>> Ignite ver. 2.0.0#20170430-sha1:d4eef3c68ff116ee34bc13648cd82c640b3ea072 >>> stopped OK >>> +---------------------------------------------------------------------------------+ >>> Grid uptime: 00:00:00:131 17/06/09 00:26:20 INFO mapred.LocalJobRunner: 17/06/09 00:26:20 INFO mapred.MapTask: Starting flush of map output 17/06/09 00:26:20 INFO mapred.MapTask: Spilling map output 17/06/09 00:26:20 INFO mapred.MapTask: bufstart = 0; bufend = 5605; bufvoid = 104857600 17/06/09 00:26:20 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26213716(104854864); length = 681/6553600 17/06/09 00:26:20 INFO mapred.MapTask: Finished spill 0 17/06/09 00:26:20 INFO mapred.Task: Task:attempt_local2117899413_0001_m_000000_0 is done. And is in the process of committing 17/06/09 00:26:20 INFO mapred.LocalJobRunner: map 17/06/09 00:26:20 INFO mapred.Task: Task 'attempt_local2117899413_0001_m_000000_0' done. 17/06/09 00:26:20 INFO mapred.LocalJobRunner: Finishing task: attempt_local2117899413_0001_m_000000_0 17/06/09 00:26:20 INFO mapred.LocalJobRunner: map task executor complete. 17/06/09 00:26:20 INFO mapred.LocalJobRunner: Waiting for reduce tasks 17/06/09 00:26:20 INFO mapred.LocalJobRunner: Starting task: attempt_local2117899413_0001_r_000000_0 17/06/09 00:26:20 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1 17/06/09 00:26:20 INFO mapred.Task: Using ResourceCalculatorProcessTree : [ ] 17/06/09 00:26:20 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6c48fcaa 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=13362160640, maxSingleShuffleLimit=3340540160, mergeThreshold=8819025920, ioSortFactor=10, memToMemMergeOutputsThreshold=10 17/06/09 00:26:20 INFO reduce.EventFetcher: attempt_local2117899413_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events 17/06/09 00:26:20 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local2117899413_0001_m_000000_0 decomp: 5949 len: 5953 to MEMORY 17/06/09 00:26:20 INFO reduce.InMemoryMapOutput: Read 5949 bytes from map-output for attempt_local2117899413_0001_m_000000_0 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5949, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->5949 17/06/09 00:26:20 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning 17/06/09 00:26:20 INFO mapred.LocalJobRunner: 1 / 1 copied. 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs 17/06/09 00:26:20 INFO mapred.Merger: Merging 1 sorted segments 17/06/09 00:26:20 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 5942 bytes 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: Merged 1 segments, 5949 bytes to disk to satisfy reduce memory limit 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: Merging 1 files, 5953 bytes from disk 17/06/09 00:26:20 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce 17/06/09 00:26:20 INFO mapred.Merger: Merging 1 sorted segments 17/06/09 00:26:20 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 5942 bytes 17/06/09 00:26:20 INFO mapred.LocalJobRunner: 1 / 1 copied. 17/06/09 00:26:20 INFO Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords 17/06/09 00:26:20 INFO mapred.Task: Task:attempt_local2117899413_0001_r_000000_0 is done. And is in the process of committing 17/06/09 00:26:20 INFO mapred.LocalJobRunner: 1 / 1 copied. 17/06/09 00:26:20 INFO mapred.Task: Task attempt_local2117899413_0001_r_000000_0 is allowed to commit now 17/06/09 00:26:20 INFO output.FileOutputCommitter: Saved output of task 'attempt_local2117899413_0001_r_000000_0' to hdfs://localhost:9001/pravin/output/_temporary/0/task_local2117899413_0001_r_000000 17/06/09 00:26:20 INFO mapred.LocalJobRunner: reduce > reduce 17/06/09 00:26:20 INFO mapred.Task: Task 'attempt_local2117899413_0001_r_000000_0' done. 17/06/09 00:26:20 INFO mapred.LocalJobRunner: Finishing task: attempt_local2117899413_0001_r_000000_0 17/06/09 00:26:20 INFO mapred.LocalJobRunner: reduce task executor complete. 17/06/09 00:26:20 INFO mapreduce.Job: map 100% reduce 100% 17/06/09 00:26:20 INFO mapreduce.Job: Job job_local2117899413_0001 completed successfully 17/06/09 00:26:20 INFO mapreduce.Job: Counters: 35 File System Counters FILE: Number of bytes read=150814666 FILE: Number of bytes written=152574059 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=9842 HDFS: Number of bytes written=286 HDFS: Number of read operations=13 HDFS: Number of large read operations=0 HDFS: Number of write operations=4 Map-Reduce Framework Map input records=19 Map output records=171 Map output bytes=5605 Map output materialized bytes=5953 Input split bytes=117 Combine input records=0 Combine output records=0 Reduce input groups=9 Reduce shuffle bytes=5953 Reduce input records=171 Reduce output records=9 Spilled Records=342 Shuffled Maps =1 Failed Shuffles=0 Merged Map outputs=1 GC time elapsed (ms)=108 Total committed heap usage (bytes)=5053087744 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=4921 File Output Format Counters Bytes Written=286 ------------------------------------------------------------------------------------------ Thanks, Prashant -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Cache-returning-Null-value-from-Mapper-tp13158p13518.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
