Thanks vkulichenko.
1)I have tried this code as your new method on our production env and submit
to yarn cluster, final result is not correct, it seems that case data was
lost.
val sharedRDD = ic.fromCache(new CacheConfiguration[String,
String]().setCacheMode(CacheMode.REPLICATED));
2) this is all the executor logs
spark-submit print logs
$/u01/spark-1.6.0-hive/bin/spark-submit --driver-memory 4G --class
com..ValidSparkCache --master yarn --executor-cores 5 --executor-memory
15000m --num-executors 5 --conf spark.rdd.compress=false --conf
spark.shuffle.compress=false --conf spark.broadcast.compress=false
/u01/xx/spark_zmqpull_engine841.jar
initalRDD.couner=/. 100000 partition=> 10
*=====>totalcounter20000 paris => 1024 is should be 100000
**=====>10000 *
totally num-executors 5
==1)=============
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/filecache/871/spark-assembly-1.6.0-hadoop2.5.0-cdh5.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/u01/hbase/hadoop-2.5.0-cdh5.3.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/08/17 09:28:11 INFO executor.CoarseGrainedExecutorBackend: Registered
signal handlers for [TERM, HUP, INT]
16/08/17 09:28:12 INFO spark.SecurityManager: Changing view acls to: hbase
16/08/17 09:28:12 INFO spark.SecurityManager: Changing modify acls to: hbase
16/08/17 09:28:12 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(hbase); users with modify permissions: Set(hbase)
16/08/17 09:28:13 INFO spark.SecurityManager: Changing view acls to: hbase
16/08/17 09:28:13 INFO spark.SecurityManager: Changing modify acls to: hbase
16/08/17 09:28:13 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(hbase); users with modify permissions: Set(hbase)
16/08/17 09:28:13 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/08/17 09:28:13 INFO Remoting: Starting remoting
16/08/17 09:28:13 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkExecutorActorSystem@xxxx:18374]
16/08/17 09:28:13 INFO util.Utils: Successfully started service
'sparkExecutorActorSystem' on port 18374.
16/08/17 09:28:13 INFO storage.DiskBlockManager: Created local directory at
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/blockmgr-5c0d998e-15b8-43c5-b73d-96e1e76af179
16/08/17 09:28:14 INFO storage.MemoryStore: MemoryStore started with
capacity 10.3 GB
16/08/17 09:28:14 INFO executor.CoarseGrainedExecutorBackend: Connecting to
driver: spark://CoarseGrainedScheduler@10.194.70.26:64381
16/08/17 09:28:14 INFO executor.CoarseGrainedExecutorBackend: Successfully
registered with driver
16/08/17 09:28:14 INFO executor.Executor: Starting executor ID 1 on host xxx
16/08/17 09:28:14 INFO util.Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 28593.
16/08/17 09:28:14 INFO netty.NettyBlockTransferService: Server created on
28593
16/08/17 09:28:14 INFO storage.BlockManagerMaster: Trying to register
BlockManager
16/08/17 09:28:14 INFO storage.BlockManagerMaster: Registered BlockManager
16/08/17 09:28:17 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 1
16/08/17 09:28:17 INFO executor.Executor: Running task 1.0 in stage 0.0 (TID
1)
16/08/17 09:28:17 INFO executor.Executor: Fetching
http://10.194.70.26:64443/jars/spark_zmqpull_engine841.jar with timestamp
1471397276248
16/08/17 09:28:17 INFO util.Utils: Fetching
http://xxxxx:64443/jars/spark_zmqpull_engine841.jar to
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/spark-a963fd26-783c-4f09-947c-48163270764d/fetchFileTemp8027243307717085221.tmp
16/08/17 09:28:23 INFO util.Utils: Copying
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/spark-a963fd26-783c-4f09-947c-48163270764d/15389795251471397276248_cache
to
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000002/./spark_zmqpull_engine841.jar
16/08/17 09:28:24 INFO executor.Executor: Adding
file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000002/./spark_zmqpull_engine841.jar
to class loader
16/08/17 09:28:24 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 0
16/08/17 09:28:24 INFO storage.MemoryStore: Block broadcast_0_piece0 stored
as bytes in memory (estimated size 1571.0 B, free 1571.0 B)
16/08/17 09:28:24 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 0 took 128 ms
16/08/17 09:28:24 INFO storage.MemoryStore: Block broadcast_0 stored as
values in memory (estimated size 1608.0 B, free 3.1 KB)
16/08/17 09:28:27 INFO internal.IgniteKernal:
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
16/08/17 09:28:27 INFO internal.IgniteKernal: Config URL: n/a
16/08/17 09:28:27 INFO internal.IgniteKernal: Daemon mode: off
16/08/17 09:28:27 INFO internal.IgniteKernal: OS: Linux
2.6.32-220.23.2.ali878.el6.x86_64 amd64
16/08/17 09:28:27 INFO internal.IgniteKernal: OS user: hbase
16/08/17 09:28:27 INFO internal.IgniteKernal: Language runtime: Java
Platform API Specification ver. 1.7
16/08/17 09:28:27 INFO internal.IgniteKernal: VM information: Java(TM) SE
Runtime Environment 1.7.0_79-b15 Oracle Corporation OpenJDK (Alibaba) 64-Bit
Server VM 24.79-b02-internal
16/08/17 09:28:27 INFO internal.IgniteKernal: VM total memory: 14.0GB
16/08/17 09:28:27 INFO internal.IgniteKernal: Remote Management [restart:
off, REST: on, JMX (remote: off)]
16/08/17 09:28:27 INFO internal.IgniteKernal: IGNITE_HOME=null
16/08/17 09:28:27 INFO internal.IgniteKernal: VM arguments:
[-XX:OnOutOfMemoryError=kill %p, -Xms15000m, -Xmx15000m,
-XX:MaxPermSize=256M,
-Djava.io.tmpdir=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000002/tmp,
-Dspark.driver.port=64381,
-Dspark.yarn.app.container.log.dir=/u01/hbase/hadoop-2.5.0-cdh5.3.0/logs/userlogs/application_1455892346017_5248/container_1455892346017_5248_01_000002,
-XX:MaxPermSize=256m]
16/08/17 09:28:27 INFO internal.IgniteKernal: Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache',
'ignite-atomics-sys-cache']
16/08/17 09:28:27 INFO internal.IgniteKernal: Non-loopback local IPs: xxxxx
16/08/17 09:28:27 INFO internal.IgniteKernal: Enabled local MACs:
283152A81308
16/08/17 09:28:27 INFO plugin.IgnitePluginProcessor: Configured plugins:
16/08/17 09:28:27 INFO plugin.IgnitePluginProcessor: ^-- None
16/08/17 09:28:27 INFO plugin.IgnitePluginProcessor:
16/08/17 09:28:27 INFO tcp.TcpCommunicationSpi: IPC shared memory server
endpoint started [port=48100,
tokDir=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000002/tmp/ignite/work/ipc/shmem/6fc9a7ab-ebfc-4d84-8a66-8aa83f4ef9ec-77197]
16/08/17 09:28:27 INFO tcp.TcpCommunicationSpi: Successfully bound shared
memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:27 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP
port [port=47100, locHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:27 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to
enable configure any GridCheckpointSpi implementation)
16/08/17 09:28:28 WARN collision.GridCollisionManager: Collision resolution
is disabled (all jobs will be activated upon arrival).
16/08/17 09:28:28 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To
enable use FileSwapSpaceSpi.
16/08/17 09:28:28 INFO internal.IgniteKernal: Security status
[authentication=off, tls/ssl=off]
16/08/17 09:28:28 INFO tcp.GridTcpRestProtocol: Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211]
16/08/17 09:28:28 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port
[port=47500, localHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:28 WARN multicast.TcpDiscoveryMulticastIpFinder:
TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is
recommended in production to specify at least one address in
TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
16/08/17 09:28:29 INFO cache.GridCacheProcessor: Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
16/08/17 09:28:29 INFO cache.GridCacheProcessor: Started cache
[name=ignite-atomics-sys-cache, mode=PARTITIONED]
16/08/17 09:28:29 INFO cache.GridCacheProcessor: Started cache
[name=ignite-sys-cache, mode=REPLICATED]
16/08/17 09:28:30 INFO cache.GridCachePartitionExchangeManager: Cache
rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]]
16/08/17 09:28:30 INFO cache.GridCachePartitionExchangeManager: Cache
rebalancing scheduled: [cache=ignite-marshaller-sys-cache, waitList=[]]
16/08/17 09:28:30 INFO cache.GridCachePartitionExchangeManager: Cache
rebalancing scheduled: [cache=ignite-atomics-sys-cache,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]]
16/08/17 09:28:30 INFO cache.GridCachePartitionExchangeManager: Rebalancing
required [top=AffinityTopologyVersion [topVer=2, minorTopVer=0],
evt=NODE_JOINED, node=6fc9a7ab-ebfc-4d84-8a66-8aa83f4ef9ec]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-marshaller-sys-cache> Starting rebalancing
[cache=ignite-marshaller-sys-cache, mode=SYNC,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03, partitionsCount=20,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], updateSeq=1]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-sys-cache> Starting rebalancing [cache=ignite-sys-cache, mode=SYNC,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03, partitionsCount=100,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], updateSeq=1]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-marshaller-sys-cache> Completed (final) rebalancing
[cache=ignite-marshaller-sys-cache,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], time=20 ms]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-sys-cache> Completed (final) rebalancing [cache=ignite-sys-cache,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], time=20 ms]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-atomics-sys-cache> Starting rebalancing
[cache=ignite-atomics-sys-cache, mode=SYNC,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03, partitionsCount=500,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], updateSeq=1]
16/08/17 09:28:30 INFO preloader.GridDhtPartitionDemander:
<ignite-atomics-sys-cache> Completed (final) rebalancing
[cache=ignite-atomics-sys-cache,
fromNode=c2671205-0499-428b-b2a3-c180a70a6c03,
topology=AffinityTopologyVersion [topVer=2, minorTopVer=0], time=61 ms]
16/08/17 09:28:30 INFO internal.IgniteKernal: To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
16/08/17 09:28:30 INFO internal.IgniteKernal:
16/08/17 09:28:30 INFO internal.IgniteKernal:
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-220.23.2.ali878.el6.x86_64 amd64
>>> CPU(s): 24
>>> Heap: 15.0GB
>>> VM name: 77197@xxxx
>>> Local node [ID=6FC9A7AB-EBFC-4D84-8A66-8AA83F4EF9EC, order=2,
>>> clientMode=false]
>>> Local node addresses: [xxxx, /127.0.0.1]
>>> Local ports: TCP:11211 TCP:47100 UDP:47400 TCP:47500 TCP:48100
16/08/17 09:28:30 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=2, servers=2, clients=0, CPUs=48, heap=29.0GB]
16/08/17 09:28:30 INFO executor.Executor: Finished task 1.0 in stage 0.0
(TID 1). 903 bytes result sent to driver
16/08/17 09:28:31 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2,
minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT,
node=c2671205-0499-428b-b2a3-c180a70a6c03]
16/08/17 09:28:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 9
16/08/17 09:28:33 INFO executor.Executor: Running task 4.0 in stage 1.0 (TID
9)
16/08/17 09:28:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 14
16/08/17 09:28:33 INFO executor.Executor: Running task 9.0 in stage 1.0 (TID
14)
16/08/17 09:28:33 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 1
16/08/17 09:28:33 INFO storage.MemoryStore: Block broadcast_1_piece0 stored
as bytes in memory (estimated size 1845.0 B, free 1845.0 B)
16/08/17 09:28:33 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 1 took 13 ms
16/08/17 09:28:33 INFO storage.MemoryStore: Block broadcast_1 stored as
values in memory (estimated size 1888.0 B, free 3.6 KB)
16/08/17 09:28:33 INFO executor.Executor: Finished task 9.0 in stage 1.0
(TID 14). 905 bytes result sent to driver
16/08/17 09:28:33 INFO executor.Executor: Finished task 4.0 in stage 1.0
(TID 9). 905 bytes result sent to driver
16/08/17 09:28:34 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 18
16/08/17 09:28:34 INFO executor.Executor: Running task 3.0 in stage 2.0 (TID
18)
16/08/17 09:28:34 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 23
16/08/17 09:28:34 INFO executor.Executor: Running task 8.0 in stage 2.0 (TID
23)
16/08/17 09:28:34 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 2
16/08/17 09:28:34 INFO storage.MemoryStore: Block broadcast_2_piece0 stored
as bytes in memory (estimated size 2.9 KB, free 6.6 KB)
16/08/17 09:28:34 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 2 took 13 ms
16/08/17 09:28:34 INFO storage.MemoryStore: Block broadcast_2 stored as
values in memory (estimated size 3.0 KB, free 9.5 KB)
16/08/17 09:28:34 INFO cache.GridCacheProcessor: Started cache
[name=sharedBaselineCacheRDD, mode=PARTITIONED]
16/08/17 09:28:34 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2,
minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT,
node=c2671205-0499-428b-b2a3-c180a70a6c03]
16/08/17 09:28:35 INFO executor.Executor: Finished task 8.0 in stage 2.0
(TID 23). 903 bytes result sent to driver
16/08/17 09:28:35 INFO executor.Executor: Finished task 3.0 in stage 2.0
(TID 18). 903 bytes result sent to driver
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2077
16/08/17 09:28:40 INFO executor.Executor: Running task 4.0 in stage 5.0 (TID
2077)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2082
16/08/17 09:28:40 INFO executor.Executor: Running task 9.0 in stage 5.0 (TID
2082)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2087
16/08/17 09:28:40 INFO executor.Executor: Running task 14.0 in stage 5.0
(TID 2087)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2092
16/08/17 09:28:40 INFO executor.Executor: Running task 19.0 in stage 5.0
(TID 2092)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2097
16/08/17 09:28:40 INFO executor.Executor: Running task 24.0 in stage 5.0
(TID 2097)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 5
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_5_piece0 stored
as bytes in memory (estimated size 2.7 KB, free 12.2 KB)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 5 took 10 ms
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_5 stored as
values in memory (estimated size 2.7 KB, free 15.0 KB)
16/08/17 09:28:40 INFO executor.Executor: Finished task 9.0 in stage 5.0
(TID 2082). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 4.0 in stage 5.0
(TID 2077). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 19.0 in stage 5.0
(TID 2092). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 24.0 in stage 5.0
(TID 2097). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 14.0 in stage 5.0
(TID 2087). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2113
16/08/17 09:28:40 INFO executor.Executor: Running task 40.0 in stage 5.0
(TID 2113)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2114
16/08/17 09:28:40 INFO executor.Executor: Running task 41.0 in stage 5.0
(TID 2114)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2115
16/08/17 09:28:40 INFO executor.Executor: Running task 42.0 in stage 5.0
(TID 2115)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2116
16/08/17 09:28:40 INFO executor.Executor: Running task 43.0 in stage 5.0
(TID 2116)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2117
16/08/17 09:28:40 INFO executor.Executor: Running task 44.0 in stage 5.0
(TID 2117)
16/08/17 09:28:40 INFO executor.Executor: Finished task 42.0 in stage 5.0
(TID 2115). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 44.0 in stage 5.0
(TID 2117). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 43.0 in stage 5.0
(TID 2116). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 40.0 in stage 5.0
(TID 2113). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 41.0 in stage 5.0
(TID 2114). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2124
16/08/17 09:28:40 INFO executor.Executor: Running task 1.0 in stage 6.0 (TID
2124)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2129
16/08/17 09:28:40 INFO executor.Executor: Running task 5.0 in stage 6.0 (TID
2129)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2134
16/08/17 09:28:40 INFO executor.Executor: Running task 10.0 in stage 6.0
(TID 2134)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2139
16/08/17 09:28:40 INFO executor.Executor: Running task 15.0 in stage 6.0
(TID 2139)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and
clearing cache
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 6
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_6_piece0 stored
as bytes in memory (estimated size 2.5 KB, free 17.5 KB)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 6 took 10 ms
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_6 stored as
values in memory (estimated size 2.6 KB, free 20.0 KB)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
NettyRpcEndpointRef(spark://MapOutputTracker@10.194.70.26:64381)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Got the output
locations
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote
fetches in 2 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 11 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 14 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 13 ms
16/08/17 09:28:40 INFO executor.Executor: Finished task 5.0 in stage 6.0
(TID 2129). 1172 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 10.0 in stage 6.0
(TID 2134). 1172 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 15.0 in stage 6.0
(TID 2139). 1166 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 1.0 in stage 6.0
(TID 2124). 1172 bytes result sent to driver
16/08/17 09:28:42 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2150
16/08/17 09:28:42 INFO executor.Executor: Running task 0.0 in stage 14.0
(TID 2150)
16/08/17 09:28:42 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 14
16/08/17 09:28:42 INFO storage.MemoryStore: Block broadcast_14_piece0 stored
as bytes in memory (estimated size 62.4 KB, free 82.4 KB)
16/08/17 09:28:42 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 14 took 12 ms
16/08/17 09:28:42 INFO storage.MemoryStore: Block broadcast_14 stored as
values in memory (estimated size 62.4 KB, free 144.8 KB)
16/08/17 09:28:42 INFO util.RecurringTimer: Started timer for BlockGenerator
at time 1471397324000
16/08/17 09:28:42 INFO receiver.BlockGenerator: Started BlockGenerator
16/08/17 09:28:42 INFO receiver.BlockGenerator: Started block pushing thread
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Starting receiver
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Called receiver
onStart
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Waiting for receiver
to be stopped
16/08/17 09:28:43 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2152
16/08/17 09:28:43 INFO executor.Executor: Running task 0.0 in stage 16.0
(TID 2152)
16/08/17 09:28:43 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 16
16/08/17 09:28:43 INFO storage.MemoryStore: Block broadcast_16_piece0 stored
as bytes in memory (estimated size 62.4 KB, free 207.2 KB)
16/08/17 09:28:43 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 16 took 10 ms
16/08/17 09:28:43 INFO storage.MemoryStore: Block broadcast_16 stored as
values in memory (estimated size 62.4 KB, free 269.6 KB)
16/08/17 09:28:43 INFO util.RecurringTimer: Started timer for BlockGenerator
at time 1471397324000
16/08/17 09:28:43 INFO receiver.BlockGenerator: Started BlockGenerator
16/08/17 09:28:43 INFO receiver.BlockGenerator: Started block pushing thread
16/08/17 09:28:43 INFO receiver.ReceiverSupervisorImpl: Starting receiver
16/08/17 09:28:43 INFO receiver.ReceiverSupervisorImpl: Called receiver
onStart
16/08/17 09:28:43 INFO receiver.ReceiverSupervisorImpl: Waiting for receiver
to be stopped
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 30
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 29
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 28
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 18
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 19
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 20
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 21
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 22
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 23
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 24
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 25
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 26
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 27
16/08/17 09:29:30 INFO internal.IgniteKernal:
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=6fc9a7ab, name=null, uptime=00:01:00:008]
^-- H/N/C [hosts=2, nodes=2, CPUs=48]
^-- CPU [cur=0.13%, avg=1.2%, GC=0%]
^-- Heap [used=2651MB, free=81.56%, comm=14375MB]
^-- Non heap [used=59MB, free=80.42%, comm=59MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
16/08/17 09:29:39 INFO cluster.GridUpdateNotifier: Update status is not
available.
16/08/17 09:29:40 INFO storage.BlockManager: Removing RDD 43
16/08/17 09:29:40 INFO storage.BlockManager: Removing RDD 42
==2)=============
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/filecache/818/spark-assembly-1.6.0-hadoop2.5.0-cdh5.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/u01/hbase/hadoop-2.5.0-cdh5.3.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/08/17 09:28:13 INFO executor.CoarseGrainedExecutorBackend: Registered
signal handlers for [TERM, HUP, INT]
16/08/17 09:28:14 INFO spark.SecurityManager: Changing view acls to: hbase
16/08/17 09:28:14 INFO spark.SecurityManager: Changing modify acls to: hbase
16/08/17 09:28:14 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(hbase); users with modify permissions: Set(hbase)
16/08/17 09:28:15 INFO spark.SecurityManager: Changing view acls to: hbase
16/08/17 09:28:15 INFO spark.SecurityManager: Changing modify acls to: hbase
16/08/17 09:28:15 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(hbase); users with modify permissions: Set(hbase)
16/08/17 09:28:15 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/08/17 09:28:16 INFO Remoting: Starting remoting
16/08/17 09:28:16 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkExecutorActorSystem@xxx:30500]
16/08/17 09:28:16 INFO util.Utils: Successfully started service
'sparkExecutorActorSystem' on port 30500.
16/08/17 09:28:16 INFO storage.DiskBlockManager: Created local directory at
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/blockmgr-46f4b00b-c1ce-4c08-b96c-508af544e8f3
16/08/17 09:28:16 INFO storage.MemoryStore: MemoryStore started with
capacity 10.3 GB
16/08/17 09:28:16 INFO executor.CoarseGrainedExecutorBackend: Connecting to
driver: spark://CoarseGrainedScheduler@10.194.70.26:64381
16/08/17 09:28:16 INFO executor.CoarseGrainedExecutorBackend: Successfully
registered with driver
16/08/17 09:28:16 INFO executor.Executor: Starting executor ID 2 on host xx
16/08/17 09:28:16 INFO util.Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 34050.
16/08/17 09:28:16 INFO netty.NettyBlockTransferService: Server created on
34050
16/08/17 09:28:16 INFO storage.BlockManagerMaster: Trying to register
BlockManager
16/08/17 09:28:16 INFO storage.BlockManagerMaster: Registered BlockManager
16/08/17 09:28:17 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 3
16/08/17 09:28:17 INFO executor.Executor: Running task 3.0 in stage 0.0 (TID
3)
16/08/17 09:28:17 INFO executor.Executor: Fetching
http://10.194.70.26:64443/jars/spark_zmqpull_engine841.jar with timestamp
1471397276248
16/08/17 09:28:17 INFO util.Utils: Fetching
http://10.194.70.26:64443/jars/spark_zmqpull_engine841.jar to
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/spark-15ae60da-1f76-49fb-998e-ebac19da08a5/fetchFileTemp6372437656391040566.tmp
16/08/17 09:28:21 INFO util.Utils: Copying
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/spark-15ae60da-1f76-49fb-998e-ebac19da08a5/15389795251471397276248_cache
to
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000003/./spark_zmqpull_engine841.jar
16/08/17 09:28:22 INFO executor.Executor: Adding
file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000003/./spark_zmqpull_engine841.jar
to class loader
16/08/17 09:28:22 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 0
16/08/17 09:28:23 INFO storage.MemoryStore: Block broadcast_0_piece0 stored
as bytes in memory (estimated size 1571.0 B, free 1571.0 B)
16/08/17 09:28:23 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 0 took 277 ms
16/08/17 09:28:23 INFO storage.MemoryStore: Block broadcast_0 stored as
values in memory (estimated size 1608.0 B, free 3.1 KB)
16/08/17 09:28:23 INFO internal.IgniteKernal:
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
16/08/17 09:28:23 INFO internal.IgniteKernal: Config URL: n/a
16/08/17 09:28:23 INFO internal.IgniteKernal: Daemon mode: off
16/08/17 09:28:23 INFO internal.IgniteKernal: OS: Linux
2.6.32-220.23.2.ali878.el6.x86_64 amd64
16/08/17 09:28:23 INFO internal.IgniteKernal: OS user: hbase
16/08/17 09:28:23 INFO internal.IgniteKernal: Language runtime: Java
Platform API Specification ver. 1.7
16/08/17 09:28:23 INFO internal.IgniteKernal: VM information: Java(TM) SE
Runtime Environment 1.7.0_79-b15 Oracle Corporation OpenJDK (Alibaba) 64-Bit
Server VM 24.79-b02-internal
16/08/17 09:28:23 INFO internal.IgniteKernal: VM total memory: 14.0GB
16/08/17 09:28:23 INFO internal.IgniteKernal: Remote Management [restart:
off, REST: on, JMX (remote: off)]
16/08/17 09:28:23 INFO internal.IgniteKernal: IGNITE_HOME=null
16/08/17 09:28:23 INFO internal.IgniteKernal: VM arguments:
[-XX:OnOutOfMemoryError=kill %p, -Xms15000m, -Xmx15000m,
-XX:MaxPermSize=256M,
-Djava.io.tmpdir=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000003/tmp,
-Dspark.driver.port=64381,
-Dspark.yarn.app.container.log.dir=/u01/hbase/hadoop-2.5.0-cdh5.3.0/logs/userlogs/application_1455892346017_5248/container_1455892346017_5248_01_000003,
-XX:MaxPermSize=256m]
16/08/17 09:28:23 INFO internal.IgniteKernal: Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache',
'ignite-atomics-sys-cache']
16/08/17 09:28:23 INFO internal.IgniteKernal: Non-loopback local IPs:
10.194.62.14
16/08/17 09:28:23 INFO internal.IgniteKernal: Enabled local MACs:
283152A835B8
16/08/17 09:28:23 INFO plugin.IgnitePluginProcessor: Configured plugins:
16/08/17 09:28:23 INFO plugin.IgnitePluginProcessor: ^-- None
16/08/17 09:28:23 INFO plugin.IgnitePluginProcessor:
16/08/17 09:28:23 INFO tcp.TcpCommunicationSpi: IPC shared memory server
endpoint started [port=48100,
tokDir=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5248/container_1455892346017_5248_01_000003/tmp/ignite/work/ipc/shmem/bc7e0b69-22f1-499b-8363-4291fff4a50e-22030]
16/08/17 09:28:23 INFO tcp.TcpCommunicationSpi: Successfully bound shared
memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:23 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP
port [port=47100, locHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:23 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to
enable configure any GridCheckpointSpi implementation)
16/08/17 09:28:23 WARN collision.GridCollisionManager: Collision resolution
is disabled (all jobs will be activated upon arrival).
16/08/17 09:28:23 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To
enable use FileSwapSpaceSpi.
16/08/17 09:28:23 INFO internal.IgniteKernal: Security status
[authentication=off, tls/ssl=off]
16/08/17 09:28:24 INFO tcp.GridTcpRestProtocol: Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211]
16/08/17 09:28:24 INFO tcp.TcpDiscoverySpi: Successfully bound to TCP port
[port=47500, localHost=0.0.0.0/0.0.0.0]
16/08/17 09:28:24 WARN multicast.TcpDiscoveryMulticastIpFinder:
TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is
recommended in production to specify at least one address in
TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
16/08/17 09:28:26 INFO cache.GridCacheProcessor: Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
16/08/17 09:28:26 INFO cache.GridCacheProcessor: Started cache
[name=ignite-atomics-sys-cache, mode=PARTITIONED]
16/08/17 09:28:26 INFO cache.GridCacheProcessor: Started cache
[name=ignite-sys-cache, mode=REPLICATED]
16/08/17 09:28:26 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1,
minorTopVer=0], evt=NODE_JOINED, node=bc7e0b69-22f1-499b-8363-4291fff4a50e]
16/08/17 09:28:26 INFO internal.IgniteKernal: To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
16/08/17 09:28:26 INFO internal.IgniteKernal:
16/08/17 09:28:26 INFO internal.IgniteKernal:
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-220.23.2.ali878.el6.x86_64 amd64
>>> CPU(s): 24
>>> Heap: 15.0GB
>>> VM name: 22030@xxx
>>> Local node [ID=BC7E0B69-22F1-499B-8363-4291FFF4A50E, order=1,
>>> clientMode=false]
>>> Local node addresses: [xxx, /127.0.0.1]
>>> Local ports: TCP:11211 TCP:47100 UDP:47400 TCP:47500 TCP:48100
16/08/17 09:28:26 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=1, servers=1, clients=0, CPUs=24, heap=15.0GB]
16/08/17 09:28:26 INFO executor.Executor: Finished task 3.0 in stage 0.0
(TID 3). 903 bytes result sent to driver
16/08/17 09:28:28 INFO discovery.GridDiscoveryManager: Added new node to
topology: TcpDiscoveryNode [id=150c335f-9127-4771-a035-25ac29a286a9,
addrs=[10.194.62.42, 127.0.0.1], sockAddrs=[xxx:47500, /xxx:47500,
/127.0.0.1:47500], discPort=47500, order=2, intOrder=2,
lastExchangeTime=1471397308216, loc=false, ver=1.6.0#20160518-sha1:0b22c45b,
isClient=false]
16/08/17 09:28:28 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=2, servers=2, clients=0, CPUs=48, heap=29.0GB]
16/08/17 09:28:29 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2,
minorTopVer=0], evt=NODE_JOINED, node=150c335f-9127-4771-a035-25ac29a286a9]
16/08/17 09:28:30 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2,
minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT,
node=bc7e0b69-22f1-499b-8363-4291fff4a50e]
16/08/17 09:28:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 5
16/08/17 09:28:33 INFO executor.Executor: Running task 0.0 in stage 1.0 (TID
5)
16/08/17 09:28:33 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 10
16/08/17 09:28:33 INFO executor.Executor: Running task 5.0 in stage 1.0 (TID
10)
16/08/17 09:28:33 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 1
16/08/17 09:28:33 INFO storage.MemoryStore: Block broadcast_1_piece0 stored
as bytes in memory (estimated size 1845.0 B, free 1845.0 B)
16/08/17 09:28:33 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 1 took 11 ms
16/08/17 09:28:33 INFO storage.MemoryStore: Block broadcast_1 stored as
values in memory (estimated size 1888.0 B, free 3.6 KB)
16/08/17 09:28:33 INFO executor.Executor: Finished task 0.0 in stage 1.0
(TID 5). 905 bytes result sent to driver
16/08/17 09:28:33 INFO executor.Executor: Finished task 5.0 in stage 1.0
(TID 10). 905 bytes result sent to driver
16/08/17 09:28:34 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 17
16/08/17 09:28:34 INFO executor.Executor: Running task 2.0 in stage 2.0 (TID
17)
16/08/17 09:28:34 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 22
16/08/17 09:28:34 INFO executor.Executor: Running task 7.0 in stage 2.0 (TID
22)
16/08/17 09:28:34 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 2
16/08/17 09:28:34 INFO storage.MemoryStore: Block broadcast_2_piece0 stored
as bytes in memory (estimated size 2.9 KB, free 6.6 KB)
16/08/17 09:28:34 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 2 took 11 ms
16/08/17 09:28:34 INFO storage.MemoryStore: Block broadcast_2 stored as
values in memory (estimated size 3.0 KB, free 9.5 KB)
16/08/17 09:28:34 INFO cache.GridCacheProcessor: Started cache
[name=sharedBaselineCacheRDD, mode=PARTITIONED]
16/08/17 09:28:34 INFO cache.GridCachePartitionExchangeManager: Skipping
rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2,
minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT,
node=bc7e0b69-22f1-499b-8363-4291fff4a50e]
16/08/17 09:28:35 INFO executor.Executor: Finished task 7.0 in stage 2.0
(TID 22). 903 bytes result sent to driver
16/08/17 09:28:35 INFO executor.Executor: Finished task 2.0 in stage 2.0
(TID 17). 903 bytes result sent to driver
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2074
16/08/17 09:28:40 INFO executor.Executor: Running task 1.0 in stage 5.0 (TID
2074)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2079
16/08/17 09:28:40 INFO executor.Executor: Running task 6.0 in stage 5.0 (TID
2079)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2084
16/08/17 09:28:40 INFO executor.Executor: Running task 11.0 in stage 5.0
(TID 2084)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2089
16/08/17 09:28:40 INFO executor.Executor: Running task 16.0 in stage 5.0
(TID 2089)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2094
16/08/17 09:28:40 INFO executor.Executor: Running task 21.0 in stage 5.0
(TID 2094)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 5
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_5_piece0 stored
as bytes in memory (estimated size 2.7 KB, free 12.2 KB)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 5 took 64 ms
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_5 stored as
values in memory (estimated size 2.7 KB, free 15.0 KB)
16/08/17 09:28:40 INFO executor.Executor: Finished task 21.0 in stage 5.0
(TID 2094). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 6.0 in stage 5.0
(TID 2079). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 1.0 in stage 5.0
(TID 2074). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 16.0 in stage 5.0
(TID 2089). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 11.0 in stage 5.0
(TID 2084). 1162 bytes result sent to driver
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2125
16/08/17 09:28:40 INFO executor.Executor: Running task 2.0 in stage 6.0 (TID
2125)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2130
16/08/17 09:28:40 INFO executor.Executor: Running task 7.0 in stage 6.0 (TID
2130)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2135
16/08/17 09:28:40 INFO executor.Executor: Running task 12.0 in stage 6.0
(TID 2135)
16/08/17 09:28:40 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2140
16/08/17 09:28:40 INFO executor.Executor: Running task 17.0 in stage 6.0
(TID 2140)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Updating epoch to 1 and
clearing cache
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 6
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_6_piece0 stored
as bytes in memory (estimated size 2.5 KB, free 17.5 KB)
16/08/17 09:28:40 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 6 took 9 ms
16/08/17 09:28:40 INFO storage.MemoryStore: Block broadcast_6 stored as
values in memory (estimated size 2.6 KB, free 20.0 KB)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Don't have map outputs
for shuffle 0, fetching them
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
NettyRpcEndpointRef(spark://MapOutputTracker@10.194.70.26:64381)
16/08/17 09:28:40 INFO spark.MapOutputTrackerWorker: Got the output
locations
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 11 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 8 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 7 ms
16/08/17 09:28:40 INFO storage.ShuffleBlockFetcherIterator: Started 1 remote
fetches in 12 ms
16/08/17 09:28:40 INFO executor.Executor: Finished task 17.0 in stage 6.0
(TID 2140). 1166 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 7.0 in stage 6.0
(TID 2130). 1172 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 12.0 in stage 6.0
(TID 2135). 1166 bytes result sent to driver
16/08/17 09:28:40 INFO executor.Executor: Finished task 2.0 in stage 6.0
(TID 2125). 1172 bytes result sent to driver
16/08/17 09:28:41 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2143
16/08/17 09:28:41 INFO executor.Executor: Running task 0.0 in stage 7.0 (TID
2143)
16/08/17 09:28:41 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 7
16/08/17 09:28:41 INFO storage.MemoryStore: Block broadcast_7_piece0 stored
as bytes in memory (estimated size 62.4 KB, free 82.4 KB)
16/08/17 09:28:41 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 7 took 10 ms
16/08/17 09:28:41 INFO storage.MemoryStore: Block broadcast_7 stored as
values in memory (estimated size 62.4 KB, free 144.8 KB)
16/08/17 09:28:41 INFO util.RecurringTimer: Started timer for BlockGenerator
at time 1471397324000
16/08/17 09:28:41 INFO receiver.BlockGenerator: Started BlockGenerator
16/08/17 09:28:41 INFO receiver.BlockGenerator: Started block pushing thread
16/08/17 09:28:41 INFO receiver.ReceiverSupervisorImpl: Starting receiver
16/08/17 09:28:41 INFO receiver.ReceiverSupervisorImpl: Called receiver
onStart
16/08/17 09:28:41 INFO receiver.ReceiverSupervisorImpl: Waiting for receiver
to be stopped
16/08/17 09:28:42 INFO executor.CoarseGrainedExecutorBackend: Got assigned
task 2145
16/08/17 09:28:42 INFO executor.Executor: Running task 0.0 in stage 9.0 (TID
2145)
16/08/17 09:28:42 INFO broadcast.TorrentBroadcast: Started reading broadcast
variable 9
16/08/17 09:28:42 INFO storage.MemoryStore: Block broadcast_9_piece0 stored
as bytes in memory (estimated size 62.4 KB, free 207.2 KB)
16/08/17 09:28:42 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 9 took 11 ms
16/08/17 09:28:42 INFO storage.MemoryStore: Block broadcast_9 stored as
values in memory (estimated size 62.4 KB, free 269.6 KB)
16/08/17 09:28:42 INFO util.RecurringTimer: Started timer for BlockGenerator
at time 1471397324000
16/08/17 09:28:42 INFO receiver.BlockGenerator: Started BlockGenerator
16/08/17 09:28:42 INFO receiver.BlockGenerator: Started block pushing thread
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Starting receiver
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Called receiver
onStart
16/08/17 09:28:42 INFO receiver.ReceiverSupervisorImpl: Waiting for receiver
to be stopped
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 29
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 30
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 28
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 18
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 19
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 20
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 21
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 22
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 23
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 24
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 25
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 26
16/08/17 09:29:20 INFO storage.BlockManager: Removing RDD 27
16/08/17 09:29:26 INFO internal.IgniteKernal:
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Embedded-mode-ignite-on-spark-tp6942p7119.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
