additional logs here. 14/10/06 18:06:16 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(11,[Lscala.Tuple2;@630ff939,BlockManagerId(11, cluster12, 48053, 0)) from Actor[akka.tcp://sparkExecutor@cluster12:57686/temp/$e] 14/10/06 18:06:16 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(11, cluster12, 48053, 0)) from Actor[akka://sparkDriver/temp/$c] 14/10/06 18:06:16 DEBUG BlockManagerMasterActor: [actor] handled message (0.141 ms) BlockManagerHeartbeat(BlockManagerId(11, cluster12, 48053, 0)) from Actor[akka://sparkDriver/temp/$c] 14/10/06 18:06:16 DEBUG HeartbeatReceiver: [actor] handled message (2.354929 ms) Heartbeat(11,[Lscala.Tuple2;@630ff939,BlockManagerId(11, cluster12, 48053, 0)) from Actor[akka.tcp://sparkExecutor@cluster12:57686/temp/$e] 14/10/06 18:06:17 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:17 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.562905 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:18 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:18 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.609549 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:18 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(2,[Lscala.Tuple2;@38cf728d,BlockManagerId(2, cluster06, 46216, 0)) from Actor[akka.tcp://sparkExecutor@cluster06:44636/temp/$e] 14/10/06 18:06:18 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(2, cluster06, 46216, 0)) from Actor[akka://sparkDriver/temp/$d] 14/10/06 18:06:18 DEBUG BlockManagerMasterActor: [actor] handled message (0.122902 ms) BlockManagerHeartbeat(BlockManagerId(2, cluster06, 46216, 0)) from Actor[akka://sparkDriver/temp/$d] 14/10/06 18:06:18 DEBUG HeartbeatReceiver: [actor] handled message (0.665318 ms) Heartbeat(2,[Lscala.Tuple2;@38cf728d,BlockManagerId(2, cluster06, 46216, 0)) from Actor[akka.tcp://sparkExecutor@cluster06:44636/temp/$e] 14/10/06 18:06:18 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(6,[Lscala.Tuple2;@e000dd7,BlockManagerId(6, cluster13, 49455, 0)) from Actor[akka.tcp://sparkExecutor@cluster13:39667/temp/$e] 14/10/06 18:06:18 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(6, cluster13, 49455, 0)) from Actor[akka://sparkDriver/temp/$e] 14/10/06 18:06:18 DEBUG BlockManagerMasterActor: [actor] handled message (0.101067 ms) BlockManagerHeartbeat(BlockManagerId(6, cluster13, 49455, 0)) from Actor[akka://sparkDriver/temp/$e] 14/10/06 18:06:18 DEBUG HeartbeatReceiver: [actor] handled message (0.50806 ms) Heartbeat(6,[Lscala.Tuple2;@e000dd7,BlockManagerId(6, cluster13, 49455, 0)) from Actor[akka.tcp://sparkExecutor@cluster13:39667/temp/$e] 14/10/06 18:06:19 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:19 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.539143 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:19 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(9,[Lscala.Tuple2;@769d509b,BlockManagerId(9, cluster11, 47568, 0)) from Actor[akka.tcp://sparkExecutor@cluster11:42211/temp/$e] 14/10/06 18:06:19 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(9, cluster11, 47568, 0)) from Actor[akka://sparkDriver/temp/$f] 14/10/06 18:06:19 DEBUG BlockManagerMasterActor: [actor] handled message (0.106651 ms) BlockManagerHeartbeat(BlockManagerId(9, cluster11, 47568, 0)) from Actor[akka://sparkDriver/temp/$f] 14/10/06 18:06:19 DEBUG HeartbeatReceiver: [actor] handled message (0.520058 ms) Heartbeat(9,[Lscala.Tuple2;@769d509b,BlockManagerId(9, cluster11, 47568, 0)) from Actor[akka.tcp://sparkExecutor@cluster11:42211/temp/$e] 14/10/06 18:06:19 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(5,[Lscala.Tuple2;@6f882f9f,BlockManagerId(5, cluster08, 41699, 0)) from Actor[akka.tcp://sparkExecutor@cluster08:43238/temp/$e] 14/10/06 18:06:19 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(5, cluster08, 41699, 0)) from Actor[akka://sparkDriver/temp/$g] 14/10/06 18:06:19 DEBUG BlockManagerMasterActor: [actor] handled message (0.137943 ms) BlockManagerHeartbeat(BlockManagerId(5, cluster08, 41699, 0)) from Actor[akka://sparkDriver/temp/$g] 14/10/06 18:06:19 DEBUG HeartbeatReceiver: [actor] handled message (0.468053 ms) Heartbeat(5,[Lscala.Tuple2;@6f882f9f,BlockManagerId(5, cluster08, 41699, 0)) from Actor[akka.tcp://sparkExecutor@cluster08:43238/temp/$e] 14/10/06 18:06:20 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:20 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.56174 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(0,[Lscala.Tuple2;@27948bae,BlockManagerId(0, cluster04, 35816, 0)) from Actor[akka.tcp://sparkExecutor@cluster04:58637/temp/$e] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(0, cluster04, 35816, 0)) from Actor[akka://sparkDriver/temp/$h] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] handled message (0.431716 ms) Heartbeat(0,[Lscala.Tuple2;@27948bae,BlockManagerId(0, cluster04, 35816, 0)) from Actor[akka.tcp://sparkExecutor@cluster04:58637/temp/$e] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] handled message (0.087421 ms) BlockManagerHeartbeat(BlockManagerId(0, cluster04, 35816, 0)) from Actor[akka://sparkDriver/temp/$h] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(3,[Lscala.Tuple2;@1325bad7,BlockManagerId(3, cluster07, 55461, 0)) from Actor[akka.tcp://sparkExecutor@cluster07:58464/temp/$e] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(3, cluster07, 55461, 0)) from Actor[akka://sparkDriver/temp/$i] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] handled message (0.084813 ms) BlockManagerHeartbeat(BlockManagerId(3, cluster07, 55461, 0)) from Actor[akka://sparkDriver/temp/$i] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] handled message (0.488643 ms) Heartbeat(3,[Lscala.Tuple2;@1325bad7,BlockManagerId(3, cluster07, 55461, 0)) from Actor[akka.tcp://sparkExecutor@cluster07:58464/temp/$e] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(10,[Lscala.Tuple2;@35185da7,BlockManagerId(10, cluster03, 45785, 0)) from Actor[akka.tcp://sparkExecutor@cluster03:58650/temp/$e] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(10, cluster03, 45785, 0)) from Actor[akka://sparkDriver/temp/$j] 14/10/06 18:06:20 DEBUG BlockManagerMasterActor: [actor] handled message (0.089349 ms) BlockManagerHeartbeat(BlockManagerId(10, cluster03, 45785, 0)) from Actor[akka://sparkDriver/temp/$j] 14/10/06 18:06:20 DEBUG HeartbeatReceiver: [actor] handled message (0.493703 ms) Heartbeat(10,[Lscala.Tuple2;@35185da7,BlockManagerId(10, cluster03, 45785, 0)) from Actor[akka.tcp://sparkExecutor@cluster03:58650/temp/$e] 14/10/06 18:06:21 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(8,[Lscala.Tuple2;@41bde91b,BlockManagerId(8, cluster09, 51665, 0)) from Actor[akka.tcp://sparkExecutor@cluster09:52863/temp/$e] 14/10/06 18:06:21 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(8, cluster09, 51665, 0)) from Actor[akka://sparkDriver/temp/$k] 14/10/06 18:06:21 DEBUG BlockManagerMasterActor: [actor] handled message (0.094511 ms) BlockManagerHeartbeat(BlockManagerId(8, cluster09, 51665, 0)) from Actor[akka://sparkDriver/temp/$k] 14/10/06 18:06:21 DEBUG HeartbeatReceiver: [actor] handled message (0.430835 ms) Heartbeat(8,[Lscala.Tuple2;@41bde91b,BlockManagerId(8, cluster09, 51665, 0)) from Actor[akka.tcp://sparkExecutor@cluster09:52863/temp/$e] 14/10/06 18:06:21 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:21 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.626521 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:22 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:22 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.569276 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:22 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(7,[Lscala.Tuple2;@7fd05555,BlockManagerId(7, cluster05, 39640, 0)) from Actor[akka.tcp://sparkExecutor@cluster05:36063/temp/$e] 14/10/06 18:06:22 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(7, cluster05, 39640, 0)) from Actor[akka://sparkDriver/temp/$l] 14/10/06 18:06:22 DEBUG HeartbeatReceiver: [actor] handled message (0.439054 ms) Heartbeat(7,[Lscala.Tuple2;@7fd05555,BlockManagerId(7, cluster05, 39640, 0)) from Actor[akka.tcp://sparkExecutor@cluster05:36063/temp/$e] 14/10/06 18:06:22 DEBUG BlockManagerMasterActor: [actor] handled message (0.094583 ms) BlockManagerHeartbeat(BlockManagerId(7, cluster05, 39640, 0)) from Actor[akka://sparkDriver/temp/$l] 14/10/06 18:06:23 DEBUG SparkDeploySchedulerBackend: [actor] received message ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:23 DEBUG SparkDeploySchedulerBackend: [actor] handled message (0.623003 ms) ReviveOffers from Actor[akka://sparkDriver/user/CoarseGrainedScheduler#1212957677] 14/10/06 18:06:23 DEBUG HeartbeatReceiver: [actor] received message Heartbeat(4,[Lscala.Tuple2;@3c538cd9,BlockManagerId(4, cluster14, 48874, 0)) from Actor[akka.tcp://sparkExecutor@cluster14:52289/temp/$e] 14/10/06 18:06:23 DEBUG BlockManagerMasterActor: [actor] received message BlockManagerHeartbeat(BlockManagerId(4, cluster14, 48874, 0)) from Actor[akka://sparkDriver/temp/$m] 14/10/06 18:06:23 DEBUG BlockManagerMasterActor: [actor] handled message (0.138648 ms) BlockManagerHeartbeat(BlockManagerId(4, cluster14, 48874, 0)) from Actor[akka://sparkDriver/temp/$m] 14/10/06 18:06:23 DEBUG HeartbeatReceiver: [actor] handled message (0.758515 ms) Heartbeat(4,[Lscala.Tuple2;@3c538cd9,BlockManagerId(4, cluster14, 48874, 0)) from Actor[akka.tcp://sparkExecutor@cluster14:52289/temp/$e]
.... It permanently generates above logs. Any ideas? Kevin -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Stucked-job-works-well-after-rdd-count-or-rdd-collect-tp15776p15783.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
