chengning created SPARK-22424:
---------------------------------
Summary: Task not finished for a long time in monitor UI, but I
found it finished in logs
Key: SPARK-22424
URL: https://issues.apache.org/jira/browse/SPARK-22424
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.0
Reporter: chengning
Priority: Blocking
Task not finished for a long time in monitor UI, but I found it finished in logs
Thanks a lot.
!https://i.stack.imgur.com/C33oL.jpg!
executor log:
17/09/29 17:32:28 INFO executor.CoarseGrainedExecutorBackend: Got assigned task
213492
17/09/29 17:32:28 INFO executor.Executor: Running task 52.0 in stage 2468.0
(TID 213492)
17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Getting 30
non-empty blocks out of 30 blocks
17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Started 29 remote
fetches in 1 ms
17:32:28.447: tcPartition=7 ms
17/09/29 17:32:28 INFO executor.Executor: Finished task 52.0 in stage 2468.0
(TID 213492). 2755 bytes result sent to driver
driver logļ¼:
17/09/29 17:32:28 INFO scheduler.TaskSetManager: Starting task 52.0 in stage
2468.0 (TID 213492, HMGQXD2, executor 1, partition 52, PROCESS_LOCAL, 6386
bytes)
17/09/29 17:32:28 INFO scheduler.TaskSetManager: Finished task 52.0 in stage
2468.0 (TID 213492) in 24 ms on HMGQXD2 (executor 1) (53/200)
17/09/29 17:32:28 INFO cluster.YarnScheduler: Removed TaskSet 2468.0, whose
tasks have all completed, from pool
17/09/29 17:32:28 INFO scheduler.DAGScheduler: ResultStage 2468
(foreachPartition at Counter2.java:152) finished in 0.255 s
17/09/29 17:32:28 INFO scheduler.DAGScheduler: Job 1647 finished:
foreachPartition at Counter2.java:152, took 0.415256 s
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
