[
https://issues.apache.org/jira/browse/SPARK-22424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235365#comment-16235365
]
chengning commented on SPARK-22424:
-----------------------------------
Oh, I saw that the state is really SUCCESS, but Event Timeline show not
execute, I guess it cause the batch "2017/09/29 17:32:28" not finished
> Task not finished for a long time in monitor UI, but I found it finished in
> logs
> --------------------------------------------------------------------------------
>
> Key: SPARK-22424
> URL: https://issues.apache.org/jira/browse/SPARK-22424
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.1.0
> Reporter: chengning
> Priority: Blocking
> Attachments: C33oL.jpg
>
>
> Task not finished for a long time in monitor UI, but I found it finished in
> logs
> Thanks a lot.
> !https://i.stack.imgur.com/C33oL.jpg!
> !C33oL.jpg|thumbnail!
> executor log:
> 17/09/29 17:32:28 INFO executor.CoarseGrainedExecutorBackend: Got assigned
> task 213492
> 17/09/29 17:32:28 INFO executor.Executor: Running task 52.0 in stage 2468.0
> (TID 213492)
> 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Getting 30
> non-empty blocks out of 30 blocks
> 17/09/29 17:32:28 INFO storage.ShuffleBlockFetcherIterator: Started 29 remote
> fetches in 1 ms
> 17:32:28.447: tcPartition=7 ms
> 17/09/29 17:32:28 INFO executor.Executor: Finished task 52.0 in stage 2468.0
> (TID 213492). 2755 bytes result sent to driver
> driver logļ¼:
> 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Starting task 52.0 in stage
> 2468.0 (TID 213492, HMGQXD2, executor 1, partition 52, PROCESS_LOCAL, 6386
> bytes)
> 17/09/29 17:32:28 INFO scheduler.TaskSetManager: Finished task 52.0 in stage
> 2468.0 (TID 213492) in 24 ms on HMGQXD2 (executor 1) (53/200)
> 17/09/29 17:32:28 INFO cluster.YarnScheduler: Removed TaskSet 2468.0, whose
> tasks have all completed, from pool
> 17/09/29 17:32:28 INFO scheduler.DAGScheduler: ResultStage 2468
> (foreachPartition at Counter2.java:152) finished in 0.255 s
> 17/09/29 17:32:28 INFO scheduler.DAGScheduler: Job 1647 finished:
> foreachPartition at Counter2.java:152, took 0.415256 s
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
