[
https://issues.apache.org/jira/browse/SPARK-19030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-19030:
---------------------------------
Labels: bulk-closed (was: )
> Dropped event errors being reported after SparkContext has been stopped
> -----------------------------------------------------------------------
>
> Key: SPARK-19030
> URL: https://issues.apache.org/jira/browse/SPARK-19030
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.2
> Environment: Debian 8 using spark-submit with MATLAB integration
> spark code is being code using java.
> Reporter: michael procopio
> Priority: Minor
> Labels: bulk-closed
>
> After stop has been called on SparkContext, errors are being reported.
> 6/12/29 15:54:04 ERROR scheduler.LiveListenerBus: SparkListenerBus has
> already stopped! Dropping event
> SparkListenerExecutorMetricsUpdate(2,WrappedArray())
> The stack in the hearbeat thread is at the point where the error is thrown is:
> Daemon Thread [heartbeat-receiver-event-loop-thread] (Suspended (breakpoint
> at line 124 in LiveListenerBus))
> LiveListenerBus.post(SparkListenerEvent) line: 124
> DAGScheduler.executorHeartbeatReceived(String,
> Tuple4<Object,Object,Object,Seq<AccumulableInfo>>[], BlockManagerId) line:
> 228
> YarnScheduler(TaskSchedulerImpl).executorHeartbeatReceived(String,
> Tuple2<Object,Seq<AccumulatorV2<?,?>>>[], BlockManagerId) line: 402
>
> HeartbeatReceiver$$anonfun$receiveAndReply$1$$anon$2$$anonfun$run$2.apply$mcV$sp()
> line: 128
> Utils$.tryLogNonFatalError(Function0<BoxedUnit>) line: 1290
> HeartbeatReceiver$$anonfun$receiveAndReply$1$$anon$2.run() line: 127
> Executors$RunnableAdapter<T>.call() line: 511
> ScheduledThreadPoolExecutor$ScheduledFutureTask<V>(FutureTask<V>).run()
> line: 266
>
> ScheduledThreadPoolExecutor$ScheduledFutureTask<V>.access$201(ScheduledThreadPoolExecutor$ScheduledFutureTask)
> line: 180
> ScheduledThreadPoolExecutor$ScheduledFutureTask<V>.run() line: 293
>
> ScheduledThreadPoolExecutor(ThreadPoolExecutor).runWorker(ThreadPoolExecutor$Worker)
> line: 1142
> ThreadPoolExecutor$Worker.run() line: 617
> Thread.run() line: 745
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
