Yang Liang created SPARK-17449:
----------------------------------
Summary: executorTimeoutMs configure error
Key: SPARK-17449
URL: https://issues.apache.org/jira/browse/SPARK-17449
Project: Spark
Issue Type: Bug
Components: Spark Core
Reporter: Yang Liang
$ spark-shell --master yarn --conf spark.executor.heartbeatInterval=20s
--num-executors 1
WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 168136
ms exceeds timeout 120000 ms
ERROR YarnScheduler: Lost executor 1 on datanode16: Executor heartbeat timed
out after 168136 ms
spark-shell --master yarn --conf spark.executor.heartbeatInterval=200s --conf
spark.network.timeout=10s --num-executors 1
WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 11949 ms
exceeds timeout 10000 ms
ERROR YarnScheduler: Lost executor 1 on datanode31: Executor heartbeat timed
out after 11949 m
spark-shell --master yarn --conf spark.executor.heartbeatInterval=200s --conf
spark.network.timeout=10s --num-executors 1
WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 39299 ms
exceeds timeout 10000 ms
ERROR YarnScheduler: Lost executor 1 on datanode19: Executor heartbeat timed
out after 39299 ms
Source Code:
spark/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
private val executorTimeoutMs =
sc.conf.getTimeAsSeconds("spark.network.timeout", s"${slaveTimeoutMs}ms") *
1000
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
