Github user viper-kun commented on a diff in the pull request:
https://github.com/apache/spark/pull/5523#discussion_r28502410
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -75,6 +75,8 @@ import org.apache.spark.util._
*/
class SparkContext(config: SparkConf) extends Logging with
ExecutorAllocationClient {
+ var isInited: Boolean = false
--- End diff --
>>> I also don't think that a lack of executor messages indicates a
disconnection; it's not possible to distinguish from temporary loss of
connectivity this way.
All executors send heartbeat to driver at fixed Rate.Over a period of time,
all executors are expire, I think there is a disconnection. Is there any
better way to distinguish from temporary loss of connectivity.
Can we check some times? If all executors still expire, we indicates a
disconnection.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
