[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-23 Thread viper-kun
Github user viper-kun closed the pull request at: https://github.com/apache/spark/pull/5523 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-23 Thread viper-kun
Github user viper-kun commented on the pull request: https://github.com/apache/spark/pull/5523#issuecomment-95764614 ok. I will close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-23 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5523#issuecomment-95577801 I think https://github.com/apache/spark/pull/5663 stands a better chance of addressing the issue and being merged. Do you mind commenting on that one, and closing this

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-16 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5523#discussion_r28494320 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -75,6 +75,8 @@ import org.apache.spark.util._ */ class SparkContext(config:

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-16 Thread viper-kun
Github user viper-kun commented on a diff in the pull request: https://github.com/apache/spark/pull/5523#discussion_r28502410 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -75,6 +75,8 @@ import org.apache.spark.util._ */ class

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-16 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5523#issuecomment-93716364 Have a look at https://github.com/apache/spark/commit/de4fa6b6d12e2bee0307ffba2abfca0c33f15e45 which may resolve the issue of bad state after construction. I

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-16 Thread viper-kun
Github user viper-kun commented on the pull request: https://github.com/apache/spark/pull/5523#issuecomment-93728497 Between construction, it is normal that it didn't hear from executors. Only after construction, executors have connected and sent heartbeat to driver. We can indicates

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-16 Thread viper-kun
Github user viper-kun commented on a diff in the pull request: https://github.com/apache/spark/pull/5523#discussion_r28501942 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -75,6 +75,8 @@ import org.apache.spark.util._ */ class

[GitHub] spark pull request: [Spark-6924]Fix driver hangs in yarn-client mo...

2015-04-15 Thread viper-kun
Github user viper-kun commented on the pull request: https://github.com/apache/spark/pull/5523#issuecomment-93615543 @srowen I updated the jira. Pls review it. Thanks。 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.