[GitHub] spark pull request: [SPARK-2524] missing document about spark.depl...

2014-07-16 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/1443#issuecomment-49249536 @pwendell thanks. i address your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: discarded exceeded completedDrivers

2014-07-15 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/1114#issuecomment-48995170 @andrewor14 i have created a jira issue SPARK-2302. yes, it is for reducing Master's memory. Thank you. --- If your project is set up for it, you can reply

[GitHub] spark pull request: add ability to submit multiple jars for Driver

2014-06-18 Thread lianhuiwang
GitHub user lianhuiwang opened a pull request: https://github.com/apache/spark/pull/1113 add ability to submit multiple jars for Driver add ability to submit multiple jars for Driver You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] spark pull request: discarded exceeded completedDrivers

2014-06-18 Thread lianhuiwang
GitHub user lianhuiwang opened a pull request: https://github.com/apache/spark/pull/1114 discarded exceeded completedDrivers When completedDrivers number exceeds the threshold, the first Max(spark.deploy.retainedDrivers, 1) will be discarded. You can merge this pull request

[GitHub] spark pull request: bugfix worker DriverStateChanged state should ...

2014-05-25 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/864#issuecomment-44158350 can anyone verify this patch?thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-1886] check executor id existence when ...

2014-05-23 Thread lianhuiwang
Github user lianhuiwang commented on the pull request: https://github.com/apache/spark/pull/827#issuecomment-44000844 great zhpengg in our environment it appears this problem and we fix it. so we should quickly merge into 1.0 release --- If your project is set up for it, you can

[GitHub] spark pull request: bugfix worker DriverStateChanged state should ...

2014-05-23 Thread lianhuiwang
GitHub user lianhuiwang opened a pull request: https://github.com/apache/spark/pull/864 bugfix worker DriverStateChanged state should match DriverState.FAILED bugfix worker DriverStateChanged state should match DriverState.FAILED You can merge this pull request into a Git

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-16 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12464105 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-15 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12472994 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-12 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/731#discussion_r12564010 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -466,30 +466,14 @@ private[spark] class Master( * launched

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12507640 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12509207 --- Diff: core/src/main/scala/org/apache/spark/deploy/ApplicationDescription.scala --- @@ -28,6 +28,7 @@ private[spark] class ApplicationDescription

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-05 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12268618 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -523,6 +504,81 @@ private[spark] class Master

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-05 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12310911 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -523,6 +504,89 @@ private[spark] class Master

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-05 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/636#discussion_r12310983 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -523,6 +504,89 @@ private[spark] class Master

<    1   2   3   4   5   6