[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-spark/pull/641 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35963256 Merged into master and branch-0.9. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35946252 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12832/ --- If you

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35946250 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10012382 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10012275 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10011948 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10011413 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35939422 Okay, I think I've fixed the shuffleToMapStage removal part: https://github.com/mateiz/incubator-spark/commit/0187cef0f284e6cb22cb3986c327c43304daf57d. --- If yo

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35939003 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35939005 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10006949 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -272,8 +272,10 @@ class DAGScheduler( if (mapOutputTr

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10004187 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10003953 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -272,8 +272,10 @@ class DAGScheduler( if (mapOutputTracker

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r10001290 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1990 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1970 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1899 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1819 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1699 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r1592 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r9997152 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r9996859 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -272,8 +272,10 @@ class DAGScheduler( if (mapOutputTra

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r9996518 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/incubator-spark/pull/641#discussion_r9990785 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -373,25 +375,26 @@ class DAGScheduler( } else {

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35885498 Looks good, nice catch ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-pos

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35865525 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12826/ --- If you

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35865523 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35864121 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/incubator-spark/pull/641#issuecomment-35864120 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please t

[GitHub] incubator-spark pull request: SPARK-1124: Fix infinite retries of ...

2014-02-23 Thread mateiz
GitHub user mateiz opened a pull request: https://github.com/apache/incubator-spark/pull/641 SPARK-1124: Fix infinite retries of reduce stage when a map stage failed In the previous code, if you had a failing map stage and then tried to run reduce stages on it repeatedly, the first