[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42920479 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42920541 Also we might want to call this saveAsPickleFile and pickleFile instead to make clear that it's not compatible with the Java/Scala objectFile. --- If your project is set

[GitHub] spark pull request: SPARK-571: forbid return statements in cleaned...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/717#issuecomment-42913623 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14932/ --- If your project

[GitHub] spark pull request: SPARK-1772 Stop catching Throwable, let Execut...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/715#issuecomment-42858250 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread ash211
GitHub user ash211 opened a pull request: https://github.com/apache/spark/pull/756 SPARK-1818 Freshen Mesos documentation Place more emphasis on using precompiled binary versions of Spark and Mesos instead of encouraging the reader to compile from source. You can merge this

[GitHub] spark pull request: L-BFGS Documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/702#issuecomment-42735955 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42922492 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42922493 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14935/ --- If your project

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42922840 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12569697 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,105 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters

[GitHub] spark pull request: [SPARK-1779] add warning when memoryFraction i...

2014-05-13 Thread scwf
Github user scwf commented on a diff in the pull request: https://github.com/apache/spark/pull/714#discussion_r12502268 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1045,6 +1045,9 @@ private[spark] object BlockManager extends Logging {

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42920512 How can you make sure that in future versions of PySpark, the same deserializer will be used? You should force this to save pickled objects somehow instead of relying on

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42925453 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42924065 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread ash211
Github user ash211 commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12569909 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,105 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12570563 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,105 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12570645 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,105 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters

[GitHub] spark pull request: [SPARK-1749] Job cancellation when SchedulerBa...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/686#issuecomment-42868016 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1746: Support setting SPARK_JAVA_OPTS on...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/676#issuecomment-42393188 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42926323 Made a few surface level comments - this is a great and much-needed update. Thanks! --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42926895 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14937/ --- If your project

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42926894 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42920487 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1161] Add saveAsObjectFile and SparkCon...

2014-05-13 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-42920463 Jenkins, this is ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [Spark-1461] Deferred Expression Evaluation (s...

2014-05-13 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/446#issuecomment-42713490 test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1749] Job cancellation when SchedulerBa...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/686#issuecomment-42494318 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1768] History server enhancements.

2014-05-13 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/718 [SPARK-1768] History server enhancements. Two improvements to the history server: - Separate the HTTP handling from history fetching, so that it's easy to add new backends later

[GitHub] spark pull request: SPARK-1668: Add implicit preference as an opti...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/597#issuecomment-42405189 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1770: Revert accidental(?) fix

2014-05-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/716 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42924078 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-05-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/552#issuecomment-42450961 @ScrapCodes you'll need to merge this with master - unfortunately there was another patch that renamed/moved some of the example files. --- If your project is set up

[GitHub] spark pull request: SPARK-1668: Add implicit preference as an opti...

2014-05-13 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/597#discussion_r12388902 --- Diff: examples/src/main/scala/org/apache/spark/examples/mllib/MovieLensALS.scala --- @@ -121,11 +157,14 @@ object MovieLensALS { } /**

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42928732 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1814: Splash page should include correct...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/752#issuecomment-42908116 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42928721 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42931944 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42931947 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14938/ --- If your project

[GitHub] spark pull request: [SPARK-1819] [SQL] Fix GetField.nullable.

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/757#issuecomment-42932030 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1819] [SQL] Fix GetField.nullable.

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/757#issuecomment-42932047 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42930878 cc: @ceteri -- we're updating the Spark documentation for running on Mesos. Given your expertise with this setup (I believe you did the video and wrote the docs below),

[GitHub] spark pull request: [SPARK-1527] change rootDir*.getName to rootDi...

2014-05-13 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/436#issuecomment-42933352 @pwendell On the subject of SPARK-1623, this PR / JIRA can also go in, in my opinion. It's a related small good fix to a potential test problem. Then I think both are

[GitHub] spark pull request: [SPARK-1819] [SQL] Fix GetField.nullable.

2014-05-13 Thread ueshin
GitHub user ueshin opened a pull request: https://github.com/apache/spark/pull/757 [SPARK-1819] [SQL] Fix GetField.nullable. `GetField.nullable` should be `true` not only when `field.nullable` is `true` but also when `child.nullable` is `true`. You can merge this pull request into

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12570602 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,105 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters

[GitHub] spark pull request: Implement ApproximateCountDistinct for SparkSq...

2014-05-13 Thread larvaboy
Github user larvaboy commented on a diff in the pull request: https://github.com/apache/spark/pull/737#discussion_r12574227 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -269,6 +308,34 @@ case class CountFunction(expr:

[GitHub] spark pull request: Implement ApproximateCountDistinct for SparkSq...

2014-05-13 Thread larvaboy
Github user larvaboy commented on the pull request: https://github.com/apache/spark/pull/737#issuecomment-42934624 All the review issues should have been fixed in the most recent version of the code. Please let me know if I missed anything. Thanks a lot for the quick

[GitHub] spark pull request: Implement ApproximateCountDistinct for SparkSq...

2014-05-13 Thread larvaboy
Github user larvaboy commented on a diff in the pull request: https://github.com/apache/spark/pull/737#discussion_r12574394 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -166,10 +167,48 @@ case class

[GitHub] spark pull request: Implement ApproximateCountDistinct for SparkSq...

2014-05-13 Thread larvaboy
Github user larvaboy commented on a diff in the pull request: https://github.com/apache/spark/pull/737#discussion_r12574415 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -166,10 +167,48 @@ case class

[GitHub] spark pull request: [SPARK-1819] [SQL] Fix GetField.nullable.

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/757#issuecomment-42938171 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-1819] [SQL] Fix GetField.nullable.

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/757#issuecomment-42938172 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14939/ --- If your project

[GitHub] spark pull request: SPARK-1487 [SQL] Support record filtering via ...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/511#issuecomment-42737714 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Synthetic GraphX Benchmark

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/720#issuecomment-42756916 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Implement ApproximateCountDistinct for SparkSq...

2014-05-13 Thread larvaboy
Github user larvaboy commented on a diff in the pull request: https://github.com/apache/spark/pull/737#discussion_r12574452 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregates.scala --- @@ -166,10 +167,48 @@ case class

[GitHub] spark pull request: SPARK-1143: refactor TaskSchedulerImplSuite

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/339#issuecomment-42944676 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread maasg
Github user maasg commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12578665 --- Diff: docs/running-on-mesos.md --- @@ -3,19 +3,109 @@ layout: global title: Running Spark on Mesos --- -Spark can run on clusters managed

[GitHub] spark pull request: SPARK-1143: refactor TaskSchedulerImplSuite

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/339#issuecomment-42944668 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread maasg
Github user maasg commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42945385 Great work. I'd love to see some more background of the dynamics of Spark running on Mesos. It has been a tough learning experience to get our Spark + Spark Streaming

[GitHub] spark pull request: SPARK-1143: refactor TaskSchedulerImplSuite

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/339#issuecomment-42946397 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14940/ --- If your project is set up for it, you can

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42928672 Made changes to cover Patrick's suggestions. I had some trouble getting LZO libraries accessible from the Mesos executor and never actually got that working. Do

[GitHub] spark pull request: SPARK-1143: refactor TaskSchedulerImplSuite

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/339#issuecomment-42946396 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread maasg
Github user maasg commented on a diff in the pull request: https://github.com/apache/spark/pull/756#discussion_r12578801 --- Diff: docs/running-on-mesos.md --- @@ -25,31 +115,52 @@ val conf = new SparkConf() val sc = new SparkContext(conf) {% endhighlight %}

[GitHub] spark pull request: SPARK-1803 Replaced colon in filenames with a ...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/739#issuecomment-42908906 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fixed streaming examples docs to use run-examp...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/722#issuecomment-42739223 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14870/ --- If your project

[GitHub] spark pull request: Added SparkGCE Script for Version 0.9.1

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/681#issuecomment-42443819 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WIP]SPARK-1706: Allow multiple executors per ...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/636#issuecomment-42596560 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: The org.datanucleus:* should not be packaged i...

2014-05-13 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/688#issuecomment-42507202 Should probably do this for sbt as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/636#issuecomment-42423135 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: use Iterator#size in RDD#count

2014-05-13 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/736#issuecomment-42955215 @rxin I'm sorry I didn't got a link for that, but I didn't find any discussion about performance issue of Iterator#size, either. I just checked the source code of

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42922832 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1818 Freshen Mesos documentation

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/756#issuecomment-42925454 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14936/ --- If your project

[GitHub] spark pull request: SPARK-1798. Tests should clean up temp files

2014-05-13 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/732#issuecomment-42889334 Okay, i'll pull this in. If there was a reason to swallow exceptions then we can add that back easily. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [WIP]SPARK-1712: TaskDescription instance is t...

2014-05-13 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/677 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1143: refactor TaskSchedulerImplSuite

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/339#issuecomment-42911951 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-1791 - SVM implementation does not use t...

2014-05-13 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/725#discussion_r12594375 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/classification/SVMSuite.scala --- @@ -69,6 +69,43 @@ class SVMSuite extends FunSuite with

[GitHub] spark pull request: SPARK-1791 - SVM implementation does not use t...

2014-05-13 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/725#issuecomment-42981423 ah, I made this ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42981436 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42981451 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1779] add warning when memoryFraction i...

2014-05-13 Thread erikerlandson
Github user erikerlandson commented on the pull request: https://github.com/apache/spark/pull/714#issuecomment-42983694 I coded up a proposal where SparkConf owns the checking inside of getInt(), getDouble() and friends, described here:

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-42914809 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14934/ --- If your project

[GitHub] spark pull request: use Iterator#size in RDD#count

2014-05-13 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/736#issuecomment-42968273 This is not equivalent performance wise from casual look. Even assuming everything is same, it is still invoking function in loop versus direct addition. --- If your

[GitHub] spark pull request: [SPARK-1741][MLLIB] add predict(JavaRDD) to Re...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/670#issuecomment-42990250 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1485][MLLIB] Implement Butterfly AllRed...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/506#issuecomment-42990253 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598841 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598965 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -102,16 +105,55 @@ case class HiveTableScan(

[GitHub] spark pull request: [SPARK-1741][MLLIB] add predict(JavaRDD) to Re...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/670#issuecomment-42990282 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598706 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598829 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42991927 Nice speed up! :) I looked at the test failure. Looks like [this

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598783 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/758 [SPARK-1368][SQL] Optimized HiveTableScan JIRA issue: [SPARK-1368](https://issues.apache.org/jira/browse/SPARK-1368) This PR introduces two major updates: - Replaced FP style code

[GitHub] spark pull request: SPARK-571: forbid return statements in cleaned...

2014-05-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/717#issuecomment-42992463 @willb can you also add a test case where an inline function is using return statement in its closure to make sure that is allowed? e.g. ```scala

[GitHub] spark pull request: SPARK-1565, update examples to be used with sp...

2014-05-13 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/552#discussion_r12370101 --- Diff: examples/src/main/java/org/apache/spark/examples/JavaLogQuery.java --- @@ -98,15 +99,11 @@ public static Stats extractStats(String line) {

[GitHub] spark pull request: [Docs] Update YARN and standalone docs

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/701#issuecomment-42713039 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1688] Propagate PySpark worker stderr t...

2014-05-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/603 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-1708. Add a ClassTag on Serializer and t...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/700#issuecomment-42610754 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14824/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1754] [SQL] Add missing arithmetic DSL ...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/689#issuecomment-42510321 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1745] Move interrupted flag from TaskCo...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/675#issuecomment-42386918 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14754/ --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-1485][MLLIB] Implement Butterfly AllRed...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/506#issuecomment-42990283 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1816] LiveListenerBus dies if a listene...

2014-05-13 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/759 [SPARK-1816] LiveListenerBus dies if a listener throws an exception The solution is to wrap a try / catch / log around the posting of each event to each listener. You can merge this pull request

[GitHub] spark pull request: [SPARK-1816] LiveListenerBus dies if a listene...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/759#issuecomment-42995350 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-1741][MLLIB] add predict(JavaRDD) to Re...

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/670#issuecomment-42995335 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

  1   2   3   >