spark git commit: [SPARK-11344] Made ApplicationDescription and DriverDescription case classes

Repository: spark Updated Branches: refs/heads/master b86f2cab6 -> 233e534ac [SPARK-11344] Made ApplicationDescription and DriverDescription case classes DriverDescription refactored to case class because it included no mutable fields. ApplicationDescription had one mutable field, which was

spark git commit: [SPARK-11404] [SQL] Support for groupBy using column expressions

Repository: spark Updated Branches: refs/heads/master 425ff03f5 -> b86f2cab6 [SPARK-11404] [SQL] Support for groupBy using column expressions This PR adds a new method `groupBy(cols: Column*)` to `Dataset` that allows users to group using column expressions instead of a lambda function.

spark git commit: [SPARK-11436] [SQL] rebind right encoder when join 2 datasets

Repository: spark Updated Branches: refs/heads/master 67e23b39a -> 425ff03f5 [SPARK-11436] [SQL] rebind right encoder when join 2 datasets When we join 2 datasets, we will combine 2 encoders into a tupled one, and use it as the encoder for the jioned dataset. Assume both of the 2 encoders

spark git commit: [SPARK-10304] [SQL] Partition discovery should throw an exception if the dir structure is invalid

Repository: spark Updated Branches: refs/heads/master 57446eb69 -> d6035d97c [SPARK-10304] [SQL] Partition discovery should throw an exception if the dir structure is invalid JIRA: https://issues.apache.org/jira/browse/SPARK-10304 This patch detects if the structure of partition directories

spark git commit: [SPARK-10978][SQL] Allow data sources to eliminate filters

Repository: spark Updated Branches: refs/heads/master b2e4b314d -> ebf8b0b48 [SPARK-10978][SQL] Allow data sources to eliminate filters This PR adds a new method `unhandledFilters` to `BaseRelation`. Data sources which implement this method properly may avoid the overhead of defensive

spark git commit: [SPARK-11424] Guard against double-close() of RecordReaders (branch-1.3 backport)

Repository: spark Updated Branches: refs/heads/branch-1.3 0ce148533 -> b90e5cba2 [SPARK-11424] Guard against double-close() of RecordReaders (branch-1.3 backport) This is a branch-1.3 backport of #9382, a fix for SPARK-11424. Author: Josh Rosen Closes #9423 from

spark git commit: [SPARK-11477] [SQL] support create Dataset from RDD

Repository: spark Updated Branches: refs/heads/master 1d04dc95c -> f6fcb4874 [SPARK-11477] [SQL] support create Dataset from RDD Author: Wenchen Fan Closes #9434 from cloud-fan/rdd2ds and squashes the following commits: 0892d72 [Wenchen Fan] support create Dataset

spark git commit: [SPARK-11407][SPARKR] Add doc for running from RStudio

Repository: spark Updated Branches: refs/heads/master ebf8b0b48 -> a9676cc71 [SPARK-11407][SPARKR] Add doc for running from RStudio  (This is without css, but you get the idea)

spark git commit: [SPARK-11489][SQL] Only include common first order statistics in GroupedData

Repository: spark Updated Branches: refs/heads/master 53e9cee3e -> 5051262d4 [SPARK-11489][SQL] Only include common first order statistics in GroupedData We added a bunch of higher order statistics such as skewness and kurtosis to GroupedData. I don't think they are common enough to justify

spark git commit: [DOC] Missing link to R DataFrame API doc

Repository: spark Updated Branches: refs/heads/master 5051262d4 -> d648a4ad5 [DOC] Missing link to R DataFrame API doc Author: lewuathe Author: Lewuathe Closes #9394 from Lewuathe/missing-link-to-R-dataframe. Project:

spark git commit: Fix typo in WebUI

Repository: spark Updated Branches: refs/heads/master f6fcb4874 -> 680b4e7bc Fix typo in WebUI Author: Jacek Laskowski Closes #9444 from jaceklaskowski/TImely-fix. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Fix typo in WebUI

Repository: spark Updated Branches: refs/heads/branch-1.5 072afc6f4 -> c022c0aa4 Fix typo in WebUI Author: Jacek Laskowski Closes #9444 from jaceklaskowski/TImely-fix. (cherry picked from commit 680b4e7bca935dc1569f35fa319bdfb01a12f7e0) Signed-off-by: Reynold

spark git commit: [SPARK-11466][CORE] Avoid mockito in multi-threaded FsHistoryProviderSuite test.

Repository: spark Updated Branches: refs/heads/master 680b4e7bc -> 53e9cee3e [SPARK-11466][CORE] Avoid mockito in multi-threaded FsHistoryProviderSuite test. The test functionality should be the same, but without using mockito; logs don't really say anything useful but I suspect it may be the

spark git commit: [SPARK-11329] [SQL] Cleanup from spark-11329 fix.

Repository: spark Updated Branches: refs/heads/master d648a4ad5 -> e352de0db [SPARK-11329] [SQL] Cleanup from spark-11329 fix. Author: Nong Closes #9442 from nongli/spark-11483. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11455][SQL] fix case sensitivity of partition by

Repository: spark Updated Branches: refs/heads/master e352de0db -> 2692bdb7d [SPARK-11455][SQL] fix case sensitivity of partition by depend on `caseSensitive` to do column name equality check, instead of just `==` Author: Wenchen Fan Closes #9410 from

svn commit: r1712484 - in /spark: _layouts/ images/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: pwendell Date: Wed Nov 4 07:17:45 2015 New Revision: 1712484 URL: http://svn.apache.org/viewvc?rev=1712484=rev Log: Adding trademark to logo Added: spark/images/spark-logo-trademark.png (with props) spark/images/spark-logo-trademark.xcf (with props)

spark git commit: [SPARK-10533][SQL] handle scientific notation in sqlParser

Repository: spark Updated Branches: refs/heads/master 233e534ac -> d188a6776 [SPARK-10533][SQL] handle scientific notation in sqlParser https://issues.apache.org/jira/browse/SPARK-10533 val df = sqlContext.createDataFrame(Seq(("a",1.0),("b",2.0),("c",3.0))) df.filter("_2 < 2.0e1").show

spark git commit: [MINOR][ML] Fix naming conventions of AFTSurvivalRegression coefficients

Repository: spark Updated Branches: refs/heads/master d6f10aa7e -> 3434572b1 [MINOR][ML] Fix naming conventions of AFTSurvivalRegression coefficients Rename ```regressionCoefficients``` back to ```coefficients```, and name ```weights``` to ```parameters```. See discussion

spark git commit: [SPARK-11188] [SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions

Repository: spark Updated Branches: refs/heads/branch-1.5 b85bf8f49 -> 5604ce9c1 [SPARK-11188] [SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions Only print the error message to the console for Analysis Exceptions in sql-shell Author: Dilip Biswal Closes

spark git commit: Update branch-1.5 for 1.5.2 release.

Repository: spark Updated Branches: refs/heads/branch-1.5 5604ce9c1 -> 979566690 Update branch-1.5 for 1.5.2 release. Author: Reynold Xin Closes #9435 from rxin/patch1.5.2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.5.2-rc2 [created] 49c30c1f6 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org