spark git commit: [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

Repository: spark Updated Branches: refs/heads/master 9ace2e5c8 -> e359d5dcf [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml jira: https://issues.apache.org/jira/browse/SPARK-11689 Add simple user guide for LDA under spark.ml and example code under examples/. Use

spark git commit: [SPARK-11852][ML] StandardScaler minor refactor

Repository: spark Updated Branches: refs/heads/branch-1.6 eab90d3f3 -> b11aa1797 [SPARK-11852][ML] StandardScaler minor refactor ```withStd``` and ```withMean``` should be params of ```StandardScaler``` and ```StandardScalerModel```. Author: Yanbo Liang Closes #9839

spark git commit: [SPARK-11852][ML] StandardScaler minor refactor

Repository: spark Updated Branches: refs/heads/master a66142dec -> 9ace2e5c8 [SPARK-11852][ML] StandardScaler minor refactor ```withStd``` and ```withMean``` should be params of ```StandardScaler``` and ```StandardScalerModel```. Author: Yanbo Liang Closes #9839 from

spark git commit: [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

Repository: spark Updated Branches: refs/heads/branch-1.6 b11aa1797 -> 92d3563fd [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml jira: https://issues.apache.org/jira/browse/SPARK-11689 Add simple user guide for LDA under spark.ml and example code under examples/.

spark git commit: [SPARK-11876][SQL] Support printSchema in DataSet API

Repository: spark Updated Branches: refs/heads/master e359d5dcf -> bef361c58 [SPARK-11876][SQL] Support printSchema in DataSet API DataSet APIs look great! However, I am lost when doing multiple level joins. For example, ``` val ds1 = Seq(("a", 1), ("b", 2)).toDS().as("a") val ds2 =

spark git commit: [SPARK-11819][SQL] nice error message for missing encoder

Repository: spark Updated Branches: refs/heads/master 60bfb1133 -> 3b9d2a347 [SPARK-11819][SQL] nice error message for missing encoder before this PR, when users try to get an encoder for an un-supported class, they will only get a very simple error message like `Encoder for type xxx is not

spark git commit: [SPARK-11876][SQL] Support printSchema in DataSet API

Repository: spark Updated Branches: refs/heads/branch-1.6 92d3563fd -> 3662b9f4c [SPARK-11876][SQL] Support printSchema in DataSet API DataSet APIs look great! However, I am lost when doing multiple level joins. For example, ``` val ds1 = Seq(("a", 1), ("b", 2)).toDS().as("a") val ds2 =

spark git commit: [SPARK-11819][SQL] nice error message for missing encoder

Repository: spark Updated Branches: refs/heads/branch-1.6 119f92b4e -> ff156a3a6 [SPARK-11819][SQL] nice error message for missing encoder before this PR, when users try to get an encoder for an un-supported class, they will only get a very simple error message like `Encoder for type xxx is

spark git commit: [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL

Repository: spark Updated Branches: refs/heads/branch-1.5 6fe1ce6ab -> 9a906c1c3 [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL JIRA: https://issues.apache.org/jira/browse/SPARK-11817 Instead of return None, we should truncate the fractional seconds to

spark git commit: [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL

Repository: spark Updated Branches: refs/heads/master bef361c58 -> 60bfb1133 [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL JIRA: https://issues.apache.org/jira/browse/SPARK-11817 Instead of return None, we should truncate the fractional seconds to prevent

spark git commit: [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL

Repository: spark Updated Branches: refs/heads/branch-1.6 3662b9f4c -> 119f92b4e [SPARK-11817][SQL] Truncating the fractional seconds to prevent inserting a NULL JIRA: https://issues.apache.org/jira/browse/SPARK-11817 Instead of return None, we should truncate the fractional seconds to

spark git commit: [SPARK-11724][SQL] Change casting between int and timestamp to consistently treat int in seconds.

Repository: spark Updated Branches: refs/heads/master 652def318 -> 9ed4ad426 [SPARK-11724][SQL] Change casting between int and timestamp to consistently treat int in seconds. Hive has since changed this behavior as well. https://issues.apache.org/jira/browse/HIVE-3454 Author: Nong Li

spark git commit: [SPARK-11724][SQL] Change casting between int and timestamp to consistently treat int in seconds.

Repository: spark Updated Branches: refs/heads/branch-1.6 6fc968754 -> 9c8e17984 [SPARK-11724][SQL] Change casting between int and timestamp to consistently treat int in seconds. Hive has since changed this behavior as well. https://issues.apache.org/jira/browse/HIVE-3454 Author: Nong Li

spark git commit: [SPARK-11650] Reduce RPC timeouts to speed up slow AkkaUtilsSuite test

Repository: spark Updated Branches: refs/heads/branch-1.6 ff156a3a6 -> 6fc968754 [SPARK-11650] Reduce RPC timeouts to speed up slow AkkaUtilsSuite test This patch reduces some RPC timeouts in order to speed up the slow "AkkaUtilsSuite.remote fetch ssl on - untrusted server", which used to

spark git commit: [SPARK-11650] Reduce RPC timeouts to speed up slow AkkaUtilsSuite test

Repository: spark Updated Branches: refs/heads/master 3b9d2a347 -> 652def318 [SPARK-11650] Reduce RPC timeouts to speed up slow AkkaUtilsSuite test This patch reduces some RPC timeouts in order to speed up the slow "AkkaUtilsSuite.remote fetch ssl on - untrusted server", which used to take

spark git commit: [SPARK-11890][SQL] Fix compilation for Scala 2.11

Repository: spark Updated Branches: refs/heads/branch-1.6 7e06d51d5 -> e0bb4e09c [SPARK-11890][SQL] Fix compilation for Scala 2.11 Author: Michael Armbrust Closes #9871 from marmbrus/scala211-break. (cherry picked from commit

spark git commit: [SPARK-11890][SQL] Fix compilation for Scala 2.11

Repository: spark Updated Branches: refs/heads/master 968acf3bd -> 68ed04683 [SPARK-11890][SQL] Fix compilation for Scala 2.11 Author: Michael Armbrust Closes #9871 from marmbrus/scala211-break. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites

Repository: spark Updated Branches: refs/heads/branch-1.6 1ce6394e3 -> eab90d3f3 [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites This patch fixes an issue where the `spark.sql.TungstenAggregate.testFallbackStartsAt` SQLConf setting was not properly reset / cleared

spark git commit: [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites

Repository: spark Updated Branches: refs/heads/master 3e1d120ce -> a66142dec [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites This patch fixes an issue where the `spark.sql.TungstenAggregate.testFallbackStartsAt` SQLConf setting was not properly reset / cleared at

spark git commit: Revert "[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml"

Repository: spark Updated Branches: refs/heads/master 47815878a -> a2dce22e0 Revert "[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml" This reverts commit e359d5dcf5bd300213054ebeae9fe75c4f7eb9e7. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Revert "[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml"

Repository: spark Updated Branches: refs/heads/branch-1.6 285e4017a -> 33d856df5 Revert "[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml" This reverts commit 92d3563fd0cf0c3f4fe037b404d172125b24cf2f. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-11716][SQL] UDFRegistration just drops the input type when re-creating the UserDefinedFunction

Repository: spark Updated Branches: refs/heads/branch-1.6 fbe6888cc -> b9b0e1747 [SPARK-11716][SQL] UDFRegistration just drops the input type when re-creating the UserDefinedFunction https://issues.apache.org/jira/browse/SPARK-11716 This is one is #9739 and a regression test. When commit

spark git commit: [SPARK-11716][SQL] UDFRegistration just drops the input type when re-creating the UserDefinedFunction

Repository: spark Updated Branches: refs/heads/master 89fd9bd06 -> 03ba56d78 [SPARK-11716][SQL] UDFRegistration just drops the input type when re-creating the UserDefinedFunction https://issues.apache.org/jira/browse/SPARK-11716 This is one is #9739 and a regression test. When commit it,

spark git commit: [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly

Repository: spark Updated Branches: refs/heads/master 03ba56d78 -> a6239d587 [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly Fix use of aliases and changes uses of rdname and seealso `aliases` is the hint for `?` - it should

[2/2] spark git commit: [SPARK-11549][DOCS] Replace example code in mllib-evaluation-metrics.md using include_example

[SPARK-11549][DOCS] Replace example code in mllib-evaluation-metrics.md using include_example Author: Vikas Nelamangala Closes #9689 from vikasnp/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[1/2] spark git commit: [SPARK-11549][DOCS] Replace example code in mllib-evaluation-metrics.md using include_example

Repository: spark Updated Branches: refs/heads/master 4b84c72df -> ed47b1e66 http://git-wip-us.apache.org/repos/asf/spark/blob/ed47b1e6/examples/src/main/scala/org/apache/spark/examples/mllib/MultiLabelMetricsExample.scala --

[1/2] spark git commit: [SPARK-11549][DOCS] Replace example code in mllib-evaluation-metrics.md using include_example

Repository: spark Updated Branches: refs/heads/branch-1.6 0665fb5ea -> 1dde97176 http://git-wip-us.apache.org/repos/asf/spark/blob/1dde9717/examples/src/main/scala/org/apache/spark/examples/mllib/MultiLabelMetricsExample.scala

spark git commit: [SPARK-11889][SQL] Fix type inference for GroupedDataset.agg in REPL

Repository: spark Updated Branches: refs/heads/master 58b4e4f88 -> 968acf3bd [SPARK-11889][SQL] Fix type inference for GroupedDataset.agg in REPL In this PR I delete a method that breaks type inference for aggregators (only in the REPL) The error when this method is present is: ``` :38:

spark git commit: [SPARK-11889][SQL] Fix type inference for GroupedDataset.agg in REPL

Repository: spark Updated Branches: refs/heads/branch-1.6 7437a7f5b -> 7e06d51d5 [SPARK-11889][SQL] Fix type inference for GroupedDataset.agg in REPL In this PR I delete a method that breaks type inference for aggregators (only in the REPL) The error when this method is present is: ``` :38:

spark git commit: [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer

Repository: spark Updated Branches: refs/heads/branch-1.6 9c8e17984 -> 0c23dd52d [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer TransformFunction and TransformFunctionSerializer don't rethrow the exception, so when any exception

spark git commit: [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer

Repository: spark Updated Branches: refs/heads/branch-1.4 5118abb4e -> 94789f374 [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer TransformFunction and TransformFunctionSerializer don't rethrow the exception, so when any exception

spark git commit: [SPARK-11887] Close PersistenceEngine at the end of PersistenceEngineSuite tests

Repository: spark Updated Branches: refs/heads/master be7a2cfd9 -> 89fd9bd06 [SPARK-11887] Close PersistenceEngine at the end of PersistenceEngineSuite tests In PersistenceEngineSuite, we do not call `close()` on the PersistenceEngine at the end of the test. For the

spark git commit: [SPARK-11887] Close PersistenceEngine at the end of PersistenceEngineSuite tests

Repository: spark Updated Branches: refs/heads/branch-1.6 0c23dd52d -> fbe6888cc [SPARK-11887] Close PersistenceEngine at the end of PersistenceEngineSuite tests In PersistenceEngineSuite, we do not call `close()` on the PersistenceEngine at the end of the test. For the

spark git commit: [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer

Repository: spark Updated Branches: refs/heads/branch-1.5 9a906c1c3 -> e9ae1fda9 [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer TransformFunction and TransformFunctionSerializer don't rethrow the exception, so when any exception

spark git commit: [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer

Repository: spark Updated Branches: refs/heads/master 9ed4ad426 -> be7a2cfd9 [SPARK-11870][STREAMING][PYSPARK] Rethrow the exceptions in TransformFunction and TransformFunctionSerializer TransformFunction and TransformFunctionSerializer don't rethrow the exception, so when any exception

spark git commit: [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly

Repository: spark Updated Branches: refs/heads/branch-1.6 b9b0e1747 -> 11a11f0ff [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly Fix use of aliases and changes uses of rdname and seealso `aliases` is the hint for `?` - it

spark git commit: [SPARK-11636][SQL] Support classes defined in the REPL with Encoders

Repository: spark Updated Branches: refs/heads/branch-1.6 11a11f0ff -> 0665fb5ea [SPARK-11636][SQL] Support classes defined in the REPL with Encoders #theScaryParts (i.e. changes to the repl, executor classloaders and codegen)... Author: Michael Armbrust Author: Yin

spark git commit: [SPARK-11636][SQL] Support classes defined in the REPL with Encoders

Repository: spark Updated Branches: refs/heads/master a6239d587 -> 4b84c72df [SPARK-11636][SQL] Support classes defined in the REPL with Encoders #theScaryParts (i.e. changes to the repl, executor classloaders and codegen)... Author: Michael Armbrust Author: Yin Huai

spark git commit: [SPARK-11787][SPARK-11883][SQL][FOLLOW-UP] Cleanup for this patch.

Repository: spark Updated Branches: refs/heads/master ed47b1e66 -> 58b4e4f88 [SPARK-11787][SPARK-11883][SQL][FOLLOW-UP] Cleanup for this patch. This mainly moves SqlNewHadoopRDD to the sql package. There is some state that is shared between core and I've left that in core. This allows some

spark git commit: [SPARK-11787][SPARK-11883][SQL][FOLLOW-UP] Cleanup for this patch.

Repository: spark Updated Branches: refs/heads/branch-1.6 1dde97176 -> 7437a7f5b [SPARK-11787][SPARK-11883][SQL][FOLLOW-UP] Cleanup for this patch. This mainly moves SqlNewHadoopRDD to the sql package. There is some state that is shared between core and I've left that in core. This allows

[1/2] spark git commit: Preparing Spark release v1.6.0-preview1

Repository: spark Updated Branches: refs/heads/branch-1.6 e0bb4e09c -> d409afdbc Preparing Spark release v1.6.0-preview1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7582425d Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.6.0-preview1 [created] 7582425d1 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.6.0-SNAPSHOT

Preparing development version 1.6.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d409afdb Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d409afdb Diff:

spark git commit: [HOTFIX] Fix Java Dataset Tests

Repository: spark Updated Branches: refs/heads/master 68ed04683 -> 47815878a [HOTFIX] Fix Java Dataset Tests Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/47815878 Tree:

spark git commit: [SPARK-11819][SQL][FOLLOW-UP] fix scala 2.11 build

Repository: spark Updated Branches: refs/heads/master a2dce22e0 -> 7d3f922c4 [SPARK-11819][SQL][FOLLOW-UP] fix scala 2.11 build seems scala 2.11 doesn't support: define private methods in `trait xxx` and use it in `object xxx extend xxx`. Author: Wenchen Fan Closes