spark git commit: [SPARK-14498][ML][PYTHON][SQL] Many cleanups to ML and ML-related docs

2016-04-08 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 813e96e6f -> d7af736b2 [SPARK-14498][ML][PYTHON][SQL] Many cleanups to ML and ML-related docs ## What changes were proposed in this pull request? Cleanups to documentation. No changes to code. * GBT docs: Move Scala doc for private

spark git commit: [SPARK-14454] Better exception handling while marking tasks as failed

2016-04-08 Thread davies
Repository: spark Updated Branches: refs/heads/master 4d7c35926 -> 813e96e6f [SPARK-14454] Better exception handling while marking tasks as failed ## What changes were proposed in this pull request? This patch adds support for better handling of exceptions inside catch blocks if the code

spark git commit: [SPARK-14437][CORE] Use the address that NettyBlockTransferService listens to create BlockManagerId

2016-04-08 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 906eef4c7 -> 4d7c35926 [SPARK-14437][CORE] Use the address that NettyBlockTransferService listens to create BlockManagerId ## What changes were proposed in this pull request? Here is why SPARK-14437 happens: BlockManagerId is created

spark git commit: [SPARK-11416][BUILD] Update to Chill 0.8.0 & Kryo 3.0.3

2016-04-08 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 464a3c1e0 -> 906eef4c7 [SPARK-11416][BUILD] Update to Chill 0.8.0 & Kryo 3.0.3 This patch upgrades Chill to 0.8.0 and Kryo to 3.0.3. While we'll likely need to bump these dependencies again before Spark 2.0 (due to SPARK-14221 /

spark git commit: [SPARK-14435][BUILD] Shade Kryo in our custom Hive 1.2.1 fork

2016-04-08 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master f8c9beca3 -> 464a3c1e0 [SPARK-14435][BUILD] Shade Kryo in our custom Hive 1.2.1 fork This patch updates our custom Hive 1.2.1 fork in order to shade Kryo in Hive. This is a blocker for upgrading Spark to use Kryo 3 (see #12076). The

spark git commit: [SPARK-14394][SQL] Generate AggregateHashMap class for LongTypes during TungstenAggregate codegen

2016-04-08 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 02757535b -> f8c9beca3 [SPARK-14394][SQL] Generate AggregateHashMap class for LongTypes during TungstenAggregate codegen ## What changes were proposed in this pull request? This PR adds support for generating the `AggregateHashMap` class

spark git commit: [SPARK-14448] Improvements to ColumnVector

2016-04-08 Thread davies
Repository: spark Updated Branches: refs/heads/master 56af8e85c -> 02757535b [SPARK-14448] Improvements to ColumnVector ## What changes were proposed in this pull request? In this PR, two changes are proposed for ColumnVector : 1. ColumnVector should be declared as implementing AutoCloseable

spark git commit: [SPARK-14298][ML][MLLIB] LDA should support disable checkpoint

2016-04-08 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 94ac58b2a -> 56af8e85c [SPARK-14298][ML][MLLIB] LDA should support disable checkpoint ## What changes were proposed in this pull request? In the doc of

spark git commit: [BUILD][HOTFIX] Download Maven from regular mirror network rather than archive.apache.org

2016-04-08 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master e0ad75f2b -> 94ac58b2a [BUILD][HOTFIX] Download Maven from regular mirror network rather than archive.apache.org [archive.apache.org](https://archive.apache.org/) is undergoing maintenance, breaking our `build/mvn` script: > We are in

spark git commit: [SPARK-12569][PYSPARK][ML] DecisionTreeRegressor: provide variance of prediction: Python API

2016-04-08 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master e5d8d6e09 -> e0ad75f2b [SPARK-12569][PYSPARK][ML] DecisionTreeRegressor: provide variance of prediction: Python API ## What changes were proposed in this pull request? A new column VarianceCol has been added to DecisionTreeRegressor in

spark git commit: [SPARK-14373][PYSPARK] PySpark RandomForestClassifier, Regressor support export/import

2016-04-08 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master a9b630f42 -> e5d8d6e09 [SPARK-14373][PYSPARK] PySpark RandomForestClassifier, Regressor support export/import ## What changes were proposed in this pull request? supporting `RandomForest{Classifier, Regressor}` save/load for Python API.

spark git commit: [SPARK-14477][BUILD] Allow custom mirrors for downloading artifacts in build/mvn

2016-04-08 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 583b5e053 -> a9b630f42 [SPARK-14477][BUILD] Allow custom mirrors for downloading artifacts in build/mvn ## What changes were proposed in this pull request? Allows to override locations for downloading Apache and Typesafe artifacts in

spark git commit: [SPARK-14470] Allow for overriding both httpclient and httpcore versions

2016-04-08 Thread srowen
Repository: spark Updated Branches: refs/heads/master 644709801 -> 583b5e053 [SPARK-14470] Allow for overriding both httpclient and httpcore versions ## What changes were proposed in this pull request? This splits commons.httpclient.version from commons.httpcore.version, since these two

spark git commit: [SPARK-14402][HOTFIX] Fix ExpressionDescription annotation

2016-04-08 Thread srowen
Repository: spark Updated Branches: refs/heads/master 73b56a3c6 -> 644709801 [SPARK-14402][HOTFIX] Fix ExpressionDescription annotation ## What changes were proposed in this pull request? Fix for the error introduced in

spark git commit: [SPARK-14189][SQL] JSON data sources find compatible types even if inferred decimal type is not capable of the others

2016-04-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 725b860e2 -> 73b56a3c6 [SPARK-14189][SQL] JSON data sources find compatible types even if inferred decimal type is not capable of the others ## What changes were proposed in this pull request?