spark git commit: [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 011b07e23 -> 9d6475b93 [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists cc yhuai Author: Davies Liu Closes #6558 from davies/decimalType and squashes the following commits: c877ca8 [Davies Liu] Update Parq

spark git commit: [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0221c7f0e -> bcb47ad77 [SPARK-6917] [SQL] DecimalType is not read back when non-native type exists cc yhuai Author: Davies Liu Closes #6558 from davies/decimalType and squashes the following commits: c877ca8 [Davies Liu] Update ParquetC

spark git commit: [SPARK-7582] [MLLIB] user guide for StringIndexer

2015-06-01 Thread meng
Repository: spark Updated Branches: refs/heads/master b53a01164 -> 0221c7f0e [SPARK-7582] [MLLIB] user guide for StringIndexer This PR adds a Java unit test and user guide for `StringIndexer`. I put it before `OneHotEncoder` because they are closely related. jkbradley Author: Xiangrui Meng

spark git commit: [SPARK-7582] [MLLIB] user guide for StringIndexer

2015-06-01 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 575f3b3aa -> 011b07e23 [SPARK-7582] [MLLIB] user guide for StringIndexer This PR adds a Java unit test and user guide for `StringIndexer`. I put it before `OneHotEncoder` because they are closely related. jkbradley Author: Xiangrui Me

spark git commit: Fixed typo in the previous commit.

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 e6d58955c -> 575f3b3aa Fixed typo in the previous commit. (cherry picked from commit b53a0116473a03607c5be3e4135151b4932acc06) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-w

spark git commit: Fixed typo in the previous commit.

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master e797dba58 -> b53a01164 Fixed typo in the previous commit. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b53a0116 Tree: http://git-wip-us.apache.org/repos/asf/spark/tr

spark git commit: [SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multiple window expressions and make parser match window frames in case insensitive way

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 0d21a41be -> e6d58955c [SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multiple window expressions and make parser match window frames in case insensitive way JIRAs: https://issues.apache.org/jira/browse/SPARK-7965 https:

spark git commit: [SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multiple window expressions and make parser match window frames in case insensitive way

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7f74bb3bc -> e797dba58 [SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multiple window expressions and make parser match window frames in case insensitive way JIRAs: https://issues.apache.org/jira/browse/SPARK-7965 https://is

spark git commit: [SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 3af4c0b4e -> 0d21a41be [SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated Streaming methods Scala `deprecated` annotation actually doesn't show up in JavaDoc. Author: zsxwing Closes #6564 from zsxwing/SPARK-8025 and

spark git commit: [SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated Streaming methods

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 75dda33f3 -> 7f74bb3bc [SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated Streaming methods Scala `deprecated` annotation actually doesn't show up in JavaDoc. Author: zsxwing Closes #6564 from zsxwing/SPARK-8025 and squ

spark git commit: Revert "[SPARK-8020] Spark SQL in spark-defaults.conf make metadataHive get constructed too early"

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 91f6be87b -> 75dda33f3 Revert "[SPARK-8020] Spark SQL in spark-defaults.conf make metadataHive get constructed too early" This reverts commit 91f6be87bc5cff41ca7a9cca9fdcc4678a4e7086. Project: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-8020] Spark SQL in spark-defaults.conf make metadataHive get constructed too early

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4c868b994 -> 91f6be87b [SPARK-8020] Spark SQL in spark-defaults.conf make metadataHive get constructed too early https://issues.apache.org/jira/browse/SPARK-8020 Author: Yin Huai Closes #6563 from yhuai/SPARK-8020 and squashes the follo

spark git commit: [minor doc] Add exploratory data analysis warning for DataFrame.stat.freqItem API

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master cae9306c4 -> 4c868b994 [minor doc] Add exploratory data analysis warning for DataFrame.stat.freqItem API Author: Reynold Xin Closes #6569 from rxin/freqItemsWarning and squashes the following commits: 7eec145 [Reynold Xin] [minor doc] A

spark git commit: [minor doc] Add exploratory data analysis warning for DataFrame.stat.freqItem API

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 d542a35ad -> 3af4c0b4e [minor doc] Add exploratory data analysis warning for DataFrame.stat.freqItem API Author: Reynold Xin Closes #6569 from rxin/freqItemsWarning and squashes the following commits: 7eec145 [Reynold Xin] [minor do

spark git commit: [SPARK-8027] [SPARKR] Add maven profile to build R package docs

2015-06-01 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.4 8ac23762e -> d542a35ad [SPARK-8027] [SPARKR] Add maven profile to build R package docs Also use that profile in create-release.sh cc pwendell -- Note that this means that we need `knitr` and `roxygen` installed on the machines used fo

spark git commit: [SPARK-8027] [SPARKR] Add maven profile to build R package docs

2015-06-01 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 89f642a0e -> cae9306c4 [SPARK-8027] [SPARKR] Add maven profile to build R package docs Also use that profile in create-release.sh cc pwendell -- Note that this means that we need `knitr` and `roxygen` installed on the machines used for bu

spark git commit: [SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6396cc030 -> 89f642a0e [SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API Author: Reynold Xin Closes #6565 from rxin/alias and squashes the following commits: 286d880 [Reynold Xin] [SPARK-8026][SQL] Add Column.alias to Scala/

spark git commit: [SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 efc0e0532 -> 8ac23762e [SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API Author: Reynold Xin Closes #6565 from rxin/alias and squashes the following commits: 286d880 [Reynold Xin] [SPARK-8026][SQL] Add Column.alias to Sc

spark git commit: [SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of null for pairs that don't appear

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6b44278ef -> 6396cc030 [SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of null for pairs that don't appear Author: Reynold Xin Closes #6566 from rxin/crosstab and squashes the following commits: e0ace1c [Reynold Xin] [SPA

spark git commit: [SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of null for pairs that don't appear

2015-06-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 cbfb682ab -> efc0e0532 [SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of null for pairs that don't appear Author: Reynold Xin Closes #6566 from rxin/crosstab and squashes the following commits: e0ace1c [Reynold Xin]

spark git commit: [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR

2015-06-01 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 15d7c90ae -> 6b44278ef [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared while using `--packages` or `--jars` cc pwendell davies brkyvz Author: Shivaram Venkataraman Closes #6

spark git commit: [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR

2015-06-01 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.4 f5a9833f3 -> cbfb682ab [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared while using `--packages` or `--jars` cc pwendell davies brkyvz Author: Shivaram Venkataraman Close

spark git commit: [MINOR] [UI] Improve error message on log page

2015-06-01 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 a7c8b00b7 -> f5a9833f3 [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [MINOR] [UI] Improve error message on log page

2015-06-01 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 2f9c7519d -> 15d7c90ae [MINOR] [UI] Improve error message on log page Currently if a bad log type if specified, then we get blank. We should provide a more informative error message. Project: http://git-wip-us.apache.org/repos/asf/spark/r

spark git commit: [SPARK-7958] [STREAMING] Handled exception in StreamingContext.start() to prevent leaking of actors

2015-06-01 Thread tdas
Repository: spark Updated Branches: refs/heads/master 90c606925 -> 2f9c7519d [SPARK-7958] [STREAMING] Handled exception in StreamingContext.start() to prevent leaking of actors StreamingContext.start() can throw exception because DStream.validateAtStart() fails (say, checkpoint directory not

spark git commit: [SPARK-7958] [STREAMING] Handled exception in StreamingContext.start() to prevent leaking of actors

2015-06-01 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.4 a76c2e128 -> a7c8b00b7 [SPARK-7958] [STREAMING] Handled exception in StreamingContext.start() to prevent leaking of actors StreamingContext.start() can throw exception because DStream.validateAtStart() fails (say, checkpoint directory

[1/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

2015-06-01 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.4 4cafc6352 -> a76c2e128 http://git-wip-us.apache.org/repos/asf/spark/blob/a76c2e12/python/pyspark/sql/types.py -- diff --git a/python/pyspark/sql/types.py b/python/pyspar

[2/2] spark git commit: [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict

2015-06-01 Thread davies
[SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict This PR makes the types module in `pyspark/sql/types` work with pylint static analysis by removing the dynamic naming of the `pyspark/sql/_types` module to `pyspark/sql/types`. Tests are now loaded using `$PYSPARK_DRIVER_PYTH

spark git commit: [SPARK-7584] [MLLIB] User guide for VectorAssembler

2015-06-01 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 d023300f4 -> 4cafc6352 [SPARK-7584] [MLLIB] User guide for VectorAssembler This PR adds a section in the user guide for `VectorAssembler` with code examples in Python/Java/Scala. It also adds a unit test in Java. jkbradley Author: Xi

spark git commit: [SPARK-7584] [MLLIB] User guide for VectorAssembler

2015-06-01 Thread meng
Repository: spark Updated Branches: refs/heads/master b7ab0299b -> 90c606925 [SPARK-7584] [MLLIB] User guide for VectorAssembler This PR adds a section in the user guide for `VectorAssembler` with code examples in Python/Java/Scala. It also adds a unit test in Java. jkbradley Author: Xiangr

spark git commit: [SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests

2015-06-01 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.4 2f41cf3e2 -> d023300f4 [SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests Increase the duration and timeout in streaming python tests. Author: Davies Liu Closes #6239 from davies/flaky_tests and squashes the following commi

spark git commit: [SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests

2015-06-01 Thread tdas
Repository: spark Updated Branches: refs/heads/master e7c7e51f2 -> b7ab0299b [SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests Increase the duration and timeout in streaming python tests. Author: Davies Liu Closes #6239 from davies/flaky_tests and squashes the following commits:

spark git commit: [DOC] Minor modification to Streaming docs with regards to parallel data receiving

2015-06-01 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 78a6723e8 -> 2f41cf3e2 [DOC] Minor modification to Streaming docs with regards to parallel data receiving pwendell tdas Author: Nishkam Ravi Author: nishkamravi2 Author: nravi Closes #6544 from nishkamravi2/master_nravi and squash

spark git commit: [DOC] Minor modification to Streaming docs with regards to parallel data receiving

2015-06-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3c0156899 -> e7c7e51f2 [DOC] Minor modification to Streaming docs with regards to parallel data receiving pwendell tdas Author: Nishkam Ravi Author: nishkamravi2 Author: nravi Closes #6544 from nishkamravi2/master_nravi and squashes t