spark git commit: [SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 adfc9d1fa -> 0d093d6e7 [SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD Author: Cheng Lian Closes #6529 from liancheng/schemardd-deprecation-fix and squashes the following commits: 49765c2 [Cheng Lian] Adds @deprecated Sc

spark git commit: [SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 084fef76e -> 8764dcceb [SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD Author: Cheng Lian Closes #6529 from liancheng/schemardd-deprecation-fix and squashes the following commits: 49765c2 [Cheng Lian] Adds @deprecated Scalad

spark git commit: [SPARK-7976] Add style checker to disallow overriding finalize.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 5e268d395 -> adfc9d1fa [SPARK-7976] Add style checker to disallow overriding finalize. Author: Reynold Xin Closes #6528 from rxin/style-finalizer and squashes the following commits: a2211ca [Reynold Xin] [SPARK-7976] Enable NoFinaliz

spark git commit: [SPARK-7976] Add style checker to disallow overriding finalize.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master f7fe9e474 -> 084fef76e [SPARK-7976] Add style checker to disallow overriding finalize. Author: Reynold Xin Closes #6528 from rxin/style-finalizer and squashes the following commits: a2211ca [Reynold Xin] [SPARK-7976] Enable NoFinalizeChe

spark git commit: [SQL] [MINOR] Fixes a minor comment mistake in IsolatedClientLoader

2015-05-30 Thread lian
Repository: spark Updated Branches: refs/heads/master 00a713790 -> f7fe9e474 [SQL] [MINOR] Fixes a minor comment mistake in IsolatedClientLoader Author: Cheng Lian Closes #6521 from liancheng/classloader-comment-fix and squashes the following commits: fc09606 [Cheng Lian] Addresses @srowen

spark git commit: Update documentation for the new DataFrame reader/writer interface.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master c63e1a742 -> 00a713790 Update documentation for the new DataFrame reader/writer interface. Author: Reynold Xin Closes #6522 from rxin/sql-doc-1.4 and squashes the following commits: c227be7 [Reynold Xin] Updated link. 040b6d7 [Reynold Xi

spark git commit: Update documentation for the new DataFrame reader/writer interface.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 e74ea7827 -> 5e268d395 Update documentation for the new DataFrame reader/writer interface. Author: Reynold Xin Closes #6522 from rxin/sql-doc-1.4 and squashes the following commits: c227be7 [Reynold Xin] Updated link. 040b6d7 [Reynol

spark git commit: [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methods

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 dc58e688a -> e74ea7827 [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methods Scala deprecated annotation actually doesn't show up in JavaDoc. Author: Reynold Xin Closes #6523 from rxin/df-deprecated-javadoc and

spark git commit: [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methods

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 14b314dc2 -> c63e1a742 [SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame methods Scala deprecated annotation actually doesn't show up in JavaDoc. Author: Reynold Xin Closes #6523 from rxin/df-deprecated-javadoc and squa

spark git commit: [SQL] Tighten up visibility for JavaDoc.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 a60b8bf32 -> dc58e688a [SQL] Tighten up visibility for JavaDoc. I went through all the JavaDocs and tightened up visibility. Author: Reynold Xin Closes #6526 from rxin/sql-1.4-visibility-for-docs and squashes the following commits:

spark git commit: [SQL] Tighten up visibility for JavaDoc.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2b258e1c0 -> 14b314dc2 [SQL] Tighten up visibility for JavaDoc. I went through all the JavaDocs and tightened up visibility. Author: Reynold Xin Closes #6526 from rxin/sql-1.4-visibility-for-docs and squashes the following commits: bc3

spark git commit: [SPARK-5610] [DOC] update genjavadocSettings to use the patched version of genjavadoc

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 df56309b0 -> a60b8bf32 [SPARK-5610] [DOC] update genjavadocSettings to use the patched version of genjavadoc This PR updates `genjavadocSettings` to use a patched version of `genjavadoc-plugin` that hides package private classes/metho

spark git commit: [SPARK-5610] [DOC] update genjavadocSettings to use the patched version of genjavadoc

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 66a53a696 -> 2b258e1c0 [SPARK-5610] [DOC] update genjavadocSettings to use the patched version of genjavadoc This PR updates `genjavadocSettings` to use a patched version of `genjavadoc-plugin` that hides package private classes/methods/i

spark git commit: [HOTFIX] Replace FunSuite with SparkFunSuite.

2015-05-30 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 1281a3518 -> 66a53a696 [HOTFIX] Replace FunSuite with SparkFunSuite. This fixes a build break introduced by merging a6430028ecd7a6130f1eb15af9ec00e242c46725, which fails the new style checks that ensure that we use SparkFunSuite instead of

spark git commit: [SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Related Documentation Example).

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 1617363fb -> 1281a3518 [SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Related Documentation Example). The MLlib ChiSqSelector class is not serializable, and so the example in the ChiSqSelector documentation fails. Also,

spark git commit: [SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Related Documentation Example).

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 2790bb035 -> df56309b0 [SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Related Documentation Example). The MLlib ChiSqSelector class is not serializable, and so the example in the ChiSqSelector documentation fails. A

spark git commit: [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 6d7cf5382 -> 2790bb035 [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature Check then make the MLlib Python evaluation and feature doc to be as complete as the Scala doc. Author: Yanbo Liang Closes #6461 fr

spark git commit: [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master a6430028e -> 1617363fb [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature Check then make the MLlib Python evaluation and feature doc to be as complete as the Scala doc. Author: Yanbo Liang Closes #6461 from y

spark git commit: [SPARK-7855] Move bypassMergeSort-handling from ExternalSorter to own component

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7716a5a1e -> a6430028e [SPARK-7855] Move bypassMergeSort-handling from ExternalSorter to own component Spark's `ExternalSorter` writes shuffle output files during sort-based shuffle. Sort-shuffle contains a configuration, `spark.shuffle.s

spark git commit: Updated SQL programming guide's Hive connectivity section.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6e3f0c781 -> 7716a5a1e Updated SQL programming guide's Hive connectivity section. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7716a5a1 Tree: http://git-wip-us.apach

spark git commit: Updated SQL programming guide's Hive connectivity section.

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 b2b760147 -> 6d7cf5382 Updated SQL programming guide's Hive connectivity section. (cherry picked from commit 7716a5a1ec8ff8dc24e0146f8ead2f51da6512ad) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/r

spark git commit: [SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 e7ba3ea86 -> b2b760147 [SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4 Author: Cheng Lian Closes #6520 from liancheng/spark-7849 and squashes the following commits: 705264b [Cheng Lian] Updates SQL programming guide f

spark git commit: [SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master d34b43bd5 -> 6e3f0c781 [SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4 Author: Cheng Lian Closes #6520 from liancheng/spark-7849 and squashes the following commits: 705264b [Cheng Lian] Updates SQL programming guide for 1

spark git commit: Closes #4685

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3ab71eb9d -> d34b43bd5 Closes #4685 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d34b43bd Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d34b43bd Diff: http

spark git commit: [DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 d6e9eade6 -> e7ba3ea86 [DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6 Updated the doc for the hadoop-2.6 profile, which is new to Spark 1.4 Author: Taka Shinagawa Closes #6450 from mrt/docfix2 and squashes the fo

spark git commit: [DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2b35c99c7 -> 3ab71eb9d [DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6 Updated the doc for the hadoop-2.6 profile, which is new to Spark 1.4 Author: Taka Shinagawa Closes #6450 from mrt/docfix2 and squashes the follow

spark git commit: [SPARK-7717] [WEBUI] Only showing total memory and cores for alive workers

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9d8aadb72 -> 2b35c99c7 [SPARK-7717] [WEBUI] Only showing total memory and cores for alive workers Author: zhichao.li Closes #6317 from zhichao-li/workers and squashes the following commits: d68bf11 [zhichao.li] change prefix 99b6768 [zhi

spark git commit: [SPARK-7945] [CORE] Do trim to values in properties file

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 8c8de3ed8 -> 9d8aadb72 [SPARK-7945] [CORE] Do trim to values in properties file https://issues.apache.org/jira/browse/SPARK-7945 Now applications submited by org.apache.spark.launcher.Main read properties file without doing trim to values

spark git commit: [SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0978aec9c -> 8c8de3ed8 [SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka Remove caveat about Kafka / JDBC not being supported for Scala 2.11 Author: Sean Owen Closes #6470 from srowen/SPARK-7890 and squashes the following c

spark git commit: [SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka

2015-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 2c45009da -> d6e9eade6 [SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka Remove caveat about Kafka / JDBC not being supported for Scala 2.11 Author: Sean Owen Closes #6470 from srowen/SPARK-7890 and squashes the followi

spark git commit: [SPARK-7964][SQL] remove unnecessary type coercion rule

2015-05-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master e3a437483 -> 0978aec9c [SPARK-7964][SQL] remove unnecessary type coercion rule We have defined these logics in `Cast` already, I think we should remove this rule. Author: Wenchen Fan Closes #6516 from cloud-fan/tmp2 and squashes the fol

spark git commit: [SPARK-7459] [MLLIB] ElementwiseProduct Java example

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 8938a7489 -> 2c45009da [SPARK-7459] [MLLIB] ElementwiseProduct Java example Author: Octavian Geagla Closes #6008 from ogeagla/elementwise-prod-doc and squashes the following commits: 72e6dc0 [Octavian Geagla] [SPARK-7459] [MLLIB] Ja

spark git commit: [SPARK-7459] [MLLIB] ElementwiseProduct Java example

2015-05-30 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 78657d53d -> e3a437483 [SPARK-7459] [MLLIB] ElementwiseProduct Java example Author: Octavian Geagla Closes #6008 from ogeagla/elementwise-prod-doc and squashes the following commits: 72e6dc0 [Octavian Geagla] [SPARK-7459] [MLLIB] Java e