spark git commit: [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package

2016-08-16 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 45036327f -> 2e2c787bf [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package ## What changes were proposed in this pull request? This PR is a small follow-up to https://github.com/apache/spark/pull/14554. This also wi

spark git commit: [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package

2016-08-16 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7b65030e7 -> 8fdc6ce40 [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package ## What changes were proposed in this pull request? This PR is a small follow-up to https://github.com/apache/spark/pull/14554. This also widens

spark git commit: [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists

2016-08-13 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 a21ecc996 -> 750f88045 [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists ## What changes were proposed in this pull request? Don't override app name specified in `SparkConf` with a random app name. On

spark git commit: [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists

2016-08-13 Thread rxin
Repository: spark Updated Branches: refs/heads/master 67f025d90 -> cdaa562c9 [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists ## What changes were proposed in this pull request? Don't override app name specified in `SparkConf` with a random app name. Only

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master abff92bfd -> 00e103a6e [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary minus

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

2016-08-12 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 b4047fc21 -> bde94cd71 [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary mi

spark git commit: [SPARK-17018][SQL] literals.sql for testing literal parsing

2016-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 6bf20cd94 -> bc683f037 [SPARK-17018][SQL] literals.sql for testing literal parsing ## What changes were proposed in this pull request? This patch adds literals.sql for testing literal parsing end-to-end in SQL. ## How was this patch te

spark git commit: [SPARK-17018][SQL] literals.sql for testing literal parsing

2016-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master acaf2a81a -> cf9367826 [SPARK-17018][SQL] literals.sql for testing literal parsing ## What changes were proposed in this pull request? This patch adds literals.sql for testing literal parsing end-to-end in SQL. ## How was this patch tested

spark git commit: [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests

2016-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 33a213f33 -> 6bf20cd94 [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests This patch adds three test files: 1. arithmetic.sql.out 2. order-by-ordinal.sql 3. group-by-ordinal.sql This includes https://github.com/apache/sp

spark git commit: [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests

2016-08-11 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0db373aaf -> a7b02db45 [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests ## What changes were proposed in this pull request? This patch adds three test files: 1. arithmetic.sql.out 2. order-by-ordinal.sql 3. group-by-ordinal

spark git commit: [SPARK-17011][SQL] Support testing exceptions in SQLQueryTestSuite

2016-08-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7a6a3c3fb -> 0db373aaf [SPARK-17011][SQL] Support testing exceptions in SQLQueryTestSuite ## What changes were proposed in this pull request? This patch adds exception testing to SQLQueryTestSuite. When there is an exception in query execu

spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document

2016-08-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 665e17532 -> 7a6a3c3fb [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review Aut

spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document

2016-08-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 d3a30d2f0 -> 1e4013571 [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review

spark git commit: [SPARK-17007][SQL] Move test data files into a test-data folder

2016-08-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 425c7c2db -> 665e17532 [SPARK-17007][SQL] Move test data files into a test-data folder ## What changes were proposed in this pull request? This patch moves all the test data files in sql/core/src/test/resources to sql/core/src/test/resourc

spark git commit: [SPARK-17008][SPARK-17009][SQL] Normalization and isolation in SQLQueryTestSuite.

2016-08-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master ab648c000 -> 425c7c2db [SPARK-17008][SPARK-17009][SQL] Normalization and isolation in SQLQueryTestSuite. ## What changes were proposed in this pull request? This patch enhances SQLQueryTestSuite in two ways: 1. SPARK-17009: Use a new Spar

spark git commit: Fixed typo

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master 121643bc7 -> 9dc3e602d Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz Closes #14569 from jupblb/ty

spark git commit: Fixed typo

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 2d136dba4 -> 475ee3815 Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz Closes #14569 from jupbl

spark git commit: Make logDir easily copy/paste-able

2016-08-09 Thread rxin
Repository: spark Updated Branches: refs/heads/master b89b3a5c8 -> 121643bc7 Make logDir easily copy/paste-able In many terminals double-clicking and dragging also includes the trailing period. Simply remove this to make the value more easily copy/pasteable. Example value: `hdfs://mybox-123

spark git commit: [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug

2016-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 6fc54b776 -> 601c649d0 [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug ## What changes were proposed in this pull request? Add a constant iterator which point to head of result. The header will be used to reset iterato

spark git commit: [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug

2016-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master bca43cd63 -> e17a76efd [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug ## What changes were proposed in this pull request? Add a constant iterator which point to head of result. The header will be used to reset iterator wh

spark git commit: Update docs to include SASL support for RPC

2016-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 9748a2928 -> 6fc54b776 Update docs to include SASL support for RPC ## What changes were proposed in this pull request? Update docs to include SASL support for RPC Evidence: https://github.com/apache/spark/blob/master/core/src/main/sc

spark git commit: Update docs to include SASL support for RPC

2016-08-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9216901d5 -> 53d1c7877 Update docs to include SASL support for RPC ## What changes were proposed in this pull request? Update docs to include SASL support for RPC Evidence: https://github.com/apache/spark/blob/master/core/src/main/scala/

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.6 52d8837c6 -> d2518acc1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO collecti

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 bb30a3d0f -> 11854e5a1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO collecti

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master c5eb1df72 -> 583d91a19 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO collection.E

spark git commit: [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master e9fc0b6a8 -> b73a57060 [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState ### What changes were proposed in this pull request? This PR is to remove `TestHiveSharedState`. Also, this is also associated with the Hive refractoring for re

spark git commit: [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master cbdff4935 -> a9beeaaae [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala ## What changes were proposed in this pull request? `Greatest` and `Least` are not conditional expressions, but arithm

spark git commit: [SPARK-16850][SQL] Improve type checking error message for greatest/least

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 a937c9ee4 -> f190bb83b [SPARK-16850][SQL] Improve type checking error message for greatest/least Greatest/least function does not have the most friendly error message for data types. This patch improves the error message to not show th

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/master 146001a9f -> 2330f3ecb [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP` func

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

2016-08-02 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 ef7927e8e -> a937c9ee4 [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP`

spark git commit: [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive.

2016-08-01 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2eedc00b0 -> 5184df06b [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive. ## What changes were proposed in this pull request? With SPARK-15034, we could use the value of spark.sql.warehouse.dir to set the warehous

spark git commit: [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions

2016-08-01 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 1813bbd9b -> 5fbf5f93e [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions https://github.com/apache/spark/pull/14425 rebased for branch-2.0 Author: Eric Liang Closes #14427 from ericl/spark-16818

spark git commit: [SPARK-16813][SQL] Remove private[sql] and private[spark] from catalyst package

2016-07-31 Thread rxin
ate[spark]. It simply makes debugging harder when Spark developers need to inspect the plans at runtime. This patch removes all private[sql] and private[spark] visibility modifiers in org.apache.spark.sql.catalyst. N/A - just visibility changes. Author: Reynold Xin Closes #14418 from rxin/SPARK-16

spark git commit: [SPARK-16812] Open up SparkILoop.getAddedJars

2016-07-30 Thread rxin
ars added. ## How was this patch tested? N/A - this is a simple visibility change. Author: Reynold Xin Closes #14417 from rxin/SPARK-16812. (cherry picked from commit 7c27d075c39ebaf3e762284e2536fe7be0e3da87) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/r

spark git commit: [SPARK-16812] Open up SparkILoop.getAddedJars

2016-07-30 Thread rxin
ars added. ## How was this patch tested? N/A - this is a simple visibility change. Author: Reynold Xin Closes #14417 from rxin/SPARK-16812. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7c27d075 Tree: http://git-wip-us.apache.

spark git commit: [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions

2016-07-30 Thread rxin
may not be uniquely identifying. cc rxin ## How was this patch tested? Unit tests. Author: Eric Liang Closes #14425 from ericl/spark-16818. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/957a8ab3 Tree: http://git-

spark git commit: [SPARK-16772][PYTHON][DOCS] Restore "datatype string" to Python API docstrings

2016-07-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2c15323ad -> 2182e4322 [SPARK-16772][PYTHON][DOCS] Restore "datatype string" to Python API docstrings ## What changes were proposed in this pull request? This PR corrects [an error made in an earlier PR](https://github.com/apache/spark/pu

spark git commit: [SPARK-16772] Correct API doc references to PySpark classes + formatting fixes

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3fd39b87b -> 274f3b9ec [SPARK-16772] Correct API doc references to PySpark classes + formatting fixes ## What's Been Changed The PR corrects several broken or missing class references in the Python API docs. It also correct formatting pro

spark git commit: [SPARK-16772] Correct API doc references to PySpark classes + formatting fixes

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 fb09a693d -> 5cd79c396 [SPARK-16772] Correct API doc references to PySpark classes + formatting fixes ## What's Been Changed The PR corrects several broken or missing class references in the Python API docs. It also correct formatting

spark git commit: [SPARK-16764][SQL] Recommend disabling vectorized parquet reader on OutOfMemoryError

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 f46a07451 -> fb09a693d [SPARK-16764][SQL] Recommend disabling vectorized parquet reader on OutOfMemoryError ## What changes were proposed in this pull request? We currently don't bound or manage the data array size used by column vect

spark git commit: [SPARK-16764][SQL] Recommend disabling vectorized parquet reader on OutOfMemoryError

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1178d61ed -> 3fd39b87b [SPARK-16764][SQL] Recommend disabling vectorized parquet reader on OutOfMemoryError ## What changes were proposed in this pull request? We currently don't bound or manage the data array size used by column vectors

spark git commit: [SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowMap

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 825c83717 -> f46a07451 [SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowMap Avoid overflow of Long type causing a NegativeArraySizeException a few lines later. Unit tests for HashedRelationSuite still pass. I can confirm the py

spark git commit: [SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowMap

2016-07-28 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9ade77c3f -> 1178d61ed [SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowMap ## What changes were proposed in this pull request? Avoid overflow of Long type causing a NegativeArraySizeException a few lines later. ## How was this pat

spark git commit: [SPARK-15232][SQL] Add subquery SQL building tests to LogicalPlanToSQLSuite

2016-07-27 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 2d56a2136 -> 0fd2dfb6d [SPARK-15232][SQL] Add subquery SQL building tests to LogicalPlanToSQLSuite ## What changes were proposed in this pull request? We currently test subquery SQL building using the `HiveCompatibilitySuite`. The is

spark git commit: [SPARK-15232][SQL] Add subquery SQL building tests to LogicalPlanToSQLSuite

2016-07-27 Thread rxin
Repository: spark Updated Branches: refs/heads/master 11d427c92 -> 5c2ae79bf [SPARK-15232][SQL] Add subquery SQL building tests to LogicalPlanToSQLSuite ## What changes were proposed in this pull request? We currently test subquery SQL building using the `HiveCompatibilitySuite`. The is not

spark-website git commit: Added "Support launching multiple mesos executors in coarse grained mesos mode" to the release notes

2016-07-27 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 62155dfa6 -> 65ec30e24 Added "Support launching multiple mesos executors in coarse grained mesos mode" to the release notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/

spark git commit: [MINOR][DOC] missing keyword new

2016-07-27 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 8bc2877d8 -> 2f4e06e38 [MINOR][DOC] missing keyword new ## What changes were proposed in this pull request? added missing keyword for java example ## How was this patch tested? wasn't Author: Bartek Wiśniewski Closes #14381 from

spark git commit: [MINOR][DOC] missing keyword new

2016-07-27 Thread rxin
Repository: spark Updated Branches: refs/heads/master 70f846a31 -> bc4851ade [MINOR][DOC] missing keyword new ## What changes were proposed in this pull request? added missing keyword for java example ## How was this patch tested? wasn't Author: Bartek Wiśniewski Closes #14381 from wed

spark-website git commit: Fix a few bugs in the release notes.

2016-07-27 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 46fb65a40 -> 62155dfa6 Fix a few bugs in the release notes. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/62155dfa Tree: http://git-wip-us.a

spark git commit: [SPARK-16729][SQL] Throw analysis exception for invalid date casts

2016-07-27 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 4e98e6905 -> 8bc2877d8 [SPARK-16729][SQL] Throw analysis exception for invalid date casts Spark currently throws exceptions for invalid casts for all other data types except date type. Somehow date type returns null. It should be consi

[1/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 44234b1c4 -> be9965b07 http://git-wip-us.apache.org/repos/asf/spark/blob/be9965b0/sql/hive/src/test/resources/sqlgen/rollup_cube_4_2.sql -- diff --git a/sql/hive/src/tes

[2/2] spark git commit: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-26 Thread rxin
[SPARK-16621][SQL] Generate stable SQLs in SQLBuilder Currently, the generated SQLs have not-stable IDs for generated attributes. The stable generated SQL will give more benefit for understanding or testing the queries. This PR provides stable SQL generation by the followings. - Provide unique

[2/2] spark-website git commit: Move 2.0.0 release date to July 26 since I managed to push it out tonight.

2016-07-26 Thread rxin
Move 2.0.0 release date to July 26 since I managed to push it out tonight. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/46fb65a4 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/46fb65a4 Diff:

[1/2] spark-website git commit: Move 2.0.0 release date to July 26 since I managed to push it out tonight.

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 0915efb8d -> 46fb65a40 http://git-wip-us.apache.org/repos/asf/spark-website/blob/46fb65a4/site/news/spark-summit-europe-agenda-posted.html -- diff --git a/site/new

spark-website git commit: Updated Scala 2.11 note

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site d7dcb6c8b -> 0915efb8d Updated Scala 2.11 note Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/0915efb8 Tree: http://git-wip-us.apache.org/rep

spark-website git commit: removed old versions (<1.3) and re-arranged download options.

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 33d86d7bf -> d7dcb6c8b removed old versions (<1.3) and re-arranged download options. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d7dcb6c8

[1/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 214938a57 -> 33d86d7bf http://git-wip-us.apache.org/repos/asf/spark-website/blob/33d86d7b/site/releases/spark-release-1-0-2.html -- diff --git a/site/releases/spar

[3/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
2.0.0 release Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/33d86d7b Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/33d86d7b Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/33

[2/3] spark-website git commit: 2.0.0 release

2016-07-26 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/33d86d7b/site/news/spark-1-6-1-released.html -- diff --git a/site/news/spark-1-6-1-released.html b/site/news/spark-1-6-1-released.html index 8c838a0..c0e1d15 100644 --- a/s

spark git commit: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator

2016-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0b71d9ae0 -> 738b4cc54 [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator ## What changes were proposed in this pull request? This PR is the first step for the following feature: For hash aggregation in Spark SQL, we use a fast

spark-website git commit: Update release notes

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 33bab055d -> 214938a57 Update release notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/214938a5 Tree: http://git-wip-us.apache.org/repos/

[2/2] spark-website git commit: Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources.

2016-07-26 Thread rxin
Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/33bab055 Tree: http://git-wip-us.apache.org/repos/asf

[1/2] spark-website git commit: Change title for Documentation -> "Other Resources" to Documentation -> Older Versions and Other Resources.

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site f0578ab3f -> 33bab055d http://git-wip-us.apache.org/repos/asf/spark-website/blob/33bab055/site/releases/spark-release-1-5-2.html -- diff --git a/site/releases/spar

spark-website git commit: Add 2.0.0 to documentation page

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 7cd1fdf23 -> f0578ab3f Add 2.0.0 to documentation page Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/f0578ab3 Tree: http://git-wip-us.apache

spark-website git commit: More comprehensive new features

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 175d31a25 -> 7cd1fdf23 More comprehensive new features Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/7cd1fdf2 Tree: http://git-wip-us.apache

spark-website git commit: Add a link

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site a9ba7a4c6 -> 175d31a25 Add a link Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/175d31a2 Tree: http://git-wip-us.apache.org/repos/asf/spark-

spark-website git commit: Better release notes for 2.0.0

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 0323eb078 -> a9ba7a4c6 Better release notes for 2.0.0 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/a9ba7a4c Tree: http://git-wip-us.apache.

svn commit: r14549 - /dev/spark/spark-2.0.0/ /release/spark/spark-2.0.0/

2016-07-26 Thread rxin
Author: rxin Date: Tue Jul 26 22:06:04 2016 New Revision: 14549 Log: Spark 2.0.0 Added: release/spark/spark-2.0.0/ - copied from r14548, dev/spark/spark-2.0.0/ Removed: dev/spark/spark-2.0.0/ - To unsubscribe, e

svn commit: r14548 - /dev/spark/spark-2.0.0/

2016-07-26 Thread rxin
Author: rxin Date: Tue Jul 26 21:58:58 2016 New Revision: 14548 Log: Add Spark 2.0.0 Added: dev/spark/spark-2.0.0/ dev/spark/spark-2.0.0/spark-2.0.0-bin-hadoop2.3.tgz (with props) dev/spark/spark-2.0.0/spark-2.0.0-bin-hadoop2.3.tgz.asc dev/spark/spark-2.0.0/spark-2.0.0-bin

spark-website git commit: Add 2.0.0 release notes

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site effcd547b -> 0323eb078 Add 2.0.0 release notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/0323eb07 Tree: http://git-wip-us.apache.org/rep

spark-website git commit: Remove test.html

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site b98c7b9d1 -> effcd547b Remove test.html Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/effcd547 Tree: http://git-wip-us.apache.org/repos/asf/

spark-website git commit: Test

2016-07-26 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site aff7e088c -> b98c7b9d1 Test Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/b98c7b9d Tree: http://git-wip-us.apache.org/repos/asf/spark-websit

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0-rc1 [deleted] 0c66ca41a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0-rc2 [deleted] 4a55b2326 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0-rc3 [deleted] 48d1fa3e7 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0-rc4 [deleted] e5f8c1117 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0-rc5 [deleted] 13650fc58 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.0 [created] 13650fc58 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 aeb6d5c05 -> 4b38a6a53 [SPARK-16724] Expose DefinedByConstructorParams We don't generally make things in catalyst/execution private. Instead they are just undocumented due to their lack of stability guarantees. Author: Michael Armbru

spark git commit: [SPARK-16724] Expose DefinedByConstructorParams

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 8a8d26f1e -> f99e34e8e [SPARK-16724] Expose DefinedByConstructorParams We don't generally make things in catalyst/execution private. Instead they are just undocumented due to their lack of stability guarantees. Author: Michael Armbrust

spark git commit: [SPARK-16672][SQL] SQLBuilder should not raise exceptions on EXISTS queries

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 3d3547487 -> aeb6d5c05 [SPARK-16672][SQL] SQLBuilder should not raise exceptions on EXISTS queries ## What changes were proposed in this pull request? Currently, `SQLBuilder` raises `empty.reduceLeft` exceptions on *unoptimized* `EXIS

spark git commit: [SPARK-16672][SQL] SQLBuilder should not raise exceptions on EXISTS queries

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master ba0aade6d -> 8a8d26f1e [SPARK-16672][SQL] SQLBuilder should not raise exceptions on EXISTS queries ## What changes were proposed in this pull request? Currently, `SQLBuilder` raises `empty.reduceLeft` exceptions on *unoptimized* `EXISTS`

spark git commit: Fix description of spark.speculation.quantile

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3fc456694 -> ba0aade6d Fix description of spark.speculation.quantile ## What changes were proposed in this pull request? Minor doc fix regarding the spark.speculation.quantile configuration parameter. It incorrectly states it should be a

spark git commit: Fix description of spark.speculation.quantile

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 9d581dc61 -> 3d3547487 Fix description of spark.speculation.quantile ## What changes were proposed in this pull request? Minor doc fix regarding the spark.speculation.quantile configuration parameter. It incorrectly states it should

spark git commit: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 f0d05f669 -> 1b4f7cf13 [SQL][DOC] Fix a default name for parquet compression ## What changes were proposed in this pull request? This pr is to fix a wrong description for parquet default compression. Author: Takeshi YAMAMURO Closes #

spark git commit: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master fc17121d5 -> cda4603de [SQL][DOC] Fix a default name for parquet compression ## What changes were proposed in this pull request? This pr is to fix a wrong description for parquet default compression. Author: Takeshi YAMAMURO Closes #1435

spark git commit: [SPARK-16703][SQL] Remove extra whitespace in SQL generation for window functions

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 b52e639a8 -> 57d65e511 [SPARK-16703][SQL] Remove extra whitespace in SQL generation for window functions ## What changes were proposed in this pull request? This PR fixes a minor formatting issue of `WindowSpecDefinition.sql` when no

spark git commit: [SPARK-16703][SQL] Remove extra whitespace in SQL generation for window functions

2016-07-25 Thread rxin
Repository: spark Updated Branches: refs/heads/master 79826f3c7 -> 7ea6d282b [SPARK-16703][SQL] Remove extra whitespace in SQL generation for window functions ## What changes were proposed in this pull request? This PR fixes a minor formatting issue of `WindowSpecDefinition.sql` when no par

spark git commit: [SPARK-16699][SQL] Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread rxin
Repository: spark Updated Branches: refs/heads/master daace6014 -> 468a3c3ac [SPARK-16699][SQL] Fix performance bug in hash aggregate on long string keys In the following code in `VectorizedHashMapGenerator.scala`: ``` def hashBytes(b: String): String = { val hash = ctx.freshName("ha

spark git commit: [SPARK-16699][SQL] Fix performance bug in hash aggregate on long string keys

2016-07-24 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 198b0426e -> d226dce12 [SPARK-16699][SQL] Fix performance bug in hash aggregate on long string keys ## What changes were proposed in this pull request? In the following code in `VectorizedHashMapGenerator.scala`: ``` def hashBytes(

spark git commit: [SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 da34e8e8f -> 31c3bcb46 [SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView after https://github.com/apache/spark/pull/12945, we renamed the `registerTempTable` to `createTempView`, as we do create a view actually. Thi

spark git commit: [SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding

2016-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 28bb2b044 -> da34e8e8f [SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding This PR is based on PR #14098 authored by wangmiao1981. ## What changes were proposed in this pull request? This PR

spark git commit: [SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding

2016-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 86c275206 -> 53b2456d1 [SPARK-16380][EXAMPLES] Update SQL examples and programming guide for Python language binding This PR is based on PR #14098 authored by wangmiao1981. ## What changes were proposed in this pull request? This PR repl

spark git commit: [SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView

2016-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master ab6e4aea5 -> 86c275206 [SPARK-16690][TEST] rename SQLTestUtils.withTempTable to withTempView ## What changes were proposed in this pull request? after https://github.com/apache/spark/pull/12945, we renamed the `registerTempTable` to `crea

spark git commit: [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader

2016-07-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9abd99b3c -> 46f80a307 [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader ## What changes were proposed in this pull request? As part of the bugfix in https://github.com/apache/spark/pull/12279, if a row

spark git commit: [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader

2016-07-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cd41e6a33 -> 4cb8ff73f [SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader ## What changes were proposed in this pull request? As part of the bugfix in https://github.com/apache/spark/pull/12279, if a r

spark git commit: [SPARK-16613][CORE] RDD.pipe returns values for empty partitions

2016-07-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 83b957e6a -> b177e082f [SPARK-16613][CORE] RDD.pipe returns values for empty partitions ## What changes were proposed in this pull request? Document RDD.pipe semantics; don't execute process for empty input partitions. Note this inclu

spark git commit: [SPARK-16613][CORE] RDD.pipe returns values for empty partitions

2016-07-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 95abbe537 -> 4b079dc39 [SPARK-16613][CORE] RDD.pipe returns values for empty partitions ## What changes were proposed in this pull request? Document RDD.pipe semantics; don't execute process for empty input partitions. Note this includes

spark git commit: [SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code

2016-07-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 307f8922b -> f58fd4620 [SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code ## What changes were proposed in this pull request? update `refreshTable` API in python code of the sql-programming-

spark git commit: [SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code

2016-07-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master 004e29cba -> 9674af6f6 [SPARK-16568][SQL][DOCUMENTATION] update sql programming guide refreshTable API in python code ## What changes were proposed in this pull request? update `refreshTable` API in python code of the sql-programming-guid

<    4   5   6   7   8   9   10   11   12   13   >