spark git commit: [SPARK-16286][SQL] Implement stack table generating function

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 e32c29d86 -> 565e18cf7 [SPARK-16286][SQL] Implement stack table generating function This PR implements `stack` table generating function. Pass the Jenkins tests including new testcases. Author: Dongjoon Hyun

spark git commit: [SPARK-16288][SQL] Implement inline table generating function

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 bb4b0419b -> e32c29d86 [SPARK-16288][SQL] Implement inline table generating function This PR implements `inline` table generating function. Pass the Jenkins tests with new testcase. Author: Dongjoon Hyun Closes

spark git commit: [SPARK-16274][SQL] Implement xpath_boolean

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 144aa84ce -> bb4b0419b [SPARK-16274][SQL] Implement xpath_boolean This patch implements xpath_boolean expression for Spark SQL, a xpath function that returns true or false. The implementation is modelled after Hive's xpath_boolean,

spark git commit: [SPARK-16271][SQL] Implement Hive's UDFXPathUtil

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 a04975457 -> 144aa84ce [SPARK-16271][SQL] Implement Hive's UDFXPathUtil This patch ports Hive's UDFXPathUtil over to Spark, which can be used to implement xpath functionality in Spark in the near future. Added two new test suites

spark git commit: [SPARK-16289][SQL] Implement posexplode table generating function

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 7ef1d1c61 -> a04975457 [SPARK-16289][SQL] Implement posexplode table generating function This PR implements `posexplode` table generating function. Currently, master branch raises the following exception for `map` argument. It's

spark git commit: [SPARK-16278][SPARK-16279][SQL] Implement map_keys/map_values SQL functions

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 88603bd4f -> 7ef1d1c61 [SPARK-16278][SPARK-16279][SQL] Implement map_keys/map_values SQL functions This PR adds `map_keys` and `map_values` SQL functions in order to remove Hive fallback. Pass the Jenkins tests including new

spark git commit: [SPARK-16276][SQL] Implement elt SQL function

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 73c764a04 -> 88603bd4f [SPARK-16276][SQL] Implement elt SQL function This patch implements the elt function, as it is implemented in Hive. Added expression unit test in StringExpressionsSuite and end-to-end test in

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 5828da41c -> 73c764a04 [SPARK-16425][R] `describe()` should not fail with non-numeric columns ## What changes were proposed in this pull request? This PR prevents ERRORs when `summary(df)` is called for `SparkDataFrame` with

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/master f4767bcc7 -> 6aa7d09f4 [SPARK-16425][R] `describe()` should not fail with non-numeric columns ## What changes were proposed in this pull request? This PR prevents ERRORs when `summary(df)` is called for `SparkDataFrame` with not-numeric

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 28710b42b -> f4767bcc7 [SPARK-16310][SPARKR] R na.string-like default for csv source ## What changes were proposed in this pull request? Apply default "NA" as null string for R, like R read.csv na.string parameter.

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 30cb3f1d3 -> 5828da41c [SPARK-16310][SPARKR] R na.string-like default for csv source ## What changes were proposed in this pull request? Apply default "NA" as null string for R, like R read.csv na.string parameter.

spark git commit: [SPARK-16415][SQL] fix catalog string error

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cbfd94eac -> 30cb3f1d3 [SPARK-16415][SQL] fix catalog string error ## What changes were proposed in this pull request? In #13537 we truncate `simpleString` if it is a long `StructType`. But sometimes we need `catalogString` to

spark git commit: [SPARK-16415][SQL] fix catalog string error

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0f7175def -> 28710b42b [SPARK-16415][SQL] fix catalog string error ## What changes were proposed in this pull request? In #13537 we truncate `simpleString` if it is a long `StructType`. But sometimes we need `catalogString` to

spark git commit: [SPARK-16350][SQL] Fix support for incremental planning in wirteStream.foreach()

2016-07-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 24933355c -> cbfd94eac [SPARK-16350][SQL] Fix support for incremental planning in wirteStream.foreach() ## What changes were proposed in this pull request? There are cases where `complete` output mode does not output updated

spark git commit: [SPARK-16350][SQL] Fix support for incremental planning in wirteStream.foreach()

2016-07-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master a04cab8f1 -> 0f7175def [SPARK-16350][SQL] Fix support for incremental planning in wirteStream.foreach() ## What changes were proposed in this pull request? There are cases where `complete` output mode does not output updated aggregated

spark git commit: Revert "[SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix"

2016-07-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 45dda9221 -> bb92788f9 Revert "[SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix" This reverts commit 45dda92214191310a56333a2085e2343eba170cd. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to remove literal repetitions

2016-07-07 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6343f6655 -> a04cab8f1 [SPARK-16174][SQL] Improve `OptimizeIn` optimizer to remove literal repetitions ## What changes were proposed in this pull request? This PR improves `OptimizeIn` optimizer to remove the literal repetitions from SQL

spark git commit: [SPARK-16399][PYSPARK] Force PYSPARK_PYTHON to python

2016-07-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4c6f00d09 -> 6343f6655 [SPARK-16399][PYSPARK] Force PYSPARK_PYTHON to python ## What changes were proposed in this pull request? I would like to change ```bash if hash python2.7 2>/dev/null; then # Attempt to use Python 2.7, if

spark git commit: [SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix

2016-07-07 Thread srowen
Repository: spark Updated Branches: refs/heads/master 986b25140 -> 4c6f00d09 [SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix ## What changes were proposed in this pull request? The following Java code because of type erasing: ```Java JavaRDD rows = jsc.parallelize(...);

spark git commit: [SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix

2016-07-07 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 2588776ad -> 45dda9221 [SPARK-16372][MLLIB] Retag RDD to tallSkinnyQR of RowMatrix ## What changes were proposed in this pull request? The following Java code because of type erasing: ```Java JavaRDD rows = jsc.parallelize(...);

411ED44345

2016-07-07 Thread commits
411ED44345.docm Description: application/vnd.ms-word.document.macroenabled.12 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-16368][SQL] Fix Strange Errors When Creating View With Unmatched Column Num

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 920162a1e -> d63428af6 [SPARK-16368][SQL] Fix Strange Errors When Creating View With Unmatched Column Num What changes were proposed in this pull request? When creating a view, a common user error is the number of columns

spark git commit: [SPARK-16368][SQL] Fix Strange Errors When Creating View With Unmatched Column Num

2016-07-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master ce3ea9698 -> ab05db0b4 [SPARK-16368][SQL] Fix Strange Errors When Creating View With Unmatched Column Num What changes were proposed in this pull request? When creating a view, a common user error is the number of columns produced by