spark git commit: [DOC] improve python doc for rdd.histogram and dataframe.join

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1426a0805 -> 6ee40d2cc [DOC] improve python doc for rdd.histogram and dataframe.join ## What changes were proposed in this pull request? doc change only ## How was this patch tested? doc change only Author: Mortada Mehyar Closes #1425

spark git commit: [DOC] improve python doc for rdd.histogram and dataframe.join

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 ef2a6f131 -> 504aa6f7a [DOC] improve python doc for rdd.histogram and dataframe.join ## What changes were proposed in this pull request? doc change only ## How was this patch tested? doc change only Author: Mortada Mehyar Closes #

spark git commit: [SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update

2016-07-18 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 24ea87519 -> ef2a6f131 [SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update ## What changes were proposed in this pull request? This PR moves one and the last hard-coded Scala example snippet from the SQL programming guide in

spark git commit: [SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update

2016-07-18 Thread yhuai
Repository: spark Updated Branches: refs/heads/master e5fbb182c -> 1426a0805 [SPARK-16303][DOCS][EXAMPLES] Minor Scala/Java example update ## What changes were proposed in this pull request? This PR moves one and the last hard-coded Scala example snippet from the SQL programming guide into `

spark git commit: [MINOR] Remove unused arg in als.py

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master 69c773052 -> e5fbb182c [MINOR] Remove unused arg in als.py ## What changes were proposed in this pull request? The second arg in method `update()` is never used. So I delete it. ## How was this patch tested? local run with `./bin/spark-sub

spark git commit: [SPARK-16615][SQL] Expose sqlContext in SparkSession

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master c4524f519 -> 69c773052 [SPARK-16615][SQL] Expose sqlContext in SparkSession ## What changes were proposed in this pull request? This patch removes the private[spark] qualifier for SparkSession.sqlContext, as discussed in http://apache-spa

spark git commit: [SPARK-16615][SQL] Expose sqlContext in SparkSession

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 1dd152656 -> 24ea87519 [SPARK-16615][SQL] Expose sqlContext in SparkSession ## What changes were proposed in this pull request? This patch removes the private[spark] qualifier for SparkSession.sqlContext, as discussed in http://apache

spark git commit: [HOTFIX] Fix Scala 2.10 compilation

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 aac860802 -> 1dd152656 [HOTFIX] Fix Scala 2.10 compilation (cherry picked from commit c4524f5193e1b3ce1c56c5aed126f4121ce26d23) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [HOTFIX] Fix Scala 2.10 compilation

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master ea78edb80 -> c4524f519 [HOTFIX] Fix Scala 2.10 compilation Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c4524f51 Tree: http://git-wip-us.apache.org/repos/asf/spark/t

[1/2] spark git commit: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/master 75f0efe74 -> ea78edb80 http://git-wip-us.apache.org/repos/asf/spark/blob/ea78edb8/sql/hive/src/test/resources/sqlgen/script_transformation_row_format_one.sql -- diff --git

[2/2] spark git commit: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-18 Thread rxin
[SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly ## What changes were proposed in this pull request? This PR improves `LogicalPlanToSQLSuite` to check the generated SQL directly by **structure**. So far, `LogicalPlanToSQLSuite` relies on `checkHiveQl` to ensure

[1/2] spark git commit: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-18 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 7889585cc -> aac860802 http://git-wip-us.apache.org/repos/asf/spark/blob/aac86080/sql/hive/src/test/resources/sqlgen/script_transformation_row_format_one.sql -- diff --g

[2/2] spark git commit: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly

2016-07-18 Thread rxin
[SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to check generated SQL directly ## What changes were proposed in this pull request? This PR improves `LogicalPlanToSQLSuite` to check the generated SQL directly by **structure**. So far, `LogicalPlanToSQLSuite` relies on `checkHiveQl` to ensure

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 33d92f7f3 -> 7889585cc [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shivaram Au

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 96e9afaae -> 75f0efe74 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shivaram Author

spark git commit: [SPARK-16515][SQL] set default record reader and writer for script transformation

2016-07-18 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 085f3cc85 -> 33d92f7f3 [SPARK-16515][SQL] set default record reader and writer for script transformation ## What changes were proposed in this pull request? In ScriptInputOutputSchema, we read default RecordReader and RecordWriter from

spark git commit: [SPARK-16515][SQL] set default record reader and writer for script transformation

2016-07-18 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 2877f1a52 -> 96e9afaae [SPARK-16515][SQL] set default record reader and writer for script transformation ## What changes were proposed in this pull request? In ScriptInputOutputSchema, we read default RecordReader and RecordWriter from co

spark git commit: [SPARK-16351][SQL] Avoid per-record type dispatch in JSON when writing

2016-07-18 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 8ea3f4eae -> 2877f1a52 [SPARK-16351][SQL] Avoid per-record type dispatch in JSON when writing ## What changes were proposed in this pull request? Currently, `JacksonGenerator.apply` is doing type-based dispatch for each row to write appro

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master a529fc944 -> 8ea3f4eae [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-16055 sparkPackages - argument is passed

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 2365d6352 -> 085f3cc85 [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-16055 sparkPackages - argument is pas

spark git commit: [MINOR][TYPO] fix fininsh typo

2016-07-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 808d69aaa -> 2365d6352 [MINOR][TYPO] fix fininsh typo ## What changes were proposed in this pull request? fininsh => finish ## How was this patch tested? N/A Author: WeichenXu Closes #14238 from WeichenXu123/fix_fininsh_typo. (ch

spark git commit: [MINOR][TYPO] fix fininsh typo

2016-07-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 480c87064 -> a529fc944 [MINOR][TYPO] fix fininsh typo ## What changes were proposed in this pull request? fininsh => finish ## How was this patch tested? N/A Author: WeichenXu Closes #14238 from WeichenXu123/fix_fininsh_typo. Projec