spark git commit: [SPARK-17077][SQL] Cardinality estimation for project operator

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 19d9d4c85 -> 3ccabdfb4 [SPARK-17077][SQL] Cardinality estimation for project operator ## What changes were proposed in this pull request? Support cardinality estimation for project operator. ## How was this patch tested? Add a test

spark git commit: [SPARK-18903][SPARKR][BACKPORT-2.1] Add API to get SparkUI URL

2017-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 8779e6a46 -> 80a3e13e5 [SPARK-18903][SPARKR][BACKPORT-2.1] Add API to get SparkUI URL ## What changes were proposed in this pull request? backport to 2.1 Author: Felix Cheung Closes #16507 from

spark git commit: [SPARK-19126][DOCS] Update Join Documentation Across Languages

2017-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 1f6ded645 -> 19d9d4c85 [SPARK-19126][DOCS] Update Join Documentation Across Languages ## What changes were proposed in this pull request? - [X] Make sure all join types are clearly mentioned - [X] Make join labeling/style consistent - [X]

spark git commit: [SPARK-19126][DOCS] Update Join Documentation Across Languages

2017-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 8690d4bd1 -> 8779e6a46 [SPARK-19126][DOCS] Update Join Documentation Across Languages ## What changes were proposed in this pull request? - [X] Make sure all join types are clearly mentioned - [X] Make join labeling/style consistent -

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 ecc16220d -> 8690d4bd1 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4351e6220 -> 1f6ded645 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages equivalent

spark git commit: [SPARK-19093][SQL] Cached tables are not used in SubqueryExpression

2017-01-08 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master cd1d00ada -> 4351e6220 [SPARK-19093][SQL] Cached tables are not used in SubqueryExpression ## What changes were proposed in this pull request? Consider the plans inside subquery expressions while looking up cache manager to make use of

spark git commit: [SPARK-19026] SPARK_LOCAL_DIRS(multiple directories on different disks) cannot be deleted

2017-01-08 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6b6b555a1 -> cd1d00ada [SPARK-19026] SPARK_LOCAL_DIRS(multiple directories on different disks) cannot be deleted JIRA Issue: https://issues.apache.org/jira/browse/SPARK-19026 SPARK_LOCAL_DIRS (Standalone) can be a comma-separated list

[4/5] spark git commit: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files

2017-01-08 Thread yliang
http://git-wip-us.apache.org/repos/asf/spark/blob/6b6b555a/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R deleted file mode 100644 index d736bbb..000 --- a/R/pkg/R/mllib.R +++ /dev/null @@ -1,2114 +0,0 @@ -#

[5/5] spark git commit: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files

2017-01-08 Thread yliang
[SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files ## What changes were proposed in this pull request? SparkR ```mllib.R``` is getting bigger as we add more ML wrappers, I'd like to split it into multiple files to make us easy to maintain: * mllib_classification.R *

[1/5] spark git commit: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files

2017-01-08 Thread yliang
Repository: spark Updated Branches: refs/heads/master 923e59484 -> 6b6b555a1 http://git-wip-us.apache.org/repos/asf/spark/blob/6b6b555a/R/pkg/inst/tests/testthat/test_mllib_classification.R -- diff --git

[3/5] spark git commit: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files

2017-01-08 Thread yliang
http://git-wip-us.apache.org/repos/asf/spark/blob/6b6b555a/R/pkg/R/mllib_classification.R -- diff --git a/R/pkg/R/mllib_classification.R b/R/pkg/R/mllib_classification.R new file mode 100644 index 000..8da8449 --- /dev/null

[2/5] spark git commit: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into multiple files

2017-01-08 Thread yliang
http://git-wip-us.apache.org/repos/asf/spark/blob/6b6b555a/R/pkg/R/mllib_tree.R -- diff --git a/R/pkg/R/mllib_tree.R b/R/pkg/R/mllib_tree.R new file mode 100644 index 000..0d53fad --- /dev/null +++ b/R/pkg/R/mllib_tree.R @@