[GitHub] spark pull request #16431: [SPARK-19020] [SQL] Cardinality estimation of agg...

2017-01-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16431#discussion_r95118524 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/AggEstimationSuite.scala --- @@ -0,0 +1,113 @@ +/* + * Licensed to

[GitHub] spark pull request #16431: [SPARK-19020] [SQL] Cardinality estimation of agg...

2017-01-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16431#discussion_r95118459 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/AggEstimationSuite.scala --- @@ -0,0 +1,113 @@ +/* + * Licensed to

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 hm concrete suggestion: 1. pass the conf and cache the computed statistics the first time 2. have a simple invalidateStatsCache method that can be called manually to invalidate

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 But you can't do a lazy val unless you have the conf passed in, since you will be adding knobs to the CBO stats soon wouldn't you? Also there is really nothing basic vs CBO here

[GitHub] spark pull request #16431: [SPARK-19020] [SQL] Cardinality estimation of agg...

2017-01-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16431#discussion_r95103316 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/AggregateEstimation.scala --- @@ -0,0 +1,59

[GitHub] spark issue #16431: [SPARK-19020] [SQL] Cardinality estimation of aggregate ...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16431 Can you update the pull request and the test cases to use the new test infra? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

spark git commit: [SPARK-17077][SQL] Cardinality estimation for project operator

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 19d9d4c85 -> 3ccabdfb4 [SPARK-17077][SQL] Cardinality estimation for project operator ## What changes were proposed in this pull request? Support cardinality estimation for project operator. ## How was this patch tested? Add a test suite

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16430 Alright I'm going to merge this since this patch introduces test infrastructure that can be used by other tests. Please submit a follow-up PR to add more test cases. --- If your project i

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 ecc16220d -> 8690d4bd1 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages equival

spark git commit: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4351e6220 -> 1f6ded645 [SPARK-19127][DOCS] Update Rank Function Documentation ## What changes were proposed in this pull request? - [X] Fix inconsistencies in function reference for dense rank and dense - [X] Make all languages equivalent

[GitHub] spark issue #16505: [SPARK-19127][DOCS] Update Rank Function Documentation

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16505 Thanks - merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 So to be clear, my biggest issue with the current code is that it is confusing to track two sets of stats. The invalidation problem already exists in the current code base. I'm OK for the invalid

[GitHub] spark issue #16498: SPARK-9487][Tests] Begin the work of robustifying unit t...

2017-01-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16498 Can you explain why this makes it more robust? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r95040736 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/ProjectEstimation.scala --- @@ -0,0 +1,44

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r95040478 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/ProjectEstimationSuite.scala --- @@ -0,0 +1,51 @@ +/* + * Licensed

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95023996 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95023960 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -1528,6 +1528,18 @@ object functions { def factorial(e: Column): Column

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95024068 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -340,3 +341,91 @@ object CaseKeyWhen

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-06 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95023939 --- Diff: python/pyspark/sql/functions.py --- @@ -320,6 +320,22 @@ def countDistinct(col, *cols): return Column(jc) +@since(2.2

[GitHub] spark issue #16488: [MINOR] Bump R version to 2.2.0.

2017-01-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16488 I believe this is done automatically as part of the release scripts, so we don't need to do anything here. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 When would you set statsConfChanged to false? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16431: [SPARK-19020] [SQL] Cardinality estimation of agg...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16431#discussion_r94906692 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/AggregateEstimation.scala --- @@ -0,0 +1,59

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906528 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906278 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906270 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906266 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906221 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906180 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/Range.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94906142 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/Range.scala --- @@ -0,0 +1,75 @@ +/* + * Licensed to the

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94905939 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94905864 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94905897 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/FilterEstimation.scala --- @@ -0,0 +1,479

[GitHub] spark pull request #16395: [SPARK-17075][SQL] implemented filter estimation

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16395#discussion_r94905771 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/estimation/FilterEstimationSuite.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94905442 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/estimation/EstimationSuite.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 How about the following? ``` def stats(conf: CatalystConf): Statistics = statsCache.getOrElse { invalidateStatsCache() statsCache = Some(computeStats(conf)) statsCache.get

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94903216 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/estimation/EstimationSuite.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94903188 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/estimation/EstimationSuite.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #16401: [SPARK-18998] [SQL] Add a cbo conf to switch between def...

2017-01-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16401 @wzhfy I thought about this more. Why don't we just get rid of the existing "def statistics", and keep only one function ``` def statistics(conf: CatalystCo

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94902185 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/ProjectEstimation.scala --- @@ -0,0 +1,44

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94902161 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/ProjectEstimation.scala --- @@ -0,0 +1,44

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94902084 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/EstimationUtils.scala --- @@ -0,0 +1,54

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94902048 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/estimation/EstimationUtils.scala --- @@ -0,0 +1,54

[GitHub] spark pull request #16430: [SPARK-17077] [SQL] Cardinality estimation for pr...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16430#discussion_r94901694 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/estimation/EstimationSuite.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r94892571 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -543,6 +546,58 @@ object ParquetFileFormat

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r94892533 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -593,13 +650,10 @@ object

[GitHub] spark pull request #16474: [SPARK-19082][SQL] Make ignoreCorruptFiles work f...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16474#discussion_r94892001 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -593,13 +650,10 @@ object

[GitHub] spark issue #16337: [SPARK-18871][SQL] New test cases for IN/NOT IN subquery

2017-01-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16337 Go for it! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16401: [SPARK-18998] [SQL] Add a cbo conf to switch betw...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16401#discussion_r94859595 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala --- @@ -95,6 +96,29 @@ abstract class LogicalPlan extends

[GitHub] spark issue #16347: [SPARK-18934][SQL] Writing to dynamic partitions does no...

2017-01-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16347 What I was suggesting was to allow sort by without bucketing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16475: [MINOR][CORE] Remove code duplication (so the interface ...

2017-01-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16475 Can we please close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16401: [SPARK-18998] [SQL] Add a cbo conf to switch betw...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16401#discussion_r94732192 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala --- @@ -95,6 +96,29 @@ abstract class LogicalPlan extends

[GitHub] spark pull request #16401: [SPARK-18998] [SQL] Add a cbo conf to switch betw...

2017-01-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16401#discussion_r94731500 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala --- @@ -95,6 +96,29 @@ abstract class LogicalPlan extends

[GitHub] spark issue #16347: [SPARK-18934][SQL] Writing to dynamic partitions does no...

2017-01-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16347 Maybe we should make DataFrameWriter.sortBy work here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #16401: [SPARK-18998] [SQL] Add a cbo conf to switch betw...

2017-01-04 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16401#discussion_r94708121 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala --- @@ -95,6 +96,29 @@ abstract class LogicalPlan extends

[GitHub] spark issue #16308: [SPARK-18936][SQL] Infrastructure for session local time...

2017-01-03 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16308 @hvanhovell anything else to do here other than bringing it up to date? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2017-01-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16435 What exactly is the new policy? I don't think size in bytes is a good choice, since it's the number of objects that can destroy GC. --- If your project is set up for it, you can reply to

[GitHub] spark issue #16395: [SPARK-17075][SQL][WIP] implemented filter estimation

2016-12-23 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16395 cc @srinathshankar --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2016-12-22 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r93731259 --- Diff: python/pyspark/sql/readwriter.py --- @@ -155,21 +155,24 @@ def load(self, path=None, format=None, schema=None, **options): return

[GitHub] spark issue #16371: [SPARK-18932][SQL] Support partial aggregation for colle...

2016-12-22 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16371 sounds good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[04/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html b/site/docs/2.1.0/api/java/org/ap

[38/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/greatest.html -- diff --git a/site/docs/2.1.0/api/R/greatest.html b/site/docs/2.1.0/api/R/greatest.html new file mode 100644 index 000..2

[20/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.df.html -- diff --git a/site/docs/2.1.0/api/R/write.df.html b/site/docs/2.1.0/api/R/write.df.html new file mode 100644 index 000..1

[14/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index.html -- diff --git a/site/docs/2.1.0/api/java/index.html b/site/docs/2.1.0/api/java/index.html new file mode 100644 index 000..2

[43/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/crossJoin.html -- diff --git a/site/docs/2.1.0/api/R/crossJoin.html b/site/docs/2.1.0/api/R/crossJoin.html new file mode 100644 index 000

[15/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index-all.html -- diff --git a/site/docs/2.1.0/api/java/index-all.html b/site/docs/2.1.0/api/java/index-all.html new file mode 100644 inde

[47/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/approxCountDistinct.html -- diff --git a/site/docs/2.1.0/api/R/approxCountDistinct.html b/site/docs/2.1.0/api/R/approxCountDistinct.html new

[01/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site a82adf043 -> 066dfa274 http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkJobInfo.html -- diff --git

[05/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html b/site/docs/2.1.0/a

[31/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/randomSplit.html -- diff --git a/site/docs/2.1.0/api/R/randomSplit.html b/site/docs/2.1.0/api/R/randomSplit.html new file mode 100644 index 0

[25/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/sparkR.callJStatic.html -- diff --git a/site/docs/2.1.0/api/R/sparkR.callJStatic.html b/site/docs/2.1.0/api/R/sparkR.callJStatic.html new fil

[16/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/constant-values.html -- diff --git a/site/docs/2.1.0/api/java/constant-values.html b/site/docs/2.1.0/api/java/constant-values.html new fil

[39/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/floor.html -- diff --git a/site/docs/2.1.0/api/R/floor.html b/site/docs/2.1.0/api/R/floor.html new file mode 100644 index 000..2dfc290 ---

[35/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/locate.html -- diff --git a/site/docs/2.1.0/api/R/locate.html b/site/docs/2.1.0/api/R/locate.html new file mode 100644 index 000..30170e5

[44/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/conv.html -- diff --git a/site/docs/2.1.0/api/R/conv.html b/site/docs/2.1.0/api/R/conv.html new file mode 100644 index 000..b7f1a82 --- /d

[49/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00Index.html -- diff --git a/site/docs/2.1.0/api/R/00Index.html b/site/docs/2.1.0/api/R/00Index.html new file mode 100644 index 000..917d

[10/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html b/site/docs/2.1.0/api/java/org/

[34/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/merge.html -- diff --git a/site/docs/2.1.0/api/R/merge.html b/site/docs/2.1.0/api/R/merge.html new file mode 100644 index 000..9ebbee4 ---

[40/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/explain.html -- diff --git a/site/docs/2.1.0/api/R/explain.html b/site/docs/2.1.0/api/R/explain.html new file mode 100644 index 000..cc03

[07/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html b/site/docs/2

[13/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.1.0/api/java/lib/jquery.js b/site/docs/2.1.0/api/java/lib/jquery.js new file mode 100644 index 0

[19/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.parquet.html -- diff --git a/site/docs/2.1.0/api/R/write.parquet.html b/site/docs/2.1.0/api/R/write.parquet.html new file mode 100644 i

[37/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ifelse.html -- diff --git a/site/docs/2.1.0/api/R/ifelse.html b/site/docs/2.1.0/api/R/ifelse.html new file mode 100644 index 000..8046b45

[06/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html b/site/docs/2.1

[02/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html b/site/docs/2.1.0/api/java/org/apac

[17/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-noframe.html b/site/docs/2.1.0/api/java/allclasses-noframe.htm

[21/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/var_pop.html -- diff --git a/site/docs/2.1.0/api/R/var_pop.html b/site/docs/2.1.0/api/R/var_pop.html new file mode 100644 index 000..6c33

[23/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/summary.html -- diff --git a/site/docs/2.1.0/api/R/summary.html b/site/docs/2.1.0/api/R/summary.html new file mode 100644 index 000..c62b

[42/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/datediff.html -- diff --git a/site/docs/2.1.0/api/R/datediff.html b/site/docs/2.1.0/api/R/datediff.html new file mode 100644 index 000..3

[48/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.1.0/api/R/00frame_toc.html b/site/docs/2.1.0/api/R/00frame_toc.html new file mode 100644 index 0

[11/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/AccumulatorParam.Int

[41/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/dropDuplicates.html -- diff --git a/site/docs/2.1.0/api/R/dropDuplicates.html b/site/docs/2.1.0/api/R/dropDuplicates.html new file mode 10064

[24/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/struct.html -- diff --git a/site/docs/2.1.0/api/R/struct.html b/site/docs/2.1.0/api/R/struct.html new file mode 100644 index 000..f3fc288

[18/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-frame.html b/site/docs/2.1.0/api/java/allclasses-frame.html new

[22/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/translate.html -- diff --git a/site/docs/2.1.0/api/R/translate.html b/site/docs/2.1.0/api/R/translate.html new file mode 100644 index 000

[50/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/README.md -- diff --git a/site/docs/2.1.0/README.md b/site/docs/2.1.0/README.md new file mode 100644 index 000..ffd3b57 --- /dev/null +++ b/site

[45/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ceil.html -- diff --git a/site/docs/2.1.0/api/R/ceil.html b/site/docs/2.1.0/api/R/ceil.html new file mode 100644 index 000..7c1c73c --- /d

[12/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/Accumulable.html b/site/docs/2.1.0/api/java/or

[03/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkContext.html b/site/docs/2.1.0/api/java/

[30/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/registerTempTable-deprecated.html -- diff --git a/site/docs/2.1.0/api/R/registerTempTable-deprecated.html b/site/docs/2.1.0/api/R/registerTem

[46/51] [partial] spark-website git commit: Add docs for 2.1.0

2016-12-22 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/attach.html -- diff --git a/site/docs/2.1.0/api/R/attach.html b/site/docs/2.1.0/api/R/attach.html new file mode 100644 index 000..a026f7c

<    8   9   10   11   12   13   14   15   16   17   >