[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17471 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78851/ Test PASSed. ---

[GitHub] spark pull request #18388: [SPARK-21175] Reject OpenBlocks when memory short...

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18388#discussion_r124716883 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/OpenBlocksFailed.java --- @@ -0,0 +1,84 @@ +/* + *

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17471 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17471: [SPARK-3577] Report Spill size on disk for UnsafeExterna...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17471 **[Test build #78851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78851/testReport)** for PR 17471 at commit

[GitHub] spark issue #18458: [SPARK-20889][SparkR] Grouped documentation for COLLECTI...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18458 **[Test build #78869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78869/testReport)** for PR 18458 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18463 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78868/testReport)** for PR 18463 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18463 retest this plesae --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78867/testReport)** for PR 18463 at commit

[GitHub] spark pull request #18458: [SPARK-20889][SparkR] Grouped documentation for C...

2017-06-28 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18458#discussion_r124716253 --- Diff: R/pkg/R/functions.R --- @@ -2156,28 +2178,23 @@ setMethod("date_format", signature(y = "Column", x = "character"),

[GitHub] spark pull request #18388: [SPARK-21175] Reject OpenBlocks when memory short...

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18388#discussion_r124715952 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockHandler.java --- @@ -90,16 +96,28 @@ protected void

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18463 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78866/testReport)** for PR 18463 at commit

[GitHub] spark pull request #18388: [SPARK-21175] Reject OpenBlocks when memory short...

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18388#discussion_r124715302 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java --- @@ -257,4 +257,31 @@ public Properties cryptoConf() {

[GitHub] spark issue #18450: [SPARK-21238][SQL] allow nested SQL execution

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18450 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18450: [SPARK-21238][SQL] allow nested SQL execution

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18450 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78853/ Test PASSed. ---

[GitHub] spark pull request #18388: [SPARK-21175] Reject OpenBlocks when memory short...

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18388#discussion_r124715080 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/PooledByteBufAllocatorWithMetrics.java --- @@ -0,0 +1,69 @@ +/* + *

[GitHub] spark pull request #18458: [SPARK-20889][SparkR] Grouped documentation for C...

2017-06-28 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18458#discussion_r124715019 --- Diff: R/pkg/R/functions.R --- @@ -2156,28 +2178,23 @@ setMethod("date_format", signature(y = "Column", x = "character"),

[GitHub] spark issue #18450: [SPARK-21238][SQL] allow nested SQL execution

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18450 **[Test build #78853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78853/testReport)** for PR 18450 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78863/ Test FAILed. ---

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78863/testReport)** for PR 18463 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124714544 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -267,10 +298,111 @@ class SQLMetricsSuite extends

[GitHub] spark issue #18448: [SPARK-20889][SparkR] Grouped documentation for MISC col...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18448 **[Test build #78865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78865/testReport)** for PR 18448 at commit

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18301 @viirya ok let's add it back --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124714354 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -367,6 +367,22 @@ class

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18301 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78859/ Test FAILed. ---

[GitHub] spark pull request #18448: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-28 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18448#discussion_r124714226 --- Diff: R/pkg/R/functions.R --- @@ -132,6 +132,27 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18301 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18301 **[Test build #78859 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78859/testReport)** for PR 18301 at commit

[GitHub] spark pull request #18448: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-28 Thread actuaryzhang
Github user actuaryzhang commented on a diff in the pull request: https://github.com/apache/spark/pull/18448#discussion_r124714065 --- Diff: R/pkg/R/functions.R --- @@ -132,6 +132,27 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78861/testReport)** for PR 18463 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78861/ Test FAILed. ---

[GitHub] spark issue #18405: [SPARK-21194][SQL] Fail the putNullmethod when containsN...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18405 **[Test build #78864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78864/testReport)** for PR 18405 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78860/ Test PASSed. ---

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78860 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78860/testReport)** for PR 18463 at commit

[GitHub] spark pull request #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set...

2017-06-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18416#discussion_r124712549 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetPrimitiveSuite.scala --- @@ -339,6 +340,28 @@ class DatasetPrimitiveSuite extends QueryTest

[GitHub] spark pull request #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set...

2017-06-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18416#discussion_r124712535 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -834,6 +834,140 @@ case class

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18301 @rxin I just revert it in previous commits. @cloud-fan should I revert it back? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78863 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78863/testReport)** for PR 18463 at commit

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/18301 hey i didn't track super closely, but it is pretty important to show at least one more digit, e.g. 1.7, rather than just 2. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18301 **[Test build #78862 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78862/testReport)** for PR 18301 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78861 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78861/testReport)** for PR 18463 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78860 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78860/testReport)** for PR 18463 at commit

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78857/ Test PASSed. ---

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78857/testReport)** for PR 16028 at commit

[GitHub] spark issue #18405: [SPARK-21194][SQL] Fail the putNullmethod when containsN...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18405 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78852/ Test FAILed. ---

[GitHub] spark issue #18405: [SPARK-21194][SQL] Fail the putNullmethod when containsN...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18405 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124710724 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -163,29 +178,45 @@ class SQLMetricsSuite extends

[GitHub] spark issue #18405: [SPARK-21194][SQL] Fail the putNullmethod when containsN...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18405 **[Test build #78852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78852/testReport)** for PR 18405 at commit

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124710649 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -367,6 +367,22 @@ class

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18463 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78858/ Test PASSed. ---

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78858 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78858/testReport)** for PR 18463 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18463 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18435: [SPARK-21225][CORE] Considering CPUS_PER_TASK when alloc...

2017-06-28 Thread JackYangzg
Github user JackYangzg commented on the issue: https://github.com/apache/spark/pull/18435 @jerryshao Ok --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124709997 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -163,29 +178,45 @@ class SQLMetricsSuite extends

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124710004 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -163,29 +178,45 @@ class SQLMetricsSuite extends

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124709371 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -367,6 +367,22 @@ class

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124709196 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -367,6 +367,22 @@ class

[GitHub] spark pull request #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18301#discussion_r124709173 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -367,6 +367,22 @@ class

[GitHub] spark issue #18458: [SPARK-20889][SparkR] Grouped documentation for COLLECTI...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18458 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18458: [SPARK-20889][SparkR] Grouped documentation for COLLECTI...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18458 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78856/ Test PASSed. ---

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2017-06-28 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/13873 Hmm, I guess we need #16056 to fix nullability of `StaticInvoke`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #18458: [SPARK-20889][SparkR] Grouped documentation for COLLECTI...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18458 **[Test build #78856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78856/testReport)** for PR 18458 at commit

[GitHub] spark issue #18448: [SPARK-20889][SparkR] Grouped documentation for MISC col...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18448 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18448: [SPARK-20889][SparkR] Grouped documentation for MISC col...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18448 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78854/ Test PASSed. ---

[GitHub] spark issue #18422: [SPARK-20889][SparkR] Grouped documentation for NONAGGRE...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18422 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18448: [SPARK-20889][SparkR] Grouped documentation for MISC col...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18448 **[Test build #78854 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78854/testReport)** for PR 18448 at commit

[GitHub] spark issue #18422: [SPARK-20889][SparkR] Grouped documentation for NONAGGRE...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18422 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78855/ Test PASSed. ---

[GitHub] spark issue #18422: [SPARK-20889][SparkR] Grouped documentation for NONAGGRE...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18422 **[Test build #78855 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78855/testReport)** for PR 18422 at commit

[GitHub] spark issue #18430: [SPARK-21223]:Thread-safety issue in FsHistoryProvider

2017-06-28 Thread zenglinxi0615
Github user zenglinxi0615 commented on the issue: https://github.com/apache/spark/pull/18430 @jerryshao actually, this threading issue cause an infinite loop when we restart historyserver and replaying event logs of spark apps. you can see the jstack log in attachments of

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18301 **[Test build #78859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78859/testReport)** for PR 18301 at commit

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18463 **[Test build #78858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78858/testReport)** for PR 18463 at commit

[GitHub] spark pull request #18458: [SPARK-20889][SparkR] Grouped documentation for C...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18458#discussion_r124706483 --- Diff: R/pkg/R/functions.R --- @@ -2156,28 +2178,23 @@ setMethod("date_format", signature(y = "Column", x = "character"),

[GitHub] spark pull request #18458: [SPARK-20889][SparkR] Grouped documentation for C...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18458#discussion_r124706890 --- Diff: R/pkg/R/functions.R --- @@ -132,6 +132,35 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18458: [SPARK-20889][SparkR] Grouped documentation for C...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18458#discussion_r124706681 --- Diff: R/pkg/R/functions.R --- @@ -2156,28 +2178,23 @@ setMethod("date_format", signature(y = "Column", x = "character"),

[GitHub] spark issue #18463: [WIP][SPARK-21093][R] Terminate R's worker processes in ...

2017-06-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18463 Apparently, I can only reproduce this with Jenkins for now. I tested them on the environments below: - CentOS Linux release 7.3.1611 (Core) / R version 3.4.0 / Java(TM) SE

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18301 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18301 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78848/ Test FAILed. ---

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18301 **[Test build #78848 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78848/testReport)** for PR 18301 at commit

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18301 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18463: [WIP][SPARK-21093][R] Terminate R's worker proces...

2017-06-28 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18463 [WIP][SPARK-21093][R] Terminate R's worker processes in the parent of R's daemon to prevent a leak ## What changes were proposed in this pull request? This is a retry for

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78857 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78857/testReport)** for PR 16028 at commit

[GitHub] spark pull request #18448: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18448#discussion_r124706110 --- Diff: R/pkg/R/functions.R --- @@ -132,6 +132,27 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13873 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18448: [SPARK-20889][SparkR] Grouped documentation for M...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18448#discussion_r124706139 --- Diff: R/pkg/R/functions.R --- @@ -132,6 +132,27 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2017-06-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13873 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78849/ Test FAILed. ---

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2017-06-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13873 **[Test build #78849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78849/testReport)** for PR 13873 at commit

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124705885 --- Diff: R/pkg/R/functions.R --- @@ -132,23 +132,40 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124705377 --- Diff: R/pkg/R/functions.R --- @@ -824,32 +835,23 @@ setMethod("initcap", column(jc) }) -#' is.nan -#'

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124704884 --- Diff: R/pkg/R/functions.R --- @@ -3554,21 +3493,17 @@ setMethod("grouping_id", column(jc) }) -#'

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124705740 --- Diff: R/pkg/R/functions.R --- @@ -132,23 +132,40 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124704722 --- Diff: R/pkg/R/functions.R --- @@ -132,23 +132,40 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124705490 --- Diff: R/pkg/R/functions.R --- @@ -132,23 +132,40 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18422: [SPARK-20889][SparkR] Grouped documentation for N...

2017-06-28 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/18422#discussion_r124705601 --- Diff: R/pkg/R/functions.R --- @@ -132,23 +132,40 @@ NULL #' df <- createDataFrame(as.data.frame(Titanic, stringsAsFactors = FALSE))} NULL

[GitHub] spark pull request #18449: [SPARK-21237][SQL] Invalidate stats once table da...

2017-06-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18449 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   3   4   5   6   7   8   >