[GitHub] spark issue #15569: [SPARK-18029][SQL] PruneFileSourcePartitions should not ...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15569 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15569: [SPARK-18029][SQL] PruneFileSourcePartitions should not ...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67269/ Test PASSed. ---

[GitHub] spark issue #15569: [SPARK-18029][SQL] PruneFileSourcePartitions should not ...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15569 **[Test build #67269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67269/consoleFull)** for PR 15569 at commit

[GitHub] spark issue #15513: [WIP][SPARK-17963][SQL][Documentation] Add examples (ext...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67274/consoleFull)** for PR 15513 at commit

[GitHub] spark pull request #15567: [SPARK-14393][SQL] values generated by non-determ...

2016-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15567#discussion_r84333445 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -274,12 +274,12 @@ trait Nondeterministic extends

[GitHub] spark pull request #15567: [SPARK-14393][SQL] values generated by non-determ...

2016-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15567#discussion_r84333278 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -787,14 +787,26 @@ abstract class RDD[T: ClassTag]( } /** - *

[GitHub] spark pull request #15569: [SPARK-18029][SQL] PruneFileSourcePartitions shou...

2016-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15569#discussion_r84332975 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -102,8 +102,8 @@ case class CatalogTablePartition(

[GitHub] spark pull request #13526: [SPARK-15780][SQL] Support mapValues on KeyValueG...

2016-10-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13526 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-10-20 Thread mateiz
Github user mateiz commented on the issue: https://github.com/apache/spark/pull/12913 @techaddict Cool, thanks! Just remembered a couple more things: - Can you edit KryoSerializerSuite to set the flag to false? Otherwise we might silently end up with both suites testing on true if

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13526 Alright merging in master. Thanks. @koertkuipers would you be able to add the optimizer rule? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13526 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13526 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67268/ Test PASSed. ---

[GitHub] spark issue #15562: [SPARK-18021][SQL] Refactor file name specification for ...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15562 **[Test build #67273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67273/consoleFull)** for PR 15562 at commit

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13526 **[Test build #67268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67268/consoleFull)** for PR 13526 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #67272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67272/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15559: [SPARK-18013][SPARKR] add crossJoin API

2016-10-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15559 cc @srinathshankar --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15272: [SPARK-17698] [SQL] Join predicates should not co...

2016-10-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15272#discussion_r84328352 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala --- @@ -408,6 +467,25 @@ class BucketedReadSuite extends QueryTest with

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15433 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #15272: [SPARK-17698] [SQL] Join predicates should not co...

2016-10-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15272 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15272: [SPARK-17698] [SQL] Join predicates should not contain f...

2016-10-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15272 Merged in master. @tejasapatil can you create a backport for branch-2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15272: [SPARK-17698] [SQL] Join predicates should not contain f...

2016-10-20 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15272 Actually let me just merge it. I will fix this in my other pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #15569: [SPARK-18029][SQL] PruneFileSourcePartitions shou...

2016-10-20 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15569#discussion_r84324810 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -102,8 +102,8 @@ case class CatalogTablePartition(

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #67271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67271/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15556 That's right, it still reads the whole file but skips posting most of it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15567 **[Test build #67270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67270/consoleFull)** for PR 15567 at commit

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15568 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15568 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67266/ Test PASSed. ---

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15568 **[Test build #67266 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67266/consoleFull)** for PR 15568 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67267/ Test FAILed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #67267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67267/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflict check...

2016-10-20 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15423 @cloud-fan @viirya Thank you very much !! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15569: [SPARK-18029][SQL] PruneFileSourcePartitions should not ...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15569 **[Test build #67269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67269/consoleFull)** for PR 15569 at commit

[GitHub] spark issue #15569: [SPARK-18029][SQL] PruneFileSourcePartitions should not ...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15569 cc @ericl @mallman @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15569: [SPARK-18029][SQL] PruneFileSourcePartitions shou...

2016-10-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15569 [SPARK-18029][SQL] PruneFileSourcePartitions should not change the output of LogicalRelation ## What changes were proposed in this pull request? In `PruneFileSourcePartitions`, we will

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-20 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15556 So this is still reading the entire file, its just filtering out just the start and end log entries? so basically the listener bus only replays those events vs all of them. Have you

[GitHub] spark issue #15557: [SPARK-17944] [DEPLOY] sbin/start-* scripts use of `host...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15557 **[Test build #3367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3367/consoleFull)** for PR 15557 at commit

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13526 **[Test build #67268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67268/consoleFull)** for PR 13526 at commit

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-10-20 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r84299435 --- Diff: mesos/src/test/scala/org/apache/spark/deploy/mesos/MesosClusterDispatcherArgumentsSuite.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-10-20 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r84299382 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala --- @@ -412,10 +412,9 @@ private[deploy] class SparkSubmitArguments(args:

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-10-20 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r84299319 --- Diff: core/src/main/scala/org/apache/spark/util/CommandLineUtils.scala --- @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-10-20 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14650 @vanzin ok I will update the PR asap. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14650: [SPARK-17062][MESOS] add conf option to mesos dis...

2016-10-20 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14650#discussion_r84297878 --- Diff: core/src/main/scala/org/apache/spark/util/CommandLineUtils.scala --- @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #15297: [SPARK-9862]Handling data skew

2016-10-20 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15297 I haven't looked through the code in detail but can you clarify the design a bit on this, the design pretty much just says we are splitting up the fetch of the map outputs but it doesn't say what

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #67267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67267/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15568 **[Test build #67266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67266/consoleFull)** for PR 15568 at commit

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15544 @hvanhovell Now HyperLogLogPlusPlus is kept as an ImperativeAggregate and the algorithm is separated from it. I also modify the newly added IntervalDistinctApprox as an ImperativeAggregate too. ---

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15436 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15436 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67255/ Test FAILed. ---

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15436 **[Test build #67255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67255/consoleFull)** for PR 15436 at commit

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15568 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67265/ Test FAILed. ---

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15568 **[Test build #67265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67265/consoleFull)** for PR 15568 at commit

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15568 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15568 cc @ericl @mallman @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15568 **[Test build #67265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67265/consoleFull)** for PR 15568 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67262/ Test PASSed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67263/ Test FAILed. ---

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15544 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #67263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67263/consoleFull)** for PR 15433 at commit

[GitHub] spark pull request #15568: [SPARK-18028][SQL] simplify TableFileCatalog

2016-10-20 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15568 [SPARK-18028][SQL] simplify TableFileCatalog ## What changes were proposed in this pull request? Simplify/cleanup TableFileCatalog: 1. pass a `CatalogTable` instead of

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15544 **[Test build #67262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67262/consoleFull)** for PR 15544 at commit

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15436 Well, heck. This all works fine except with Python 3.x tests. I don't know why yet. Still debugging. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15557: [SPARK-17944] [DEPLOY] sbin/start-* scripts use of `host...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15557 **[Test build #3367 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3367/consoleFull)** for PR 15557 at commit

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

2016-10-20 Thread robert3005
Github user robert3005 commented on the issue: https://github.com/apache/spark/pull/14615 @rxin any chance you or someone else can take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #15376: [SPARK-17796][SQL] Support wildcard character in ...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15376#discussion_r84271330 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -246,7 +247,27 @@ case class LoadDataCommand( val

[GitHub] spark issue #15272: [SPARK-17698] [SQL] Join predicates should not contain f...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15272 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15272: [SPARK-17698] [SQL] Join predicates should not co...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15272#discussion_r84269182 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala --- @@ -408,6 +467,25 @@ class BucketedReadSuite extends QueryTest

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13526 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13526 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67264/ Test FAILed. ---

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13526 **[Test build #67264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67264/consoleFull)** for PR 13526 at commit

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13526 **[Test build #67264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67264/consoleFull)** for PR 13526 at commit

[GitHub] spark pull request #15556: [SPARK-18010][Core] Reduce work performed for bui...

2016-10-20 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/15556#discussion_r84267482 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ReplayListenerBus.scala --- @@ -43,38 +43,56 @@ private[spark] class ReplayListenerBus

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13526 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13526: [SPARK-15780][SQL] Support mapValues on KeyValueGroupedD...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13526 it lacks an optimizer rule to collapse `AppendColumns`, but seems ok to merge it first and add the rule in follow-up. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67260/ Test FAILed. ---

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15567 **[Test build #67260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67260/consoleFull)** for PR 15567 at commit

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67257/ Test FAILed. ---

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15567 **[Test build #67257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67257/consoleFull)** for PR 15567 at commit

[GitHub] spark pull request #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflic...

2016-10-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15423 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15423: [SPARK-17860][SQL] SHOW COLUMN's database conflict check...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15423 it's fine, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67254/ Test PASSed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #67263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67263/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67254/consoleFull)** for PR 15566 at commit

[GitHub] spark pull request #15556: [SPARK-18010][Core] Reduce work performed for bui...

2016-10-20 Thread vijoshi
Github user vijoshi commented on a diff in the pull request: https://github.com/apache/spark/pull/15556#discussion_r84261940 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ReplayListenerBus.scala --- @@ -43,19 +43,25 @@ private[spark] class ReplayListenerBus extends

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML][WIP]add feature selector method...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15212 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67261/ Test PASSed. ---

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML][WIP]add feature selector method...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15212 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML][WIP]add feature selector method...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15212 **[Test build #67261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67261/consoleFull)** for PR 15212 at commit

[GitHub] spark issue #15564: [SPARK-17331][FOLLOWUP][ML][CORE] Avoid allocating 0-len...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15564 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15564: [SPARK-17331][FOLLOWUP][ML][CORE] Avoid allocating 0-len...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15564 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67250/ Test PASSed. ---

[GitHub] spark issue #15564: [SPARK-17331][FOLLOWUP][ML][CORE] Avoid allocating 0-len...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15564 **[Test build #67250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67250/consoleFull)** for PR 15564 at commit

[GitHub] spark issue #15526: [SPARK-17986] [ML] SQLTransformer should remove temporar...

2016-10-20 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15526 cc @srowen @MLnick @jkbradley @rxin Could you add @drewrobb to whitelist? I can not trigger the Jenkins job. Thanks. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15544 **[Test build #67262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67262/consoleFull)** for PR 15544 at commit

[GitHub] spark issue #15544: [SPARK-17997] [SQL] Add an aggregation function for coun...

2016-10-20 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15544 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15565: [DO NOT MERGE][17972][SQL] Another try of PR #15517

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15565 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15565: [DO NOT MERGE][17972][SQL] Another try of PR #15517

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15565 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67251/ Test PASSed. ---

[GitHub] spark issue #15565: [DO NOT MERGE][17972][SQL] Another try of PR #15517

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15565 **[Test build #67251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67251/consoleFull)** for PR 15565 at commit

<    1   2   3   4   5   6   7   >