[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15889 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15925 That isn't the same case. In one instance you are showing an example of SQL syntax, and in the other, usage of a programmatic Scala API. The SQL query is not semantically wrong, but syntactically

[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15889 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68839/ Test PASSed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68840/ Test PASSed. ---

[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15889 **[Test build #68839 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68839/consoleFull)** for PR 15889 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68840 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68840/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15913: [SPARK-18481][ML] ML 2.1 QA: Remove deprecated methods f...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15913 **[Test build #68849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68849/consoleFull)** for PR 15913 at commit

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/15925 ok,thanks! another one is spark.sql("select * from test where key in()") throw a exception, it is not consistent with the isin of dataset, it is ok? if is ok, I will try to optimize

[GitHub] spark issue #15917: SPARK-18252: Using RoaringBitmap for bloom filters

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15917 Yes all good points, this is more complex than I had imagined, especially with the good point about needing to support older serialized forms. This may not be worth it, yes. It would be

[GitHub] spark issue #15803: [SPARK-18298][Web UI]change gmt time to local zone time ...

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15803 To be clear, the history server already shows UTC always right? this change depends on that being true. Yes, I think it's not true of the other UIs. We already have this inconsistency.

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15868 Conceptually, it does seem nicer to resolve this with a connection pool. There is however some complexity in implementing our own connection pool. I think you've pointed out a key issue:

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove unnecessary backticks in a piv...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14812 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68844/ Test FAILed. ---

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove unnecessary backticks in a piv...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14812 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove unnecessary backticks in a piv...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14812 **[Test build #68844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68844/consoleFull)** for PR 14812 at commit

[GitHub] spark pull request #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `...

2016-11-18 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15889#discussion_r88634271 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/PCA.scala --- @@ -142,8 +142,8 @@ class PCAModel private[ml] ( /** * Transform

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15930 **[Test build #68848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68848/consoleFull)** for PR 15930 at commit

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68842/ Test PASSed. ---

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #68842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68842/consoleFull)** for PR 15928 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68834/ Test PASSed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68834/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15930 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15931: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15931 See my comments from your previous PR; they still apply. https://github.com/apache/spark/pull/15905 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68845/ Test PASSed. ---

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15930 **[Test build #68845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68845/consoleFull)** for PR 15930 at commit

[GitHub] spark issue #15931: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15931 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15930 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68847/ Test FAILed. ---

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15930 **[Test build #68847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68847/consoleFull)** for PR 15930 at commit

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15930 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15931: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge...

2016-11-18 Thread AnthonyTruchet
GitHub user AnthonyTruchet opened a pull request: https://github.com/apache/spark/pull/15931 [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vectors of 0 ## What changes were proposed in this pull request? The zero for the aggregation used to be shipped into a closure

[GitHub] spark issue #15901: [SPARK-18467][SQL] Extracts method for preparing argumen...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15901 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68833/ Test PASSed. ---

[GitHub] spark issue #15901: [SPARK-18467][SQL] Extracts method for preparing argumen...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15901 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15901: [SPARK-18467][SQL] Extracts method for preparing argumen...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15901 **[Test build #68833 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68833/consoleFull)** for PR 15901 at commit

[GitHub] spark issue #15930: [SPARK-18501][ML][SparkR] Fix spark.glm errors when fitt...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15930 **[Test build #68847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68847/consoleFull)** for PR 15930 at commit

[GitHub] spark pull request #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-11-18 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/13065#discussion_r88630739 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -113,4 +117,25 @@ class WholeStageCodegenSuite

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15927 **[Test build #68846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68846/consoleFull)** for PR 15927 at commit

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/15927 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68836/ Test FAILed. ---

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15927 **[Test build #68836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68836/consoleFull)** for PR 15927 at commit

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #68835 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68835/consoleFull)** for PR 15780 at commit

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68835/ Test FAILed. ---

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-18 Thread lichenglin
Github user lichenglin commented on the issue: https://github.com/apache/spark/pull/15868 In fact,I have idea . We can change the param to "connections pool size on each executor",every partition task on the same executor use the same connection pool to save data. we can

[GitHub] spark pull request #15907: [SPARK-18458][CORE] Fix signed integer overflow p...

2016-11-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15907#discussion_r88627141 --- Diff: core/src/test/scala/org/apache/spark/util/collection/unsafe/sort/RadixSortSuite.scala --- @@ -30,7 +32,7 @@ import

[GitHub] spark pull request #15907: [SPARK-18458][CORE] Fix signed integer overflow p...

2016-11-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15907#discussion_r88627152 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/RadixSort.java --- @@ -40,28 +42,28 @@ * of always copying the data

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread kapilsingh5050
Github user kapilsingh5050 commented on the issue: https://github.com/apache/spark/pull/15620 @cloud-fan the same tests which failed earlier are failing again. Could you issue retest request one more time? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15868: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15868 I see, because a user can specify this option through SQL only? Ok, then that logic makes sense to me. It's still kinda a coarse way to achieve a limit on concurrent connections. Some

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #68838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68838/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68838/ Test FAILed. ---

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15930: [][][] Fix spark.glm throws errors when fitting on colli...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15930 **[Test build #68845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68845/consoleFull)** for PR 15930 at commit

[GitHub] spark pull request #15930: [][][] Fix spark.glm throws errors when fitting o...

2016-11-18 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/15930 [][][] Fix spark.glm throws errors when fitting on collinear data ## What changes were proposed in this pull request? * Fix spark.glm throws errors when fitting on collinear data, since

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15925 Yes you're exactly right, what I meant was that if "IN (empty set)" is never generated in SQL, then there's no problem with how it's generated. I suppose it would still also be correct to make sure

[GitHub] spark pull request #15907: [SPARK-18458][CORE] Fix signed integer overflow p...

2016-11-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15907#discussion_r88621634 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/RadixSort.java --- @@ -40,28 +42,28 @@ * of always copying the

[GitHub] spark pull request #15907: [SPARK-18458][CORE] Fix signed integer overflow p...

2016-11-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15907#discussion_r88621534 --- Diff: core/src/test/scala/org/apache/spark/util/collection/unsafe/sort/RadixSortSuite.scala --- @@ -30,7 +32,7 @@ import

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r88621571 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,55 @@ trait ExpressionEvalHelper

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15925 BTW optimizer technically shouldn't have anything to do with correctness, so it shouldn't be the optimizer's job to make sure jdbc can connect. I'd just generate the SQL to "false" (depending on how

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15925 +1 I don't think we really gain anything by restricting this use case that we allowed before. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14812: [SPARK-17237][SQL] Remove unnecessary backticks in a piv...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14812 **[Test build #68844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68844/consoleFull)** for PR 14812 at commit

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15929 **[Test build #68843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68843/consoleFull)** for PR 15929 at commit

[GitHub] spark issue #15929: [SPARK-18053][SQL] compare unsafe and safe complex-type ...

2016-11-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15929 @yhuai @liancheng @davies @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15929: [SPARK-18053][SQL] compare unsafe and safe comple...

2016-11-18 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15929 [SPARK-18053][SQL] compare unsafe and safe complex-type values correctly ## What changes were proposed in this pull request? In Spark SQL, some expression may output safe format values,

[GitHub] spark pull request #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `...

2016-11-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15889#discussion_r88619770 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaPairRDD.scala --- @@ -234,6 +234,9 @@ class JavaPairRDD[K, V](val rdd: RDD[(K, V)]) * In

[GitHub] spark pull request #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `...

2016-11-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15889#discussion_r88619386 --- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala --- @@ -1014,7 +1015,7 @@ class PairRDDFunctions[K, V](self: RDD[(K, V)]) *

[GitHub] spark pull request #14039: [SPARK-15896][SQL] Clean up shuffle files just af...

2016-11-18 Thread maropu
Github user maropu closed the pull request at: https://github.com/apache/spark/pull/14039 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #68842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68842/consoleFull)** for PR 15928 at commit

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r88618891 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -574,7 +574,8 @@ object ScalaReflection extends

[GitHub] spark issue #15925: [SPARK-18436][SQL]isin with a empty list throw exception

2016-11-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15925 The original issue was that the generated SQL code was, apparently, invalid for at least one JDBC driver. Semantically there's nothing wrong with "in (empty set)" right? it's false, always.

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68841/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #68840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68840/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15889 **[Test build #68839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68839/consoleFull)** for PR 15889 at commit

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #68837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68837/consoleFull)** for PR 15928 at commit

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68837/ Test FAILed. ---

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #68838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68838/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15928 **[Test build #68837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68837/consoleFull)** for PR 15928 at commit

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/15928 okay, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15928 We will probably visit this after 2.1 is cut. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15803: [SPARK-18298][Web UI]change gmt time to local zone time ...

2016-11-18 Thread WangTaoTheTonic
Github user WangTaoTheTonic commented on the issue: https://github.com/apache/spark/pull/15803 It's always better to show a timezone in table header, i think, no matter what the timezone it really uses. But changing to show GMT/UTC always? I have to say it's a bold move even

[GitHub] spark pull request #15928: [SPARK-18478][SQL] Support codegen'd Hive UDFs

2016-11-18 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/15928 [SPARK-18478][SQL] Support codegen'd Hive UDFs ## What changes were proposed in this pull request? This pr is to support codegen'd Hive UDFs. ## How was this patch tested? Add tests

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88615462 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88614492 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88614235 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88615203 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15927 **[Test build #68836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68836/consoleFull)** for PR 15927 at commit

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/15927 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #68835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68835/consoleFull)** for PR 15780 at commit

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88613516 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +317,188 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68832/ Test FAILed. ---

[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15889 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68828/ Test FAILed. ---

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88612985 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15889: [SPARK-18445][BUILD][DOCS] Fix the markdown for `Note:`/...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15889 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88613129 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -437,62 +438,76 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68830/ Test FAILed. ---

[GitHub] spark issue #15927: [SPARK-18500][SQL] Make GenericStrategy be able to prune...

2016-11-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15927 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68831/ Test FAILed. ---

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-18 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r88613426 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala --- @@ -992,6 +994,46 @@ class TaskSetManagerSuite extends

<    1   2   3   4   5   >