[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16867 **[Test build #74640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74640/testReport)** for PR 16867 at commit [`104e867`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74640/ Test FAILed. ---

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #74646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74646/testReport)** for PR 17308 at commit [`830d76d`](https://github.com/apache/spark/commit/83

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74644/ Test FAILed. ---

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17287 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74643/ Test FAILed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74641/ Test FAILed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17287 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17287 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17270: [SPARK-19929] [SQL] Showing Hive Managed table's ...

2017-03-16 Thread ouyangxiaochen
Github user ouyangxiaochen closed the pull request at: https://github.com/apache/spark/pull/17270 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request #17309: same rdd rule testcase

2017-03-16 Thread jianran
GitHub user jianran opened a pull request: https://github.com/apache/spark/pull/17309 same rdd rule testcase ## What changes were proposed in this pull request? I improvise and change the testcase because rdd_0_2 didn't removed is because of same rdd-rule not because of rd

[GitHub] spark issue #17309: same rdd rule testcase

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17309 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #17070: [SPARK-19721][SS] Good error message for version mismatc...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17070 **[Test build #74648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74648/testReport)** for PR 17070 at commit [`32c0017`](https://github.com/apache/spark/commit/32

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17287 **[Test build #74647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74647/testReport)** for PR 17287 at commit [`d82e8ed`](https://github.com/apache/spark/commit/d8

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16867 **[Test build #74649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74649/testReport)** for PR 16867 at commit [`2518a95`](https://github.com/apache/spark/commit/25

[GitHub] spark issue #17238: getRackForHost returns None if host is unknown by driver

2017-03-16 Thread morenn520
Github user morenn520 commented on the issue: https://github.com/apache/spark/pull/17238 Thanks @tgravescs , we has used a dynamic topology discovery script to avoid this problem. Since tez and mr don‘t do this, maybe spark could not fix this problem. --- If your project is set up

[GitHub] spark pull request #17070: [SPARK-19721][SS] Good error message for version ...

2017-03-16 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/17070#discussion_r106352628 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala --- @@ -195,6 +195,11 @@ class HDFSMetadataLog[T <: AnyRef

[GitHub] spark issue #16672: [SPARK-19329][SQL]Reading from or writing to a datasourc...

2017-03-16 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16672 To backport https://github.com/apache/spark/pull/17097, we need to backport multiple PRs. This is one of it. @windpiger Could you please submit a PR to backport it to Spark 2.1? --- If

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/11601 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #17242: [SPARK-19902][SQL] Support more expression canonicalizat...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17242 **[Test build #74650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74650/testReport)** for PR 17242 at commit [`b1a0641`](https://github.com/apache/spark/commit/b1

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11601 **[Test build #74651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74651/testReport)** for PR 11601 at commit [`c67afc1`](https://github.com/apache/spark/commit/c6

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74652/testReport)** for PR 16626 at commit [`211287e`](https://github.com/apache/spark/commit/21

[GitHub] spark pull request #17286: [SPARK-19915][SQL] Exclude cartesian product cand...

2017-03-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/17286#discussion_r106355108 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -128,38 +128,43 @@ case class CostBasedJoinRe

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/11601 Created [SPARK-19969](https://issues.apache.org/jira/browse/SPARK-19969) to track doc and examples to be done for 2.2 release. I can help with this if you're tied up. --- If your project is set up

[GitHub] spark pull request #17286: [SPARK-19915][SQL] Exclude cartesian product cand...

2017-03-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/17286#discussion_r106357158 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -696,6 +696,13 @@ object SQLConf { .intConf .cr

[GitHub] spark pull request #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace an...

2017-03-16 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/17310 [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options in CSV writing ## What changes were proposed in this pull request? This PR proposes to support _not_

[GitHub] spark issue #17296: [SPARK-19953][ML] Random Forest Models use parent UID wh...

2017-03-16 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17296 hmm I would prefer to test it though I do get it's pretty tricky to do generically. I don't think training a tiny model on a couple data points will add too much overhead. --- If your project is se

[GitHub] spark pull request #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace an...

2017-03-16 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17310#discussion_r106357631 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala --- @@ -92,8 +92,13 @@ class CSVOptions(

[GitHub] spark issue #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignor...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17310 **[Test build #74653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74653/testReport)** for PR 17310 at commit [`a16f0c5`](https://github.com/apache/spark/commit/a1

[GitHub] spark issue #17242: [SPARK-19902][SQL] Add optimization rule to simplify exp...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17242 **[Test build #74650 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74650/testReport)** for PR 17242 at commit [`b1a0641`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #17242: [SPARK-19902][SQL] Add optimization rule to simplify exp...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17242 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74650/ Test FAILed. ---

[GitHub] spark issue #17242: [SPARK-19902][SQL] Add optimization rule to simplify exp...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17242 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][WIP] R should check for java when ...

2017-03-16 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16596 @shivaram what do you think about https://github.com/apache/spark/pull/16596#issuecomment-286015752? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #16330: [SPARK-18817][SPARKR][SQL] change derby log outpu...

2017-03-16 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16330#discussion_r106359526 --- Diff: core/src/main/scala/org/apache/spark/api/r/RRDD.scala --- @@ -127,6 +127,13 @@ private[r] object RRDD { sparkConf.setExecutorEnv(nam

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17251 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17309: same rdd rule testcase

2017-03-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17309 See http://spark.apache.org/contributing.html I'm not clear this adds any value? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16324: [SPARK-18910][SQL]Resolve faile to use UDF that jar file...

2017-03-16 Thread melin
Github user melin commented on the issue: https://github.com/apache/spark/pull/16324 in spark 2.1.0 0: jdbc:hive2://localhost:1> add jar hdfs:///user/datacompute/datacompute-udf-1.0- Error: java.net.MalformedURLException: unknown protocol: hdfs (state=,code=0) 0: jdbc

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #74654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74654/testReport)** for PR 17251 at commit [`c951084`](https://github.com/apache/spark/commit/c9

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11601 **[Test build #74651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74651/testReport)** for PR 11601 at commit [`c67afc1`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11601 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74651/ Test PASSed. ---

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11601 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17290: [SPARK-16599][CORE] java.util.NoSuchElementException: No...

2017-03-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17290 I'd like to merge this as a step towards possibly resolving the problem or uncovering its root. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #17306: [MLLIB] Allow multiple pipelines when tuning

2017-03-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17306 Yes re: JIRA CC @MLNick or @jkbradley as well I agree about reusing the cached folds, that's a good point. I think this is worth considering. --- If your project is set up for it, you c

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #74646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74646/testReport)** for PR 17308 at commit [`830d76d`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17308 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74646/ Test FAILed. ---

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16476 **[Test build #74655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74655/testReport)** for PR 16476 at commit [`fc47e0f`](https://github.com/apache/spark/commit/fc

[GitHub] spark pull request #17123: [SPARK-19781][ML] Handle NULLs as well as NaNs in...

2017-03-16 Thread crackcell
Github user crackcell commented on a diff in the pull request: https://github.com/apache/spark/pull/17123#discussion_r106363022 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/Bucketizer.scala --- @@ -105,20 +106,21 @@ final class Bucketizer @Since("1.4.0") (@Since("1.4

[GitHub] spark pull request #17244: [SPARK-19889][SQL] Make TaskContext callbacks thr...

2017-03-16 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17244#discussion_r106363391 --- Diff: core/src/main/scala/org/apache/spark/TaskContextImpl.scala --- @@ -52,62 +63,79 @@ private[spark] class TaskContextImpl( @volatile privat

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-16 Thread gczsjdy
Github user gczsjdy commented on the issue: https://github.com/apache/spark/pull/16476 @cloud-fan I have submitted a new version to support implicit cast. We determine the implicit cast type in analysis stage, so maybe we won't do `eval` then, so we can't be 100% intelligent, for e

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-16 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17286 Co-existing cross joins (join without a condition) and inner joins make the reordering procedure cumbersome. On one hand, putting cross join candidates into memo is not good in terms of search perform

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17286 **[Test build #74656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74656/testReport)** for PR 17286 at commit [`237ad9d`](https://github.com/apache/spark/commit/23

[GitHub] spark pull request #15363: [SPARK-17791][SQL] Join reordering using star sch...

2017-03-16 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15363#discussion_r106364472 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -51,6 +51,11 @@ case class CostBasedJoinReord

[GitHub] spark issue #17070: [SPARK-19721][SS] Good error message for version mismatc...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17070 **[Test build #74648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74648/testReport)** for PR 17070 at commit [`32c0017`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17070: [SPARK-19721][SS] Good error message for version mismatc...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17070 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17311: [SPARK-19970][SQL] Table owner should be USER ins...

2017-03-16 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/17311 [SPARK-19970][SQL] Table owner should be USER instead of PRINCIPAL in kerberized clusters ## What changes were proposed in this pull request? In the kerberized hadoop cluster, when S

[GitHub] spark issue #17070: [SPARK-19721][SS] Good error message for version mismatc...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17070 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74648/ Test PASSed. ---

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17311 **[Test build #74657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74657/testReport)** for PR 17311 at commit [`9dfbf82`](https://github.com/apache/spark/commit/9d

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17311 Hi, @vanzin . Could you review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17287 **[Test build #74647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74647/testReport)** for PR 17287 at commit [`d82e8ed`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17308: [SPARK-19968][SS] Use a cached instance of `KafkaProduce...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17308 **[Test build #74658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74658/testReport)** for PR 17308 at commit [`0b5e2e8`](https://github.com/apache/spark/commit/0b

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17287 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17287: [SPARK-19945][SQL]add test suite for SessionCatalog with...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17287 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74647/ Test PASSed. ---

[GitHub] spark issue #17292: [SPARK-19946][testing]DebugFilesystem.assertNoOpenStream...

2017-03-16 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17292 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #74652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74652/testReport)** for PR 16626 at commit [`211287e`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #17268: [SPARK-19932][SS] Also save event time into StateStore f...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17268 **[Test build #74660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74660/testReport)** for PR 17268 at commit [`d76a138`](https://github.com/apache/spark/commit/d7

[GitHub] spark issue #17292: [SPARK-19946][testing]DebugFilesystem.assertNoOpenStream...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17292 **[Test build #74659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74659/testReport)** for PR 17292 at commit [`72d8230`](https://github.com/apache/spark/commit/72

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74652/ Test PASSed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17309: same rdd rule testcase

2017-03-16 Thread jianran
Github user jianran closed the pull request at: https://github.com/apache/spark/pull/17309 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16867 **[Test build #74649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74649/testReport)** for PR 16867 at commit [`2518a95`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74649/ Test PASSed. ---

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fai...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17274 **[Test build #74661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74661/testReport)** for PR 17274 at commit [`44e6d32`](https://github.com/apache/spark/commit/44

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17311 **[Test build #74657 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74657/testReport)** for PR 17311 at commit [`9dfbf82`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17311 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17311 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74657/ Test FAILed. ---

[GitHub] spark issue #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignor...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17310 **[Test build #74653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74653/testReport)** for PR 17310 at commit [`a16f0c5`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignor...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17310 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17312: Display num of executors for the stage.

2017-03-16 Thread jinxing64
GitHub user jinxing64 opened a pull request: https://github.com/apache/spark/pull/17312 Display num of executors for the stage. ## What changes were proposed in this pull request? In `StagePage` the total num of executors are not displayed. Since executorId may not be conse

[GitHub] spark issue #17310: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignor...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17310 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74653/ Test PASSed. ---

[GitHub] spark issue #17312: Display num of executors for the stage.

2017-03-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17312 No, just putting a number in the UI isn't correct. I am not sure this has that much value. This isn't how we manage changes anyway. Please read http://spark.apache.org/contributing.html --- If

[GitHub] spark issue #17312: Display num of executors for the stage.

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17312 **[Test build #74662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74662/testReport)** for PR 17312 at commit [`f64691c`](https://github.com/apache/spark/commit/f6

[GitHub] spark issue #17312: Display num of executors for the stage.

2017-03-16 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17312 @srowen Thanks a lot for quick reply. When we check the reason why a stage ran today much longer than yesterday, we want to know how many executors are supplied. We don't want to count the ex

[GitHub] spark issue #17311: [SPARK-19970][SQL] Table owner should be USER instead of...

2017-03-16 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17311 Oh, there exists a version issue. Let me fix that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #17312: [SPARK-19973] Display num of executors for the st...

2017-03-16 Thread jinxing64
Github user jinxing64 closed the pull request at: https://github.com/apache/spark/pull/17312 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

2017-03-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17312 I don't think this is understandable as the executor count. It would also show the total count of executors include dead ones. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request #17312: [SPARK-19973] Display num of executors for the st...

2017-03-16 Thread jinxing64
GitHub user jinxing64 reopened a pull request: https://github.com/apache/spark/pull/17312 [SPARK-19973] Display num of executors for the stage. ## What changes were proposed in this pull request? In `StagePage` the total num of executors are not displayed. Since executorId

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #74654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74654/testReport)** for PR 17251 at commit [`c951084`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74654/ Test PASSed. ---

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17312 **[Test build #74663 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74663/testReport)** for PR 17312 at commit [`7aa6fe5`](https://github.com/apache/spark/commit/7a

[GitHub] spark pull request #17313: [SPARK-19974][Block Manager] in-memory LRU for pa...

2017-03-16 Thread jianran
GitHub user jianran opened a pull request: https://github.com/apache/spark/pull/17313 [SPARK-19974][Block Manager] in-memory LRU for partitions of multiple RDDs testcase did a get that is no sense ## What changes were proposed in this pull request? in-memory LRU for partiti

[GitHub] spark pull request #17311: [SPARK-19970][SQL] Table owner should be USER ins...

2017-03-16 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17311#discussion_r106385533 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -851,7 +851,7 @@ private[hive] object HiveClientImpl {

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16476 **[Test build #74655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74655/testReport)** for PR 16476 at commit [`fc47e0f`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17313: [SPARK-19974][Block Manager] in-memory LRU for partition...

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17313 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16476 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74655/ Test PASSed. ---

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16476 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

  1   2   3   4   5   6   >