[GitHub] SparkQA removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446545889 **[Test build #100019 has

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446603719 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446603712 Merged build finished. Test FAILed.

[GitHub] ashangit commented on issue #23290: [SPARK-26340][Core] Ensure cores per executor is greater than cpu per task

2018-12-12 Thread GitBox
ashangit commented on issue #23290: [SPARK-26340][Core] Ensure cores per executor is greater than cpu per task URL: https://github.com/apache/spark/pull/23290#issuecomment-446608185 Thanks for your feedback, I've updated the PR to move the check in SparkConf as recommended

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446622023 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446621837 **[Test build #100027 has

[GitHub] cloud-fan commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
cloud-fan commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446635002 retest this please This is an automated message from

[GitHub] SparkQA commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
SparkQA commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446639099 **[Test build #100030 has

[GitHub] AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446639212 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446639200 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298#issuecomment-446641290 Merged build finished. Test PASSed. This is an automated message from

[GitHub] AmplabJenkins removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-446654889 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-446654885 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446660915 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#issuecomment-446662129 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
SparkQA commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#issuecomment-446662100 **[Test build #100034 has

[GitHub] AmplabJenkins commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#issuecomment-446662136 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] gatorsmile commented on issue #21919: [SPARK-24933][SS] Report numOutputRows in SinkProgress

2018-12-12 Thread GitBox
gatorsmile commented on issue #21919: [SPARK-24933][SS] Report numOutputRows in SinkProgress URL: https://github.com/apache/spark/pull/21919#issuecomment-446662059 retest this please This is an automated message from the

[GitHub] SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-446591064 **[Test build #100024 has

[GitHub] srowen closed pull request #23292: [SPARK-19827][R][FOLLOWUP] spark.ml R API for PIC

2018-12-12 Thread GitBox
srowen closed pull request #23292: [SPARK-19827][R][FOLLOWUP] spark.ml R API for PIC URL: https://github.com/apache/spark/pull/23292 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] dongjoon-hyun commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
dongjoon-hyun commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446620266 Right. Currently, we are retrying this in Jenkins,

[GitHub] dongjoon-hyun commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
dongjoon-hyun commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446620390 Retest this please. This is an automated

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446622023 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446622014 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446622014 Merged build finished. Test PASSed.

[GitHub] lcqzte10192193 commented on a change in pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

2018-12-12 Thread GitBox
lcqzte10192193 commented on a change in pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281#discussion_r241053564 ## File path: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446624307 Merged build finished. Test FAILed. This

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446624322 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] srowen commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore

2018-12-12 Thread GitBox
srowen commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore URL: https://github.com/apache/spark/pull/23288#discussion_r241073780 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446639212 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window)

2018-12-12 Thread GitBox
icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window) URL: https://github.com/apache/spark/pull/22305#discussion_r241074011 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446639200 Merged build finished. Test PASSed.

[GitHub] xuanyuanking opened a new pull request #23298: [SPARK-26222][SQL] Track file listing time

2018-12-12 Thread GitBox
xuanyuanking opened a new pull request #23298: [SPARK-26222][SQL] Track file listing time URL: https://github.com/apache/spark/pull/23298 ## What changes were proposed in this pull request? File listing time in scan node's SQL metrics has done and improved in

[GitHub] SparkQA removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446661016 **[Test build #100036 has

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2018-12-12 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-446668589 I'm sorry, I still don't totally follow, partially from my ignorance of some details in yarn here which I'd like to

[GitHub] AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446680362 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446603719 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] aokolnychyi commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
aokolnychyi commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446604770 I believe the last failure is not related to this PR as other PRs failed with the same error.

[GitHub] AmplabJenkins commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446636335 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446636481 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
SparkQA commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446636707 **[Test build #100028 has

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446636494 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446636349 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446636481 Merged build finished. Test PASSed. This

[GitHub] cloud-fan commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
cloud-fan commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446636762 cc @gatorsmile @dongjoon-hyun @HyukjinKwon

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446636494 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446636335 Merged build finished. Test PASSed.

[GitHub] cloud-fan opened a new pull request #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
cloud-fan opened a new pull request #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297 ## What changes were proposed in this pull request? cleanup some tests to make sure expression is resolved during test.

[GitHub] seancxmao commented on a change in pull request #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
seancxmao commented on a change in pull request #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#discussion_r241074450 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446660095 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446660095 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446660102 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] xuanyuanking opened a new pull request #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
xuanyuanking opened a new pull request #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300 ## What changes were proposed in this pull request? Backport #23277 to branch 2.2 without the metrics

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446663342 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446663191 **[Test build #100037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100037/testReport)**

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446663350 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries URL: https://github.com/apache/spark/pull/23057#issuecomment-44034 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446665401 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446676454 Merged build finished. Test FAILed. This

[GitHub] AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446676460 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446604825 Merged build finished. Test PASSed. This

[GitHub] sadhen edited a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way

2018-12-12 Thread GitBox
sadhen edited a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way URL: https://github.com/apache/spark/pull/23276#issuecomment-446490065 OK, I will polish it later. We are not using the BRACKETED_COMMENT. It seems to be a complicated task.

[GitHub] sadhen edited a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way

2018-12-12 Thread GitBox
sadhen edited a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way URL: https://github.com/apache/spark/pull/23276#issuecomment-446490065 OK, I will polish it later. We are not using the BRACKETED_COMMENT.

[GitHub] seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule

2018-12-12 Thread GitBox
seancxmao commented on issue #23273: [MINOR][DOC] Fix comments of ConvertToLocalRelation rule URL: https://github.com/apache/spark/pull/23273#issuecomment-446640278 retest this please. This is an automated message from the

[GitHub] srowen closed pull request #17085: [SPARK-24102][ML][MLLIB] ML Evaluators should use weight column - added weight column for regression evaluator

2018-12-12 Thread GitBox
srowen closed pull request #17085: [SPARK-24102][ML][MLLIB] ML Evaluators should use weight column - added weight column for regression evaluator URL: https://github.com/apache/spark/pull/17085 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it

[GitHub] SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446659465 **[Test build #100022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100022/testReport)**

[GitHub] AmplabJenkins commented on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries URL: https://github.com/apache/spark/pull/23057#issuecomment-44023 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23057: [SPARK-26078][SQL] Dedup self-join attributes on IN subqueries URL: https://github.com/apache/spark/pull/23057#issuecomment-44023 Merged build finished. Test FAILed. This

[GitHub] SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
SparkQA commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446603149 **[Test build #100019 has

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-446603712 Merged build finished. Test FAILed. This is

[GitHub] artemrd closed pull request #21354: [Web UI] Do not skip cells in Tasks table on Stage page when accumulators are not available

2018-12-12 Thread GitBox
artemrd closed pull request #21354: [Web UI] Do not skip cells in Tasks table on Stage page when accumulators are not available URL: https://github.com/apache/spark/pull/21354 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below

[GitHub] AzureQ commented on a change in pull request #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
AzureQ commented on a change in pull request #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#discussion_r241066432 ## File path: R/pkg/inst/profile/shell.R ## @@ -47,5 +47,5 @@ cat("

[GitHub] SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446636720 **[Test build #100029 has

[GitHub] SparkQA removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446569111 **[Test build #100022 has

[GitHub] vanzin commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

2018-12-12 Thread GitBox
vanzin commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446663550 retest this please This is an

[GitHub] AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446663649 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446663342 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-446663350 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
SparkQA commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446663625 **[Test build #100036 has

[GitHub] AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446663655 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-446670589 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23297: [SPARK-26348][SQL][TEST] make sure expression is resolved during test URL: https://github.com/apache/spark/pull/23297#issuecomment-446676460 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] aokolnychyi commented on issue #23171: [SPARK-26205][SQL] Optimize In for bytes, shorts, ints

2018-12-12 Thread GitBox
aokolnychyi commented on issue #23171: [SPARK-26205][SQL] Optimize In for bytes, shorts, ints URL: https://github.com/apache/spark/pull/23171#issuecomment-446679580 @mgaido91 It won't be possible to apply the switch-based approach on timestamps as they are represented as longs. We can try

[GitHub] SparkQA commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits

2018-12-12 Thread GitBox
SparkQA commented on issue #23266: [SPARK-26313][SQL] move `newScanBuilder` from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446679750 **[Test build #100025 has

[GitHub] rvesse commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support

2018-12-12 Thread GitBox
rvesse commented on issue #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904#issuecomment-446682396 @vanzin At KubeCon this week so this is on the back burner for me right now

[GitHub] AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446604833 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block

2018-12-12 Thread GitBox
SparkQA commented on issue #23294: [SPARK-26265][Core][Followup] Put freePage into a finally block URL: https://github.com/apache/spark/pull/23294#issuecomment-446605460 **[Test build #100026 has

[GitHub] srowen commented on a change in pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

2018-12-12 Thread GitBox
srowen commented on a change in pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281#discussion_r241049693 ## File path: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala ##

[GitHub] SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446623961 **[Test build #100021 has

[GitHub] SparkQA removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
SparkQA removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446567631 **[Test build #100021 has

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446624322 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] dongjoon-hyun commented on issue #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits

2018-12-12 Thread GitBox
dongjoon-hyun commented on issue #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#issuecomment-446624371 Could you update the title because we move only one method `newScanBuilder` now.

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446624307 Merged build finished. Test FAILed. This is an

[GitHub] HyukjinKwon commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
HyukjinKwon commented on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#issuecomment-446645198 Let's update PR description too. Is it okay to you @rxin?

[GitHub] AmplabJenkins removed a comment on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23293: [MINOR][R] Removed Empty Space at the beginning of SparkSession available msg URL: https://github.com/apache/spark/pull/23293#issuecomment-446381093 Can one of the admins verify this patch?

[GitHub] xuanyuanking opened a new pull request #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
xuanyuanking opened a new pull request #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299 ## What changes were proposed in this pull request? Backport #23277 to branch 2.3 without the metrics

[GitHub] AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-446654885 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
SparkQA commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-446654696 **[Test build #100035 has

[GitHub] AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-446654889 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-12 Thread GitBox
AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-446663649 Merged build finished. Test FAILed.

  1   2   3   4   5   6   7   8   9   10   >