[GitHub] [spark] AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552486832 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552486842 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552486832 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552486842 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #26466: [SPARK-29839][SQL] Supporting STORED AS in CREATE TABLE LIKE

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26466: [SPARK-29839][SQL] Supporting STORED AS in CREATE TABLE LIKE URL: https://github.com/apache/spark/pull/26466#issuecomment-552406368 **[Test build #113587 has

[GitHub] [spark] cloud-fan commented on issue #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak

2019-11-11 Thread GitBox
cloud-fan commented on issue #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak URL: https://github.com/apache/spark/pull/26471#issuecomment-552486602 note that, this is not a serious problem. The memory manager always releases all the allocated memory at the

[GitHub] [spark] SparkQA commented on issue #26466: [SPARK-29839][SQL] Supporting STORED AS in CREATE TABLE LIKE

2019-11-11 Thread GitBox
SparkQA commented on issue #26466: [SPARK-29839][SQL] Supporting STORED AS in CREATE TABLE LIKE URL: https://github.com/apache/spark/pull/26466#issuecomment-552486547 **[Test build #113587 has

[GitHub] [spark] AmplabJenkins commented on issue #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry URL: https://github.com/apache/spark/pull/26470#issuecomment-552486450 Can one of the admins verify this patch?

[GitHub] [spark] cloud-fan opened a new pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak

2019-11-11 Thread GitBox
cloud-fan opened a new pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak URL: https://github.com/apache/spark/pull/26471 ### What changes were proposed in this pull request? When whole stage codegen `HashAggregateExec`, create the

[GitHub] [spark] SparkQA commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
SparkQA commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552484673 **[Test build #113595 has

[GitHub] [spark] Ngone51 commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
Ngone51 commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552483464 cc @cloud-fan This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
SparkQA commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552483133 **[Test build #113594 has

[GitHub] [spark] SparkQA commented on issue #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry

2019-11-11 Thread GitBox
SparkQA commented on issue #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry URL: https://github.com/apache/spark/pull/26470#issuecomment-552483012 **[Test build #113593 has

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry

2019-11-11 Thread GitBox
gaborgsomogyi commented on a change in pull request #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry URL: https://github.com/apache/spark/pull/26470#discussion_r344754130 ## File path:

[GitHub] [spark] tgravescs commented on a change in pull request #26440: [WIP][SPARK-20628][CORE] Start to improve Spark decommissioning & preemption support

2019-11-11 Thread GitBox
tgravescs commented on a change in pull request #26440: [WIP][SPARK-20628][CORE] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r344751554 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#issuecomment-552468610 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
SparkQA commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#issuecomment-552478192 **[Test build #4921 has

[GitHub] [spark] srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344747970 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344747970 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] gaborgsomogyi opened a new pull request #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry

2019-11-11 Thread GitBox
gaborgsomogyi opened a new pull request #26470: [SPARK-27042][SS] Invalidate cached Kafka producer in case of task retry URL: https://github.com/apache/spark/pull/26470 ### What changes were proposed in this pull request? If a task is failing due to a corrupt cached Kafka producer and

[GitHub] [spark] tgravescs commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
tgravescs commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552474615 test this please This is an

[GitHub] [spark] SparkQA removed a comment on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#issuecomment-552464959 **[Test build #4920 has

[GitHub] [spark] SparkQA commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
SparkQA commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#issuecomment-552471833 **[Test build #4920 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552469118 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552469106 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552469115 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552469107 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552469107 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#issuecomment-552466413 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552469115 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552469118 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552469106 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#issuecomment-552468610 Can one of the admins verify this patch?

[GitHub] [spark] Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344735803 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] Icysandwich commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#discussion_r344735576 ## File path: streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala ## @@

[GitHub] [spark] SparkQA removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552390343 **[Test build #113584 has

[GitHub] [spark] Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344735263 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] Icysandwich commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#discussion_r344735576 ## File path: streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala ## @@

[GitHub] [spark] SparkQA commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression.

2019-11-11 Thread GitBox
SparkQA commented on issue #26420: [SPARK-27986][SQL] Support ANSI SQL filter predicate for aggregate expression. URL: https://github.com/apache/spark/pull/26420#issuecomment-552466871 **[Test build #113584 has

[GitHub] [spark] Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344735263 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552466881 **[Test build #113592 has

[GitHub] [spark] AmplabJenkins commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#issuecomment-552466413 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#issuecomment-552291173 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
SparkQA commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#issuecomment-552464959 **[Test build #4920 has

[GitHub] [spark] srowen commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#discussion_r344732199 ## File path: streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala ## @@ -37,10

[GitHub] [spark] srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344731778 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena…

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena… URL: https://github.com/apache/spark/pull/26315#issuecomment-547798675 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena…

2019-11-11 Thread GitBox
SparkQA commented on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena… URL: https://github.com/apache/spark/pull/26315#issuecomment-552463186 **[Test build #4919 has

[GitHub] [spark] Icysandwich opened a new pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich opened a new pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469 ### What changes were proposed in this pull request? Adjust improper unpersist timing on RDD. ### Why are the

[GitHub] [spark] steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552456614 This code LGTM: skips needless probes on the globbed paths; parallel checks on

[GitHub] [spark] Icysandwich closed pull request #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich closed pull request #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468 This is an automated message from the Apache Git

[GitHub] [spark] Icysandwich commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468#issuecomment-552456508 I am sorry that I created this PR in a wrong way.

[GitHub] [spark] steveloughran commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
steveloughran commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#discussion_r344721359 ## File path:

[GitHub] [spark] steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
steveloughran commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552454930 I'd say 40 sounds good; people can tune it

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552454522 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] cloud-fan closed pull request #26449: [SPARK-29822][SQL] Fix cast error when there are white spaces between signs and values

2019-11-11 Thread GitBox
cloud-fan closed pull request #26449: [SPARK-29822][SQL] Fix cast error when there are white spaces between signs and values URL: https://github.com/apache/spark/pull/26449 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552454188 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552454522 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] cloud-fan commented on issue #26449: [SPARK-29822][SQL] Fix cast error when there are white spaces between signs and values

2019-11-11 Thread GitBox
cloud-fan commented on issue #26449: [SPARK-29822][SQL] Fix cast error when there are white spaces between signs and values URL: https://github.com/apache/spark/pull/26449#issuecomment-552454374 thanks, merging to master!

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552454188 Merged build finished. Test PASSed.

[GitHub] [spark] Ngone51 commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-11-11 Thread GitBox
Ngone51 commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-552453978 Actually, what I want to know is whether these 2 issues(failed task/job and executor lost) happen in

[GitHub] [spark] SparkQA removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552381407 **[Test build #113583 has

[GitHub] [spark] SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552453539 **[Test build #113583 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552452414 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552452405 Merged build finished. Test PASSed.

[GitHub] [spark] amanomer commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD

2019-11-11 Thread GitBox
amanomer commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD URL: https://github.com/apache/spark/pull/26454#discussion_r344718067 ## File path: mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala ## @@ -141,8 +141,10

[GitHub] [spark] AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552452414 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468#issuecomment-552451593 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552452405 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468#issuecomment-552452118 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552406400 **[Test build #113588 has

[GitHub] [spark] SparkQA commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
SparkQA commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552451683 **[Test build #113588 has

[GitHub] [spark] AmplabJenkins commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468#issuecomment-552451593 Can one of the admins verify this patch?

[GitHub] [spark] Icysandwich opened a new pull request #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich opened a new pull request #26468: [SPARK-29844][ML] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26468 ### Why are the changes needed? The improper unpersist timing on RDDs will result in recomputation and memory

[GitHub] [spark] amanomer commented on issue #26454: [SPARK-29818][MLLIB] Missing persist on RDD

2019-11-11 Thread GitBox
amanomer commented on issue #26454: [SPARK-29818][MLLIB] Missing persist on RDD URL: https://github.com/apache/spark/pull/26454#issuecomment-552450738 @srowen There are some JIRA tickets created for unnecessary use of persist and improper persist strategy (like

[GitHub] [spark] AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552450597 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552450586 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552450597 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552450586 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552394538 **[Test build #113585 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449671 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
SparkQA commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449938 **[Test build #113585 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449680 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449680 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449671 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
SparkQA commented on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552449371 **[Test build #113589 has

[GitHub] [spark] SparkQA removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-552409131 **[Test build #113589 has

[GitHub] [spark] iRakson commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena…

2019-11-11 Thread GitBox
iRakson commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena… URL: https://github.com/apache/spark/pull/26315#discussion_r344714361 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552449062 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552449057 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552449062 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552449057 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#issuecomment-552448165 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#issuecomment-552448715 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] SparkQA commented on issue #26463: [SPARK-29837][SLQ] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
SparkQA commented on issue #26463: [SPARK-29837][SLQ] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552448297 **[Test build #113591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113591/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467#issuecomment-552448165 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] iRakson opened a new pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab

2019-11-11 Thread GitBox
iRakson opened a new pull request #26467: [SPARK-29477]Improve tooltip for Streaming tab URL: https://github.com/apache/spark/pull/26467 ### What changes were proposed in this pull request? Added tooltip for duration columns in the batch table of streaming tab of Web UI.

[GitHub] [spark] shahidki31 edited a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI

2019-11-11 Thread GitBox
shahidki31 edited a comment on issue #26378: [SPARK-29724][SPARK-29726][WEBUI][SQL] Support JDBC/ODBC tab for HistoryServer WebUI URL: https://github.com/apache/spark/pull/26378#issuecomment-551203468 gentle ping @juliuszsompolski @vanzin

[GitHub] [spark] gaborgsomogyi closed pull request #23956: [SPARK-27042][SS] Close cached Kafka producer in case of task retry

2019-11-11 Thread GitBox
gaborgsomogyi closed pull request #23956: [SPARK-27042][SS] Close cached Kafka producer in case of task retry URL: https://github.com/apache/spark/pull/23956 This is an automated message from the Apache Git Service. To

[GitHub] [spark] ulysses-you commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
ulysses-you commented on issue #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#issuecomment-552440032 Thanks for review, please help to test.

<    1   2   3   4   5   6   7   8   9   >