[GitHub] [spark] AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574912488 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu commented on a change in pull request #27217: [SPARK-30518] Precision and scale should be same for values between -1.0 and 1.0 in Decimal

2020-01-15 Thread GitBox
maropu commented on a change in pull request #27217: [SPARK-30518] Precision and scale should be same for values between -1.0 and 1.0 in Decimal URL: https://github.com/apache/spark/pull/27217#discussion_r367167676 ## File path:

[GitHub] [spark] zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2020-01-15 Thread GitBox
zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#discussion_r367167581 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ##

[GitHub] [spark] SparkQA removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574854699 **[Test build #116797 has

[GitHub] [spark] vanzin commented on a change in pull request #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#discussion_r367167489 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
dongjoon-hyun commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574912098 +1, late LGTM. This is

[GitHub] [spark] SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574911930 **[Test build #116797 has

[GitHub] [spark] zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2020-01-15 Thread GitBox
zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#discussion_r367166582 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ##

[GitHub] [spark] zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2020-01-15 Thread GitBox
zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#discussion_r367166582 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ##

[GitHub] [spark] zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2020-01-15 Thread GitBox
zero323 commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#discussion_r367166582 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ##

[GitHub] [spark] ifilonenko commented on a change in pull request #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2020-01-15 Thread GitBox
ifilonenko commented on a change in pull request #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#discussion_r367164947 ## File path:

[GitHub] [spark] maropu closed pull request #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
maropu closed pull request #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219 This is an automated message from the Apache Git

[GitHub] [spark] maropu commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables

2020-01-15 Thread GitBox
maropu commented on issue #27219: [SPARK-26736][SQL] Partition pruning through nondeterministic expressions in Hive tables URL: https://github.com/apache/spark/pull/27219#issuecomment-574907847 Merged to master. This is an

[GitHub] [spark] viirya commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output

2020-01-15 Thread GitBox
viirya commented on a change in pull request #26247: [SPARK-29566][ML] Imputer should support single-column input/output URL: https://github.com/apache/spark/pull/26247#discussion_r367160760 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/Imputer.scala ##

[GitHub] [spark] dongjoon-hyun commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated

2020-01-15 Thread GitBox
dongjoon-hyun commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-574902922 Thank you all! This is an

[GitHub] [spark] xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574898994 @vanzin will do. @srowen to be honest, I don't see any flaws in previous implementation

[GitHub] [spark] vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574898859 I think that since Netty makes an effort to look at the OS configuration to define the default

[GitHub] [spark] viirya commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
viirya commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574898173 @dongjoon-hyun I found you cut v2.4.5-rc1 already. If this goes into master/2.4, then you need to cut

[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574896763 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574896758 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574896763 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574896758 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574735130 **[Test build #116792 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116792/testReport)**

[GitHub] [spark] SparkQA commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation

2020-01-15 Thread GitBox
SparkQA commented on issue #24553: [WIP][SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-574896520 **[Test build #116792 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116792/testReport)** for

[GitHub] [spark] srowen commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
srowen commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574896268 Does it make any sense to leave the default but make it higher, if the default can vary a lot and

[GitHub] [spark] AmplabJenkins removed a comment on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224#issuecomment-574895407 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224#issuecomment-574895772 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367137498 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367137936 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367142717 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367146348 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367148994 ## File path:

[GitHub] [spark] vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#discussion_r367149532 ## File path: docs/configuration.md ## @@ -1023,6 +1023,24 @@ Apart from

[GitHub] [spark] AmplabJenkins commented on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224#issuecomment-574895407 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] jaltekruse opened a new pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates

2020-01-15 Thread GitBox
jaltekruse opened a new pull request #27224: [SPARK-30523][SQL] - Collapse nested aggregates URL: https://github.com/apache/spark/pull/27224 ### What changes were proposed in this pull request? Combines two adjacent Aggregate operators into one, if the first one is not

[GitHub] [spark] viirya commented on a change in pull request #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-15 Thread GitBox
viirya commented on a change in pull request #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#discussion_r367142380 ## File path:

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-15 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-574886877 @kiszk @viirya are you ok with this PR then? If so I'd like to merge to

[GitHub] [spark] vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
vanzin commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574885029 Ah, in that case it might be a better idea to revert the configuration change. Want to open a PR?

[GitHub] [spark] viirya commented on issue #27201: [SPARK-30246][CORE][SHUFFLE] fix spark external shuffle service memory leak

2020-01-15 Thread GitBox
viirya commented on issue #27201: [SPARK-30246][CORE][SHUFFLE] fix spark external shuffle service memory leak URL: https://github.com/apache/spark/pull/27201#issuecomment-574884342 Yea, for memory leak, I think #27064 should fix it.

[GitHub] [spark] xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog.

2020-01-15 Thread GitBox
xCASx commented on issue #24732: [SPARK-27868][core] Better default value and documentation for socket server backlog. URL: https://github.com/apache/spark/pull/24732#issuecomment-574883825 First of all, sorry, "the default JVM value" is just a poor wording from my side. I blindly

[GitHub] [spark] gengliangwang commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
gengliangwang commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574877233 It seems that there is an error in the scala linter:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574872966 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574872980 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574872980 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574872966 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574872397 **[Test build #116800 has

[GitHub] [spark] vanzin commented on issue #27201: [SPARK-30246][CORE][SHUFFLE] fix spark external shuffle service memory leak

2020-01-15 Thread GitBox
vanzin commented on issue #27201: [SPARK-30246][CORE][SHUFFLE] fix spark external shuffle service memory leak URL: https://github.com/apache/spark/pull/27201#issuecomment-574868983 Your fix is very different, but from your explanation in the PR, it sounds like #27064 will also fix your

[GitHub] [spark] vanzin commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated

2020-01-15 Thread GitBox
vanzin commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-574867775 FYI: fixed a trivial conflict in 2.4, and had to add a couple of things to the test: -

[GitHub] [spark] viirya commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-15 Thread GitBox
viirya commented on issue #27210: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27210#issuecomment-574867009 @dongjoon-hyun Do you have some comment on this change? If not, I will merge this.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574864206 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574864193 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574864189 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574864180 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574864193 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574864206 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574864180 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574864189 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
HeartSaVioR commented on issue #27208: [SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574864245 cc. @vanzin @squito @gaborgsomogyi

[GitHub] [spark] yhuai commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
yhuai commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574863876 lgtm This is an automated

[GitHub] [spark] vanzin closed pull request #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated

2020-01-15 Thread GitBox
vanzin closed pull request #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064 This is an automated message from the Apache Git

[GitHub] [spark] vanzin commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated

2020-01-15 Thread GitBox
vanzin commented on issue #27064: [SPARK-30246][CORE] OneForOneStreamManager might leak memory in connectionTerminated URL: https://github.com/apache/spark/pull/27064#issuecomment-574863693 Merging to master / 2.4. This is

[GitHub] [spark] SparkQA commented on issue #27208: [WIP][SPARK-30481][CORE] Integrate event log compactor into Spark History Server

2020-01-15 Thread GitBox
SparkQA commented on issue #27208: [WIP][SPARK-30481][CORE] Integrate event log compactor into Spark History Server URL: https://github.com/apache/spark/pull/27208#issuecomment-574863479 **[Test build #116798 has

[GitHub] [spark] SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
SparkQA commented on issue #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#issuecomment-574863500 **[Test build #116799 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574862607 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574862598 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574862607 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574862598 Merged build finished. Test FAILed.

[GitHub] [spark] rdblue commented on a change in pull request #26957: [SPARK-30314] Add identifier and catalog information to DataSourceV2Relation

2020-01-15 Thread GitBox
rdblue commented on a change in pull request #26957: [SPARK-30314] Add identifier and catalog information to DataSourceV2Relation URL: https://github.com/apache/spark/pull/26957#discussion_r367114890 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574689521 **[Test build #116787 has

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-15 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-574861840 **[Test build #116787 has

[GitHub] [spark] vanzin commented on a change in pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-01-15 Thread GitBox
vanzin commented on a change in pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#discussion_r367111046 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression

2020-01-15 Thread GitBox
maropu commented on a change in pull request #27198: [SPARK-27986][SQL][FOLLOWUP] Respect filter in sql/toString of AggregateExpression URL: https://github.com/apache/spark/pull/27198#discussion_r367109633 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-15 Thread GitBox
HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-574858221 Thanks for reviewing and merging! This is an

[GitHub] [spark] mengCareers commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
mengCareers commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574856765 My PR against the master branch has been updated.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574855302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574855290 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574855302 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574855290 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
SparkQA commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-574854699 **[Test build #116797 has

[GitHub] [spark] MaxGekk closed pull request #26102: [SPARK-29448][SQL] Support the `INTERVAL` type by Parquet datasource

2020-01-15 Thread GitBox
MaxGekk closed pull request #26102: [SPARK-29448][SQL] Support the `INTERVAL` type by Parquet datasource URL: https://github.com/apache/spark/pull/26102 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#issuecomment-574848773 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#issuecomment-574849197 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#issuecomment-574848773 Can one of the admins verify this patch?

[GitHub] [spark] linzebing commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread GitBox
linzebing commented on issue #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#issuecomment-574848435 @jiangxb1987 @vanzin @cloud-fan

[GitHub] [spark] turboFei commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType

2020-01-15 Thread GitBox
turboFei commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType URL: https://github.com/apache/spark/pull/27150#issuecomment-574848260 retest this please This is an automated message

[GitHub] [spark] srowen commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
srowen commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574847987 It could in theory break the build, so matters w.r.t. managing an RC process. But indeed this

[GitHub] [spark] linzebing opened a new pull request #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors

2020-01-15 Thread GitBox
linzebing opened a new pull request #27223: [SPARK-30511][CORE] Spark marks ended speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223 ### What changes were proposed in this pull request? Currently, when speculative tasks

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574845356 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574845356 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574845362 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574845362 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574735109 **[Test build #116791 has

[GitHub] [spark] SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties

2020-01-15 Thread GitBox
SparkQA commented on issue #27197: [SPARK-30507][SQL] TableCalalog reserved properties shoudn't be changed via options or tblpropeties URL: https://github.com/apache/spark/pull/27197#issuecomment-574844653 **[Test build #116791 has

[GitHub] [spark] yhuai commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
yhuai commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574840015 @dongjoon-hyun how does voting for 2.4.5 affect this since it will not be part of the artifact?

[GitHub] [spark] AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574837710 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574837715 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574837710 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
AmplabJenkins commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574837715 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
SparkQA removed a comment on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574774533 **[Test build #116794 has

[GitHub] [spark] SparkQA commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier

2020-01-15 Thread GitBox
SparkQA commented on issue #27178: [SPARK-30491][INFRA][2.4] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27178#issuecomment-574837254 **[Test build #116794 has

<    1   2   3   4   5   6   7   8   9   10   >