[GitHub] [spark] kiszk commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
kiszk commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575875962 This is not available yet at https://mvnrepository.com/artifact/org.lz4/lz4-java/1.7.1, too.

[GitHub] [spark] dongjoon-hyun commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873811 The Jenkins will pass because Google Maven Central is only used in GitHub Action. So, we can merge this when GitHub Action

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
dongjoon-hyun edited a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873734 Yes, I've been waiting for this, @maropu . However, it seems that we need to wait for one or two days because

[GitHub] [spark] dongjoon-hyun commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873734 Yes, I've been waiting for this, @maropu . However, it seems that we need to wait for one or two days because `Google

[GitHub] [spark] AmplabJenkins removed a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873349 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873349 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
SparkQA commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873282 **[Test build #116972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116972/testReport)** for PR

[GitHub] [spark] maropu commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
maropu commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873248 FYI: https://github.com/lz4/lz4-java/issues/156 This is an

[GitHub] [spark] maropu commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
maropu commented on issue #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271#issuecomment-575873235 cc: @HyukjinKwon @dongjoon-hyun @srowen This is an automated

[GitHub] [spark] maropu opened a new pull request #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1

2020-01-17 Thread GitBox
maropu opened a new pull request #27271: [SPARK-30486][BUILD] Bump lz4-java version to 1.7.1 URL: https://github.com/apache/spark/pull/27271 ### What changes were proposed in this pull request? This pr intends to upgrade lz4-java from 1.7.0 to 1.7.1. ### Why are the

[GitHub] [spark] guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-575870211 @gengliangwang thanks for reviewing. I agree with your concern, this can be improved in subsequent PRs

[GitHub] [spark] guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-575870211 @gengliangwang thanks for reviewing. I agree with your concern, this can be improved in subsequent PRs

[GitHub] [spark] guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
guykhazma edited a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-575870211 @gengliangwang thanks for reviewing. I agree with your concern, this can be improved in subsequent PRs

[GitHub] [spark] guykhazma commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
guykhazma commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-575870211 @gengliangwang thanks for reviewing. I agree with your concern, and also this can be improved in subsequent

[GitHub] [spark] guykhazma commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
guykhazma commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#discussion_r368208826 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala

[GitHub] [spark] linzebing commented on issue #27223: [SPARK-30511][SPARK-28403][CORE] Don't treat failed/killed speculative tasks as pending in Spark scheduler

2020-01-17 Thread GitBox
linzebing commented on issue #27223: [SPARK-30511][SPARK-28403][CORE] Don't treat failed/killed speculative tasks as pending in Spark scheduler URL: https://github.com/apache/spark/pull/27223#issuecomment-575865048 > Seem likes the same problem also exists for normal task when speculative

[GitHub] [spark] AmplabJenkins commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864674 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864676 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864676 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864674 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
SparkQA commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864592 **[Test build #116971 has

[GitHub] [spark] linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors

2020-01-17 Thread GitBox
linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#discussion_r368204585 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575864284 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gatorsmile commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE

2020-01-17 Thread GitBox
gatorsmile commented on issue #27260: [SPARK-30549][SQL] Fix the subquery shown issue in UI When enable AQE URL: https://github.com/apache/spark/pull/27260#issuecomment-575864324 retest this please This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575864282 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575864282 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575864284 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
SparkQA removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575841050 **[Test build #116968 has

[GitHub] [spark] SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575864178 **[Test build #116968 has

[GitHub] [spark] linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors

2020-01-17 Thread GitBox
linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#discussion_r368203963 ## File path:

[GitHub] [spark] linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors

2020-01-17 Thread GitBox
linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#discussion_r368203860 ## File path:

[GitHub] [spark] linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors

2020-01-17 Thread GitBox
linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#discussion_r368203775 ## File path:

[GitHub] [spark] linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors

2020-01-17 Thread GitBox
linzebing commented on a change in pull request #27223: [SPARK-30511][CORE] Spark marks intentionally killed speculative tasks as pending leads to holding idle executors URL: https://github.com/apache/spark/pull/27223#discussion_r368203775 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575859310 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575859307 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575859310 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA removed a comment on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857893 **[Test build #116970 has

[GitHub] [spark] AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575859307 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575859247 **[Test build #116970 has

[GitHub] [spark] vanzin commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2020-01-17 Thread GitBox
vanzin commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-575858951 That's the same "Launcher client dependencies" test that seems super flaky, and has failed with the same

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857986 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857983 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857986 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857983 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575857893 **[Test build #116970 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575856520 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575856520 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855200 **[Test build #116969 has

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575856518 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575856476 **[Test build #116969 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575856518 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855305 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855305 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend

2020-01-17 Thread GitBox
SparkQA commented on issue #27245: [WIP][SPARK-29212][ML][PYSPARK] Add common classes without using JVM backend URL: https://github.com/apache/spark/pull/27245#issuecomment-575855200 **[Test build #116969 has

[GitHub] [spark] zero323 commented on issue #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels

2020-01-17 Thread GitBox
zero323 commented on issue #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels URL: https://github.com/apache/spark/pull/27241#issuecomment-575855169 Thanks @huaxingao @srowen @zhengruifeng

[GitHub] [spark] dongjoon-hyun commented on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error URL: https://github.com/apache/spark/pull/27268#issuecomment-575854721 Oh, got it. Thank you for checking. This is an

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-17 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r368196763 ## File path:

[GitHub] [spark] srowen commented on issue #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels

2020-01-17 Thread GitBox
srowen commented on issue #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels URL: https://github.com/apache/spark/pull/27241#issuecomment-575853279 Merged to master This is an

[GitHub] [spark] srowen closed pull request #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels

2020-01-17 Thread GitBox
srowen closed pull request #27241: [SPARK-30533][ML][PYSPARK] Add classes to represent Java Regressors and RegressionModels URL: https://github.com/apache/spark/pull/27241 This is an automated message from the Apache Git

[GitHub] [spark] fuwhu commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore

2020-01-17 Thread GitBox
fuwhu commented on issue #27232: [SPARK-30525][SQL]HiveTableScanExec do not need to prune partitions again after pushing down to hive metastore URL: https://github.com/apache/spark/pull/27232#issuecomment-575852899 cc @cloud-fan

[GitHub] [spark] bettermouse edited a comment on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error

2020-01-17 Thread GitBox
bettermouse edited a comment on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error URL: https://github.com/apache/spark/pull/27268#issuecomment-575852494 @dongjoon-hyun I have checked it.The class JavaStructuredNetworkWordCountWindowed does not use API

[GitHub] [spark] bettermouse commented on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error

2020-01-17 Thread GitBox
bettermouse commented on issue #27268: [SPARK-30553][DOCS] fix structured-streaming java example error URL: https://github.com/apache/spark/pull/27268#issuecomment-575852494 I have checked it.The class JavaStructuredNetworkWordCountWindowed does not use API withWatermark. So there is no

[GitHub] [spark] dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#issuecomment-575852458 You are faster than me. :) This

[GitHub] [spark] maropu commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
maropu commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#issuecomment-575852189 hahaha, I was a bit late ;) This is an

[GitHub] [spark] dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#issuecomment-575851846 Thank you, @maropu ! This is an

[GitHub] [spark] dongjoon-hyun closed pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun closed pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#discussion_r368195075 ## File path: docs/sql-migration-guide.md ## @@ -344,6

[GitHub] [spark] dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on issue #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#issuecomment-575851702 Merged to master/2.4. This is

[GitHub] [spark] dongjoon-hyun closed pull request #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
dongjoon-hyun closed pull request #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130 This is an automated message from the Apache

[GitHub] [spark] viirya commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
viirya commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#discussion_r368194683 ## File path: docs/sql-migration-guide.md ## @@ -344,6 +344,12 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#discussion_r368193217 ## File path: docs/sql-migration-guide.md ## @@ -344,6

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect

2020-01-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27270: [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC dialect URL: https://github.com/apache/spark/pull/27270#discussion_r368193120 ## File path: docs/sql-migration-guide.md ## @@ -344,6

[GitHub] [spark] AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575849751 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575849745 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
AmplabJenkins commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575849751 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575849745 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
SparkQA removed a comment on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575824139 **[Test build #116967 has

[GitHub] [spark] SparkQA commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-17 Thread GitBox
SparkQA commented on issue #27130: [SPARK-25993][SQL][TESTS] Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/27130#issuecomment-575849490 **[Test build #116967 has

[GitHub] [spark] gengliangwang commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
gengliangwang commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-575848049 @guykhazma Sorry to reply late. I was thinking about another approach, but I can't come up with a better

[GitHub] [spark] gengliangwang commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
gengliangwang commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#discussion_r368189535 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-17 Thread GitBox
gengliangwang commented on a change in pull request #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#discussion_r368189550 ## File path:

[GitHub] [spark] github-actions[bot] closed pull request #21006: [SPARK-22256][MESOS] - Introduce spark.mesos.driver.memoryOverhead

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #21006: [SPARK-22256][MESOS] - Introduce spark.mesos.driver.memoryOverhead URL: https://github.com/apache/spark/pull/21006 This is an automated message from the Apache Git Service. To

[GitHub] [spark] github-actions[bot] commented on issue #14431: [SPARK-16258][SparkR] Automatically append the grouping keys in SparkR's gapply

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #14431: [SPARK-16258][SparkR] Automatically append the grouping keys in SparkR's gapply URL: https://github.com/apache/spark/pull/14431#issuecomment-575841442 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on

[GitHub] [spark] github-actions[bot] commented on issue #14936: [SPARK-7877][MESOS] Allow configuration of framework timeout

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #14936: [SPARK-7877][MESOS] Allow configuration of framework timeout URL: https://github.com/apache/spark/pull/14936#issuecomment-575841434 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR

[GitHub] [spark] github-actions[bot] closed pull request #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables URL: https://github.com/apache/spark/pull/15326 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] github-actions[bot] commented on issue #21164: [SPARK-24098][SQL] ScriptTransformationExec should wait process exiting before output iterator finish

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #21164: [SPARK-24098][SQL] ScriptTransformationExec should wait process exiting before output iterator finish URL: https://github.com/apache/spark/pull/21164#issuecomment-575841397 We're closing this PR because it hasn't been updated in a while. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575841301 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] github-actions[bot] commented on issue #15496: [SPARK-17950] [Python] Match SparseVector behavior with DenseVector

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #15496: [SPARK-17950] [Python] Match SparseVector behavior with DenseVector URL: https://github.com/apache/spark/pull/15496#issuecomment-575841424 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of

[GitHub] [spark] github-actions[bot] closed pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies method for Word2VecModel

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies method for Word2VecModel URL: https://github.com/apache/spark/pull/17234 This is an automated message from the Apache Git Service.

[GitHub] [spark] github-actions[bot] closed pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to HDFS size of partitions that are involved in Query for JoinSelection.

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallback to HDFS size of partitions that are involved in Query for JoinSelection. URL: https://github.com/apache/spark/pull/18193

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-575841295 Merged build finished. Test PASSed.

[GitHub] [spark] github-actions[bot] closed pull request #17365: [SPARK-19962] [MLlib] add DictVectorizer to ml.feature

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #17365: [SPARK-19962] [MLlib] add DictVectorizer to ml.feature URL: https://github.com/apache/spark/pull/17365 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] github-actions[bot] commented on issue #20935: [SPARK-23819][SQL] Fix InMemoryTableScanExec complex type pruning

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #20935: [SPARK-23819][SQL] Fix InMemoryTableScanExec complex type pruning URL: https://github.com/apache/spark/pull/20935#issuecomment-575841406 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of

[GitHub] [spark] github-actions[bot] commented on issue #13650: [SPARK-9623] [ML] Provide conditional variance for RandomForestRegressor

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #13650: [SPARK-9623] [ML] Provide conditional variance for RandomForestRegressor URL: https://github.com/apache/spark/pull/13650#issuecomment-575841447 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the

[GitHub] [spark] github-actions[bot] commented on issue #13379: [SPARK-12431][GraphX] Add local checkpointing to GraphX.

2020-01-17 Thread GitBox
github-actions[bot] commented on issue #13379: [SPARK-12431][GraphX] Add local checkpointing to GraphX. URL: https://github.com/apache/spark/pull/13379#issuecomment-575841455 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in

[GitHub] [spark] github-actions[bot] closed pull request #18123: [SPARK-20903] [ML] Word2Vec Skip-Gram + Negative Sampling

2020-01-17 Thread GitBox
github-actions[bot] closed pull request #18123: [SPARK-20903] [ML] Word2Vec Skip-Gram + Negative Sampling URL: https://github.com/apache/spark/pull/18123 This is an automated message from the Apache Git Service. To respond

  1   2   3   4   5   6   7   8   9   10   >