[GitHub] [spark] JkSelf commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
JkSelf commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564423425 Please help to retest. Thanks. This is an

[GitHub] [spark] HeartSaVioR edited a comment on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS

2019-12-10 Thread GitBox
HeartSaVioR edited a comment on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS URL: https://github.com/apache/spark/pull/26821#issuecomment-564422644 @shahidki31 No I didn't intend to persuade you to close this. I'd just wanted to make sure we get a

[GitHub] [spark] HeartSaVioR commented on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS

2019-12-10 Thread GitBox
HeartSaVioR commented on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS URL: https://github.com/apache/spark/pull/26821#issuecomment-564422644 @shahidki31 No I didn't intend to persuade you to close this. I'd just wanted to make sure we get a clear

[GitHub] [spark] yaooqinn commented on issue #26847: [SPARK-30214][SQL] Support COMMENT ON syntax

2019-12-10 Thread GitBox
yaooqinn commented on issue #26847: [SPARK-30214][SQL] Support COMMENT ON syntax URL: https://github.com/apache/spark/pull/26847#issuecomment-564422183 a pre-discussion might be found here https://github.com/apache/spark/pull/26806 thanks again.

[GitHub] [spark] yaooqinn commented on issue #26847: [SPARK-30214][SQL] Support COMMENT ON syntax

2019-12-10 Thread GitBox
yaooqinn commented on issue #26847: [SPARK-30214][SQL] Support COMMENT ON syntax URL: https://github.com/apache/spark/pull/26847#issuecomment-564421490 cc @cloud-fan @maropu, thanks for reviewing this. This is an automated

[GitHub] [spark] yaooqinn opened a new pull request #26847: [SPARK-30214][SQL] Support COMMENT ON syntax

2019-12-10 Thread GitBox
yaooqinn opened a new pull request #26847: [SPARK-30214][SQL] Support COMMENT ON syntax URL: https://github.com/apache/spark/pull/26847 ### What changes were proposed in this pull request? As the new design of catalog v2, some properties become reserved, e.g. `location`, `comment`.

[GitHub] [spark] shahidki31 edited a comment on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS

2019-12-10 Thread GitBox
shahidki31 edited a comment on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS URL: https://github.com/apache/spark/pull/26821#issuecomment-564417301 > From what I tested locally, filtering by lines roughly takes about 30 seconds for file sizes ranging

[GitHub] [spark] SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564419192 **[Test build #115158 has

[GitHub] [spark] dongjoon-hyun edited a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun edited a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417855 FYI, `make-distribution.sh` is also used in the following Jenkins job. I triggered to make it sure that our

[GitHub] [spark] dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417855 FYI, `make-distribution.sh` is also used in the following Jenkins job. I triggered to make it sure that our Jenkins is

[GitHub] [spark] zhengruifeng edited a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
zhengruifeng edited a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564413213 @srowen I impl a simple `treeAggregateByKey`

[GitHub] [spark] cloud-fan commented on a change in pull request #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#discussion_r356439923 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417286 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417274 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417286 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] shahidki31 commented on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS

2019-12-10 Thread GitBox
shahidki31 commented on issue #26821: [SPARK-20656][CORE]Support Incremental parsing of event logs in SHS URL: https://github.com/apache/spark/pull/26821#issuecomment-564417301 > From what I tested locally, filtering by lines roughly takes about 30 seconds for file sizes ranging from 10MB

[GitHub] [spark] AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564417274 Merged build finished. Test PASSed. This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #26779: [SPARK-30150][SQL] ADD FILE, ADD JAR, LIST FILE & LIST JAR Command do not accept quoted path

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26779: [SPARK-30150][SQL] ADD FILE, ADD JAR, LIST FILE & LIST JAR Command do not accept quoted path URL: https://github.com/apache/spark/pull/26779#discussion_r356438818 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564416361 It's merged now. Please proceed to the docker issue and ping me if you need my help.

[GitHub] [spark] SparkQA commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
SparkQA commented on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564416473 **[Test build #115145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115145/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564383404 **[Test build #115145 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564415612 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun closed pull request #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun closed pull request #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564415605 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564415423 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564415419 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#issuecomment-564415544 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564415463 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564415460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#issuecomment-564415495 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#issuecomment-564415481 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26844: [SPARK-30211][INFRA] Use python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564415450 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564415605 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564415447 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#issuecomment-564415538 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564415612 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564415450 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#issuecomment-564415495 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#issuecomment-564415481 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564415463 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564415460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#issuecomment-564415538 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564415447 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564415423 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#issuecomment-564415544 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564415419 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces

2019-12-10 Thread GitBox
SparkQA commented on issue #26773: [SPARK-30126][CORE] sparkContext.addFile and sparkContext.addJar fails when file path contains spaces URL: https://github.com/apache/spark/pull/26773#issuecomment-564414528 **[Test build #115157 has

[GitHub] [spark] SparkQA commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
SparkQA commented on issue #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#issuecomment-564414526 **[Test build #115156 has

[GitHub] [spark] SparkQA commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
SparkQA commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564414518 **[Test build #115154 has

[GitHub] [spark] SparkQA commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
SparkQA commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564414517 **[Test build #115155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115155/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
SparkQA commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564414490 **[Test build #115153 has

[GitHub] [spark] SparkQA commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
SparkQA commented on issue #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846#issuecomment-564414338 **[Test build #115152 has

[GitHub] [spark] dongjoon-hyun removed a comment on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun removed a comment on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564414062 Let's revert the doc~ This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#discussion_r356435745 ## File path: docs/building-spark.md ## @@ -66,7 +66,7 @@ with Maven

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#discussion_r356435745 ## File path: docs/building-spark.md ## @@ -66,7 +66,7 @@ with Maven

[GitHub] [spark] cloud-fan commented on issue #26811: [SPARK-29600][SQL] array_contains built in function is not backward compatible in 3.0

2019-12-10 Thread GitBox
cloud-fan commented on issue #26811: [SPARK-29600][SQL] array_contains built in function is not backward compatible in 3.0 URL: https://github.com/apache/spark/pull/26811#issuecomment-564414076 @amanomer do you know which PR causes the compatibility issue? We need to see if it's

[GitHub] [spark] dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
dongjoon-hyun commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564414062 Let's revert the doc~ This is an automated

[GitHub] [spark] Fokko commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-12-10 Thread GitBox
Fokko commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-564413559 Rebased onto master This is an automated message

[GitHub] [spark] wangyum commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
wangyum commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564413141 > Do you want to do that separately? Then, I'll merge this first. Yes. I'd like to do that separately.

[GitHub] [spark] zhengruifeng commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
zhengruifeng commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564413213 @srowen I impl a simple `treeAggregateByKey`

[GitHub] [spark] Fokko commented on a change in pull request #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
Fokko commented on a change in pull request #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#discussion_r356433990 ## File path: python/pyspark/sql/avro/functions.py ## @@ -30,9 +30,10

[GitHub] [spark] Fokko commented on a change in pull request #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-10 Thread GitBox
Fokko commented on a change in pull request #26780: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/26780#discussion_r356433702 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356432760 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356432466 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564410295 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356432466 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564410289 Merged build finished. Test PASSed. This is an

[GitHub] [spark] wangyum commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh

2019-12-10 Thread GitBox
wangyum commented on issue #26844: [SPARK-30211][INFRA] Switch python to python3 in make-distribution.sh URL: https://github.com/apache/spark/pull/26844#issuecomment-564410098 SPARK-29672 changed it: https://github.com/apache/spark/pull/26330/files#diff-8cf6167d58ce775a08acafcfe6f40966

[GitHub] [spark] AmplabJenkins commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564410289 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564410295 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356432239 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356432177 ## File path:

[GitHub] [spark] JkSelf opened a new pull request #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec

2019-12-10 Thread GitBox
JkSelf opened a new pull request #26846: [SPARK-30213] [SQL]Remove the mutable status in ShuffleQueryStageExec URL: https://github.com/apache/spark/pull/26846 ### What changes were proposed in this pull request? Currently `ShuffleQueryStageExec `contain the mutable status, eg

[GitHub] [spark] HeartSaVioR commented on issue #24128: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2019-12-10 Thread GitBox
HeartSaVioR commented on issue #24128: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files URL: https://github.com/apache/spark/pull/24128#issuecomment-564409487 @uncleGen Hi, do you plan to go ahead with your idea? I have been thinking about this

[GitHub] [spark] SparkQA commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
SparkQA commented on issue #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#issuecomment-564409357 **[Test build #115151 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115151/testReport)** for PR

[GitHub] [spark] PavithraRamachandran commented on issue #26384: [SPARK-29460] [WEBUI]Add tooltip for Jobs page

2019-12-10 Thread GitBox
PavithraRamachandran commented on issue #26384: [SPARK-29460] [WEBUI]Add tooltip for Jobs page URL: https://github.com/apache/spark/pull/26384#issuecomment-564408513 @srowen could you help me re trigger the PR build? This is

[GitHub] [spark] HeartSaVioR commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly

2019-12-10 Thread GitBox
HeartSaVioR commented on issue #26845: [SPARK-21869][SS] Revise Kafka producer pool to implement 'expire' correctly URL: https://github.com/apache/spark/pull/26845#issuecomment-564407397 Ah yes I had been investigating the issue. Thanks for reminding! Will update soon.

[GitHub] [spark] amanomer commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
amanomer commented on a change in pull request #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#discussion_r356428632 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564405114 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564405106 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564405200 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564405203 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564405200 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564405203 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564387974 **[Test build #115146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115146/testReport)**

[GitHub] [spark] SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-564404957 **[Test build #115146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115146/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564405114 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564405106 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564387975 **[Test build #115147 has

[GitHub] [spark] SparkQA commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
SparkQA commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-564404790 **[Test build #115147 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115147/testReport)**

[GitHub] [spark] SparkQA commented on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
SparkQA commented on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#issuecomment-564404094 **[Test build #115150 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution

2019-12-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26840#discussion_r356423436 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution

2019-12-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26840#discussion_r356423491 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution

2019-12-10 Thread GitBox
dongjoon-hyun commented on a change in pull request #26840: [SPARK-30038][SQL] DESCRIBE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26840#discussion_r356423053 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26512: [SPARK-29493][SQL] Arrow MapType support

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26512: [SPARK-29493][SQL] Arrow MapType support URL: https://github.com/apache/spark/pull/26512#issuecomment-564400557 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#issuecomment-564400567 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#issuecomment-564400558 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26512: [SPARK-29493][SQL] Arrow MapType support

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26512: [SPARK-29493][SQL] Arrow MapType support URL: https://github.com/apache/spark/pull/26512#issuecomment-564400566 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #26817: [SPARK-30192][SQL] support column position in DS v2

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26817: [SPARK-30192][SQL] support column position in DS v2 URL: https://github.com/apache/spark/pull/26817#discussion_r356422627 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/TableChange.java

[GitHub] [spark] AmplabJenkins commented on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26808: [SPARK-30184][SQL] Implement a helper method for aliasing functions URL: https://github.com/apache/spark/pull/26808#issuecomment-564400558 Merged build finished. Test PASSed. This is

  1   2   3   4   5   6   7   8   9   10   >