[GitHub] [spark] AmplabJenkins commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#issuecomment-571683395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#issuecomment-571683386 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] SparkQA commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-07 Thread GitBox
SparkQA commented on issue #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#issuecomment-571682818 **[Test build #116252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116252/testReport)*

[GitHub] [spark] mengxr commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
mengxr commented on a change in pull request #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#discussion_r363845469 ## File path: python/pyspark/sql/dataframe.py ## @@ -31,23 +3

[GitHub] [spark] AmplabJenkins removed a comment on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571673144 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571673144 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571673155 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571673155 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] [spark] SparkQA commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
SparkQA commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571672667 **[Test build #116251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] AmplabJenkins commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats URL: https://github.com/apache/spark/pull/26016#issuecomment-571669899 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats URL: https://github.com/apache/spark/pull/26016#issuecomment-571669899 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats URL: https://github.com/apache/spark/pull/26016#issuecomment-571669887 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats URL: https://github.com/apache/spark/pull/26016#issuecomment-571669887 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats

2020-01-07 Thread GitBox
SparkQA commented on issue #26016: [SPARK-24914][SQL] New statistic to improve data size estimate for columnar storage formats URL: https://github.com/apache/spark/pull/26016#issuecomment-571669236 **[Test build #116250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] cloud-fan closed pull request #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-07 Thread GitBox
cloud-fan closed pull request #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] cloud-fan commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution

2020-01-07 Thread GitBox
cloud-fan commented on issue #26890: [SPARK-30039][SQL] CREATE FUNCTION should do multi-catalog resolution URL: https://github.com/apache/spark/pull/26890#issuecomment-571667688 thanks, merging to master! This is an automated

[GitHub] [spark] 012huang commented on issue #27060: [SPARK-30246][CORE][SHUFFLE]fix spark external shuffle memory leak

2020-01-07 Thread GitBox
012huang commented on issue #27060: [SPARK-30246][CORE][SHUFFLE]fix spark external shuffle memory leak URL: https://github.com/apache/spark/pull/27060#issuecomment-571666482 the shuffle service still exists memory leak in 2.4.3 and I am informed some other users have facing the problem.

[GitHub] [spark] viirya commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
viirya commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571664120 > If we really need to output the error message for large `expected.catalogString`, it will fail wi

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363833688 ## File path: docs/sql-migration-guide.md ## @@ -264,6 +264,8

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363833688 ## File path: docs/sql-migration-guide.md ## @@ -264,6 +264,8

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363832515 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/D

[GitHub] [spark] cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#discussion_r363832757 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/D

[GitHub] [spark] SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
SparkQA commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571658302 **[Test build #116249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r363825813 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQue

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571655131 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] [spark] AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571655117 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571655117 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE NAMESPACE syntax URL: https://github.com/apache/spark/pull/26806#issuecomment-571655131 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r363824664 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/InsertAdapt

[GitHub] [spark] amanomer closed pull request #27108: [SPARK-30437][SQL] Uneven spaces for some fields in EXPLAIN FORMATTED

2020-01-07 Thread GitBox
amanomer closed pull request #27108: [SPARK-30437][SQL] Uneven spaces for some fields in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27108 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] amanomer commented on a change in pull request #27108: [SPARK-30437][SQL] Uneven spaces for some fields in EXPLAIN FORMATTED

2020-01-07 Thread GitBox
amanomer commented on a change in pull request #27108: [SPARK-30437][SQL] Uneven spaces for some fields in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/27108#discussion_r363823835 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashJoin.sca

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r363822669 ## File path: sql/core/src/test/resources/sql-tests/inputs/explain.sql ## @@ -1,

[GitHub] [spark] cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#discussion_r363822361 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571651384 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571651368 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571651384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571651150 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571651110 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571651150 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571651127 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571651168 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571651368 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571651127 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571651168 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571651110 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571647598 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] SparkQA commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
SparkQA commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571650447 **[Test build #116247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116247/testReport)** fo

[GitHub] [spark] peter-toth commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
peter-toth commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571650699 I extracted this bug fixing part from https://github.com/apache/spark/pull/24553, its easier to review. --

[GitHub] [spark] SparkQA commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
SparkQA commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571650486 **[Test build #116248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116248/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571647590 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571586512 **[Test build #116240 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] [spark] SparkQA commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package

2020-01-07 Thread GitBox
SparkQA commented on issue #27109: [SPARK-30434][PYTHON][SQL] Move pandas related functionalities into 'pandas' sub-package URL: https://github.com/apache/spark/pull/27109#issuecomment-571650150 **[Test build #116240 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571473740 Can one of the admins verify this patch?

[GitHub] [spark] cloud-fan commented on a change in pull request #27110: [SPARK-30439][SQL] Support NOT NULL in column data type

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #27110: [SPARK-30439][SQL] Support NOT NULL in column data type URL: https://github.com/apache/spark/pull/27110#discussion_r363819737 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] srowen commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
srowen commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571649732 Jenkins test this please This is an automated m

[GitHub] [spark] ajithme commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
ajithme commented on issue #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#issuecomment-571649163 Updated with review comments. Please review cc @srowen @Ngone51 @cloud-fan ---

[GitHub] [spark] echauchot removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2020-01-07 Thread GitBox
echauchot removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-532221366 @AmplabJenkins it requires a more in depth change of spark (change the watermarks design). So it cannot be merge

[GitHub] [spark] AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571647590 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119#issuecomment-571647598 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] ajithme commented on a change in pull request #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
ajithme commented on a change in pull request #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#discussion_r363817058 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scal

[GitHub] [spark] ajithme commented on a change in pull request #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite

2020-01-07 Thread GitBox
ajithme commented on a change in pull request #27115: [SPARK-30440] Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite URL: https://github.com/apache/spark/pull/27115#discussion_r363816675 ## File path: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scal

[GitHub] [spark] peter-toth opened a new pull request #27119: [SPARK-30447][SQL] Constant propagation nullability issue

2020-01-07 Thread GitBox
peter-toth opened a new pull request #27119: [SPARK-30447][SQL] Constant propagation nullability issue URL: https://github.com/apache/spark/pull/27119 ## What changes were proposed in this pull request? This PR fixes `ConstantPropagation` rule as the current implementation produce i

[GitHub] [spark] AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571642623 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571642629 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571629148 **[Test build #116244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571642623 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571642629 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] SparkQA commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException

2020-01-07 Thread GitBox
SparkQA commented on issue #27042: [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent ClassNotFoundException URL: https://github.com/apache/spark/pull/27042#issuecomment-571642455 **[Test build #116244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] cloud-fan commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor

2020-01-07 Thread GitBox
cloud-fan commented on issue #27117: [SPARK-30429][SQL] ValidateExternalType should not initiate errMsg in the constructor URL: https://github.com/apache/spark/pull/27117#issuecomment-571640555 +1 to truncate `expected.catalogString`

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571636899 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571636890 Merged build finished. Test FAILed. Th

[GitHub] [spark] AmplabJenkins commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118#issuecomment-571636871 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571636853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571636853 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] SparkQA removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571566579 **[Test build #116239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116239/

[GitHub] [spark] AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571636832 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118#issuecomment-571636858 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571636832 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571636899 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118#issuecomment-571636858 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118#issuecomment-571636871 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571636890 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default

2020-01-07 Thread GitBox
SparkQA commented on issue #26813: [SPARK-30188][SQL][WIP] Enable adaptive query execution by default URL: https://github.com/apache/spark/pull/26813#issuecomment-571636549 **[Test build #116239 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116239/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635715 Test FAILed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] SparkQA commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
SparkQA commented on issue #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118#issuecomment-571636245 **[Test build #116245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11624

[GitHub] [spark] AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635701 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
SparkQA commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571636234 **[Test build #116246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116246/tes

[GitHub] [spark] tgravescs opened a new pull request #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0

2020-01-07 Thread GitBox
tgravescs opened a new pull request #27118: [SPARK-30445][Core] Accelerator aware scheduling handle setting configs to 0 URL: https://github.com/apache/spark/pull/27118 …0 better ### What changes were proposed in this pull request? Handle the accelerator aware conf

[GitHub] [spark] srowen commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
srowen commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635858 Jenkins retest this please This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635701 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635715 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571589779 **[Test build #116241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] SparkQA commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs

2020-01-07 Thread GitBox
SparkQA commented on issue #27061: [MINOR][CORE] Process bar should print new line to avoid polluting logs URL: https://github.com/apache/spark/pull/27061#issuecomment-571635316 **[Test build #116241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116241/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571633955 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
AmplabJenkins removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571633933 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571633955 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
AmplabJenkins commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571633933 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
SparkQA commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571633408 **[Test build #116242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116

[GitHub] [spark] SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-07 Thread GitBox
SparkQA removed a comment on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-571589849 **[Test build #116242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] cloud-fan commented on a change in pull request #27110: [SPARK-30439][SQL] Support NOT NULL in column data type

2020-01-07 Thread GitBox
cloud-fan commented on a change in pull request #27110: [SPARK-30439][SQL] Support NOT NULL in column data type URL: https://github.com/apache/spark/pull/27110#discussion_r363796155 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala

<    3   4   5   6   7   8   9   10   11   12   >