[GitHub] [spark] AmplabJenkins commented on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic URL: https://github.com/apache/spark/pull/26830#issuecomment-564020424 Merged build finished. Test FAILed. This

[GitHub] [spark] cloud-fan commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
cloud-fan commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564020392 thanks, merging to master! This i

[GitHub] [spark] cloud-fan edited a comment on issue #26473: [SPARK-29864][SPARK-29920][SQL] Strict parsing of day-time strings to intervals

2019-12-10 Thread GitBox
cloud-fan edited a comment on issue #26473: [SPARK-29864][SPARK-29920][SQL] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-564020139 It has been a while, can you remind me what's your workaround? BTW I feel it's also OK to use m

[GitHub] [spark] cloud-fan commented on issue #26473: [SPARK-29864][SPARK-29920][SQL] Strict parsing of day-time strings to intervals

2019-12-10 Thread GitBox
cloud-fan commented on issue #26473: [SPARK-29864][SPARK-29920][SQL] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-564020139 It has been a while, can you remind me what's your workaround? BTW I feel it's also OK to use my fix:

[GitHub] [spark] srowen commented on a change in pull request #26826: [SPARK-30195][SQL][CORE][ML] Change some function, import definitions to work with stricter compiler in Scala 2.13

2019-12-10 Thread GitBox
srowen commented on a change in pull request #26826: [SPARK-30195][SQL][CORE][ML] Change some function, import definitions to work with stricter compiler in Scala 2.13 URL: https://github.com/apache/spark/pull/26826#discussion_r356019937 ## File path: sql/core/src/main/scala/org/a

[GitHub] [spark] SparkQA removed a comment on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic URL: https://github.com/apache/spark/pull/26830#issuecomment-563948496 **[Test build #115096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] SparkQA commented on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic

2019-12-10 Thread GitBox
SparkQA commented on issue #26830: [MINOR][SQL] Rename normalizeFilters in DataSourceStrategy to be generic URL: https://github.com/apache/spark/pull/26830#issuecomment-564019829 **[Test build #115096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115096/t

[GitHub] [spark] cloud-fan commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE …

2019-12-10 Thread GitBox
cloud-fan commented on issue #26806: [SPARK-30183][SQL] Disallow to specify reserved properties in CREATE … URL: https://github.com/apache/spark/pull/26806#issuecomment-564019443 presto also has the COMMENT ON command: https://prestosql.io/docs/current/sql/comment.html Can we add it

[GitHub] [spark] yaooqinn commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal

2019-12-10 Thread GitBox
yaooqinn commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal URL: https://github.com/apache/spark/pull/26537#discussion_r356016864 ## File path: sql/core/src/test/resources/sql-tests/inputs/show-create-table.

[GitHub] [spark] cloud-fan commented on issue #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal

2019-12-10 Thread GitBox
cloud-fan commented on issue #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal URL: https://github.com/apache/spark/pull/26537#issuecomment-564016015 According to the SQL standard, I think we should have named our float type as REAL, and decimal type

[GitHub] [spark] cloud-fan commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal URL: https://github.com/apache/spark/pull/26537#discussion_r356014143 ## File path: sql/core/src/test/resources/sql-tests/inputs/show-create-table

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-564014287 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-564014270 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-564014287 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-564014270 Merged build finished. Test PASSed. Th

[GitHub] [spark] SparkQA removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-563926086 **[Test build #115094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
SparkQA commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-564013619 **[Test build #115094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115094

[GitHub] [spark] cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#discussion_r356009963 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer

[GitHub] [spark] cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#discussion_r356007245 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer

[GitHub] [spark] AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564008292 Test FAILed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] SparkQA removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564002149 **[Test build #115103 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564008282 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564008282 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564008292 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] SparkQA commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
SparkQA commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564008242 **[Test build #115103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] AmplabJenkins commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564004934 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564004941 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564004941 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564004934 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-563921038 **[Test build #115093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#discussion_r356000489 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/

[GitHub] [spark] cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#discussion_r356000376 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/

[GitHub] [spark] SparkQA commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched

2019-12-10 Thread GitBox
SparkQA commented on issue #26781: [SPARK-30151][SQL] Issue better error message when user-specified schema mismatched URL: https://github.com/apache/spark/pull/26781#issuecomment-564004240 **[Test build #115093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564003144 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564003136 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564003136 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564003144 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] ulysses-you closed pull request #26627: [SPARK-29987][SQL] Add CatalogTable cache in SessionCatalog to improve performance

2019-12-10 Thread GitBox
ulysses-you closed pull request #26627: [SPARK-29987][SQL] Add CatalogTable cache in SessionCatalog to improve performance URL: https://github.com/apache/spark/pull/26627 This is an automated message from the Apache Git Serv

[GitHub] [spark] SparkQA commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
SparkQA commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-564002149 **[Test build #115103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-564001257 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-564001249 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-564001257 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-564001249 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] SparkQA removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-563915601 **[Test build #115091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115091/testReport)*

[GitHub] [spark] SparkQA commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
SparkQA commented on issue #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#issuecomment-564000272 **[Test build #115091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115091/testReport)** for

[GitHub] [spark] yaooqinn commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
yaooqinn commented on issue #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833#issuecomment-563998926 cc @cloud-fan @maropu @HyukjinKwon @gengliangwang @gatorsmile @dongjoon-hyun, IIUC, the

[GitHub] [spark] cloud-fan commented on a change in pull request #26779: [SPARK-30150][SQL]ADD FILE, ADD JAR, LIST FILE & LIST JAR Command do not accept quoted path

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26779: [SPARK-30150][SQL]ADD FILE, ADD JAR, LIST FILE & LIST JAR Command do not accept quoted path URL: https://github.com/apache/spark/pull/26779#discussion_r355993690 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/

[GitHub] [spark] yaooqinn opened a new pull request #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function

2019-12-10 Thread GitBox
yaooqinn opened a new pull request #26833: [WIP][SPARK-30203][SQL] store assignable if there is an appropriate user-defined cast function URL: https://github.com/apache/spark/pull/26833 … ### What changes were proposed in this pull request? 9.2 Store assignment # S

[GitHub] [spark] AmplabJenkins removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563996344 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] SparkQA removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563955336 **[Test build #115098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115098/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563996337 Merged build finished. Test FAILed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563996337 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563996344 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] SparkQA commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0

2019-12-10 Thread GitBox
SparkQA commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-563996031 **[Test build #115098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115098/testReport)** fo

[GitHub] [spark] AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563994649 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563994649 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563994644 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563994644 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] SparkQA removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563970236 **[Test build #115099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115099/testReport

[GitHub] [spark] SparkQA commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures

2019-12-10 Thread GitBox
SparkQA commented on issue #26803: [SPARK-30178][ML] RobustScaler support large numFeatures URL: https://github.com/apache/spark/pull/26803#issuecomment-563994217 **[Test build #115099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115099/testReport)** fo

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355987639 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchan

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355987379 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/SkewedShuffle

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355986671 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/SkewedShuffle

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355986671 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/SkewedShuffle

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992296 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992631 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992631 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT URL: https://github.com/apache/spark/pull/26831#issuecomment-563991455 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992288 Merged build finished. Test FAILed. This is an automated messag

[GitHub] [spark] SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992276 **[Test build #115102 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115102/testReport)** for PR 26

[GitHub] [spark] AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992288 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
SparkQA removed a comment on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563991560 **[Test build #115102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115102/testReport)** fo

[GitHub] [spark] AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563992296 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] AmplabJenkins commented on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT URL: https://github.com/apache/spark/pull/26831#issuecomment-563992488 Can one of the admins verify this patch? -

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355985392 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355985286 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
SparkQA commented on issue #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832#issuecomment-563991560 **[Test build #115102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/115102/testReport)** for PR 268

[GitHub] [spark] AmplabJenkins commented on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT

2019-12-10 Thread GitBox
AmplabJenkins commented on issue #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT URL: https://github.com/apache/spark/pull/26831#issuecomment-563991455 Can one of the admins verify this patch? -

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355981900 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] ulysses-you commented on a change in pull request #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain

2019-12-10 Thread GitBox
ulysses-you commented on a change in pull request #26829: [SPARK-30200][SQL] Add ExplainMode for Dataset.explain URL: https://github.com/apache/spark/pull/26829#discussion_r355981777 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -522,36 +52

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355981265 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355980746 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355979974 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] zhengruifeng opened a new pull request #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform

2019-12-10 Thread GitBox
zhengruifeng opened a new pull request #26832: [SPARK-30202][ML][PYSPARK] impl QuantileTransform URL: https://github.com/apache/spark/pull/26832 ### What changes were proposed in this pull request? Impl QuantileTransform, a non-parametric transformation to map the data to another dis

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355968881 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355979211 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] ulysses-you opened a new pull request #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT

2019-12-10 Thread GitBox
ulysses-you opened a new pull request #26831: [SPARK-30201][SQL] HiveOutputWriter standardOI should use ObjectInspectorCopyOption.DEFAULT URL: https://github.com/apache/spark/pull/26831 ### What changes were proposed in this pull request? Now spark use `ObjectInspectorCopyOpt

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355978751 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355977252 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355974183 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355974183 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355973530 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355972798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] manuzhang commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
manuzhang commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355971504 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355971453 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355968844 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355968881 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-10 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r355966698 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala

<    5   6   7   8   9   10   11   12   >