[GitHub] [spark] AmplabJenkins commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base

AmplabJenkins commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base URL: https://github.com/apache/spark/pull/25101#issuecomment-510288338 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] cloud-fan commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

cloud-fan commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510288275 thanks, merging to master! This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base

AmplabJenkins commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base URL: https://github.com/apache/spark/pull/25101#issuecomment-510288331 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base

SparkQA removed a comment on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base URL: https://github.com/apache/spark/pull/25101#issuecomment-510247424 **[Test build #107487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base

SparkQA commented on issue #25101: [SPARK-28277][SQL][PYTHON][TESTS] Convert and port 'except.sql' into UDF test base URL: https://github.com/apache/spark/pull/25101#issuecomment-510287970 **[Test build #107487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] dongjoon-hyun commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

dongjoon-hyun commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287567 Sure. I'll rerun and make a PR to you tonight. ---

[GitHub] [spark] cloud-fan closed pull request #24768: [SPARK-27919][SQL] Add v2 session catalog

cloud-fan closed pull request #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [spark] dongjoon-hyun closed pull request #25097: [SPARK-28015][SQL] Check stringToDate() consumes entire input for the yyyy and yyyy-[m]m formats

dongjoon-hyun closed pull request #25097: [SPARK-28015][SQL] Check stringToDate() consumes entire input for the and -[m]m formats URL: https://github.com/apache/spark/pull/25097 This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287528 **[Test build #107495 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107495

[GitHub] [spark] HyukjinKwon closed pull request #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base

HyukjinKwon closed pull request #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base URL: https://github.com/apache/spark/pull/25069 This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

AmplabJenkins removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510287130 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

AmplabJenkins removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510287134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287126 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287126 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

AmplabJenkins commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510287130 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287122 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

AmplabJenkins commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510287134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510287122 Merged build finished. Test PASSed. --

[GitHub] [spark] HyukjinKwon commented on issue #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base

HyukjinKwon commented on issue #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base URL: https://github.com/apache/spark/pull/25069#issuecomment-510286994 Merged to master. This

[GitHub] [spark] HyukjinKwon commented on issue #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base

HyukjinKwon commented on issue #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base URL: https://github.com/apache/spark/pull/25069#issuecomment-510286949 I am going to merge this since I am anyway going to make a followup. We can proceed the

[GitHub] [spark] SparkQA removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

SparkQA removed a comment on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510256504 **[Test build #107489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107489

[GitHub] [spark] brkyvz commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog

brkyvz commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#issuecomment-510286728 After discussing with @cloud-fan offline, my thoughts are: - Getting rid of `spark.sql.catalog.session` - Use `spark.sql.default.catalog`

[GitHub] [spark] SparkQA commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

SparkQA commented on issue #24804: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor. URL: https://github.com/apache/spark/pull/24804#issuecomment-510286744 **[Test build #107489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107489/testRe

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302329225 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] viirya commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

viirya commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510286138 @dongjoon-hyun oh, yes, the new config should be enabled. Let me add it. Would you like to re-submit a PR aft

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302329089 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

dongjoon-hyun commented on a change in pull request #25059: [SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL URL: https://github.com/apache/spark/pull/25059#discussion_r302329029 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base URL: https://github.com/apache/spark/pull/25098#discussion_r302328542 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-gr

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base URL: https://github.com/apache/spark/pull/25098#discussion_r302328906 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-gr

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base URL: https://github.com/apache/spark/pull/25098#discussion_r302328827 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-gr

[GitHub] [spark] dongjoon-hyun closed pull request #25000: [SPARK-28107][SQL] Support 'DAY TO (HOUR|MINUTE|SECOND)', 'HOUR TO (MINUTE|SECOND)' and 'MINUTE TO SECOND'

dongjoon-hyun closed pull request #25000: [SPARK-28107][SQL] Support 'DAY TO (HOUR|MINUTE|SECOND)', 'HOUR TO (MINUTE|SECOND)' and 'MINUTE TO SECOND' URL: https://github.com/apache/spark/pull/25000 This is an automated messag

[GitHub] [spark] HyukjinKwon closed pull request #25093: [SPARK-28281][SQL][PYTHON][TESTS]Convert and port 'having.sql' into UDF test base

HyukjinKwon closed pull request #25093: [SPARK-28281][SQL][PYTHON][TESTS]Convert and port 'having.sql' into UDF test base URL: https://github.com/apache/spark/pull/25093 This is an automated message from the Apache Git Serv

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25096: [SPARK-28334][SQL][TEST] Port select.sql

dongjoon-hyun commented on a change in pull request #25096: [SPARK-28334][SQL][TEST] Port select.sql URL: https://github.com/apache/spark/pull/25096#discussion_r302327530 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala ## @@ -487,6 +487,3

[GitHub] [spark] brkyvz commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog

brkyvz commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#issuecomment-510284643 @cloud-fan I think it is necessary to be able to configure the session catalog. I'm just unsure on the naming of the configuration, as it may le

[GitHub] [spark] cloud-fan commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog

cloud-fan commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#issuecomment-510284607 I'm merging it and will send follow up PR according to https://github.com/rdblue/spark/pull/7 , since it's arguable if we want to make sessi

[GitHub] [spark] HyukjinKwon commented on issue #25093: [SPARK-28281][SQL][PYTHON][TESTS]Convert and port 'having.sql' into UDF test base

HyukjinKwon commented on issue #25093: [SPARK-28281][SQL][PYTHON][TESTS]Convert and port 'having.sql' into UDF test base URL: https://github.com/apache/spark/pull/25093#issuecomment-510284183 Merged to master. This is an auto

[GitHub] [spark] dongjoon-hyun commented on issue #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

dongjoon-hyun commented on issue #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base URL: https://github.com/apache/spark/pull/25086#issuecomment-510283955 Thank you, @HyukjinKwon ~ -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

AmplabJenkins removed a comment on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations. URL: https://github.com/apache/spark/pull/24875#issuecomment-510283809 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

AmplabJenkins commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510283760 Merged build finished. Test PASSed. Thi

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

dongjoon-hyun commented on a change in pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base URL: https://github.com/apache/spark/pull/25086#discussion_r302327247 ## File path: sql/core/src/test/resources/sql-tests/

[GitHub] [spark] HyukjinKwon commented on issue #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base

HyukjinKwon commented on issue #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base URL: https://github.com/apache/spark/pull/25098#issuecomment-510283866 As a workaround, maybe we can also wrap the `udf(...)` with, for instance, `upper` - `upper(udf

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510283538 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510283531 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA removed a comment on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

SparkQA removed a comment on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations. URL: https://github.com/apache/spark/pull/24875#issuecomment-510256499 **[Test build #107488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] AmplabJenkins commented on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

AmplabJenkins commented on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations. URL: https://github.com/apache/spark/pull/24875#issuecomment-510283809 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

AmplabJenkins removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510283765 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

AmplabJenkins removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510283760 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510283531 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

AmplabJenkins commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510283765 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] imback82 commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

imback82 commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#discussion_r302326966 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-exc

[GitHub] [spark] AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-510282713 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

AmplabJenkins removed a comment on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-510282716 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] SparkQA removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

SparkQA removed a comment on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510237070 **[Test build #107486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] SparkQA commented on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

SparkQA commented on issue #24875: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations. URL: https://github.com/apache/spark/pull/24875#issuecomment-510283488 **[Test build #107488 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510283538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] SparkQA removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

SparkQA removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510234655 **[Test build #107485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

SparkQA commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510283359 **[Test build #107486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107486/

[GitHub] [spark] HyukjinKwon commented on issue #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base

HyukjinKwon commented on issue #25098: [SPARK-28280][SQL][PYTHON][TESTS] Convert and port 'group-by.sql' into UDF test base URL: https://github.com/apache/spark/pull/25098#issuecomment-510283330 Yes, there is the difference about that. I noted it here - https://github.com/apache/spark/pull

[GitHub] [spark] imback82 commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

imback82 commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#discussion_r302326809 ## File path: sql/core/src/test/resources/sql-tests/results/udf/udf-e

[GitHub] [spark] SparkQA commented on issue #24561: [SPARK-26130][UI] Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables

SparkQA commented on issue #24561: [SPARK-26130][UI] Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables URL: https://github.com/apache/spark/pull/24561#issuecomment-510283061 **[Test build #107494 has started](https://amplab.cs.

[GitHub] [spark] SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode

SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-510283183 **[Test build #107485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10748

[GitHub] [spark] HyukjinKwon closed pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

HyukjinKwon closed pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base URL: https://github.com/apache/spark/pull/25086 This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

SparkQA commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-510283029 **[Test build #107493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

AmplabJenkins commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-510282716 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25069: [SPARK-28270][SQL][PYTHON] Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base URL: https://github.com/apache/spark/pull/25069#discussion_r302326130 ## File path: sql/core/src/test/resources/sql-tests/inputs/ud

[GitHub] [spark] AmplabJenkins commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

AmplabJenkins commented on issue #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103#issuecomment-510282713 Merged build finished. Test PASSed. ---

[GitHub] [spark] huaxingao opened a new pull request #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base

huaxingao opened a new pull request #25103: [SPARK-28285][SQL][PYTHON][TESTS] Convert and port 'outer-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25103 ## What changes were proposed in this pull request? This PR adds some tests converted from ```out

[GitHub] [spark] maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#discussion_r302326015 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/numeric.sql ## @@ -0,0 +1,1098 @@ +-- +-- P

[GitHub] [spark] viirya commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition

viirya commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition URL: https://github.com/apache/spark/pull/25091#issuecomment-510282365 Thanks! @HyukjinKwon @BryanCutler This is

[GitHub] [spark] HyukjinKwon commented on issue #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

HyukjinKwon commented on issue #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base URL: https://github.com/apache/spark/pull/25086#issuecomment-510282125 Merged to master. Will make a follow right away, @dongjoon-hyun. -

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25086: [SPARK-28271][SQL][PYTHON][TESTS] Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base URL: https://github.com/apache/spark/pull/25086#discussion_r302325524 ## File path: sql/core/src/test/resources/sql-tests/in

[GitHub] [spark] HyukjinKwon closed pull request #25089: [SPARK-28275][SQL][PYTHON][TESTS] Convert and port 'count.sql' into UDF test base

HyukjinKwon closed pull request #25089: [SPARK-28275][SQL][PYTHON][TESTS] Convert and port 'count.sql' into UDF test base URL: https://github.com/apache/spark/pull/25089 This is an automated message from the Apache Git Servi

[GitHub] [spark] maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#discussion_r302325204 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/numeric.sql ## @@ -0,0 +1,1098 @@ +-- +-- P

[GitHub] [spark] HyukjinKwon closed pull request #25088: [SPARK-27922][SQL][PYTHON][TESTS] Convert and port 'natural-join.sql' into UDF test base

HyukjinKwon closed pull request #25088: [SPARK-27922][SQL][PYTHON][TESTS] Convert and port 'natural-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25088 This is an automated message from the Apache Gi

[GitHub] [spark] HyukjinKwon commented on issue #25089: [SPARK-28275][SQL][PYTHON][TESTS] Convert and port 'count.sql' into UDF test base

HyukjinKwon commented on issue #25089: [SPARK-28275][SQL][PYTHON][TESTS] Convert and port 'count.sql' into UDF test base URL: https://github.com/apache/spark/pull/25089#issuecomment-510281018 Merged to master. This is an auto

[GitHub] [spark] HyukjinKwon closed pull request #25087: [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources

HyukjinKwon closed pull request #25087: [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources URL: https://github.com/apache/spark/pull/25087 This is an automated message from the Apache Git S

[GitHub] [spark] HyukjinKwon commented on issue #25088: [SPARK-27922][SQL][PYTHON][TESTS] Convert and port 'natural-join.sql' into UDF test base

HyukjinKwon commented on issue #25088: [SPARK-27922][SQL][PYTHON][TESTS] Convert and port 'natural-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25088#issuecomment-510280560 Merged to master. This is

[GitHub] [spark] HyukjinKwon commented on issue #25087: [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources

HyukjinKwon commented on issue #25087: [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources URL: https://github.com/apache/spark/pull/25087#issuecomment-510279825 Merged to master. This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#discussion_r302323340 ## File path: sql/core/src/test/resources/sql-tests/results/udf/ud

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base

HyukjinKwon commented on a change in pull request #25090: [SPARK-28278][SQL][PYTHON][TESTS] Convert and port 'except-all.sql' into UDF test base URL: https://github.com/apache/spark/pull/25090#discussion_r302323119 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-

[GitHub] [spark] joshrosen-stripe commented on issue #23621: [SPARK-26697][CORE] Log local & remote block sizes.

joshrosen-stripe commented on issue #23621: [SPARK-26697][CORE] Log local & remote block sizes. URL: https://github.com/apache/spark/pull/23621#issuecomment-510277266 (A few months late to the party here) Thanks for working on this! I'm currently debugging some FetchFailed issues a

[GitHub] [spark] gengliangwang removed a comment on issue #25094: [SPARK-28331][SQL] Catalogs.load() should be able to load built-in catalogs

gengliangwang removed a comment on issue #25094: [SPARK-28331][SQL] Catalogs.load() should be able to load built-in catalogs URL: https://github.com/apache/spark/pull/25094#issuecomment-510275130 @rdblue Do you mean you will submit fix for this? If yes, I can close this one. -

[GitHub] [spark] maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

maropu commented on a change in pull request #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#discussion_r302319639 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/numeric.sql ## @@ -0,0 +1,1098 @@ +-- +-- P

[GitHub] [spark] gengliangwang commented on issue #25094: [SPARK-28331][SQL] Catalogs.load() should be able to load built-in catalogs

gengliangwang commented on issue #25094: [SPARK-28331][SQL] Catalogs.load() should be able to load built-in catalogs URL: https://github.com/apache/spark/pull/25094#issuecomment-510275130 @rdblue Do you mean you will submit fix for this? If yes, I can close this one. -

[GitHub] [spark] carsonwang commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name

carsonwang commented on issue #25102: [SPARK-28339][SQL] Rename Spark SQL adaptive execution configuration name URL: https://github.com/apache/spark/pull/25102#issuecomment-510272227 @dongjoon-hyun Yes, we only need one umbrella config for adaptive execution, it can either be `spark.sql.ru

[GitHub] [spark] SparkQA commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

SparkQA commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#issuecomment-510271672 **[Test build #107492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107492/testReport)** for PR 25092 at com

[GitHub] [spark] AmplabJenkins commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

AmplabJenkins commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#issuecomment-510271297 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] AmplabJenkins removed a comment on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

AmplabJenkins removed a comment on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#issuecomment-510271293 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] AmplabJenkins removed a comment on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

AmplabJenkins removed a comment on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#issuecomment-510271297 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql

AmplabJenkins commented on issue #25092: [SPARK-28312][SQL][TEST] Port numeric.sql URL: https://github.com/apache/spark/pull/25092#issuecomment-510271293 Merged build finished. Test PASSed. This is an automated message from t

[GitHub] [spark] BryanCutler commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition

BryanCutler commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition URL: https://github.com/apache/spark/pull/25091#issuecomment-510269591 jira seems down, so I wasn't able to resolve the issue. will try later

[GitHub] [spark] BryanCutler commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition

BryanCutler commented on issue #25091: [SPARK-28323][SQL][Python] PythonUDF should be able to use in join condition URL: https://github.com/apache/spark/pull/25091#issuecomment-510269305 merged to master, thanks @viirya ! Thi

[GitHub] [spark] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510268964 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510268964 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510268960 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510268960 Merged build finished. Test PASSed. This is an automated message f

[GitHub] [spark] SparkQA removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

SparkQA removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510213459 **[Test build #107483 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107483/testReport)** for P

[GitHub] [spark] SparkQA commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

SparkQA commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-510268607 **[Test build #107483 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107483/testReport)** for PR 22878

[GitHub] [spark] AmplabJenkins removed a comment on issue #25096: [SPARK-28334][SQL][TEST] Port select.sql

AmplabJenkins removed a comment on issue #25096: [SPARK-28334][SQL][TEST] Port select.sql URL: https://github.com/apache/spark/pull/25096#issuecomment-510268129 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25096: [SPARK-28334][SQL][TEST] Port select.sql

AmplabJenkins removed a comment on issue #25096: [SPARK-28334][SQL][TEST] Port select.sql URL: https://github.com/apache/spark/pull/25096#issuecomment-510268135 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

<    1   2   3   4   5   6   7   8   9   10   >