[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation

AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation URL: https://github.com/apache/spark/pull/23946#issuecomment-470426278 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation

AmplabJenkins removed a comment on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation URL: https://github.com/apache/spark/pull/24000#issuecomment-470426054 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470426108 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dilipbiswal commented on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation

dilipbiswal commented on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation URL: https://github.com/apache/spark/pull/24000#issuecomment-470427151 retest this please

[GitHub] [spark] dilipbiswal commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

dilipbiswal commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470426855 retest this please This is an automated message from the Apache

[GitHub] [spark] maropu commented on issue #23998: [MINOR][SQL]Add a conf to control subqueryReuse

maropu commented on issue #23998: [MINOR][SQL]Add a conf to control subqueryReuse URL: https://github.com/apache/spark/pull/23998#issuecomment-470460793 Could you please file a jira cuz this pr adds a new config? This is an

[GitHub] [spark] AmplabJenkins commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect

AmplabJenkins commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect URL: https://github.com/apache/spark/pull/24003#issuecomment-470460801 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect

AmplabJenkins commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect URL: https://github.com/apache/spark/pull/24003#issuecomment-470460792 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR commented on issue #23634: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows

HeartSaVioR commented on issue #23634: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/23634#issuecomment-470464718 @tdas Looks like we're missing two bugfix releases for this issue though

[GitHub] [spark] AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470491165 Test PASSed. Refer to this link for build

[GitHub] [spark] gaborgsomogyi commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages

gaborgsomogyi commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages URL: https://github.com/apache/spark/pull/23991#issuecomment-470494013 @srowen @dongjoon-hyun thanks for the help! I was thinking about whether it's possible to add unit tests but since ssl

[GitHub] [spark] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263349232 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263349086 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470496952 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470496943 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470496943 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263349172 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] SparkQA removed a comment on issue #22466: [SPARK-25464][SQL] Create Database to the location, only if it is empty or does not exists.

SparkQA removed a comment on issue #22466: [SPARK-25464][SQL] Create Database to the location,only if it is empty or does not exists. URL: https://github.com/apache/spark/pull/22466#issuecomment-470428198 **[Test build #103130 has

[GitHub] [spark] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263351783 ## File path: sql/core/src/test/resources/sql-tests/inputs/subquery/any-subquery/any-multiple-columns.sql

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470498890 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470498881 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] lipzhu opened a new pull request #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

lipzhu opened a new pull request #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004 ## What changes were proposed in this pull request? Currently SparkSQL already have functions for bitwise related functions.

[GitHub] [spark] SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470499462 **[Test build #103134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103134/testReport)** for PR 23783 at

[GitHub] [spark] AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-470499349 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #22466: [SPARK-25464][SQL] Create Database to the location, only if it is empty or does not exists.

AmplabJenkins commented on issue #22466: [SPARK-25464][SQL] Create Database to the location,only if it is empty or does not exists. URL: https://github.com/apache/spark/pull/22466#issuecomment-470499511 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-470503370 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-470503370 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-470503377 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-470503377 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation

AmplabJenkins removed a comment on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation URL: https://github.com/apache/spark/pull/24000#issuecomment-470505119 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect

SparkQA commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect URL: https://github.com/apache/spark/pull/24003#issuecomment-470505487 **[Test build #103131 has

[GitHub] [spark] maropu commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

maropu commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#discussion_r263376060 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

cloud-fan commented on a change in pull request #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#discussion_r263378882 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala ## @@ -620,6 +622,12

[GitHub] [spark] wangyum commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect

wangyum commented on issue #24003: [SPARK-19678][FOLLOW-UP][SQL] Add behavior change test when table statistics are incorrect URL: https://github.com/apache/spark/pull/24003#issuecomment-470523277 cc @cloud-fan This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470534956 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages

srowen commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages URL: https://github.com/apache/spark/pull/23991#issuecomment-470536219 I just mean, do any of these links show in a UI? can we just check the HTML and find the link and verify that the href starts with

[GitHub] [spark] AmplabJenkins removed a comment on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

AmplabJenkins removed a comment on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007#issuecomment-470544750 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

SparkQA commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007#issuecomment-470546035 **[Test build #103142 has

[GitHub] [spark] AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470548546 Test FAILed. Refer to this link for build results

[GitHub] [spark] srowen commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

srowen commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-470554893 No follow up; I'm going to finish this at https://github.com/apache/spark/pull/24008

[GitHub] [spark] srowen closed pull request #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

srowen closed pull request #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

SparkQA commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470555115 **[Test build #103143 has

[GitHub] [spark] AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470557352 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception

AmplabJenkins commented on issue #24008: [SPARK-24783][SQL] spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/24008#issuecomment-470557343 Merged build finished. Test PASSed.

[GitHub] [spark] maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470492311 I reviewed and could you check? https://github.com/francis0407/spark/pull/3

[GitHub] [spark] AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

AmplabJenkins removed a comment on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-470500787 Can one of the admins verify this patch?

[GitHub] [spark] maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470501420 Also, plz update the PR description?; you need to describe the `!=` semantics in ANY there

[GitHub] [spark] maropu edited a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu edited a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470501420 Also, plz update the PR description?; to make other developers understood, you need to describe the `!=` semantics in ANY:

[GitHub] [spark] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263353800 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisErrorSuite.scala

[GitHub] [spark] SparkQA commented on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation

SparkQA commented on issue #24000: [SPARK-27079][MINOR][SQL] Fix typo & Remove useless imports & Add missing `override` annotation URL: https://github.com/apache/spark/pull/24000#issuecomment-470504515 **[Test build #103125 has

[GitHub] [spark] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263357615 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470508696 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation

SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation URL: https://github.com/apache/spark/pull/23946#issuecomment-470428162 **[Test build #103126 has

[GitHub] [spark] AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470508705 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470508696 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins removed a comment on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470508705 Test PASSed. Refer to this link for build

[GitHub] [spark] maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

maropu commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470513143 Also, I checked that the output in `results/subquery/any-subquery/*` is the same with postgresql answers.

[GitHub] [spark] SparkQA commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

SparkQA commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470522177 **[Test build #103137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103137/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

AmplabJenkins removed a comment on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470521553 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

AmplabJenkins removed a comment on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470521563 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

SparkQA commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470522175 **[Test build #103136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103136/testReport)**

[GitHub] [spark] cloud-fan commented on a change in pull request #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped

cloud-fan commented on a change in pull request #23912: [SPARK-21029][SS] StreamingQuery should be stopped when the SparkSession is stopped URL: https://github.com/apache/spark/pull/23912#discussion_r263377682 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala

[GitHub] [spark] weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r263377278 ## File path: core/src/main/scala/org/apache/spark/deploy/ExternalShuffleService.scala ## @@

[GitHub] [spark] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263382613 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470526690 hi,@squito @attilapiros,i have added WorkDirCleanup test f,PTAL and review.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470528621 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group)

srowen commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group) URL: https://github.com/apache/spark/pull/23996#issuecomment-470531900 I see, this is so we can try Hive 2/3? OK.

[GitHub] [spark] srowen commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages

srowen commented on issue #23991: [SPARK-24621][WEBUI] Show secure URLs on web pages URL: https://github.com/apache/spark/pull/23991#issuecomment-470531710 I don't think it tries to make the SSL connection, no. But I don't think we're testing here whether https and certs work, but just

[GitHub] [spark] SparkQA removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

SparkQA removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470499462 **[Test build #103134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103134/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470534956 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] skonto commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking.

skonto commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking. URL: https://github.com/apache/spark/pull/19096#issuecomment-470544923 @gaborgsomogyi I will, just didnt know what was planned here.

[GitHub] [spark] AmplabJenkins commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

AmplabJenkins commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007#issuecomment-470545186 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] Ngone51 opened a new pull request #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

Ngone51 opened a new pull request #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007 ## What changes were proposed in this pull request? This is an optional solution

[GitHub] [spark] AmplabJenkins commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions

AmplabJenkins commented on issue #24007: [SPARK-23433][SPARK-25250] [CORE][BRANCH-2.3] Later created TaskSet should learn about the finished partitions URL: https://github.com/apache/spark/pull/24007#issuecomment-470544750 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending)

SparkQA commented on issue #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-470549880 **[Test build #103140 has

[GitHub] [spark] AmplabJenkins commented on issue #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending)

AmplabJenkins commented on issue #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#issuecomment-470550035 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263420600 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470561018 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470561001 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] hehuiyuan opened a new pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations

hehuiyuan opened a new pull request #24009: [k8s]Unify the three variables' name : pod name prefix in kubernetes / spark.app.name in spark ui / spark-app-name in pod's annotations URL: https://github.com/apache/spark/pull/24009 ## What changes were proposed in this pull request?

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470561018 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

AmplabJenkins commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470491154 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470496952 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470497431 **[Test build #103133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103133/testReport)** for PR 23783 at

[GitHub] [spark] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263353085 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala

[GitHub] [spark] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r263353123 ## File path: sql/core/src/test/resources/sql-tests/inputs/subquery/any-subquery/any-multiple-columns.sql

[GitHub] [spark] SparkQA commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one

SparkQA commented on issue #23721: [SPARK-26797][SQL][WIP][test-maven] Start using the new logical types API of Parquet 1.11.0 instead of the deprecated one URL: https://github.com/apache/spark/pull/23721#issuecomment-470507254 **[Test build #103135 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation

AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] [SparkR] Fix for RangeBetween and RowsBetween docs to be in sync with spark documentation URL: https://github.com/apache/spark/pull/23946#issuecomment-470509261 Test PASSed. Refer to this link for build results

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending)

gaborgsomogyi commented on a change in pull request #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#discussion_r263371567 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

AmplabJenkins commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470521563 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470521611 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470521611 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r263376755 ## File path: core/src/test/scala/org/apache/spark/deploy/ExternalShuffleServiceDbSuite.scala ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470521593 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-470521593 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2

AmplabJenkins commented on issue #24005: [WIP][SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-470521553 Merged build finished. Test PASSed. This is an

[GitHub] [spark] weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r263381350 ## File path: core/src/main/scala/org/apache/spark/deploy/ExternalShuffleService.scala ## @@

[GitHub] [spark] wangyum commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group)

wangyum commented on issue #23996: [MINOR][BUILD] Add 2 maven properties(hive.classifier and hive.parquet.group) URL: https://github.com/apache/spark/pull/23996#issuecomment-470525406 cc @srowen In order to make the upgrade built-in Hive change smaller, I'd like to change this first.

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-470528610 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

weixiuli commented on a change in pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#discussion_r263379794 ## File path: core/src/test/scala/org/apache/spark/deploy/ExternalShuffleServiceDbSuite.scala ##

  1   2   3   4   5   6   7   8   9   10   >