[GitHub] [spark] gatorsmile commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

gatorsmile commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-498127954 cc @gengliangwang @dongjoon-hyun

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289696377 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289696377 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-497331632 Can one of the admins verify this patch? This

[GitHub] [spark] gatorsmile commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

gatorsmile commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498129430 ok to test This is an automated message from the Apache

[GitHub] [spark] gatorsmile commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

gatorsmile commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#discussion_r289704417 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala

[GitHub] [spark] lipzhu commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

lipzhu commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#discussion_r289704634 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala

[GitHub] [spark] HeartSaVioR commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

HeartSaVioR commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-498126618 When this is revisited, please consider other PRs in mine as well:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289699119 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498130761 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498130767 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498131187 **[Test build #106094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106094/testReport)**

[GitHub] [spark] SparkQA commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

SparkQA commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498131186 **[Test build #106095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106095/testReport)** for PR 24335 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498130762 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498130756 Merged build finished. Test PASSed. This is an

[GitHub] [spark] gatorsmile commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

gatorsmile commented on a change in pull request #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#discussion_r289701087 ## File path:

[GitHub] [spark] gatorsmile commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion

gatorsmile commented on issue #24068: [SPARK-27105][SQL] Optimize away exponential complexity in ORC predicate conversion URL: https://github.com/apache/spark/pull/24068#issuecomment-498129023 Added a comment https://github.com/apache/spark/pull/24068/files#r289701087

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289699119 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

HyukjinKwon commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289697871 ## File path:

[GitHub] [spark] eyalzit commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

eyalzit commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-498128234 @gaborgsomogyi @HeartSaVioR @srowen how can we retest this? scalastyle issues are fixed

[GitHub] [spark] wangyum commented on a change in pull request #24743: [SPARK-27883][SQL] Port AGGREGATES.sql [Part 2]

wangyum commented on a change in pull request #24743: [SPARK-27883][SQL] Port AGGREGATES.sql [Part 2] URL: https://github.com/apache/spark/pull/24743#discussion_r289697281 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part2.sql ## @@ -7,207

[GitHub] [spark] dongjoon-hyun commented on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

dongjoon-hyun commented on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#issuecomment-498124169 Thank you for review and approval, @HyukjinKwon .

[GitHub] [spark] HyukjinKwon commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

HyukjinKwon commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498129980 retest this please This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498129950 **[Test build #106084 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions

HyukjinKwon commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#discussion_r289702142 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498100750 **[Test build #106084 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

HyukjinKwon commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289698499 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498130761 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498130756 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498130767 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] lipzhu commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

lipzhu commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-498130745 @gatorsmile Just as I list before. Postgresql/Teradata/SQL Server have fully support of below interval functions.

[GitHub] [spark] AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498130762 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498130367 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498130379 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498130367 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498130379 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498137948 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceS

AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498138241 Merged build finished. Test

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138187 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498137944 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceS

AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498138246 Test FAILed. Refer to this

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138178 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

AmplabJenkins removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498138007 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498144856 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498144848 Merged build finished. Test PASSed. This is an

[GitHub] [spark] gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498144557 retest this please. This is an automated message from

[GitHub] [spark] SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498150163 **[Test build #106100 has

[GitHub] [spark] AmplabJenkins commented on issue #24774: [SPARK-27899][SQL] Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

AmplabJenkins commented on issue #24774: [SPARK-27899][SQL] Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API URL: https://github.com/apache/spark/pull/24774#issuecomment-498150030 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

AmplabJenkins commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498167137 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum commented on a change in pull request #24767: [WIP][SPARK-27918][SQL] Port boolean.sql

wangyum commented on a change in pull request #24767: [WIP][SPARK-27918][SQL] Port boolean.sql URL: https://github.com/apache/spark/pull/24767#discussion_r289774031 ## File path: sql/core/src/test/resources/sql-tests/results/pgSQL/boolean.sql.out ## @@ -0,0 +1,710 @@ +--

[GitHub] [spark] SparkQA commented on issue #24776: [SPARK-27926][SQL] Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

SparkQA commented on issue #24776: [SPARK-27926][SQL] Allow altering table add columns with CSVFileFormat/JsonFileFormat provider URL: https://github.com/apache/spark/pull/24776#issuecomment-498198075 **[Test build #106104 has

[GitHub] [spark] gengliangwang commented on issue #24776: [SPARK-27926][SQL] Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

gengliangwang commented on issue #24776: [SPARK-27926][SQL] Allow altering table add columns with CSVFileFormat/JsonFileFormat provider URL: https://github.com/apache/spark/pull/24776#issuecomment-498197759 @dongjoon-hyun

[GitHub] [spark] WeichenXu123 commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

WeichenXu123 commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498198840 @BryanCutler @HyukjinKwon @ueshin I update implementation and the PR

[GitHub] [spark] cryeo commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions

cryeo commented on a change in pull request #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#discussion_r289787578 ## File path:

[GitHub] [spark] gaborgsomogyi commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2.

gaborgsomogyi commented on issue #24738: [WIP][SPARK-23098][SQL] Migrate Kafka Batch source to v2. URL: https://github.com/apache/spark/pull/24738#issuecomment-498163164 @HeartSaVioR awesome that you've pinpointed the problem. @rdblue @cloud-fan since DSv2 modification needed would

[GitHub] [spark] s1ck commented on a change in pull request #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

s1ck commented on a change in pull request #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#discussion_r289775017 ## File path: dev/deps/spark-deps-hadoop-2.7 ## @@ -152,6 +152,7 @@ minlog-1.3.0.jar

[GitHub] [spark] AmplabJenkins commented on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

AmplabJenkins commented on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#issuecomment-498204626 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

AmplabJenkins commented on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#issuecomment-498204633 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

SparkQA removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#issuecomment-498162421 **[Test build #106101 has

[GitHub] [spark] AmplabJenkins commented on issue #24775: [SPARK-27925][ML] Better control numBins of curves in BinaryClassificationMetrics

AmplabJenkins commented on issue #24775: [SPARK-27925][ML] Better control numBins of curves in BinaryClassificationMetrics URL: https://github.com/apache/spark/pull/24775#issuecomment-498210158 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24775: [SPARK-27925][ML] Better control numBins of curves in BinaryClassificationMetrics

AmplabJenkins commented on issue #24775: [SPARK-27925][ML] Better control numBins of curves in BinaryClassificationMetrics URL: https://github.com/apache/spark/pull/24775#issuecomment-498210165 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

SparkQA commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498216692 **[Test build #106097 has

[GitHub] [spark] voidbag opened a new pull request #24779: [SPARK-27929][SQL] Make percentile function receive frq of double

voidbag opened a new pull request #24779: [SPARK-27929][SQL] Make percentile function receive frq of double URL: https://github.com/apache/spark/pull/24779 - Make sql.catalyst.expressions.aggregate.Percentile receive frequency column as double. - Reduce the number of binary searchs for

[GitHub] [spark] srowen commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed

srowen commented on issue #21790: [SPARK-24544][SQL] Print actual failure cause when look up function failed URL: https://github.com/apache/spark/pull/21790#issuecomment-498223655 OK, if it's pretty common after all, this can be reverted, thank you

[GitHub] [spark] AmplabJenkins commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

AmplabJenkins commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498232739 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

AmplabJenkins commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498232742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

SparkQA commented on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498232346 **[Test build #106096 has

[GitHub] [spark] SparkQA removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

SparkQA removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498102748 **[Test build #106085 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138091 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

AmplabJenkins removed a comment on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#issuecomment-498137953 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498138188 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498138175 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138087 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

SparkQA removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498115265 **[Test build #106092 has

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498116455 **[Test build #106093 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

AmplabJenkins removed a comment on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#issuecomment-498137962 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498137942 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

SparkQA removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498131187 **[Test build #106094 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

AmplabJenkins removed a comment on issue #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#issuecomment-498138003 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498138057 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

SparkQA removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498131186 **[Test build #106095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106095/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions

AmplabJenkins removed a comment on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498137940 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138178 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

SparkQA removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498110839 **[Test build #106088 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498138050 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498138175 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498138087 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498138188 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498138057 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498138246 Test FAILed. Refer to this link

[GitHub] [spark] AmplabJenkins commented on issue #24774: [SPARK-27899][SQL] Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

AmplabJenkins commented on issue #24774: [SPARK-27899][SQL] Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API URL: https://github.com/apache/spark/pull/24774#issuecomment-498149114 Can one of the admins verify this patch?

[GitHub] [spark] ozancicek commented on a change in pull request #24764: [SPARK-18570][ML][R] RFormula support * and ^ operators

ozancicek commented on a change in pull request #24764: [SPARK-18570][ML][R] RFormula support * and ^ operators URL: https://github.com/apache/spark/pull/24764#discussion_r289749330 ## File path: mllib/src/test/scala/org/apache/spark/ml/feature/RFormulaParserSuite.scala

[GitHub] [spark] skonto closed pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

skonto closed pull request #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613 This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

SparkQA removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498143208 **[Test build #106098 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

AmplabJenkins removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#issuecomment-498204633 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

AmplabJenkins removed a comment on issue #24627: [SPARK-27748][SS] Kafka consumer/producer password/token redaction. URL: https://github.com/apache/spark/pull/24627#issuecomment-498204626 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498205719 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498205709 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

SparkQA commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498210807 **[Test build #106102 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24778: [Minor][ML] add missing since annotation of meanAveragePrecision

AmplabJenkins removed a comment on issue #24778: [Minor][ML] add missing since annotation of meanAveragePrecision URL: https://github.com/apache/spark/pull/24778#issuecomment-498218266 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   8   >