[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576319#comment-17576319 ] Shixiong Zhu commented on SPARK-39915: -- {code:java} Welcome to

[jira] [Commented] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576284#comment-17576284 ] Apache Spark commented on SPARK-3: -- User 'bjornjorgensen' has created a pull re

[jira] [Assigned] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > Replace postgresql 42.3.3 with 42.2.26 >

[jira] [Assigned] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > Replace postgresql 42.3.3 with 42.2.26 > ---

[jira] [Commented] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576283#comment-17576283 ] Apache Spark commented on SPARK-3: -- User 'bjornjorgensen' has created a pull re

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576282#comment-17576282 ] Pablo Langa Blanco commented on SPARK-39915: Hi [~zsxwing] , I can't reprod

[jira] [Comment Edited] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576281#comment-17576281 ] Pablo Langa Blanco edited comment on SPARK-39796 at 8/6/22 9:17 PM: --

[jira] [Updated] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-3: Description: postgresql >= 42.3.0, < 42.4.1 is affected by [CVE-2022-31197|https://github

[jira] [Created] (SPARK-39999) Replace postgresql 42.3.3 with 42.2.26

Bjørn Jørgensen created SPARK-3: --- Summary: Replace postgresql 42.3.3 with 42.2.26 Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type: Depe

[jira] [Commented] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576281#comment-17576281 ] Pablo Langa Blanco commented on SPARK-39796: Hi [~augustine_theodore] , Is

[jira] [Commented] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576274#comment-17576274 ] Bjørn Jørgensen commented on SPARK-39996: - [GA testes failed|https://github.com

[jira] [Commented] (SPARK-39998) Can't set pyspark log level in log4j2.properties

[ https://issues.apache.org/jira/browse/SPARK-39998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576265#comment-17576265 ] Mario Grgic commented on SPARK-39998: - It turns out this is related to https://issu

[jira] [Created] (SPARK-39998) Can't set pyspark log level in log4j2.properties

Mario Grgic created SPARK-39998: --- Summary: Can't set pyspark log level in log4j2.properties Key: SPARK-39998 URL: https://issues.apache.org/jira/browse/SPARK-39998 Project: Spark Issue Type: Qu

[jira] [Commented] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576229#comment-17576229 ] Apache Spark commented on SPARK-39997: -- User 'zinking' has created a pull request f

[jira] [Assigned] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39997: Assignee: (was: Apache Spark) > ParquetSchemaConverter fails match schema by id > ---

[jira] [Assigned] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39997: Assignee: Apache Spark > ParquetSchemaConverter fails match schema by id > --

[jira] [Updated] (SPARK-39997) ParquetSchemaConverter fails match schema by id

[ https://issues.apache.org/jira/browse/SPARK-39997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-39997: -- Description: {code:scala} test("SPARK-38094: absence of field ids: reading nested schema struct fie

[jira] [Created] (SPARK-39997) ParquetSchemaConverter fails match schema by id

Zhen Wang created SPARK-39997: - Summary: ParquetSchemaConverter fails match schema by id Key: SPARK-39997 URL: https://issues.apache.org/jira/browse/SPARK-39997 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39996: Description: Security - fix: [CVE-2022-31197|https://cve.mitre.org/cgi-bin/cvename.cgi?na

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.4.1

[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-39996: Description: Security - fix: CVE-2022-31197 Fixes SQL generated in PgResultSet.refresh() t

[jira] [Created] (SPARK-39996) Upgrade postgresql to 42.4.1

Bjørn Jørgensen created SPARK-39996: --- Summary: Upgrade postgresql to 42.4.1 Key: SPARK-39996 URL: https://issues.apache.org/jira/browse/SPARK-39996 Project: Spark Issue Type: Dependency upg

[jira] [Commented] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576167#comment-17576167 ] Apache Spark commented on SPARK-39929: -- User 'zheniantoushipashi' has created a pul

[jira] [Assigned] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39929: Assignee: (was: Apache Spark) > DS V2 supports push down string functions(non ANSI)

[jira] [Commented] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576166#comment-17576166 ] Apache Spark commented on SPARK-39929: -- User 'zheniantoushipashi' has created a pul

[jira] [Assigned] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39929: Assignee: Apache Spark > DS V2 supports push down string functions(non ANSI) > -

[jira] [Created] (SPARK-39995) PySpark installation doesn't support Scala 2.13 binaries

Oleksandr Shevchenko created SPARK-39995: Summary: PySpark installation doesn't support Scala 2.13 binaries Key: SPARK-39995 URL: https://issues.apache.org/jira/browse/SPARK-39995 Project: Spar

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:55 AM:

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:52 AM:

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:49 AM:

[jira] [Comment Edited] (SPARK-39929) DS V2 supports push down string functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573529#comment-17573529 ] Sun BiaoBiao edited comment on SPARK-39929 at 8/6/22 8:45 AM: