[jira] [Updated] (SPARK-42403) JsonProtocol should handle null JSON strings

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42403: -- Summary: JsonProtocol should handle null JSON strings (was: SHS fail to parse event logs) >

[jira] [Resolved] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42403. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39973

[jira] [Resolved] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-4. - Resolution: Won't Fix > Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying

[jira] [Created] (SPARK-42404) Spark driver pod should not create executor pods when there is no driver service

Shiqi Sun created SPARK-42404: - Summary: Spark driver pod should not create executor pods when there is no driver service Key: SPARK-42404 URL: https://issues.apache.org/jira/browse/SPARK-42404 Project:

[jira] [Assigned] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42403: - Assignee: Josh Rosen > SHS fail to parse event logs > > >

[jira] [Commented] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687339#comment-17687339 ] Apache Spark commented on SPARK-42403: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687336#comment-17687336 ] Apache Spark commented on SPARK-42403: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42403: Assignee: Apache Spark > SHS fail to parse event logs > > >

[jira] [Assigned] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42403: Assignee: (was: Apache Spark) > SHS fail to parse event logs >

[jira] [Commented] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687335#comment-17687335 ] Apache Spark commented on SPARK-42403: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-42403) SHS fail to parse event logs

[ https://issues.apache.org/jira/browse/SPARK-42403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42403: -- Target Version/s: 3.4.0 > SHS fail to parse event logs > > >

[jira] [Created] (SPARK-42403) SHS fail to parse event logs

Dongjoon Hyun created SPARK-42403: - Summary: SHS fail to parse event logs Key: SPARK-42403 URL: https://issues.apache.org/jira/browse/SPARK-42403 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42402) Support parameterized SQL by sql()

[ https://issues.apache.org/jira/browse/SPARK-42402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42402: Assignee: (was: Apache Spark) > Support parameterized SQL by sql() >

[jira] [Commented] (SPARK-42402) Support parameterized SQL by sql()

[ https://issues.apache.org/jira/browse/SPARK-42402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687324#comment-17687324 ] Apache Spark commented on SPARK-42402: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42402) Support parameterized SQL by sql()

[ https://issues.apache.org/jira/browse/SPARK-42402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42402: Assignee: Apache Spark > Support parameterized SQL by sql() >

[jira] [Commented] (SPARK-42402) Support parameterized SQL by sql()

[ https://issues.apache.org/jira/browse/SPARK-42402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687323#comment-17687323 ] Apache Spark commented on SPARK-42402: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-42402) Support parameterized SQL by sql()

Takuya Ueshin created SPARK-42402: - Summary: Support parameterized SQL by sql() Key: SPARK-42402 URL: https://issues.apache.org/jira/browse/SPARK-42402 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-42401: -- Labels: correctness (was: ) > Incorrect results or NPE when inserting null value using >

[jira] [Commented] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687316#comment-17687316 ] Apache Spark commented on SPARK-42401: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42401: Assignee: (was: Apache Spark) > Incorrect results or NPE when inserting null value

[jira] [Commented] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687315#comment-17687315 ] Apache Spark commented on SPARK-42401: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42401: Assignee: Apache Spark > Incorrect results or NPE when inserting null value using >

[jira] [Created] (SPARK-42401) Incorrect results or NPE when inserting null value using array_insert/array_append

Bruce Robbins created SPARK-42401: - Summary: Incorrect results or NPE when inserting null value using array_insert/array_append Key: SPARK-42401 URL: https://issues.apache.org/jira/browse/SPARK-42401

[jira] [Commented] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687295#comment-17687295 ] Apache Spark commented on SPARK-42396: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42396: Assignee: (was: Apache Spark) > Upgrade Apache Kafka to 3.4.0 >

[jira] [Assigned] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42396: Assignee: Apache Spark > Upgrade Apache Kafka to 3.4.0 > - >

[jira] [Commented] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687283#comment-17687283 ] Apache Spark commented on SPARK-41820: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-41820: -- Description: {code:java} >>> df = spark.createDataFrame([(2, "Alice"), (5, "Bob")],

[jira] [Commented] (SPARK-42265) DataFrame.createTempView - SparkConnectGrpcException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-42265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687282#comment-17687282 ] Apache Spark commented on SPARK-42265: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41820: Assignee: (was: Apache Spark) > DataFrame.createOrReplaceGlobalTempView -

[jira] [Assigned] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41820: Assignee: Apache Spark > DataFrame.createOrReplaceGlobalTempView -

[jira] [Commented] (SPARK-41820) DataFrame.createOrReplaceGlobalTempView - SparkConnectException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-41820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687281#comment-17687281 ] Apache Spark commented on SPARK-41820: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42265) DataFrame.createTempView - SparkConnectGrpcException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-42265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42265: Assignee: (was: Apache Spark) > DataFrame.createTempView -

[jira] [Commented] (SPARK-42265) DataFrame.createTempView - SparkConnectGrpcException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-42265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687280#comment-17687280 ] Apache Spark commented on SPARK-42265: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42265) DataFrame.createTempView - SparkConnectGrpcException: requirement failed

[ https://issues.apache.org/jira/browse/SPARK-42265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42265: Assignee: Apache Spark > DataFrame.createTempView - SparkConnectGrpcException:

[jira] [Assigned] (SPARK-42400) Code clean up in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-42400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42400: Assignee: Apache Spark > Code clean up in org.apache.spark.storage >

[jira] [Commented] (SPARK-42400) Code clean up in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-42400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687279#comment-17687279 ] Apache Spark commented on SPARK-42400: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-42400) Code clean up in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-42400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42400: Assignee: (was: Apache Spark) > Code clean up in org.apache.spark.storage >

[jira] [Created] (SPARK-42400) Code clean up in org.apache.spark.storage

Khalid Mammadov created SPARK-42400: --- Summary: Code clean up in org.apache.spark.storage Key: SPARK-42400 URL: https://issues.apache.org/jira/browse/SPARK-42400 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687246#comment-17687246 ] Alex Balikov commented on SPARK-42376: -- Yay! Congrats on getting this out! > Introduce watermark

[jira] [Created] (SPARK-42399) CONV() silently overflows returning wrong results

Serge Rielau created SPARK-42399: Summary: CONV() silently overflows returning wrong results Key: SPARK-42399 URL: https://issues.apache.org/jira/browse/SPARK-42399 Project: Spark Issue

[jira] [Commented] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687236#comment-17687236 ] Dongjoon Hyun commented on SPARK-42396: --- Thank you for working on this. > Upgrade Apache Kafka to

[jira] [Commented] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687170#comment-17687170 ] Bjørn Jørgensen commented on SPARK-42396: - CC [~dongjoon] > Upgrade Apache Kafka to 3.4.0 >

[jira] [Resolved] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42162. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39722

[jira] [Assigned] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42162: --- Assignee: Supun Nakandala > Memory usage on executors increased drastically for a complex

[jira] [Commented] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687124#comment-17687124 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42398: Assignee: (was: Apache Spark) > refine default column value framework >

[jira] [Assigned] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42398: Assignee: Apache Spark > refine default column value framework >

[jira] [Created] (SPARK-42398) refine default column value framework

Wenchen Fan created SPARK-42398: --- Summary: refine default column value framework Key: SPARK-42398 URL: https://issues.apache.org/jira/browse/SPARK-42398 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42394: Assignee: Kent Yao > Fix the usage information of bin/spark-sql --help >

[jira] [Resolved] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42394. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39966

[jira] [Commented] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687029#comment-17687029 ] Bjørn Jørgensen commented on SPARK-42396: - [error]

[jira] [Updated] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Chester Jenks updated SPARK-42397: -- Description: We are seeing inconsistent data returned when using

[jira] [Updated] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Chester Jenks updated SPARK-42397: -- Description: We are seeing inconsistent data returned when using

[jira] [Commented] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687011#comment-17687011 ] Ted Chester Jenks commented on SPARK-42397: --- {{    test_df = spark.createDataFrame(}} {{       

[jira] [Updated] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Chester Jenks updated SPARK-42397: -- Description: We are seeing inconsistent data returned when using

[jira] [Created] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

Ted Chester Jenks created SPARK-42397: - Summary: Inconsistent data produced by `FlatMapCoGroupsInPandas` Key: SPARK-42397 URL: https://issues.apache.org/jira/browse/SPARK-42397 Project: Spark

[jira] [Updated] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

[ https://issues.apache.org/jira/browse/SPARK-42396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-42396: Description: [CVE-2023-25194|https://www.cve.org/CVERecord?id=CVE-2023-25194] (was:

[jira] [Created] (SPARK-42396) Upgrade Apache Kafka to 3.4.0

Bjørn Jørgensen created SPARK-42396: --- Summary: Upgrade Apache Kafka to 3.4.0 Key: SPARK-42396 URL: https://issues.apache.org/jira/browse/SPARK-42396 Project: Spark Issue Type: Dependency

[jira] [Assigned] (SPARK-42395) The code logic of the configmap max size validation lacks extra content

[ https://issues.apache.org/jira/browse/SPARK-42395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42395: Assignee: (was: Apache Spark) > The code logic of the configmap max size validation

[jira] [Assigned] (SPARK-42395) The code logic of the configmap max size validation lacks extra content

[ https://issues.apache.org/jira/browse/SPARK-42395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42395: Assignee: Apache Spark > The code logic of the configmap max size validation lacks extra

[jira] [Commented] (SPARK-42395) The code logic of the configmap max size validation lacks extra content

[ https://issues.apache.org/jira/browse/SPARK-42395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686997#comment-17686997 ] Apache Spark commented on SPARK-42395: -- User 'ninebigbig' has created a pull request for this

[jira] [Created] (SPARK-42395) The code logic of the configmap max size validation lacks extra content

Wei Yan created SPARK-42395: --- Summary: The code logic of the configmap max size validation lacks extra content Key: SPARK-42395 URL: https://issues.apache.org/jira/browse/SPARK-42395 Project: Spark

[jira] [Commented] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686969#comment-17686969 ] Apache Spark commented on SPARK-42394: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42394: Assignee: Apache Spark > Fix the usage information of bin/spark-sql --help >

[jira] [Assigned] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42394: Assignee: (was: Apache Spark) > Fix the usage information of bin/spark-sql --help >

[jira] [Updated] (SPARK-42394) Fix the usage information of bin/spark-sql --help

[ https://issues.apache.org/jira/browse/SPARK-42394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-42394: - Description: It tries to connect to HMS and fail with noisy errors > Fix the usage information of

[jira] [Created] (SPARK-42394) Fix the usage information of bin/spark-sql --help

Kent Yao created SPARK-42394: Summary: Fix the usage information of bin/spark-sql --help Key: SPARK-42394 URL: https://issues.apache.org/jira/browse/SPARK-42394 Project: Spark Issue Type: