[jira] [Assigned] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33027: Assignee: Apache Spark > Add DisableUnnecessaryBucketedScan rule to AQE

[jira] [Commented] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223418#comment-17223418 ] Apache Spark commented on SPARK-33027: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223419#comment-17223419 ] Apache Spark commented on SPARK-33027: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33027) Add DisableUnnecessaryBucketedScan rule to AQE queryStagePreparationRules

[ https://issues.apache.org/jira/browse/SPARK-33027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33027: Assignee: (was: Apache Spark) > Add DisableUnnecessaryBucketedScan rule to AQE

[jira] [Resolved] (SPARK-33248) Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size

[ https://issues.apache.org/jira/browse/SPARK-33248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33248. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30156

[jira] [Assigned] (SPARK-33248) Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size

[ https://issues.apache.org/jira/browse/SPARK-33248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33248: Assignee: angerszhu > Add a configuration to control the legacy behavior of whether need

[jira] [Commented] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223413#comment-17223413 ] Kiran Kumar Joseph commented on SPARK-33280: As of now, I worked around it by doing lazy

[jira] [Commented] (SPARK-33296) Format exception when use cube func && with cube

[ https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223402#comment-17223402 ] Apache Spark commented on SPARK-33296: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33296) Format exception when use cube func && with cube

[ https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33296: Assignee: (was: Apache Spark) > Format exception when use cube func && with cube >

[jira] [Assigned] (SPARK-33296) Format exception when use cube func && with cube

[ https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33296: Assignee: Apache Spark > Format exception when use cube func && with cube >

[jira] [Assigned] (SPARK-33297) Intermittent Compilation failure In GitHub Actions after SBT upgrade

[ https://issues.apache.org/jira/browse/SPARK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33297: Assignee: Apache Spark > Intermittent Compilation failure In GitHub Actions after SBT

[jira] [Assigned] (SPARK-33297) Intermittent Compilation failure In GitHub Actions after SBT upgrade

[ https://issues.apache.org/jira/browse/SPARK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33297: Assignee: (was: Apache Spark) > Intermittent Compilation failure In GitHub Actions

[jira] [Assigned] (SPARK-33297) Intermittent Compilation failure In GitHub Actions after SBT upgrade

[ https://issues.apache.org/jira/browse/SPARK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33297: Assignee: Apache Spark > Intermittent Compilation failure In GitHub Actions after SBT

[jira] [Commented] (SPARK-33297) Intermittent Compilation failure In GitHub Actions after SBT upgrade

[ https://issues.apache.org/jira/browse/SPARK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223395#comment-17223395 ] Apache Spark commented on SPARK-33297: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-33297) Intermittent Compilation failure In GitHub Actions after SBT upgrade

Hyukjin Kwon created SPARK-33297: Summary: Intermittent Compilation failure In GitHub Actions after SBT upgrade Key: SPARK-33297 URL: https://issues.apache.org/jira/browse/SPARK-33297 Project: Spark

[jira] [Commented] (SPARK-33296) Format exception when use cube func && with cube

[ https://issues.apache.org/jira/browse/SPARK-33296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223390#comment-17223390 ] angerszhu commented on SPARK-33296: --- Raise a pr soon > Format exception when use cube func && with

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223387#comment-17223387 ] Asif commented on SPARK-33152: -- PR opened: [pr-33152|https://github.com/apache/spark/pull/30185] >

[jira] [Created] (SPARK-33296) Format exception when use cube func && with cube

angerszhu created SPARK-33296: - Summary: Format exception when use cube func && with cube Key: SPARK-33296 URL: https://issues.apache.org/jira/browse/SPARK-33296 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33295) Upgrade ORC to 1.6.1

[ https://issues.apache.org/jira/browse/SPARK-33295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223384#comment-17223384 ] Jaanai Zhang commented on SPARK-33295: -- Do you have a plan to do this feature? [~dongjoon]

[jira] [Commented] (SPARK-33294) Add query resolved check before analyze InsertIntoDir

[ https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223382#comment-17223382 ] Apache Spark commented on SPARK-33294: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33294) Add query resolved check before analyze InsertIntoDir

[ https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33294: Assignee: (was: Apache Spark) > Add query resolved check before analyze

[jira] [Commented] (SPARK-33294) Add query resolved check before analyze InsertIntoDir

[ https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223381#comment-17223381 ] Apache Spark commented on SPARK-33294: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33294) Add query resolved check before analyze InsertIntoDir

[ https://issues.apache.org/jira/browse/SPARK-33294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33294: Assignee: Apache Spark > Add query resolved check before analyze InsertIntoDir >

[jira] [Created] (SPARK-33295) Upgrade ORC to 1.6.1

Jaanai Zhang created SPARK-33295: Summary: Upgrade ORC to 1.6.1 Key: SPARK-33295 URL: https://issues.apache.org/jira/browse/SPARK-33295 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-33294) Add query resolved check before analyze InsertIntoDir

ulysses you created SPARK-33294: --- Summary: Add query resolved check before analyze InsertIntoDir Key: SPARK-33294 URL: https://issues.apache.org/jira/browse/SPARK-33294 Project: Spark Issue

[jira] [Commented] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223367#comment-17223367 ] Apache Spark commented on SPARK-33292: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223365#comment-17223365 ] Apache Spark commented on SPARK-33183: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223366#comment-17223366 ] Apache Spark commented on SPARK-33292: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33285) Too many "Auto-application to `()` is deprecated." related compilation warnings

[ https://issues.apache.org/jira/browse/SPARK-33285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223357#comment-17223357 ] Yang Jie commented on SPARK-33285: -- Yes, it works in Scala 2.12. I'll try to fix this compilation

[jira] [Commented] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223356#comment-17223356 ] Apache Spark commented on SPARK-33183: -- User 'allisonwang-db' has created a pull request for this

[jira] [Updated] (SPARK-33268) Fix bugs for casting data from/to PythonUserDefinedType

[ https://issues.apache.org/jira/browse/SPARK-33268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33268: -- Fix Version/s: 3.0.2 2.4.8 > Fix bugs for casting data from/to

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223345#comment-17223345 ] Hyukjin Kwon commented on SPARK-33279: -- Hm, yeah so we can't upgrade and make some changes to

[jira] [Resolved] (SPARK-33286) Misleading error messages of `from_json`

[ https://issues.apache.org/jira/browse/SPARK-33286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33286. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30183

[jira] [Assigned] (SPARK-33286) Misleading error messages of `from_json`

[ https://issues.apache.org/jira/browse/SPARK-33286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33286: Assignee: Maxim Gekk > Misleading error messages of `from_json` >

[jira] [Commented] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223341#comment-17223341 ] Lu Lu commented on SPARK-33008: --- Please assign this to me. [~cloud_fan] > Division by zero on divide-like

[jira] [Resolved] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33292. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Assigned] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33292: - Assignee: Dongjoon Hyun > Make Literal ArrayBasedMapData string representation

[jira] [Updated] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-33098: -- Description: The following cases throw {{MetaException(message:Filtering is supported only on

[jira] [Updated] (SPARK-33098) Explicit or implicit casts involving partition columns can sometimes result in a MetaException.

[ https://issues.apache.org/jira/browse/SPARK-33098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-33098: -- Summary: Explicit or implicit casts involving partition columns can sometimes result in a

[jira] [Assigned] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

[ https://issues.apache.org/jira/browse/SPARK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33293: Assignee: (was: Apache Spark) > Refactor WriteToDataSourceV2Exec and reduce code

[jira] [Assigned] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

[ https://issues.apache.org/jira/browse/SPARK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33293: Assignee: Apache Spark > Refactor WriteToDataSourceV2Exec and reduce code duplication >

[jira] [Commented] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

[ https://issues.apache.org/jira/browse/SPARK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223302#comment-17223302 ] Apache Spark commented on SPARK-33293: -- User 'sunchao' has created a pull request for this issue:

[jira] [Created] (SPARK-33293) Refactor WriteToDataSourceV2Exec and reduce code duplication

Chao Sun created SPARK-33293: Summary: Refactor WriteToDataSourceV2Exec and reduce code duplication Key: SPARK-33293 URL: https://issues.apache.org/jira/browse/SPARK-33293 Project: Spark Issue

[jira] [Updated] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33273: -- Priority: Blocker (was: Major) > Fix Flaky Test: ThriftServerQueryTestSuite. >

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223279#comment-17223279 ] Dongjoon Hyun commented on SPARK-33273: --- This failure is frequent and might be a potential

[jira] [Updated] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33273: -- Labels: correctness (was: ) > Fix Flaky Test: ThriftServerQueryTestSuite. >

[jira] [Updated] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33273: -- Issue Type: Bug (was: Test) > Fix Flaky Test: ThriftServerQueryTestSuite. >

[jira] [Updated] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33273: -- Component/s: SQL > Fix Flaky Test: ThriftServerQueryTestSuite. >

[jira] [Commented] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223274#comment-17223274 ] Jungtaek Lim commented on SPARK-33280: -- Probably better to suspect Scala 2.12 as the common thing

[jira] [Commented] (SPARK-33268) Fix bugs for casting data from/to PythonUserDefinedType

[ https://issues.apache.org/jira/browse/SPARK-33268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223272#comment-17223272 ] Apache Spark commented on SPARK-33268: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223268#comment-17223268 ] Dongjoon Hyun commented on SPARK-33273: --- This happens again on master branch again. -

[jira] [Commented] (SPARK-33268) Fix bugs for casting data from/to PythonUserDefinedType

[ https://issues.apache.org/jira/browse/SPARK-33268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223264#comment-17223264 ] Apache Spark commented on SPARK-33268: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33268) Fix bugs for casting data from/to PythonUserDefinedType

[ https://issues.apache.org/jira/browse/SPARK-33268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223263#comment-17223263 ] Apache Spark commented on SPARK-33268: -- User 'maropu' has created a pull request for this issue:

[jira] [Updated] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33292: -- Affects Version/s: 2.0.2 2.1.3 2.2.3

[jira] [Assigned] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33292: Assignee: Apache Spark > Make Literal ArrayBasedMapData string representation

[jira] [Commented] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223259#comment-17223259 ] Apache Spark commented on SPARK-33292: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

[ https://issues.apache.org/jira/browse/SPARK-33292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33292: Assignee: (was: Apache Spark) > Make Literal ArrayBasedMapData string representation

[jira] [Created] (SPARK-33292) Make Literal ArrayBasedMapData string representation disambiguous

Dongjoon Hyun created SPARK-33292: - Summary: Make Literal ArrayBasedMapData string representation disambiguous Key: SPARK-33292 URL: https://issues.apache.org/jira/browse/SPARK-33292 Project: Spark

[jira] [Updated] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart White updated SPARK-33291: - Affects Version/s: 3.0.2 > Inconsistent NULL conversions to strings redux >

[jira] [Updated] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart White updated SPARK-33291: - Description: The changes in SPARK-32501 introduced some behavior that I'd like to clean up a

[jira] [Updated] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart White updated SPARK-33291: - Description: The changes in SPARK-32501 Inconsistent NULL conversions to strings introduced

[jira] [Updated] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart White updated SPARK-33291: - Description: The changes in [SPARK-32501 Inconsistent NULL conversions to

[jira] [Assigned] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33291: Assignee: (was: Apache Spark) > Inconsistent NULL conversions to strings redux >

[jira] [Commented] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223223#comment-17223223 ] Apache Spark commented on SPARK-33291: -- User 'stwhit' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33291: Assignee: Apache Spark > Inconsistent NULL conversions to strings redux >

[jira] [Commented] (SPARK-33291) Inconsistent NULL conversions to strings redux

[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223224#comment-17223224 ] Apache Spark commented on SPARK-33291: -- User 'stwhit' has created a pull request for this issue:

[jira] [Created] (SPARK-33291) Inconsistent NULL conversions to strings redux

Stuart White created SPARK-33291: Summary: Inconsistent NULL conversions to strings redux Key: SPARK-33291 URL: https://issues.apache.org/jira/browse/SPARK-33291 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

[ https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223169#comment-17223169 ] Apache Spark commented on SPARK-33290: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

[ https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223168#comment-17223168 ] Apache Spark commented on SPARK-33290: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

[ https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33290: Assignee: (was: Apache Spark) > REFRESH TABLE should invalidate cache even though

[jira] [Assigned] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

[ https://issues.apache.org/jira/browse/SPARK-33290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33290: Assignee: Apache Spark > REFRESH TABLE should invalidate cache even though the table

[jira] [Created] (SPARK-33290) REFRESH TABLE should invalidate cache even though the table itself may not be cached

Chao Sun created SPARK-33290: Summary: REFRESH TABLE should invalidate cache even though the table itself may not be cached Key: SPARK-33290 URL: https://issues.apache.org/jira/browse/SPARK-33290

[jira] [Assigned] (SPARK-23432) Expose executor memory metrics in the web UI for executors

[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23432: Assignee: Apache Spark > Expose executor memory metrics in the web UI for executors >

[jira] [Assigned] (SPARK-23432) Expose executor memory metrics in the web UI for executors

[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23432: Assignee: (was: Apache Spark) > Expose executor memory metrics in the web UI for

[jira] [Commented] (SPARK-23432) Expose executor memory metrics in the web UI for executors

[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223106#comment-17223106 ] Apache Spark commented on SPARK-23432: -- User 'warrenzhu25' has created a pull request for this

[jira] [Comment Edited] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223080#comment-17223080 ] Kiran Kumar Joseph edited comment on SPARK-33280 at 10/29/20, 5:44 PM:

[jira] [Commented] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223080#comment-17223080 ] Kiran Kumar Joseph commented on SPARK-33280: The master and slaves are running on the same

[jira] [Resolved] (SPARK-33008) Division by zero on divide-like operations returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-33008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33008. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29882

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223009#comment-17223009 ] Dongjoon Hyun commented on SPARK-33279: --- Hi, [~fan_li_ya]. In general, Apache Spark 3.0.0 was

[jira] [Commented] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223004#comment-17223004 ] Dongjoon Hyun commented on SPARK-33280: --- Hi, [~voiddrum]. 1. What is your Java version? 2. Could

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223002#comment-17223002 ] Dongjoon Hyun commented on SPARK-33279: --- cc [~hyukjin.kwon] and [~bryanc] > Spark 3.0 failure due

[jira] [Commented] (SPARK-33280) Spark 3.0 serialization issue

[ https://issues.apache.org/jira/browse/SPARK-33280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222999#comment-17222999 ] Dongjoon Hyun commented on SPARK-33280: --- cc [~viirya] and [~kabhwan] > Spark 3.0 serialization

[jira] [Created] (SPARK-33289) Error executing `SHOW VIEWS in {database}` using JDBC

Prakshal Jain created SPARK-33289: - Summary: Error executing `SHOW VIEWS in {database}` using JDBC Key: SPARK-33289 URL: https://issues.apache.org/jira/browse/SPARK-33289 Project: Spark

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222946#comment-17222946 ] Apache Spark commented on SPARK-33152: -- User 'ahshahid' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33152: Assignee: (was: Apache Spark) > Constraint Propagation code causes OOM issues or

[jira] [Assigned] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33152: Assignee: Apache Spark > Constraint Propagation code causes OOM issues or increasing

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222943#comment-17222943 ] Dongjoon Hyun commented on SPARK-33273: --- Thank you for sharing, [~gsomogyi]! > Fix Flaky Test:

[jira] [Updated] (SPARK-27733) Upgrade to Avro 1.10.0

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27733: -- Priority: Major (was: Minor) > Upgrade to Avro 1.10.0 > -- > >

[jira] [Commented] (SPARK-33288) Support k8s cluster manager with stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222942#comment-17222942 ] Dongjoon Hyun commented on SPARK-33288: --- Got it. Thanks! > Support k8s cluster manager with stage

[jira] [Assigned] (SPARK-33283) Remove useless externalBlockStoreSize from RDDInfo

[ https://issues.apache.org/jira/browse/SPARK-33283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33283: - Assignee: Yang Jie > Remove useless externalBlockStoreSize from RDDInfo >

[jira] [Resolved] (SPARK-33283) Remove useless externalBlockStoreSize from RDDInfo

[ https://issues.apache.org/jira/browse/SPARK-33283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33283. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30179

[jira] [Commented] (SPARK-33288) Support k8s cluster manager with stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222932#comment-17222932 ] Thomas Graves commented on SPARK-33288: --- yes. Really when I say hanging it means k8s won't be able

[jira] [Resolved] (SPARK-33263) Configurable StateStore compression codec

[ https://issues.apache.org/jira/browse/SPARK-33263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33263. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30162

[jira] [Updated] (SPARK-33288) Support k8s cluster manager with stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33288: -- Component/s: Spark Core > Support k8s cluster manager with stage level scheduling >

[jira] [Commented] (SPARK-33288) Support k8s cluster manager with stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222929#comment-17222929 ] Dongjoon Hyun commented on SPARK-33288: --- What do you mean `hanging`? Do you mean the behavior of

[jira] [Commented] (SPARK-33253) Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

[ https://issues.apache.org/jira/browse/SPARK-33253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222921#comment-17222921 ] Hyukjin Kwon commented on SPARK-33253: -- Thanks [~itholic]. > Migration to NumPy documentation

[jira] [Commented] (SPARK-33253) Migration to NumPy documentation style in Streaming (pyspark.streaming.*)

[ https://issues.apache.org/jira/browse/SPARK-33253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222919#comment-17222919 ] Haejoon Lee commented on SPARK-33253: - I'll take this one > Migration to NumPy documentation style

[jira] [Commented] (SPARK-33288) Support k8s cluster manager with stage level scheduling

[ https://issues.apache.org/jira/browse/SPARK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222917#comment-17222917 ] Thomas Graves commented on SPARK-33288: --- note there will be a couple of caveats here in that if

[jira] [Created] (SPARK-33288) Support k8s cluster manager with stage level scheduling

Thomas Graves created SPARK-33288: - Summary: Support k8s cluster manager with stage level scheduling Key: SPARK-33288 URL: https://issues.apache.org/jira/browse/SPARK-33288 Project: Spark

[jira] [Updated] (SPARK-33287) Expose state custom metrics information on SS UI

[ https://issues.apache.org/jira/browse/SPARK-33287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-33287: -- Affects Version/s: (was: 3.1.0) 3.0.1 > Expose state custom

  1   2   >