[jira] [Resolved] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34197. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31265

[jira] [Assigned] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

[ https://issues.apache.org/jira/browse/SPARK-34197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34197: --- Assignee: Maxim Gekk > refreshTable() should not invalidate the relation cache for

[jira] [Updated] (SPARK-34192) Move char padding to write side

[ https://issues.apache.org/jira/browse/SPARK-34192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34192: - Description: On the read side, the char length check and padding bring issues to CBO and PPD and other

[jira] [Commented] (SPARK-34216) typeName of CalendarIntervalType changed from spark 2 to 3

[ https://issues.apache.org/jira/browse/SPARK-34216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271103#comment-17271103 ] Kent Yao commented on SPARK-34216: -- oh, I have been negligent. It's better we had a migration guide.

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271098#comment-17271098 ] Dongjoon Hyun commented on SPARK-34212: --- It seems that I found the root cause. I'll make a PR

[jira] [Assigned] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33726: --- Assignee: Yian Liou > Duplicate field names causes wrong answers during aggregation >

[jira] [Resolved] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33726. - Fix Version/s: 3.1.1 3.0.2 Resolution: Fixed > Duplicate field names

[jira] [Commented] (SPARK-34203) FileSource table null partition can not be dropped

[ https://issues.apache.org/jira/browse/SPARK-34203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271087#comment-17271087 ] Wenchen Fan commented on SPARK-34203: - [~maxgekk] can you take a look? > FileSource table null

[jira] [Updated] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34212: -- Labels: correctness (was: ) > For parquet table, after changing the precision and scale of

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271075#comment-17271075 ] Dongjoon Hyun commented on SPARK-34212: --- Also, this happens only in Parquet. For ORC, it works

[jira] [Updated] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34212: -- Affects Version/s: 3.0.1 > For parquet table, after changing the precision and scale of

[jira] [Comment Edited] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271071#comment-17271071 ] Dongjoon Hyun edited comment on SPARK-34212 at 1/25/21, 5:22 AM: - As a

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271071#comment-17271071 ] Dongjoon Hyun commented on SPARK-34212: --- As a workaround, you may want to turn off

[jira] [Updated] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34212: -- Affects Version/s: 3.1.1 > For parquet table, after changing the precision and scale of

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271069#comment-17271069 ] Dongjoon Hyun commented on SPARK-34212: --- I confirmed that this exists in Apache Spark 3.1.1 RC1,

[jira] [Resolved] (SPARK-34211) Benchmark TPC-DS with 1GB scale factor

[ https://issues.apache.org/jira/browse/SPARK-34211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34211. - Resolution: Won't Fix > Benchmark TPC-DS with 1GB scale factor >

[jira] [Assigned] (SPARK-34133) [AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching

[ https://issues.apache.org/jira/browse/SPARK-34133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34133: --- Assignee: Erik Krogen > [AVRO] Respect case sensitivity when performing Catalyst-to-Avro

[jira] [Resolved] (SPARK-34133) [AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching

[ https://issues.apache.org/jira/browse/SPARK-34133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34133. - Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31201

[jira] [Assigned] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34221: Assignee: Apache Spark > In a special scenario, the error message of the stage in the UI

[jira] [Commented] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271064#comment-17271064 ] Apache Spark commented on SPARK-34221: -- User 'akiyamaneko' has created a pull request for this

[jira] [Commented] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271063#comment-17271063 ] Apache Spark commented on SPARK-34221: -- User 'akiyamaneko' has created a pull request for this

[jira] [Assigned] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34221: Assignee: (was: Apache Spark) > In a special scenario, the error message of the

[jira] [Updated] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

[ https://issues.apache.org/jira/browse/SPARK-34221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated SPARK-34221: Attachment: problem.png > In a special scenario, the error message of the stage in the UI page is

[jira] [Created] (SPARK-34221) In a special scenario, the error message of the stage in the UI page is blank

akiyamaneko created SPARK-34221: --- Summary: In a special scenario, the error message of the stage in the UI page is blank Key: SPARK-34221 URL: https://issues.apache.org/jira/browse/SPARK-34221 Project:

[jira] [Commented] (SPARK-34220) BucketedRandomProjectionLSH transform opt

[ https://issues.apache.org/jira/browse/SPARK-34220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271062#comment-17271062 ] Apache Spark commented on SPARK-34220: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-34220) BucketedRandomProjectionLSH transform opt

[ https://issues.apache.org/jira/browse/SPARK-34220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34220: Assignee: (was: Apache Spark) > BucketedRandomProjectionLSH transform opt >

[jira] [Assigned] (SPARK-34220) BucketedRandomProjectionLSH transform opt

[ https://issues.apache.org/jira/browse/SPARK-34220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34220: Assignee: Apache Spark > BucketedRandomProjectionLSH transform opt >

[jira] [Commented] (SPARK-34220) BucketedRandomProjectionLSH transform opt

[ https://issues.apache.org/jira/browse/SPARK-34220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271061#comment-17271061 ] Apache Spark commented on SPARK-34220: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-34220) BucketedRandomProjectionLSH transform opt

zhengruifeng created SPARK-34220: Summary: BucketedRandomProjectionLSH transform opt Key: SPARK-34220 URL: https://issues.apache.org/jira/browse/SPARK-34220 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33542) Group exception messages in catalyst/catalog

[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271057#comment-17271057 ] Apache Spark commented on SPARK-33542: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-34163) Spark Structured Streaming - Kafka avro transformation on optional field Failed

[ https://issues.apache.org/jira/browse/SPARK-34163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271056#comment-17271056 ] Hyukjin Kwon commented on SPARK-34163: -- For questions, please use Spark mailing lists before filing

[jira] [Resolved] (SPARK-34177) DESC command returns wrong data type

[ https://issues.apache.org/jira/browse/SPARK-34177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34177. -- Resolution: Duplicate > DESC command returns wrong data type >

[jira] [Commented] (SPARK-34177) DESC command returns wrong data type

[ https://issues.apache.org/jira/browse/SPARK-34177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271054#comment-17271054 ] Hyukjin Kwon commented on SPARK-34177: -- This will be fixed in Spark 3.1. e.g.) SPARK-33892 > DESC

[jira] [Commented] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271053#comment-17271053 ] Hyukjin Kwon commented on SPARK-34179: -- [~chetdb] are you interested in submitting a PR? >

[jira] [Updated] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

[ https://issues.apache.org/jira/browse/SPARK-34219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouliutao updated SPARK-34219: --- Issue Type: Bug (was: Question) > yark-cluster java.io.UTFDataFormatException >

[jira] [Updated] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

[ https://issues.apache.org/jira/browse/SPARK-34219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouliutao updated SPARK-34219: --- Issue Type: Question (was: Bug) > yark-cluster java.io.UTFDataFormatException >

[jira] [Updated] (SPARK-34182) [AVRO] Improve error messages when matching Catalyst-to-Avro schemas

[ https://issues.apache.org/jira/browse/SPARK-34182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34182: - Target Version/s: (was: 3.2.0) > [AVRO] Improve error messages when matching Catalyst-to-Avro

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271052#comment-17271052 ] Hyukjin Kwon commented on SPARK-34209: -- [~holden] would you mind filling the Jira description?  >

[jira] [Updated] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34212: - Description: In Hive,  {code} create table test_decimal(amt decimal(18,2)) stored as parquet; 

[jira] [Commented] (SPARK-34216) typeName of CalendarIntervalType changed from spark 2 to 3

[ https://issues.apache.org/jira/browse/SPARK-34216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271051#comment-17271051 ] Hyukjin Kwon commented on SPARK-34216: -- I think simpleName hasn't mistakenly set properly. After

[jira] [Updated] (SPARK-34216) typeName of CalendarIntervalType changed from spark 2 to 3

[ https://issues.apache.org/jira/browse/SPARK-34216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34216: - Issue Type: Improvement (was: Bug) > typeName of CalendarIntervalType changed from spark 2 to

[jira] [Resolved] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

[ https://issues.apache.org/jira/browse/SPARK-34219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34219. -- Resolution: Invalid > yark-cluster java.io.UTFDataFormatException >

[jira] [Commented] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

[ https://issues.apache.org/jira/browse/SPARK-34219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271049#comment-17271049 ] Hyukjin Kwon commented on SPARK-34219: -- The error message says something was too big during

[jira] [Updated] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

[ https://issues.apache.org/jira/browse/SPARK-34219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34219: - Priority: Major (was: Blocker) > yark-cluster java.io.UTFDataFormatException >

[jira] [Resolved] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34186. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31274

[jira] [Resolved] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34147. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31218

[jira] [Assigned] (SPARK-34147) Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

[ https://issues.apache.org/jira/browse/SPARK-34147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34147: Assignee: Peter Toth > Keep data partitioning in TPCDSQueryBenchmark when CBO is enabled

[jira] [Resolved] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34185. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31271

[jira] [Assigned] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34185: Assignee: Yuanjian Li > Review and fix issues in API docs >

[jira] [Resolved] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33489. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31285

[jira] [Assigned] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33489: Assignee: Takuya Ueshin > Support null for conversion from and to Arrow type >

[jira] [Created] (SPARK-34219) yark-cluster java.io.UTFDataFormatException

zhouliutao created SPARK-34219: -- Summary: yark-cluster java.io.UTFDataFormatException Key: SPARK-34219 URL: https://issues.apache.org/jira/browse/SPARK-34219 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34218) Add Scala 2.13 packaging and publishing

[ https://issues.apache.org/jira/browse/SPARK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34218: Assignee: (was: Apache Spark) > Add Scala 2.13 packaging and publishing >

[jira] [Commented] (SPARK-34218) Add Scala 2.13 packaging and publishing

[ https://issues.apache.org/jira/browse/SPARK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271017#comment-17271017 ] Apache Spark commented on SPARK-34218: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34218) Add Scala 2.13 packaging and publishing

[ https://issues.apache.org/jira/browse/SPARK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271018#comment-17271018 ] Apache Spark commented on SPARK-34218: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34218) Add Scala 2.13 packaging and publishing

[ https://issues.apache.org/jira/browse/SPARK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34218: Assignee: Apache Spark > Add Scala 2.13 packaging and publishing >

[jira] [Created] (SPARK-34218) Add Scala 2.13 packaging and publishing

Dongjoon Hyun created SPARK-34218: - Summary: Add Scala 2.13 packaging and publishing Key: SPARK-34218 URL: https://issues.apache.org/jira/browse/SPARK-34218 Project: Spark Issue Type:

[jira] [Closed] (SPARK-27487) Spark - Scala 2.12 compatibility

[ https://issues.apache.org/jira/browse/SPARK-27487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-27487. - > Spark - Scala 2.12 compatibility > > > Key:

[jira] [Assigned] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34180: - Assignee: Kousuke Saruta (was: Apache Spark) > Fix the regression brought by

[jira] [Issue Comment Deleted] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34217: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34217. --- Fix Version/s: 3.1.1 3.2.0 3.0.2 Assignee:

[jira] [Commented] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271007#comment-17271007 ] Apache Spark commented on SPARK-34217: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34217: Assignee: Apache Spark > Fix Scala 2.12 release profile > --

[jira] [Assigned] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34217: Assignee: (was: Apache Spark) > Fix Scala 2.12 release profile >

[jira] [Commented] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271006#comment-17271006 ] Apache Spark commented on SPARK-34217: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34217: -- Priority: Major (was: Blocker) > Fix Scala 2.12 release profile >

[jira] [Updated] (SPARK-34217) Fix Scala 2.12 release profile

[ https://issues.apache.org/jira/browse/SPARK-34217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34217: -- Priority: Blocker (was: Major) > Fix Scala 2.12 release profile >

[jira] [Created] (SPARK-34217) Fix Scala 2.12 release profile

Dongjoon Hyun created SPARK-34217: - Summary: Fix Scala 2.12 release profile Key: SPARK-34217 URL: https://issues.apache.org/jira/browse/SPARK-34217 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270992#comment-17270992 ] Dongjoon Hyun commented on SPARK-34212: --- Thank you for reporting, [~jack86596]. > For parquet

[jira] [Resolved] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34187. --- Fix Version/s: 3.1.1 3.2.0 Resolution: Fixed > Use available

[jira] [Updated] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34187: -- Fix Version/s: (was: 3.2.0) > Use available offset range obtained during polling when

[jira] [Updated] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34187: -- Affects Version/s: 3.2.0 > Use available offset range obtained during polling when checking

[jira] [Updated] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34187: -- Affects Version/s: (was: 3.2.0) > Use available offset range obtained during polling when

[jira] [Commented] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

[ https://issues.apache.org/jira/browse/SPARK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270974#comment-17270974 ] Apache Spark commented on SPARK-34213: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

[ https://issues.apache.org/jira/browse/SPARK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270971#comment-17270971 ] Apache Spark commented on SPARK-34213: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

[ https://issues.apache.org/jira/browse/SPARK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270970#comment-17270970 ] Apache Spark commented on SPARK-34213: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270968#comment-17270968 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270967#comment-17270967 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34215) Keep table cached after truncation

[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270957#comment-17270957 ] Apache Spark commented on SPARK-34215: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34215) Keep table cached after truncation

[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34215: Assignee: Apache Spark > Keep table cached after truncation >

[jira] [Assigned] (SPARK-34215) Keep table cached after truncation

[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34215: Assignee: (was: Apache Spark) > Keep table cached after truncation >

[jira] [Commented] (SPARK-34215) Keep table cached after truncation

[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270956#comment-17270956 ] Apache Spark commented on SPARK-34215: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-34216) typeName of CalendarIntervalType changed from spark 2 to 3

Sasa Zejnilovic created SPARK-34216: --- Summary: typeName of CalendarIntervalType changed from spark 2 to 3 Key: SPARK-34216 URL: https://issues.apache.org/jira/browse/SPARK-34216 Project: Spark

[jira] [Updated] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34187: Labels: correctness (was: ) > Use available offset range obtained during polling when checking

[jira] [Created] (SPARK-34215) Keep table cached after truncation

Maxim Gekk created SPARK-34215: -- Summary: Keep table cached after truncation Key: SPARK-34215 URL: https://issues.apache.org/jira/browse/SPARK-34215 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

[ https://issues.apache.org/jira/browse/SPARK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34213: -- Fix Version/s: 3.0.2 > LOAD DATA doesn't refresh v1 table cache >

[jira] [Updated] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Updated] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270865#comment-17270865 ] Apache Spark commented on SPARK-33933: -- User 'zhongyu09' has created a pull request for this issue:

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270864#comment-17270864 ] Apache Spark commented on SPARK-33933: -- User 'zhongyu09' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34214) Expose regexp_extract_all to PySpark

[ https://issues.apache.org/jira/browse/SPARK-34214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34214: Assignee: (was: Apache Spark) > Expose regexp_extract_all to PySpark >

[jira] [Assigned] (SPARK-34214) Expose regexp_extract_all to PySpark

[ https://issues.apache.org/jira/browse/SPARK-34214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34214: Assignee: Apache Spark > Expose regexp_extract_all to PySpark >

[jira] [Commented] (SPARK-34214) Expose regexp_extract_all to PySpark

[ https://issues.apache.org/jira/browse/SPARK-34214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270860#comment-17270860 ] Apache Spark commented on SPARK-34214: -- User 'asmello' has created a pull request for this issue:

[jira] [Created] (SPARK-34214) Expose regexp_extract_all to PySpark

André Sá de Mello created SPARK-34214: - Summary: Expose regexp_extract_all to PySpark Key: SPARK-34214 URL: https://issues.apache.org/jira/browse/SPARK-34214 Project: Spark Issue Type: