[jira] [Assigned] (SPARK-35130) Construct day-time interval column from integral fields

[ https://issues.apache.org/jira/browse/SPARK-35130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35130: Assignee: (was: Apache Spark) > Construct day-time interval column from integral

[jira] [Assigned] (SPARK-35130) Construct day-time interval column from integral fields

[ https://issues.apache.org/jira/browse/SPARK-35130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35130: Assignee: Apache Spark > Construct day-time interval column from integral fields >

[jira] [Commented] (SPARK-35130) Construct day-time interval column from integral fields

[ https://issues.apache.org/jira/browse/SPARK-35130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348064#comment-17348064 ] Apache Spark commented on SPARK-35130: -- User 'copperybean' has created a pull request for this

[jira] [Assigned] (SPARK-35456) Show invalid value in config entry check error message

[ https://issues.apache.org/jira/browse/SPARK-35456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35456: Assignee: Apache Spark > Show invalid value in config entry check error message >

[jira] [Commented] (SPARK-35456) Show invalid value in config entry check error message

[ https://issues.apache.org/jira/browse/SPARK-35456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348060#comment-17348060 ] Apache Spark commented on SPARK-35456: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35456) Show invalid value in config entry check error message

[ https://issues.apache.org/jira/browse/SPARK-35456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35456: Assignee: (was: Apache Spark) > Show invalid value in config entry check error

[jira] [Assigned] (SPARK-35106) HadoopMapReduceCommitProtocol performs bad rename when dynamic partition overwrite is used

[ https://issues.apache.org/jira/browse/SPARK-35106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35106: --- Assignee: Yuzhou Sun > HadoopMapReduceCommitProtocol performs bad rename when dynamic

[jira] [Assigned] (SPARK-35106) HadoopMapReduceCommitProtocol performs bad rename when dynamic partition overwrite is used

[ https://issues.apache.org/jira/browse/SPARK-35106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35106: --- Assignee: (was: Erik Krogen) > HadoopMapReduceCommitProtocol performs bad rename when

[jira] [Assigned] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27991: --- Assignee: wuyi > ShuffleBlockFetcherIterator should take Netty constant-factor overheads

[jira] [Updated] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35443: -- Affects Version/s: (was: 3.1.1) 3.2.0 > Mark K8s secrets and

[jira] [Updated] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35443: -- Labels: (was: kubernetes) > Mark K8s secrets and config maps as immutable >

[jira] [Resolved] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches

[ https://issues.apache.org/jira/browse/SPARK-27991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27991. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32287

[jira] [Resolved] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35443. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32588

[jira] [Assigned] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35443: - Assignee: Ashray Jain > Mark K8s secrets and config maps as immutable >

[jira] [Created] (SPARK-35456) Show invalid value in config entry check error message

Kent Yao created SPARK-35456: Summary: Show invalid value in config entry check error message Key: SPARK-35456 URL: https://issues.apache.org/jira/browse/SPARK-35456 Project: Spark Issue Type:

[jira] [Created] (SPARK-35455) Enhance EliminateUnnecessaryJoin

XiDuo You created SPARK-35455: - Summary: Enhance EliminateUnnecessaryJoin Key: SPARK-35455 URL: https://issues.apache.org/jira/browse/SPARK-35455 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35106) HadoopMapReduceCommitProtocol performs bad rename when dynamic partition overwrite is used

[ https://issues.apache.org/jira/browse/SPARK-35106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348033#comment-17348033 ] Yuzhou Sun commented on SPARK-35106: Thanks Erik and Wenchen for initializing and reviewing the fix!

[jira] [Created] (SPARK-35454) Ambiguous self-join doesn't fail after transfroming the dataset to dataframe

wuyi created SPARK-35454: Summary: Ambiguous self-join doesn't fail after transfroming the dataset to dataframe Key: SPARK-35454 URL: https://issues.apache.org/jira/browse/SPARK-35454 Project: Spark

[jira] [Commented] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348024#comment-17348024 ] Nguyen Quang Huy commented on SPARK-33428: -- should we consider return null value if overflow

[jira] [Resolved] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35338. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32596

[jira] [Created] (SPARK-35453) Move Koalas accessor to pandas_on_spark accessor

Haejoon Lee created SPARK-35453: --- Summary: Move Koalas accessor to pandas_on_spark accessor Key: SPARK-35453 URL: https://issues.apache.org/jira/browse/SPARK-35453 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35453) Move Koalas accessor to pandas_on_spark accessor

[ https://issues.apache.org/jira/browse/SPARK-35453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348021#comment-17348021 ] Haejoon Lee commented on SPARK-35453: - I'm working on this > Move Koalas accessor to

[jira] [Created] (SPARK-35452) Introduce ComplexTypeOps

Xinrong Meng created SPARK-35452: Summary: Introduce ComplexTypeOps Key: SPARK-35452 URL: https://issues.apache.org/jira/browse/SPARK-35452 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35320) from_json cannot parse maps with timestamp as key

[ https://issues.apache.org/jira/browse/SPARK-35320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348002#comment-17348002 ] Apache Spark commented on SPARK-35320: -- User 'planga82' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

[ https://issues.apache.org/jira/browse/SPARK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35450. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32597

[jira] [Assigned] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

[ https://issues.apache.org/jira/browse/SPARK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35450: Assignee: Takuya Ueshin > Follow checkout-merge way to use the latest commit for linter,

[jira] [Assigned] (SPARK-35320) from_json cannot parse maps with timestamp as key

[ https://issues.apache.org/jira/browse/SPARK-35320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35320: Assignee: Apache Spark > from_json cannot parse maps with timestamp as key >

[jira] [Assigned] (SPARK-35320) from_json cannot parse maps with timestamp as key

[ https://issues.apache.org/jira/browse/SPARK-35320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35320: Assignee: (was: Apache Spark) > from_json cannot parse maps with timestamp as key >

[jira] [Commented] (SPARK-35408) Improve parameter validation in DataFrame.show

[ https://issues.apache.org/jira/browse/SPARK-35408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348000#comment-17348000 ] Apache Spark commented on SPARK-35408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

[ https://issues.apache.org/jira/browse/SPARK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347997#comment-17347997 ] Apache Spark commented on SPARK-35450: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

[ https://issues.apache.org/jira/browse/SPARK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35450: Assignee: (was: Apache Spark) > Follow checkout-merge way to use the latest commit

[jira] [Assigned] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

[ https://issues.apache.org/jira/browse/SPARK-35450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35450: Assignee: Apache Spark > Follow checkout-merge way to use the latest commit for linter,

[jira] [Resolved] (SPARK-35451) Sync with Apache Spark branch for all builds such as linter in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-35451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35451. -- Resolution: Duplicate > Sync with Apache Spark branch for all builds such as linter in GitHub

[jira] [Created] (SPARK-35451) Sync with Apache Spark branch for all builds such as linter in GitHub Actions

Hyukjin Kwon created SPARK-35451: Summary: Sync with Apache Spark branch for all builds such as linter in GitHub Actions Key: SPARK-35451 URL: https://issues.apache.org/jira/browse/SPARK-35451

[jira] [Created] (SPARK-35450) Follow checkout-merge way to use the latest commit for linter, or other workflows.

Takuya Ueshin created SPARK-35450: - Summary: Follow checkout-merge way to use the latest commit for linter, or other workflows. Key: SPARK-35450 URL: https://issues.apache.org/jira/browse/SPARK-35450

[jira] [Commented] (SPARK-35446) Override getJDBCType in MySQLDialect to map FloatType to FLOAT

[ https://issues.apache.org/jira/browse/SPARK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347993#comment-17347993 ] Takeshi Yamamuro commented on SPARK-35446: -- Oh, I was a bit surprised that mysql treats real as

[jira] [Commented] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347992#comment-17347992 ] Apache Spark commented on SPARK-35338: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347991#comment-17347991 ] Apache Spark commented on SPARK-35338: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

[ https://issues.apache.org/jira/browse/SPARK-35449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347988#comment-17347988 ] Apache Spark commented on SPARK-35449: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

[ https://issues.apache.org/jira/browse/SPARK-35449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35449: Assignee: (was: Apache Spark) > Should not extract common expressions from value

[jira] [Assigned] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

[ https://issues.apache.org/jira/browse/SPARK-35449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35449: Assignee: Apache Spark > Should not extract common expressions from value expressions

[jira] [Commented] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

[ https://issues.apache.org/jira/browse/SPARK-35449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347986#comment-17347986 ] Apache Spark commented on SPARK-35449: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35338: Assignee: Xinrong Meng (was: Apache Spark) > Separate arithmetic operations into data

[jira] [Assigned] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35338: Assignee: Apache Spark (was: Xinrong Meng) > Separate arithmetic operations into data

[jira] [Updated] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35338: -- Fix Version/s: (was: 3.2.0) > Separate arithmetic operations into data type based

[jira] [Reopened] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reopened SPARK-35338: --- The PR was reverted at

[jira] [Resolved] (SPARK-35438) Minor documentation fix for window physical operator

[ https://issues.apache.org/jira/browse/SPARK-35438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35438. -- Fix Version/s: 3.2.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Comment Edited] (SPARK-35448) Subexpression elimination enhancements

[ https://issues.apache.org/jira/browse/SPARK-35448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347976#comment-17347976 ] Adam Binford edited comment on SPARK-35448 at 5/19/21, 11:21 PM: - Just

[jira] [Commented] (SPARK-35448) Subexpression elimination enhancements

[ https://issues.apache.org/jira/browse/SPARK-35448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347976#comment-17347976 ] Adam Binford commented on SPARK-35448: -- Just spitballing after looking through some of the

[jira] [Commented] (SPARK-35256) Subexpression elimination leading to a performance regression

[ https://issues.apache.org/jira/browse/SPARK-35256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347974#comment-17347974 ] Adam Binford commented on SPARK-35256: -- See https://issues.apache.org/jira/browse/SPARK-35448 for a

[jira] [Resolved] (SPARK-35338) Separate arithmetic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35338. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Reopened] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-32304: --- I reopen and convert to a subtask of SPARK-33828 . If there is no more occurrence during Apache

[jira] [Updated] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32304: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > Flaky Test:

[jira] [Updated] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32304: -- Parent: (was: SPARK-32244) Issue Type: Bug (was: Sub-task) > Flaky Test:

[jira] [Commented] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347871#comment-17347871 ] Dongjoon Hyun commented on SPARK-32304: --- Oh, got it. Thank you, [~andygrove]! > Flaky Test:

[jira] [Created] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

L. C. Hsieh created SPARK-35449: --- Summary: Should not extract common expressions from value expressions when elseValue is empty in CaseWhen Key: SPARK-35449 URL: https://issues.apache.org/jira/browse/SPARK-35449

[jira] [Commented] (SPARK-35449) Should not extract common expressions from value expressions when elseValue is empty in CaseWhen

[ https://issues.apache.org/jira/browse/SPARK-35449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347842#comment-17347842 ] L. C. Hsieh commented on SPARK-35449: - cc [~Kimahriman] > Should not extract common expressions

[jira] [Updated] (SPARK-35410) Unused subexpressions leftover in WholeStageCodegen subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35410: Parent: SPARK-35448 Issue Type: Sub-task (was: Bug) > Unused subexpressions leftover in

[jira] [Updated] (SPARK-35439) Children subexpr should come first than parent subexpr in subexpression elimination

[ https://issues.apache.org/jira/browse/SPARK-35439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35439: Parent: SPARK-35448 Issue Type: Sub-task (was: Improvement) > Children subexpr should

[jira] [Created] (SPARK-35448) Subexpression elimination enhancements

L. C. Hsieh created SPARK-35448: --- Summary: Subexpression elimination enhancements Key: SPARK-35448 URL: https://issues.apache.org/jira/browse/SPARK-35448 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-35447) optimize skew join before coalescing shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-35447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347820#comment-17347820 ] Apache Spark commented on SPARK-35447: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35447) optimize skew join before coalescing shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-35447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35447: Assignee: Apache Spark > optimize skew join before coalescing shuffle partitions >

[jira] [Commented] (SPARK-35447) optimize skew join before coalescing shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-35447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347819#comment-17347819 ] Apache Spark commented on SPARK-35447: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35447) optimize skew join before coalescing shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-35447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35447: Assignee: (was: Apache Spark) > optimize skew join before coalescing shuffle

[jira] [Commented] (SPARK-32304) Flaky Test: AdaptiveQueryExecSuite.multiple joins

[ https://issues.apache.org/jira/browse/SPARK-32304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347817#comment-17347817 ] Andy Grove commented on SPARK-32304: [~dongjoon] This is the issue we just saw in branch-3.0.    

[jira] [Created] (SPARK-35447) optimize skew join before coalescing shuffle partitions

Wenchen Fan created SPARK-35447: --- Summary: optimize skew join before coalescing shuffle partitions Key: SPARK-35447 URL: https://issues.apache.org/jira/browse/SPARK-35447 Project: Spark Issue

[jira] [Assigned] (SPARK-35343) Make conversion from/to pandas data-type-based

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35343: Assignee: (was: Apache Spark) > Make conversion from/to pandas data-type-based >

[jira] [Commented] (SPARK-35343) Make conversion from/to pandas data-type-based

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347808#comment-17347808 ] Apache Spark commented on SPARK-35343: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-35343) Make conversion from/to pandas data-type-based

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347809#comment-17347809 ] Apache Spark commented on SPARK-35343: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35343) Make conversion from/to pandas data-type-based

[ https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35343: Assignee: Apache Spark > Make conversion from/to pandas data-type-based >

[jira] [Commented] (SPARK-35373) Verify checksums of downloaded artifacts in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-35373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347765#comment-17347765 ] Apache Spark commented on SPARK-35373: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-35446) Override getJDBCType in MySQLDialect to map FloatType to FLOAT

Marios Meimaris created SPARK-35446: --- Summary: Override getJDBCType in MySQLDialect to map FloatType to FLOAT Key: SPARK-35446 URL: https://issues.apache.org/jira/browse/SPARK-35446 Project: Spark

[jira] [Commented] (SPARK-35445) Reduce the execution time of DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-35445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347704#comment-17347704 ] Apache Spark commented on SPARK-35445: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-35445) Reduce the execution time of DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-35445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347706#comment-17347706 ] Apache Spark commented on SPARK-35445: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35445) Reduce the execution time of DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-35445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35445: Assignee: (was: Apache Spark) > Reduce the execution time of DeduplicateRelations >

[jira] [Assigned] (SPARK-35445) Reduce the execution time of DeduplicateRelations

[ https://issues.apache.org/jira/browse/SPARK-35445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35445: Assignee: Apache Spark > Reduce the execution time of DeduplicateRelations >

[jira] [Updated] (SPARK-35373) Verify checksums of downloaded artifacts in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-35373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-35373: - Fix Version/s: 3.1.2 3.0.3 > Verify checksums of downloaded artifacts in

[jira] [Created] (SPARK-35445) Reduce the execution time of DeduplicateRelations

wuyi created SPARK-35445: Summary: Reduce the execution time of DeduplicateRelations Key: SPARK-35445 URL: https://issues.apache.org/jira/browse/SPARK-35445 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-35093) AQE columnar mismatch on exchange reuse

[ https://issues.apache.org/jira/browse/SPARK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-35093. --- Fix Version/s: 3.2.0 3.1.2 3.0.3 Assignee:

[jira] [Resolved] (SPARK-35362) Update null count in the column stats for UNION stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35362. -- Fix Version/s: 3.2.0 Assignee: shahid Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-35444) Improve createTable logic if table exists

[ https://issues.apache.org/jira/browse/SPARK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347620#comment-17347620 ] Apache Spark commented on SPARK-35444: -- User 'yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35444) Improve createTable logic if table exists

[ https://issues.apache.org/jira/browse/SPARK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35444: Assignee: (was: Apache Spark) > Improve createTable logic if table exists >

[jira] [Assigned] (SPARK-35444) Improve createTable logic if table exists

[ https://issues.apache.org/jira/browse/SPARK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35444: Assignee: Apache Spark > Improve createTable logic if table exists >

[jira] [Commented] (SPARK-35444) Improve createTable logic if table exists

[ https://issues.apache.org/jira/browse/SPARK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347619#comment-17347619 ] Apache Spark commented on SPARK-35444: -- User 'yikf' has created a pull request for this issue:

[jira] [Updated] (SPARK-35444) Improve createTable logic if table exists

[ https://issues.apache.org/jira/browse/SPARK-35444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yikf updated SPARK-35444: - Description: It should return directly if table exists and ignoreIfExists=true   current logic： {code:java}

[jira] [Created] (SPARK-35444) Improve createTable logic if table exists

yikf created SPARK-35444: Summary: Improve createTable logic if table exists Key: SPARK-35444 URL: https://issues.apache.org/jira/browse/SPARK-35444 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347600#comment-17347600 ] Apache Spark commented on SPARK-35443: -- User 'ashrayjain' has created a pull request for this

[jira] [Commented] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347599#comment-17347599 ] Apache Spark commented on SPARK-35443: -- User 'ashrayjain' has created a pull request for this

[jira] [Assigned] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35443: Assignee: (was: Apache Spark) > Mark K8s secrets and config maps as immutable >

[jira] [Assigned] (SPARK-35443) Mark K8s secrets and config maps as immutable

[ https://issues.apache.org/jira/browse/SPARK-35443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35443: Assignee: Apache Spark > Mark K8s secrets and config maps as immutable >

[jira] [Created] (SPARK-35443) Mark K8s secrets and config maps as immutable

Ashray Jain created SPARK-35443: --- Summary: Mark K8s secrets and config maps as immutable Key: SPARK-35443 URL: https://issues.apache.org/jira/browse/SPARK-35443 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35418) Add sentences function to functions.{scala,py}

[ https://issues.apache.org/jira/browse/SPARK-35418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35418. Fix Version/s: 3.2.0 Resolution: Fixed Resolved in

[jira] [Commented] (SPARK-26284) Spark History server object vs file storage behavior difference

[ https://issues.apache.org/jira/browse/SPARK-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347496#comment-17347496 ] Steve Loughran commented on SPARK-26284: # s3:// URLs mean you are using EMR? If so: take it up

[jira] [Updated] (SPARK-35442) Eliminate unnecessary join through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35442: -- Description: If Aggregate and Join have the same output partitioning, the plan will look like:

[jira] [Updated] (SPARK-35442) Eliminate unnecessary join through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35442: -- Description: If Aggregate and Join have the same output partitioning, the plan will look like:

[jira] [Updated] (SPARK-35442) Eliminate unnecessary join through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35442: -- Description: If Aggregate and Join have the same output partitioning, the plan will look like:

[jira] [Created] (SPARK-35442) Eliminate unnecessary join through Aggregate

XiDuo You created SPARK-35442: - Summary: Eliminate unnecessary join through Aggregate Key: SPARK-35442 URL: https://issues.apache.org/jira/browse/SPARK-35442 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35441) InMemoryFileIndex load all files into memroy

[ https://issues.apache.org/jira/browse/SPARK-35441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347404#comment-17347404 ] Yuming Wang commented on SPARK-35441: - What is your driver memory? > InMemoryFileIndex load all

[jira] [Resolved] (SPARK-35368) [SQL]Update histogram statistics for RANGE operator stats estimation

[ https://issues.apache.org/jira/browse/SPARK-35368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35368. -- Fix Version/s: 3.2.0 Assignee: shahid Resolution: Fixed Resolved by 

[jira] [Assigned] (SPARK-35106) HadoopMapReduceCommitProtocol performs bad rename when dynamic partition overwrite is used

[ https://issues.apache.org/jira/browse/SPARK-35106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35106: --- Assignee: Erik Krogen > HadoopMapReduceCommitProtocol performs bad rename when dynamic

  1   2   >