[jira] [Updated] (SPARK-38483) Column name or alias as an attribute of the PySpark Column class

2022-03-09 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Schaefer updated SPARK-38483: --- Description: Having the name of a column as an attribute of PySpark {{Column}} class

[jira] [Created] (SPARK-38483) Column name or alias as an attribute of the PySpark Column class

2022-03-09 Thread Brian Schaefer (Jira)
Brian Schaefer created SPARK-38483: -- Summary: Column name or alias as an attribute of the PySpark Column class Key: SPARK-38483 URL: https://issues.apache.org/jira/browse/SPARK-38483 Project: Spark

[jira] [Resolved] (SPARK-36681) Fail to load Snappy codec

2022-03-09 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36681. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35784

[jira] [Assigned] (SPARK-36681) Fail to load Snappy codec

2022-03-09 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36681: --- Assignee: L. C. Hsieh > Fail to load Snappy codec > - > >

[jira] [Assigned] (SPARK-38354) Add hash probes metrics for shuffled hash join

2022-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38354: --- Assignee: Cheng Su > Add hash probes metrics for shuffled hash join >

[jira] [Resolved] (SPARK-38354) Add hash probes metrics for shuffled hash join

2022-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38354. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35686

[jira] [Assigned] (SPARK-37947) Cannot use _outer generators in a lateral view

2022-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37947: --- Assignee: Bruce Robbins > Cannot use _outer generators in a lateral view >

[jira] [Resolved] (SPARK-37947) Cannot use _outer generators in a lateral view

2022-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37947. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35232

[jira] [Commented] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

2022-03-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503595#comment-17503595 ] Wenchen Fan commented on SPARK-37995: - Does this problem still exists in 3.2 and master branch? >

[jira] [Assigned] (SPARK-38482) Migrate legacy.keepCommandOutputSchema related to KeepLegacyOutputs

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38482: Assignee: (was: Apache Spark) > Migrate legacy.keepCommandOutputSchema related to

[jira] [Commented] (SPARK-38482) Migrate legacy.keepCommandOutputSchema related to KeepLegacyOutputs

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503570#comment-17503570 ] Apache Spark commented on SPARK-38482: -- User 'Yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38482) Migrate legacy.keepCommandOutputSchema related to KeepLegacyOutputs

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38482: Assignee: Apache Spark > Migrate legacy.keepCommandOutputSchema related to

[jira] [Comment Edited] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-09 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502633#comment-17502633 ] Rafal Wojdyla edited comment on SPARK-38438 at 3/9/22, 12:35 PM: - The

[jira] [Updated] (SPARK-38438) Can't update spark.jars.packages on existing global/default context

2022-03-09 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-38438: -- Description: Reproduction: {code:python} from pyspark.sql import SparkSession # default

[jira] [Created] (SPARK-38482) Migrate legacy.keepCommandOutputSchema related to KeepLegacyOutputs

2022-03-09 Thread yikf (Jira)
yikf created SPARK-38482: Summary: Migrate legacy.keepCommandOutputSchema related to KeepLegacyOutputs Key: SPARK-38482 URL: https://issues.apache.org/jira/browse/SPARK-38482 Project: Spark Issue

[jira] [Commented] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503540#comment-17503540 ] Apache Spark commented on SPARK-38481: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503538#comment-17503538 ] Apache Spark commented on SPARK-38481: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38481: Assignee: Max Gekk (was: Apache Spark) > Substitute Java overflow exception from

[jira] [Assigned] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38481: Assignee: Apache Spark (was: Max Gekk) > Substitute Java overflow exception from

[jira] [Commented] (SPARK-38187) Support resource reservation (Introduce minCPU/minMemory) with volcano implementations

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503531#comment-17503531 ] Apache Spark commented on SPARK-38187: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38187) Support resource reservation (Introduce minCPU/minMemory) with volcano implementations

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503530#comment-17503530 ] Apache Spark commented on SPARK-38187: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38213) support Metrics information report to kafkaSink.

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503529#comment-17503529 ] Apache Spark commented on SPARK-38213: -- User 'senthh' has created a pull request for this issue:

[jira] [Updated] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38481: - Description: Currently, Spark SQL can throw Java exceptions from the

[jira] [Commented] (SPARK-38455) Support driver/executor PodGroup templates

2022-03-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503527#comment-17503527 ] Apache Spark commented on SPARK-38455: -- User 'Yikun' has created a pull request for this issue:

[jira] [Updated] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38481: - Description: Currently, Spark SQL can throw Java exceptions from the

[jira] [Created] (SPARK-38481) Substitute Java overflow exception from TIMESTAMPADD by Spark exception

2022-03-09 Thread Max Gekk (Jira)
Max Gekk created SPARK-38481: Summary: Substitute Java overflow exception from TIMESTAMPADD by Spark exception Key: SPARK-38481 URL: https://issues.apache.org/jira/browse/SPARK-38481 Project: Spark

[jira] [Resolved] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

2022-03-09 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37421. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

2022-03-09 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37421: -- Assignee: dch nguyen > Inline type hints for

[jira] [Assigned] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38437: Assignee: Max Gekk > Dynamic serialization of Java datetime objects to micros/days >

[jira] [Resolved] (SPARK-38437) Dynamic serialization of Java datetime objects to micros/days

2022-03-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38437. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35756

<    1   2