[jira] [Created] (SPARK-40866) Rename Check Spark repo as Check Spark Docker repo in GA

2022-10-21 Thread Qian Sun (Jira)
Qian Sun created SPARK-40866: Summary: Rename Check Spark repo as Check Spark Docker repo in GA Key: SPARK-40866 URL: https://issues.apache.org/jira/browse/SPARK-40866 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622114#comment-17622114 ] BingKun Pan commented on SPARK-40750: - I will work on it. > Migrate type check failures of math

[jira] [Created] (SPARK-40867) Flaky test ProtobufCatalystDataConversionSuite

2022-10-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-40867: Summary: Flaky test ProtobufCatalystDataConversionSuite Key: SPARK-40867 URL: https://issues.apache.org/jira/browse/SPARK-40867 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-40870) Upgrade docker actions to cleanup warning

2022-10-21 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40870: --- Summary: Upgrade docker actions to cleanup warning Key: SPARK-40870 URL: https://issues.apache.org/jira/browse/SPARK-40870 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40871: --- Summary: Upgrade actions/script to v6 Key: SPARK-40871 URL: https://issues.apache.org/jira/browse/SPARK-40871 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40868) Avoid introducing too many partitions when bucketed scan disabled by sql planner

2022-10-21 Thread Xingchao, Zhang (Jira)
Xingchao, Zhang created SPARK-40868: --- Summary: Avoid introducing too many partitions when bucketed scan disabled by sql planner Key: SPARK-40868 URL: https://issues.apache.org/jira/browse/SPARK-40868

[jira] [Assigned] (SPARK-40868) Avoid introducing too many partitions when bucketed scan disabled by sql planner

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40868: Assignee: Apache Spark > Avoid introducing too many partitions when bucketed scan

[jira] [Commented] (SPARK-40868) Avoid introducing too many partitions when bucketed scan disabled by sql planner

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622178#comment-17622178 ] Apache Spark commented on SPARK-40868: -- User 'xingchaozh' has created a pull request for this

[jira] [Created] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-10-21 Thread Tobias Stadler (Jira)
Tobias Stadler created SPARK-40869: -- Summary: KubernetesConf.getResourceNamePrefix creates invalid name prefixes Key: SPARK-40869 URL: https://issues.apache.org/jira/browse/SPARK-40869 Project:

[jira] [Commented] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622188#comment-17622188 ] Apache Spark commented on SPARK-40869: -- User 'tobiasstadler' has created a pull request for this

[jira] [Commented] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622214#comment-17622214 ] Apache Spark commented on SPARK-40750: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40750: Assignee: (was: Apache Spark) > Migrate type check failures of math expressions onto

[jira] [Assigned] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40750: Assignee: Apache Spark > Migrate type check failures of math expressions onto error

[jira] [Created] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-10-21 Thread gaoyajun02 (Jira)
gaoyajun02 created SPARK-40872: -- Summary: Fallback to original shuffle block when a push-merged shuffle chunk is zero-size Key: SPARK-40872 URL: https://issues.apache.org/jira/browse/SPARK-40872

[jira] [Assigned] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40872: Assignee: (was: Apache Spark) > Fallback to original shuffle block when a

[jira] [Commented] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622233#comment-17622233 ] Apache Spark commented on SPARK-40872: -- User 'gaoyajun02' has created a pull request for this

[jira] [Assigned] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40872: Assignee: Apache Spark > Fallback to original shuffle block when a push-merged shuffle

[jira] [Assigned] (SPARK-40868) Avoid introducing too many partitions when bucketed scan disabled by sql planner

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40868: Assignee: (was: Apache Spark) > Avoid introducing too many partitions when bucketed

[jira] [Assigned] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40854: Assignee: Martin Grund > Change default serialization from 'broken' CSV to Spark DF JSON

[jira] [Resolved] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40854. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38300

[jira] [Commented] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622215#comment-17622215 ] Apache Spark commented on SPARK-40750: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40869: Assignee: Apache Spark > KubernetesConf.getResourceNamePrefix creates invalid name

[jira] [Commented] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622187#comment-17622187 ] Apache Spark commented on SPARK-40869: -- User 'tobiasstadler' has created a pull request for this

[jira] [Assigned] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40869: Assignee: (was: Apache Spark) > KubernetesConf.getResourceNamePrefix creates invalid

[jira] [Updated] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-10-21 Thread gaoyajun02 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-40872: --- Parent: SPARK-33235 Issue Type: Sub-task (was: Improvement) > Fallback to original shuffle

[jira] [Commented] (SPARK-40873) Spark doesn't see some Parquet columns written from r-arrow

2022-10-21 Thread Daniel Darabos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622311#comment-17622311 ] Daniel Darabos commented on SPARK-40873: This works on the R side for dropping the metadata:

[jira] [Commented] (SPARK-34210) Cannot create a record reader because of a previous error when spark accesses the hive on HBase table

2022-10-21 Thread zhangzhanchang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622328#comment-17622328 ] zhangzhanchang commented on SPARK-34210: 3.0.1 Fix > Cannot create a record reader because of a

[jira] [Commented] (SPARK-40873) Spark doesn't see some Parquet columns written from r-arrow

2022-10-21 Thread Daniel Darabos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622251#comment-17622251 ] Daniel Darabos commented on SPARK-40873: Oh, I think I got it! With debug logging Spark prints a

[jira] (SPARK-32380) sparksql cannot access hive table while data in hbase

2022-10-21 Thread Mehul Thakkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32380 ] Mehul Thakkar deleted comment on SPARK-32380: --- was (Author: JIRAUSER297345): I am waiting for the permanent fix for this issue in Spark 3.x > sparksql cannot access hive table while data

[jira] [Updated] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40874: --- Summary: Fix broadcasts in Python UDFs when encryption is enabled (was: Fix Python UDFs with

[jira] [Assigned] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40874: Assignee: Apache Spark > Fix broadcasts in Python UDFs when encryption is enabled >

[jira] [Assigned] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40874: Assignee: (was: Apache Spark) > Fix broadcasts in Python UDFs when encryption is

[jira] [Commented] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622333#comment-17622333 ] Apache Spark commented on SPARK-40874: -- User 'peter-toth' has created a pull request for this

[jira] [Updated] (SPARK-40873) Spark doesn't see some Parquet columns written from r-arrow

2022-10-21 Thread Daniel Darabos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-40873: --- Attachment: part-0.parquet > Spark doesn't see some Parquet columns written from r-arrow >

[jira] [Created] (SPARK-40873) Spark doesn't see some Parquet columns written from r-arrow

2022-10-21 Thread Daniel Darabos (Jira)
Daniel Darabos created SPARK-40873: -- Summary: Spark doesn't see some Parquet columns written from r-arrow Key: SPARK-40873 URL: https://issues.apache.org/jira/browse/SPARK-40873 Project: Spark

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

2022-10-21 Thread Mehul Thakkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622266#comment-17622266 ] Mehul Thakkar commented on SPARK-32380: --- I am waiting for the permanent fix for this issue in

[jira] [Resolved] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40865. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38329

[jira] [Commented] (SPARK-34210) Cannot create a record reader because of a previous error when spark accesses the hive on HBase table

2022-10-21 Thread Mehul Thakkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622291#comment-17622291 ] Mehul Thakkar commented on SPARK-34210: --- Which Spark release should I use to get this fix?  >

[jira] [Assigned] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40865: Assignee: Yang Jie > Upgrade jodatime to 2.12.0 > -- > >

[jira] [Created] (SPARK-40874) Fix Python UDFs with broadcasts when encryption is enabled

2022-10-21 Thread Peter Toth (Jira)
Peter Toth created SPARK-40874: -- Summary: Fix Python UDFs with broadcasts when encryption is enabled Key: SPARK-40874 URL: https://issues.apache.org/jira/browse/SPARK-40874 Project: Spark Issue

[jira] [Commented] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0

2022-10-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-40861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622322#comment-17622322 ] Bjørn Jørgensen commented on SPARK-40861: -

[jira] [Comment Edited] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0

2022-10-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-40861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622322#comment-17622322 ] Bjørn Jørgensen edited comment on SPARK-40861 at 10/21/22 3:24 PM: ---

[jira] [Updated] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40865: - Priority: Minor (was: Major) > Upgrade jodatime to 2.12.0 > -- > >

[jira] [Resolved] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40863. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38328

[jira] [Assigned] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40863: Assignee: Yang Jie > Upgrade dropwizard metrics from 4.2.10 to 4.2.12 >

[jira] [Created] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-40863: Summary: Upgrade dropwizard metrics from 4.2.10 to 4.2.12 Key: SPARK-40863 URL: https://issues.apache.org/jira/browse/SPARK-40863 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40865: Assignee: Apache Spark > Upgrade jodatime to 2.12.0 > -- > >

[jira] [Assigned] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40865: Assignee: (was: Apache Spark) > Upgrade jodatime to 2.12.0 >

[jira] [Commented] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621893#comment-17621893 ] Apache Spark commented on SPARK-40865: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40657: Assignee: Raghu Angadi > Add support for compiled classes (Java classes) >

[jira] [Resolved] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40657. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38286

[jira] [Resolved] (SPARK-40866) Rename Check Spark repo as Check Spark Docker repo in GA

2022-10-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40866. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 18

[jira] [Assigned] (SPARK-40866) Rename Check Spark repo as Check Spark Docker repo in GA

2022-10-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40866: --- Assignee: Qian Sun > Rename Check Spark repo as Check Spark Docker repo in GA >

[jira] [Created] (SPARK-40864) Remove pip/setuptools dynamic upgrade

2022-10-21 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40864: --- Summary: Remove pip/setuptools dynamic upgrade Key: SPARK-40864 URL: https://issues.apache.org/jira/browse/SPARK-40864 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40865) Upgrade jodatime to 2.12.0

2022-10-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-40865: Summary: Upgrade jodatime to 2.12.0 Key: SPARK-40865 URL: https://issues.apache.org/jira/browse/SPARK-40865 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-40839) [Python] Implement `DataFrame.sample`

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40839. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38310

[jira] [Assigned] (SPARK-40864) Remove pip/setuptools dynamic upgrade

2022-10-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40864: --- Assignee: Yikun Jiang > Remove pip/setuptools dynamic upgrade >

[jira] [Resolved] (SPARK-40864) Remove pip/setuptools dynamic upgrade

2022-10-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40864. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 17

[jira] [Assigned] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40863: Assignee: Apache Spark > Upgrade dropwizard metrics from 4.2.10 to 4.2.12 >

[jira] [Assigned] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40863: Assignee: (was: Apache Spark) > Upgrade dropwizard metrics from 4.2.10 to 4.2.12 >

[jira] [Commented] (SPARK-40863) Upgrade dropwizard metrics from 4.2.10 to 4.2.12

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621524#comment-17621524 ] Apache Spark commented on SPARK-40863: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40867) Flaky test ProtobufCatalystDataConversionSuite

2022-10-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622141#comment-17622141 ] Yang Jie commented on SPARK-40867: -- cc [~rangadi]  and [~sanysand...@gmail.com]  > Flaky test

[jira] [Updated] (SPARK-18188) Add checksum for block of broadcast

2022-10-21 Thread bettermouse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bettermouse updated SPARK-18188: Description: {color:red}着色文本{color}There is an understanding issue for a long time:

[jira] [Resolved] (SPARK-40878) pin 'grpcio==1.48.1' 'protobuf==4.21.6'

2022-10-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40878. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38338

[jira] [Assigned] (SPARK-40878) pin 'grpcio==1.48.1' 'protobuf==4.21.6'

2022-10-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40878: - Assignee: Ruifeng Zheng > pin 'grpcio==1.48.1' 'protobuf==4.21.6' >

[jira] [Commented] (SPARK-40878) pin 'grpcio==1.48.1' 'protobuf==4.21.6'

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622553#comment-17622553 ] Apache Spark commented on SPARK-40878: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40878) pin 'grpcio==1.48.1' 'protobuf==4.21.6'

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622552#comment-17622552 ] Apache Spark commented on SPARK-40878: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-40878) pin 'grpcio==1.48.1' 'protobuf==4.21.6'

2022-10-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40878: - Summary: pin 'grpcio==1.48.1' 'protobuf==4.21.6' Key: SPARK-40878 URL: https://issues.apache.org/jira/browse/SPARK-40878 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40879) Support Join UsingColumns in proto

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40879: Assignee: Apache Spark > Support Join UsingColumns in proto >

[jira] [Assigned] (SPARK-40879) Support Join UsingColumns in proto

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40879: Assignee: (was: Apache Spark) > Support Join UsingColumns in proto >

[jira] [Commented] (SPARK-40879) Support Join UsingColumns in proto

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622555#comment-17622555 ] Apache Spark commented on SPARK-40879: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-40879) Support Join UsingColumns in proto

2022-10-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-40879: Summary: Support Join UsingColumns in proto Key: SPARK-40879 URL: https://issues.apache.org/jira/browse/SPARK-40879 Project: Spark Issue Type: Sub-task

[jira] [Closed] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0

2022-10-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-40861. - > CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0 >

[jira] [Resolved] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0

2022-10-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40861. --- Target Version/s: (was: 3.0.0) Resolution: Invalid According to the community

[jira] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874 ] Peter Toth deleted comment on SPARK-40874: was (Author: petertoth): The following Pyspark script: {noformat} bin/pyspark --conf spark.io.encryption.enabled=true ... bar = {"a": "aa", "b":

[jira] [Updated] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40874: --- The following Pyspark script: {noformat} bin/pyspark --conf spark.io.encryption.enabled=true ... bar

[jira] [Updated] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40874: --- Description: The following Pyspark script: {noformat} bin/pyspark --conf

[jira] [Commented] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

2022-10-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622378#comment-17622378 ] Steve Loughran commented on SPARK-38934: sounds like there is a race condition, which surfaces

[jira] [Comment Edited] (SPARK-32380) sparksql cannot access hive table while data in hbase

2022-10-21 Thread Mehul Thakkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622497#comment-17622497 ] Mehul Thakkar edited comment on SPARK-32380 at 10/21/22 9:36 PM: -

[jira] [Commented] (SPARK-40796) Check the generated python protos in GitHub Actions

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622446#comment-17622446 ] Apache Spark commented on SPARK-40796: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

2022-10-21 Thread Mehul Thakkar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622497#comment-17622497 ] Mehul Thakkar commented on SPARK-32380: --- [~meimile] Since changes were merged on Jan 11, 2021, I

[jira] [Created] (SPARK-40877) Reimplement `crosstab` with dataframe operations

2022-10-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40877: - Summary: Reimplement `crosstab` with dataframe operations Key: SPARK-40877 URL: https://issues.apache.org/jira/browse/SPARK-40877 Project: Spark Issue

[jira] [Assigned] (SPARK-40877) Reimplement `crosstab` with dataframe operations

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40877: Assignee: Apache Spark > Reimplement `crosstab` with dataframe operations >

[jira] [Commented] (SPARK-40877) Reimplement `crosstab` with dataframe operations

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622527#comment-17622527 ] Apache Spark commented on SPARK-40877: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40877) Reimplement `crosstab` with dataframe operations

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40877: Assignee: (was: Apache Spark) > Reimplement `crosstab` with dataframe operations >

[jira] [Commented] (SPARK-40877) Reimplement `crosstab` with dataframe operations

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622528#comment-17622528 ] Apache Spark commented on SPARK-40877: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622530#comment-17622530 ] Apache Spark commented on SPARK-40871: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622531#comment-17622531 ] Apache Spark commented on SPARK-40871: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40871: Assignee: (was: Apache Spark) > Upgrade actions/script to v6 >

[jira] [Commented] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

2022-10-21 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622532#comment-17622532 ] BingKun Pan commented on SPARK-40752: - I work on it. > Migrate type check failures of misc

[jira] [Assigned] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40871: Assignee: Apache Spark > Upgrade actions/script to v6 > > >

[jira] [Resolved] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40871. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38341

[jira] [Assigned] (SPARK-40871) Upgrade actions/script to v6

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40871: Assignee: Yikun Jiang > Upgrade actions/script to v6 > > >

[jira] [Resolved] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40874. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38334

[jira] [Assigned] (SPARK-40874) Fix broadcasts in Python UDFs when encryption is enabled

2022-10-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40874: Assignee: Peter Toth > Fix broadcasts in Python UDFs when encryption is enabled >

[jira] [Assigned] (SPARK-40870) Upgrade docker actions to cleanup warning

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40870: Assignee: Apache Spark > Upgrade docker actions to cleanup warning >

[jira] [Commented] (SPARK-40870) Upgrade docker actions to cleanup warning

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622535#comment-17622535 ] Apache Spark commented on SPARK-40870: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40870) Upgrade docker actions to cleanup warning

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40870: Assignee: (was: Apache Spark) > Upgrade docker actions to cleanup warning >

[jira] [Commented] (SPARK-40777) Use error classes for Protobuf exceptions

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622543#comment-17622543 ] Apache Spark commented on SPARK-40777: -- User 'SandishKumarHN' has created a pull request for this

[jira] [Assigned] (SPARK-40777) Use error classes for Protobuf exceptions

2022-10-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40777: Assignee: (was: Apache Spark) > Use error classes for Protobuf exceptions >

  1   2   >