[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40358: Assignee: Shaokang Lv > Migrate collection type check failures onto error classes >

[jira] [Resolved] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40358. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38197

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615459#comment-17615459 ] Max Gekk commented on SPARK-37945: -- [~khalidmammad...@gmail.com] Sure, go ahead. > Use error classes

[jira] [Assigned] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40707: --- Assignee: Rui Wang > Add groupby to connect DSL and test more than one grouping

[jira] [Resolved] (SPARK-40707) Add groupby to connect DSL and test more than one grouping expressions

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40707. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38155

[jira] [Commented] (SPARK-40722) How to set BlockManager info of hostname as ipaddress

2022-10-10 Thread Chen Xia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615450#comment-17615450 ] Chen Xia commented on SPARK-40722: -- I know it can be used spark.driver.host  to set this configuration 

[jira] [Commented] (SPARK-40658) Protobuf v2 & v3 support

2022-10-10 Thread Mohan Parthasarathy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615440#comment-17615440 ] Mohan Parthasarathy commented on SPARK-40658: - [~sanysand...@gmail.com]  # I wanted to

[jira] [Commented] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615437#comment-17615437 ] Apache Spark commented on SPARK-40739: -- User 'philwalk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40738: Assignee: (was: Apache Spark) > spark-shell fails with "bad array subscript" in

[jira] [Assigned] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40738: Assignee: Apache Spark > spark-shell fails with "bad array subscript" in cygwin or msys

[jira] [Commented] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615439#comment-17615439 ] Apache Spark commented on SPARK-40738: -- User 'philwalk' has created a pull request for this issue:

[jira] [Commented] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615438#comment-17615438 ] Apache Spark commented on SPARK-40738: -- User 'philwalk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40739: Assignee: (was: Apache Spark) > "sbt packageBin" fails in cygwin or other windows

[jira] [Assigned] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40739: Assignee: Apache Spark > "sbt packageBin" fails in cygwin or other windows bash session

[jira] [Commented] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615436#comment-17615436 ] Apache Spark commented on SPARK-40739: -- User 'philwalk' has created a pull request for this issue:

[jira] [Commented] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615430#comment-17615430 ] Apache Spark commented on SPARK-40742: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40742: Assignee: (was: Apache Spark) > Java compilation warnings related to generic type >

[jira] [Commented] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615428#comment-17615428 ] Apache Spark commented on SPARK-40742: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40742: Assignee: Apache Spark > Java compilation warnings related to generic type >

[jira] [Created] (SPARK-40742) Java compilation warnings related to generic type

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40742: Summary: Java compilation warnings related to generic type Key: SPARK-40742 URL: https://issues.apache.org/jira/browse/SPARK-40742 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40516) Add official image dockerfile for Spark v3.3.0

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40516. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Assigned] (SPARK-40516) Add official image dockerfile for Spark v3.3.0

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40516: --- Assignee: Yikun Jiang > Add official image dockerfile for Spark v3.3.0 >

[jira] [Resolved] (SPARK-40698) Improve the precision of `product` for intergral inputs

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40698. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38148

[jira] [Assigned] (SPARK-40698) Improve the precision of `product` for intergral inputs

2022-10-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40698: Assignee: Ruifeng Zheng > Improve the precision of `product` for intergral inputs >

[jira] [Created] (SPARK-40741) spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误

2022-10-10 Thread kaiqingli (Jira)
kaiqingli created SPARK-40741: - Summary: spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误 Key: SPARK-40741 URL: https://issues.apache.org/jira/browse/SPARK-40741 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40358: Assignee: (was: Apache Spark) > Migrate collection type check failures onto error

[jira] [Commented] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615412#comment-17615412 ] Apache Spark commented on SPARK-40358: -- User 'lvshaokang' has created a pull request for this

[jira] [Assigned] (SPARK-40358) Migrate collection type check failures onto error classes

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40358: Assignee: Apache Spark > Migrate collection type check failures onto error classes >

[jira] [Resolved] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-10-10 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-40596. -- Assignee: Bo Zhang Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/38030 >

[jira] [Assigned] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40534: --- Assignee: Rui Wang > Extend support for Join Relation > >

[jira] [Resolved] (SPARK-40534) Extend support for Join Relation

2022-10-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40534. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38157

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: (was: Apache Spark) > Performance regression for joins in Spark 3.3 vs

[jira] [Assigned] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40703: Assignee: Apache Spark > Performance regression for joins in Spark 3.3 vs Spark 3.2 >

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615379#comment-17615379 ] Apache Spark commented on SPARK-40703: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615373#comment-17615373 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615372#comment-17615372 ] Apache Spark commented on SPARK-40725: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615370#comment-17615370 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615369#comment-17615369 ] Apache Spark commented on SPARK-40740: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: (was: Apache Spark) > Improve listFunctions in SessionCatalog >

[jira] [Assigned] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40740: Assignee: Apache Spark > Improve listFunctions in SessionCatalog >

[jira] [Created] (SPARK-40740) Improve listFunctions in SessionCatalog

2022-10-10 Thread Allison Wang (Jira)
Allison Wang created SPARK-40740: Summary: Improve listFunctions in SessionCatalog Key: SPARK-40740 URL: https://issues.apache.org/jira/browse/SPARK-40740 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37945) Use error classes in the execution errors of arithmetic ops

2022-10-10 Thread Khalid Mammadov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615361#comment-17615361 ] Khalid Mammadov commented on SPARK-37945: - [~maxgekk] I see you have already fixed most of

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615358#comment-17615358 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: Apache Spark > SPIP: Spark Connect - A client and server interface for Apache

[jira] [Assigned] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39375: Assignee: (was: Apache Spark) > SPIP: Spark Connect - A client and server interface

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615357#comment-17615357 ] Apache Spark commented on SPARK-39375: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-39199) Implement pandas API missing parameters

2022-10-10 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-39199. -- Resolution: Resolved > Implement pandas API missing parameters >

[jira] [Created] (SPARK-40739) "sbt packageBin" fails in cygwin or other windows bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40739: --- Summary: "sbt packageBin" fails in cygwin or other windows bash session Key: SPARK-40739 URL: https://issues.apache.org/jira/browse/SPARK-40739 Project: Spark

[jira] [Created] (SPARK-40738) spark-shell fails with "bad array subscript" in cygwin or msys bash session

2022-10-10 Thread Phil Walker (Jira)
Phil Walker created SPARK-40738: --- Summary: spark-shell fails with "bad array subscript" in cygwin or msys bash session Key: SPARK-40738 URL: https://issues.apache.org/jira/browse/SPARK-40738 Project:

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Bryan Keller (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615264#comment-17615264 ] Bryan Keller commented on SPARK-40703: -- Sounds good, thanks. > Performance regression for joins in

[jira] [Commented] (SPARK-40703) Performance regression for joins in Spark 3.3 vs Spark 3.2

2022-10-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615255#comment-17615255 ] Chao Sun commented on SPARK-40703: -- Thanks [~bryanck] . Now I see where the issue is. In your pyspark

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Commented] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615251#comment-17615251 ] Apache Spark commented on SPARK-40737: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: Apache Spark > Add basic support for DataFrameWriter >

[jira] [Assigned] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40737: Assignee: (was: Apache Spark) > Add basic support for DataFrameWriter >

[jira] [Created] (SPARK-40737) Add basic support for DataFrameWriter

2022-10-10 Thread Martin Grund (Jira)
Martin Grund created SPARK-40737: Summary: Add basic support for DataFrameWriter Key: SPARK-40737 URL: https://issues.apache.org/jira/browse/SPARK-40737 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Fix Version/s: 3.3.1 > Spark 3.3.0 doesn't works with Hive 3.1.2 >

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Labels: Hive spark spark3.0 (was: ) > Spark 3.3.0 doesn't works with Hive 3.1.2 >

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratik Malani updated SPARK-40736: -- Description: Hive 2.3.9 is impacted with CVE-2021-34538, so trying to use the Hive 3.1.2.

[jira] [Created] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-10 Thread Pratik Malani (Jira)
Pratik Malani created SPARK-40736: - Summary: Spark 3.3.0 doesn't works with Hive 3.1.2 Key: SPARK-40736 URL: https://issues.apache.org/jira/browse/SPARK-40736 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-40706) IllegalStateException when querying array values inside a nested struct

2022-10-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614550#comment-17614550 ] Bruce Robbins edited comment on SPARK-40706 at 10/10/22 5:01 PM: - Same

[jira] [Resolved] (SPARK-40714) Remove PartitionAlreadyExistsException

2022-10-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40714. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38161

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615201#comment-17615201 ] L. C. Hsieh commented on SPARK-36681: - This is fixed in 3.3.0 and later, yes, by upgrading to Hadoop

[jira] [Updated] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-40735: --- Component/s: Connect Kubernetes R Spark

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: Apache Spark > Consistently invoke bash with /usr/bin/env bash in scripts to

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40735: Assignee: (was: Apache Spark) > Consistently invoke bash with /usr/bin/env bash in

[jira] [Commented] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615190#comment-17615190 ] Apache Spark commented on SPARK-40735: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Created] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-10 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-40735: -- Summary: Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable Key: SPARK-40735 URL: https://issues.apache.org/jira/browse/SPARK-40735

[jira] [Resolved] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40705. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-40705) Issue with spark converting Row to Json using Scala 2.13

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40705: Assignee: Amrane Ait Zeouay > Issue with spark converting Row to Json using Scala 2.13 >

[jira] [Resolved] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40726. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38188

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40726: Assignee: Qian Sun > Supplement undocumented orc configurations in documentation >

[jira] [Created] (SPARK-40734) KafkaMicroBatchSourceSuite failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40734: Summary: KafkaMicroBatchSourceSuite failed Key: SPARK-40734 URL: https://issues.apache.org/jira/browse/SPARK-40734 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40733) ShowCreateTableSuite test failed

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40733: Summary: ShowCreateTableSuite test failed Key: SPARK-40733 URL: https://issues.apache.org/jira/browse/SPARK-40733 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40732) Floating point precision changes

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40732: Summary: Floating point precision changes Key: SPARK-40732 URL: https://issues.apache.org/jira/browse/SPARK-40732 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40731) Sealed class cannot be mock by mockito

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40731: Summary: Sealed class cannot be mock by mockito Key: SPARK-40731 URL: https://issues.apache.org/jira/browse/SPARK-40731 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40730: - Description: I run maven test with Java 19, there are some test failed,  whether it can be solved or

[jira] [Updated] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40729: - Parent: SPARK-40730 Issue Type: Sub-task (was: Improvement) > Spark-shell run failed with Java

[jira] [Created] (SPARK-40730) Java 19 related issues

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40730: Summary: Java 19 related issues Key: SPARK-40730 URL: https://issues.apache.org/jira/browse/SPARK-40730 Project: Spark Issue Type: Umbrella Components:

[jira] [Commented] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615093#comment-17615093 ] Apache Spark commented on SPARK-40729: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: Apache Spark > Spark-shell run failed with Java 19 >

[jira] [Assigned] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40729: Assignee: (was: Apache Spark) > Spark-shell run failed with Java 19 >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-10-10 Thread icyjhl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615087#comment-17615087 ] icyjhl commented on SPARK-36681: Hi [~viirya], So this is only fixed in 3.3.0 and after? Any workaround

[jira] [Resolved] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40727. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 1

[jira] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727 ] Yikun Jiang deleted comment on SPARK-40727: - was (Author: yikunkero): Issue resolved by pull request 1 [https://github.com/apache/spark-docker/pull/1] > Add merge_spark_docker_pr.py to help

[jira] [Updated] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40727: Fix Version/s: (was: 3.4.0) > Add merge_spark_docker_pr.py to help merge commit >

[jira] [Reopened] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reopened SPARK-40727: - > Add merge_spark_docker_pr.py to help merge commit >

[jira] [Resolved] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40727. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Created] (SPARK-40729) Spark-shell run failed with Java 19

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40729: Summary: Spark-shell run failed with Java 19 Key: SPARK-40729 URL: https://issues.apache.org/jira/browse/SPARK-40729 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40728: Assignee: Apache Spark > Upgrade ASM to 9.4 > -- > >

[jira] [Assigned] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40728: Assignee: (was: Apache Spark) > Upgrade ASM to 9.4 > -- > >

[jira] [Commented] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615076#comment-17615076 ] Apache Spark commented on SPARK-40728: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40728) Upgrade ASM to 9.4

2022-10-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-40728: Summary: Upgrade ASM to 9.4 Key: SPARK-40728 URL: https://issues.apache.org/jira/browse/SPARK-40728 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-40727) Add merge_spark_docker_pr.py to help merge commit

2022-10-10 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40727: --- Summary: Add merge_spark_docker_pr.py to help merge commit Key: SPARK-40727 URL: https://issues.apache.org/jira/browse/SPARK-40727 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40726: Assignee: (was: Apache Spark) > Supplement undocumented orc configurations in

[jira] [Assigned] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40726: Assignee: Apache Spark > Supplement undocumented orc configurations in documentation >

[jira] [Commented] (SPARK-40726) Supplement undocumented orc configurations in documentation

2022-10-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615003#comment-17615003 ] Apache Spark commented on SPARK-40726: -- User 'dcoliversun' has created a pull request for this

[jira] [Assigned] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40725: --- Assignee: Ruifeng Zheng > Add mypy-protobuf to requirements >

[jira] [Resolved] (SPARK-40725) Add mypy-protobuf to requirements

2022-10-10 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40725. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38186

[jira] [Assigned] (SPARK-40724) Simplify `corr` with method `inline`

2022-10-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40724: - Assignee: Ruifeng Zheng > Simplify `corr` with method `inline` >

  1   2   >