[
https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679035#comment-17679035
]
Apache Spark commented on SPARK-42114:
--
User 'ggershinsky' has created a pull reque
Gengliang Wang created SPARK-42130:
--
Summary: Handle null string values in AccumulableInfo and
ProcessSummary
Key: SPARK-42130
URL: https://issues.apache.org/jira/browse/SPARK-42130
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42114:
Assignee: (was: Apache Spark)
> Test of uniform parquet encryption
>
[
https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42114:
Assignee: Apache Spark
> Test of uniform parquet encryption
> ---
[
https://issues.apache.org/jira/browse/SPARK-42114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679025#comment-17679025
]
Apache Spark commented on SPARK-42114:
--
User 'ggershinsky' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-41976:
---
Assignee: Haejoon Lee
> Improve error message for `INDEX_NOT_FOUND`
> -
[
https://issues.apache.org/jira/browse/SPARK-41976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-41976.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39498
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-42070:
--
Assignee: Vinod KC
> Change the default value of argument of Mask udf from -1 to NULL
[
https://issues.apache.org/jira/browse/SPARK-42070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-42070.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39577
[https:
[
https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-41884:
Assignee: Hyukjin Kwon
> DataFrame `toPandas` parity in return types
> --
[
https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-41884.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39661
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679004#comment-17679004
]
Shardul Mahadik commented on SPARK-41557:
-
Confirmed that the test work fine in
[
https://issues.apache.org/jira/browse/SPARK-41557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shardul Mahadik resolved SPARK-41557.
-
Resolution: Fixed
> Union of tables with and without metadata column fails when used in
[
https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679003#comment-17679003
]
Apache Spark commented on SPARK-40925:
--
User 'HeartSaVioR' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679002#comment-17679002
]
Apache Spark commented on SPARK-42129:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42129:
Assignee: (was: Apache Spark)
> Upgrade rocksdbjni to 7.9.2
> ---
[
https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42105:
Assignee: Apache Spark
> Document work (Release note & Guide doc) for SPARK-40925
> -
[
https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679000#comment-17679000
]
Apache Spark commented on SPARK-42105:
--
User 'HeartSaVioR' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42105:
Assignee: (was: Apache Spark)
> Document work (Release note & Guide doc) for SPARK-40
[
https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42129:
Assignee: Apache Spark
> Upgrade rocksdbjni to 7.9.2
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679001#comment-17679001
]
Apache Spark commented on SPARK-42129:
--
User 'LuciferYang' has created a pull reque
Yang Jie created SPARK-42129:
Summary: Upgrade rocksdbjni to 7.9.2
Key: SPARK-42129
URL: https://issues.apache.org/jira/browse/SPARK-42129
Project: Spark
Issue Type: Improvement
Compone
[
https://issues.apache.org/jira/browse/SPARK-40925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-40925:
-
Labels: release-notes (was: )
> Fix late record filtering to support chaining of steteful opera
[
https://issues.apache.org/jira/browse/SPARK-38591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38591.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39640
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41884:
Assignee: Apache Spark
> DataFrame `toPandas` parity in return types
> --
[
https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-41884:
Assignee: (was: Apache Spark)
> DataFrame `toPandas` parity in return types
> ---
[
https://issues.apache.org/jira/browse/SPARK-41884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678984#comment-17678984
]
Apache Spark commented on SPARK-41884:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678983#comment-17678983
]
Apache Spark commented on SPARK-42128:
--
User 'sadikovi' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678982#comment-17678982
]
Apache Spark commented on SPARK-42128:
--
User 'sadikovi' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42128:
Assignee: Apache Spark
> Limit pushdown for MS SQL Server
> -
[
https://issues.apache.org/jira/browse/SPARK-42128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42128:
Assignee: (was: Apache Spark)
> Limit pushdown for MS SQL Server
> --
Ivan Sadikov created SPARK-42128:
Summary: Limit pushdown for MS SQL Server
Key: SPARK-42128
URL: https://issues.apache.org/jira/browse/SPARK-42128
Project: Spark
Issue Type: Improvement
shamim created SPARK-42127:
--
Summary: Spark 3.3.0, Error with java.io.IOException: Mkdirs
failed to create file
Key: SPARK-42127
URL: https://issues.apache.org/jira/browse/SPARK-42127
Project: Spark
Xinrong Meng created SPARK-42126:
Summary: Support user-specified return type in DDL-formatted string
Key: SPARK-42126
URL: https://issues.apache.org/jira/browse/SPARK-42126
Project: Spark
Is
Xinrong Meng created SPARK-42125:
Summary: Pandas UDF in Spark Connect
Key: SPARK-42125
URL: https://issues.apache.org/jira/browse/SPARK-42125
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42124:
Assignee: (was: Apache Spark)
> Scalar Inline Python UDF in Spark Connect
> -
[
https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42124:
Assignee: Apache Spark
> Scalar Inline Python UDF in Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-42124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678978#comment-17678978
]
Apache Spark commented on SPARK-42124:
--
User 'xinrong-meng' has created a pull requ
Xinrong Meng created SPARK-42124:
Summary: Scalar Inline Python UDF in Spark Connect
Key: SPARK-42124
URL: https://issues.apache.org/jira/browse/SPARK-42124
Project: Spark
Issue Type: Sub-tas
[
https://issues.apache.org/jira/browse/SPARK-42096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42096.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39620
[https://
[
https://issues.apache.org/jira/browse/SPARK-42096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42096:
-
Assignee: Yang Jie
> Code cleanup for connect module
> ---
[
https://issues.apache.org/jira/browse/SPARK-42112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42112.
---
Fix Version/s: 3.4.0
Assignee: Yang Jie
Resolution: Fixed
This is resolved v
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678962#comment-17678962
]
Dongjoon Hyun commented on SPARK-40034:
---
May I ask when Apache Hadoop 3.3.5 is goi
[
https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42043.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39658
[https://
[
https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42043:
-
Assignee: Zhen Li
> Basic Scala Client Result Implementation
> ---
[
https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678951#comment-17678951
]
Apache Spark commented on SPARK-42043:
--
User 'zhenlineo' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42123:
Assignee: (was: Apache Spark)
> Include column default values in DESCRIBE output
> --
[
https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678944#comment-17678944
]
Apache Spark commented on SPARK-42123:
--
User 'dtenedor' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42123:
Assignee: Apache Spark
> Include column default values in DESCRIBE output
> -
[
https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-40550:
-
Assignee: Anton Okolnychyi
> DataSource V2: Handle DELETE commands for delta-based sour
[
https://issues.apache.org/jira/browse/SPARK-40550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-40550.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38005
[https://
Daniel created SPARK-42123:
--
Summary: Include column default values in DESCRIBE output
Key: SPARK-42123
URL: https://issues.apache.org/jira/browse/SPARK-42123
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678931#comment-17678931
]
Apache Spark commented on SPARK-42119:
--
User 'allisonwang-db' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42119:
Assignee: (was: Apache Spark)
> Add built-in table-valued functions inline and inline
[
https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42119:
Assignee: Apache Spark
> Add built-in table-valued functions inline and inline_outer
> --
[
https://issues.apache.org/jira/browse/SPARK-42121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allison Wang updated SPARK-42121:
-
Description:
Add `posexplode` and `posexplode_outer` to the built-in table function registry.
A
[
https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allison Wang updated SPARK-42120:
-
Description:
Add `json_tuple` to the built-in table function registry.
Add new SQL tests in `ta
[
https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allison Wang updated SPARK-42122:
-
Description:
Add `stack` to the built-in table function registry.
Add new SQL tests in `table-v
[
https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allison Wang updated SPARK-42120:
-
Description:
Add `json_tuple` to built-in table function registry.
Add new SQL tests in `table-
Allison Wang created SPARK-42122:
Summary: Add built-in table-valued function stack
Key: SPARK-42122
URL: https://issues.apache.org/jira/browse/SPARK-42122
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allison Wang updated SPARK-42119:
-
Description:
Add `inline` and `inline_outer` to the built-in table function registry.
Add new S
Allison Wang created SPARK-42121:
Summary: Add built-in table-valued functions posexplode and
posexplode_outer
Key: SPARK-42121
URL: https://issues.apache.org/jira/browse/SPARK-42121
Project: Spark
Allison Wang created SPARK-42120:
Summary: Add built-in table-valued function json_tuple
Key: SPARK-42120
URL: https://issues.apache.org/jira/browse/SPARK-42120
Project: Spark
Issue Type: Sub
Allison Wang created SPARK-42119:
Summary: Add built-in table-valued functions inline and
inline_outer
Key: SPARK-42119
URL: https://issues.apache.org/jira/browse/SPARK-42119
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-41759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-41759:
--
Assignee: BingKun Pan
> Use `weakIntern` on string values in create new objects durin
[
https://issues.apache.org/jira/browse/SPARK-41759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-41759.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39275
[https:
[
https://issues.apache.org/jira/browse/SPARK-42118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dilip Biswal updated SPARK-42118:
-
Description:
Here is a simple reproduction of the problem. We have a JSON file whose content
lo
Dilip Biswal created SPARK-42118:
Summary: Wrong result when parsing a multiline JSON file with
differing types for same column
Key: SPARK-42118
URL: https://issues.apache.org/jira/browse/SPARK-42118
[
https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42116.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39655
[https://
[
https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42116:
-
Assignee: Dongjoon Hyun
> Mark ColumnarBatchSuite as ExtendedSQLTest
>
Bjørn Jørgensen created SPARK-42117:
---
Summary: Upgrade kubernetes-client from 6.3.1 to 6.4.0
Key: SPARK-42117
URL: https://issues.apache.org/jira/browse/SPARK-42117
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42116:
Assignee: (was: Apache Spark)
> Mark ColumnarBatchSuite as ExtendedSQLTest
>
[
https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42116:
Assignee: Apache Spark
> Mark ColumnarBatchSuite as ExtendedSQLTest
> ---
[
https://issues.apache.org/jira/browse/SPARK-42116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678827#comment-17678827
]
Apache Spark commented on SPARK-42116:
--
User 'dongjoon-hyun' has created a pull req
Dongjoon Hyun created SPARK-42116:
-
Summary: Mark ColumnarBatchSuite as ExtendedSQLTest
Key: SPARK-42116
URL: https://issues.apache.org/jira/browse/SPARK-42116
Project: Spark
Issue Type: Impr
[
https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678814#comment-17678814
]
Steve Loughran commented on SPARK-40034:
Note that these changes aren't sufficie
[
https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-42113:
-
Assignee: Haejoon Lee
> Upgrade pandas to 1.5.3
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-42113.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39651
[https://
[
https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-41793:
--
Labels: correctness (was: )
> Incorrect result for window frames defined by a range clause on
[
https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-41793:
--
Priority: Blocker (was: Major)
> Incorrect result for window frames defined by a range clause
[
https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678744#comment-17678744
]
Thomas Graves commented on SPARK-41793:
---
this sounds like a correctness issue - [~
[
https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42080.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39639
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-42080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42080:
Assignee: Haejoon Lee
> Add guideline for PySpark errors.
> -
[
https://issues.apache.org/jira/browse/SPARK-42111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-42111:
Assignee: Dongjoon Hyun
> Mark Orc*FilterSuite/OrcV*SchemaPruningSuite as ExtendedSQLTest
[
https://issues.apache.org/jira/browse/SPARK-42111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-42111.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39649
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42115:
Assignee: (was: Apache Spark)
> Push down limit through Python UDFs
> ---
[
https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678689#comment-17678689
]
Apache Spark commented on SPARK-42115:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42115:
Assignee: Apache Spark
> Push down limit through Python UDFs
> --
[
https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42115:
-
Description:
{code}
from pyspark.sql.functions import udf
spark.range(10).write.mode("overwrite
[
https://issues.apache.org/jira/browse/SPARK-42115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-42115:
-
Description:
{code}
from pyspark.sql.functions import udf
spark.range(10).write.mode("overwrite
Hyukjin Kwon created SPARK-42115:
Summary: Push down limit through Python UDFs
Key: SPARK-42115
URL: https://issues.apache.org/jira/browse/SPARK-42115
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678654#comment-17678654
]
Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:47 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678654#comment-17678654
]
Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:46 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678654#comment-17678654
]
Nikhil Sharma commented on SPARK-22588:
---
Thank you for sharing the information. Th
[
https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678654#comment-17678654
]
Nikhil Sharma edited comment on SPARK-22588 at 1/19/23 11:45 AM:
-
Gidon Gershinsky created SPARK-42114:
Summary: Test of uniform parquet encryption
Key: SPARK-42114
URL: https://issues.apache.org/jira/browse/SPARK-42114
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678641#comment-17678641
]
Apache Spark commented on SPARK-40599:
--
User 'peter-toth' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42113:
Assignee: (was: Apache Spark)
> Upgrade pandas to 1.5.3
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42113:
Assignee: Apache Spark
> Upgrade pandas to 1.5.3
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-42113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678582#comment-17678582
]
Apache Spark commented on SPARK-42113:
--
User 'itholic' has created a pull request f
1 - 100 of 106 matches
Mail list logo