[jira] [Assigned] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43295: - Assignee: Haejoon Lee > Make DataFrameGroupBy.sum support for string type columns >

[jira] [Updated] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43295: --- Labels: pull-request-available (was: ) > Make DataFrameGroupBy.sum support for string type

[jira] [Resolved] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43295. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42798

[jira] [Updated] (SPARK-45113) Refine docstrings of `collect_list/collect_set`

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45113: --- Labels: pull-request-available (was: ) > Refine docstrings of `collect_list/collect_set` >

[jira] [Created] (SPARK-45113) Refine docstrings of `collect_list/collect_set`

2023-09-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-45113: Summary: Refine docstrings of `collect_list/collect_set` Key: SPARK-45113 URL: https://issues.apache.org/jira/browse/SPARK-45113 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-43291) Generate proper warning on different behavior with numeric_only

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43291: --- Labels: pull-request-available (was: ) > Generate proper warning on different behavior

[jira] [Updated] (SPARK-44940) Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44940: --- Labels: correctness pull-request-available (was: correctness) > Improve performance of

[jira] [Updated] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43252: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class

[jira] [Updated] (SPARK-43251) Assign a name to the error class _LEGACY_ERROR_TEMP_2015

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43251: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class

[jira] [Updated] (SPARK-44942) Use Jira notification options to sync with Github

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44942: --- Labels: pull-request-available (was: ) > Use Jira notification options to sync with Github

[jira] [Updated] (SPARK-45068) Make math function output column name displayed in upper-cased style

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45068: --- Labels: pull-request-available (was: ) > Make math function output column name displayed

[jira] [Resolved] (SPARK-45044) Refine docstring of `groupBy/rollup/cube`

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45044. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42834

[jira] [Assigned] (SPARK-45044) Refine docstring of `groupBy/rollup/cube`

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45044: - Assignee: BingKun Pan > Refine docstring of `groupBy/rollup/cube` >

[jira] [Updated] (SPARK-45044) Refine docstring of `groupBy/rollup/cube`

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45044: --- Labels: pull-request-available (was: ) > Refine docstring of `groupBy/rollup/cube` >

[jira] [Updated] (SPARK-40688) Support data masking built-in function 'mask_first_n'

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40688: --- Labels: pull-request-available (was: ) > Support data masking built-in function

[jira] [Updated] (SPARK-43384) Make `df.show` print a nice string for MapType

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43384: --- Labels: pull-request-available (was: ) > Make `df.show` print a nice string for MapType >

[jira] [Resolved] (SPARK-45027) Hide internal functions/variables in `pyspark.sql.functions` from auto-completion

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45027. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42745

[jira] [Updated] (SPARK-45027) Hide internal functions/variables in `pyspark.sql.functions` from auto-completion

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45027: --- Labels: pull-request-available (was: ) > Hide internal functions/variables in

[jira] [Assigned] (SPARK-45027) Hide internal functions/variables in `pyspark.sql.functions` from auto-completion

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45027: - Assignee: Ruifeng Zheng > Hide internal functions/variables in `pyspark.sql.functions`

[jira] [Assigned] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45109: - Assignee: Peter Toth > Fix eas_decrypt and ln in connect >

[jira] [Resolved] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45109. --- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-42304) Assign name to _LEGACY_ERROR_TEMP_2189

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42304: --- Labels: pull-request-available (was: ) > Assign name to _LEGACY_ERROR_TEMP_2189 >

[jira] [Commented] (SPARK-44912) Spark 3.4 multi-column sum slows with many columns

2023-09-10 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17763455#comment-17763455 ] Bruce Robbins commented on SPARK-44912: --- It looks like this was fixed with SPARK-45071. Your issue

[jira] [Updated] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44756: --- Labels: pull-request-available (was: ) > Executor hangs when RetryingBlockTransferor fails

[jira] [Updated] (SPARK-45112) Use UnresolvedFunction in dataset functions

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45112: --- Labels: pull-request-available (was: ) > Use UnresolvedFunction in dataset functions >

[jira] [Updated] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44306: --- Labels: pull-request-available (was: ) > Group FileStatus with few RPC calls within Yarn

[jira] [Created] (SPARK-45112) Use UnresolvedFunction in dataset functions

2023-09-10 Thread Peter Toth (Jira)
Peter Toth created SPARK-45112: -- Summary: Use UnresolvedFunction in dataset functions Key: SPARK-45112 URL: https://issues.apache.org/jira/browse/SPARK-45112 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45111) Upgrade maven to 3.9.4

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45111: --- Labels: pull-request-available (was: ) > Upgrade maven to 3.9.4 > -- >

[jira] [Created] (SPARK-45111) Upgrade maven to 3.9.4

2023-09-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-45111: Summary: Upgrade maven to 3.9.4 Key: SPARK-45111 URL: https://issues.apache.org/jira/browse/SPARK-45111 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45109: -- Assignee: Apache Spark > Fix eas_decrypt and ln in connect >

[jira] [Assigned] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45109: -- Assignee: (was: Apache Spark) > Fix eas_decrypt and ln in connect >

[jira] [Updated] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-45109: --- Description: The current {{eas_descrypt}} reference to {{aes_encrypt}} is clearly a bug. The {{ln}} 

[jira] [Assigned] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45109: -- Assignee: (was: Apache Spark) > Fix eas_decrypt and ln in connect >

[jira] [Assigned] (SPARK-45110) Upgrade rocksdbjni to 8.5.3

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45110: -- Assignee: Apache Spark > Upgrade rocksdbjni to 8.5.3 > --- >

[jira] [Assigned] (SPARK-45110) Upgrade rocksdbjni to 8.5.3

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45110: -- Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 8.5.3 >

[jira] [Assigned] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45109: -- Assignee: Apache Spark > Fix eas_decrypt and ln in connect >

[jira] [Updated] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45109: --- Labels: pull-request-available (was: ) > Fix eas_decrypt and ln in connect >

[jira] [Updated] (SPARK-45110) Upgrade rocksdbjni to 8.5.3

2023-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45110: --- Labels: pull-request-available (was: ) > Upgrade rocksdbjni to 8.5.3 >

[jira] [Created] (SPARK-45110) Upgrade rocksdbjni to 8.5.3

2023-09-10 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45110: --- Summary: Upgrade rocksdbjni to 8.5.3 Key: SPARK-45110 URL: https://issues.apache.org/jira/browse/SPARK-45110 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45109) Fix eas_decrypt and ln in connect

2023-09-10 Thread Peter Toth (Jira)
Peter Toth created SPARK-45109: -- Summary: Fix eas_decrypt and ln in connect Key: SPARK-45109 URL: https://issues.apache.org/jira/browse/SPARK-45109 Project: Spark Issue Type: Bug